Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Usage] Pretrain stage did not save all required files #29

Open
james20141606 opened this issue Aug 26, 2024 · 1 comment
Open

[Usage] Pretrain stage did not save all required files #29

james20141606 opened this issue Aug 26, 2024 · 1 comment

Comments

@james20141606
Copy link

Describe the issue

Hi, I am trying to perform the pretrain task and the files which are saved are:

Screenshot 2024-08-25 at 11 54 49 PM

and within each checkpoint folder there are only two files config.json mm_projector.bin

It seems many files are missing, compared to files shown here https://huggingface.co/mucai/vip-llava-7b/tree/main

The missing files make me impossible to launch the finetuning stage. Could you provide some guidance on saving all the files? Or does it make sense to reuse the model weights in https://huggingface.co/mucai/vip-llava-7b/tree/main
I am confused if it makes sense to only use my updated mm_projector.bin and still use the files you provided?

@mu-cai
Copy link
Collaborator

mu-cai commented Sep 16, 2024

During pretraining stage, we do not train LLM, which is explained in the paper and docs. Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants