Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Qwen vl 7b instruct validation accuracy #2491

Open
achrafs758 opened this issue Nov 22, 2024 · 0 comments
Open

Qwen vl 7b instruct validation accuracy #2491

achrafs758 opened this issue Nov 22, 2024 · 0 comments

Comments

@achrafs758
Copy link

achrafs758 commented Nov 22, 2024

I’m finetunning a qwen-vl-7b-instruct model with lora on an ocr dataset.During the training ,i got around 95% as validation accuracy. I also save a checkpoint every 100 steps. When I load the checkpoint and do inference on the same validation set as during training, the accuracy is much lower. Can someone explain in this context what the accuracy calculated refers to?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant