Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ITM Loss Stuck at 0.63 #200

Open
bfan1256 opened this issue Feb 9, 2024 · 3 comments
Open

ITM Loss Stuck at 0.63 #200

bfan1256 opened this issue Feb 9, 2024 · 3 comments

Comments

@bfan1256
Copy link

bfan1256 commented Feb 9, 2024

Hi, I am trying to replicate and pretrain BLIP for distillation purposes - I am using Flickr30K + COCO and my ITM loss gets stuck at 0.63 - upon an initial look, all of the ITM predictions are 1. Is this a dataset size issue or a batch issue? I've tried changing the learning rate to a smaller LR, I've tried increasing the size of the model and more, but nothing seems to work.

@bfan1256
Copy link
Author

It seems to predict 0s for all of the ITM labels no matter what

@ahorazahedi
Copy link

so what is solution for this problem? i am encountering same problem

@Researcher-Feng
Copy link

It is a bug of the model itself

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants