-
-
Notifications
You must be signed in to change notification settings - Fork 1
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Vision encoder output dimension does not match #1
Comments
Thanks for your interests in our work! Further updates are welcome if it fails to solve your issue. 😃 |
Hi, I followed your advice and modified the config file of VC1-Base model, but error still occurred. Here is the details. |
I solved this issue by specified |
My bad. You should also set |
Hi, thanks for your excellent work! I'm trying to run
bash eval_calvin.sh
.When running to FeedbackPolicy/models/policy.py, there is an issue where the shape of the vision_x input to vision_encoder is 192 * 192, which does not match the model size of 224 * 224.
So I interpolated vision_x to 224 * 224, and the shape of output by vision_encoder is 8 * 768, which does not match the dimension of the rearrange operation.
vision_x = rearrange(vision_x, "(b T) d h w -> b T (h w) d", b=b, T=T)
The text was updated successfully, but these errors were encountered: