Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

2.0 cleanup #431

Closed
8 of 14 tasks
kvfairchild opened this issue Jan 4, 2024 · 0 comments
Closed
8 of 14 tasks

2.0 cleanup #431

kvfairchild opened this issue Jan 4, 2024 · 0 comments
Assignees

Comments

@kvfairchild
Copy link
Contributor

kvfairchild commented Jan 4, 2024

Libraries

Submission (web) (@mike-ferguson)

  • the UI offers options for private submissions and for submitting a base model (vs. brain model), neither of which we currently support.
  • when a submission is incorrectly packaged, the redirect to submit again is http://www.brain-score.org/profile/vision/submit which leads to Not Found
  • when a submission is incorrectly packaged, the error message "Please make sure your models/regnet/ folder contains at least one of the following folders:[metrics, data, benchmarks, models]. The submission packaging rules can be found here." is not very informative, the link is just to generic docs, and we do not actually specify the packaging instructions anywhere in the docs.
  • when a submission.zip is structured with a <zip>/models/regnet/{__init__.py, model.py, test.py} folder structure, it fails with a confusing error message (above). The correct structure would be to have <zip>/submission/models/regnet/... but this is not obvious from the error message

Admin

  • put a note in model-tools, candidate-models, and sample-model-submission READMEs that the repositories are discontinued and integrated into vision (@mike-ferguson )
  • incorporate Terms and Conditions (waiting for legal counsel)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants