You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Jan 5, 2024. It is now read-only.
I'm trying to replicate the brain-scoring of CORNet-S. I noticed that the brain-score leaderboard uses the MajajHong2015.IT-pls (V3) benchmark while the PyTorch candidate_models example uses dicarlo.MajajHong2015public.IT-pls. Are these the same?
The text was updated successfully, but these errors were encountered:
The website score on MajajHong2015 is run on a private (held-out) version of the data whereas the example uses a public version, so they are different. Scores on the two datasets should be related, but differ -- in my experience, the public version typically yields slightly higher scores whereas the private one seems more difficult.
We might release the currently private version at some point as we add other benchmarks with separate held-out data, but until then the best way to score models on those private data is to submit them through the website.
Sign up for freeto subscribe to this conversation on GitHub.
Already have an account?
Sign in.
I'm trying to replicate the brain-scoring of CORNet-S. I noticed that the brain-score leaderboard uses the
MajajHong2015.IT-pls (V3)
benchmark while the PyTorchcandidate_models
example usesdicarlo.MajajHong2015public.IT-pls
. Are these the same?The text was updated successfully, but these errors were encountered: