Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reproduction of model training #201

Merged
merged 5 commits into from
Jan 22, 2022
Merged

Conversation

lingwei-gu
Copy link
Contributor

Submitted the job through SLURM on Compute Canada.

One major issue for me in the sample_slurm_script.sh was:
After loading module StdEnv/2018.3, module java/11 became inactive and cannot be found anymore.
Thus, I looked up the documentations and changed it to StdEnv/2020, then it works.

@crystina-z
Copy link
Collaborator

crystina-z commented Jan 16, 2022

@lingwei-gu hi lingwei! Thanks for helping updating the repro doc. tho the monobert r expected to hv MRR@10 to be 0.35+. chould u chime in the issue #200 and see if the decay line is also missing from the script u were using as well?

@lingwei-gu
Copy link
Contributor Author

@crystina-z You are right it is missing reranker.trainer.decay=0.1 in this file: config_msmarco.txt
I'll run the experiment again and see how it goes

@d1shs0ap
Copy link

@crystina-z The decay line was no longer missing after using the latest nimasadri11/capreolus repository.

@crystina-z crystina-z merged commit 2ba1b7e into capreolus-ir:master Jan 22, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants