Reproduction of model training (#201)

*add `decay` into config_msmarco.txt * update StdEnv version in sample_slurm_script.sh * MS_MARCO repro log
capreolus-ir · Jan 22, 2022 · 2ba1b7e · 2ba1b7e
1 parent e10928f
commit 2ba1b7e
Show file tree

Hide file tree

Showing 3 changed files with 4 additions and 2 deletions.
diff --git a/docs/reproduction/MS_MARCO.md b/docs/reproduction/MS_MARCO.md
@@ -51,4 +51,5 @@ To adapt it to the `mini` version, simply change the GPU number and request time
 + Results (with hypperparameter-0) replicated by [@crystina-z](https://github.com/crystina-z) on 2020-12-06 (commit [`6c3759f`](https://github.com/crystina-z/capreolus-1/commit/6c3759fe620f18f8939670176a18c744752bc9240)) (Tesla V100 on Compute Canada)
 + Results (with hypperparameter-6) replicated by [@Dahlia-Chehata](https://github.com/Dahlia-Chehata) on 2021-03-29 (commit [`7915aad`](https://github.com/capreolus-ir/capreolus/commit/7915aad75406527a3b88498926cff85259808696)) (Tesla V100 on Compute Canada)
 + Results (with hypperparameter-7) replicated by [@larryli1999](https://github.com/larryli1999) on 2021-05-16 (commit [`6d1aed2`](https://github.com/capreolus-ir/capreolus/commit/6d1aed29de7828ceb94560a8bf7c87f1af5458b5)) (Tesla V100 on Compute Canada)
-+ Results (MRR@10=0.356) replicated by [@andrewyguo](https://github.com/andrewyguo) on 2021-05-29 (commit [`1ce71d9`](https://github.com/capreolus-ir/capreolus/commit/1ce71d93ab5473b40d4ae02768fd053261b27320)) (Tesla V100 on Compute Canada)
++ Results (MRR@10=0.356) replicated by [@andrewyguo](https://github.com/andrewyguo) on 2021-05-29 (commit [`1ce71d9`](https://github.com/capreolus-ir/capreolus/commit/1ce71d93ab5473b40d4ae02768fd053261b27320)) (Tesla V100 on Compute Canada)
++ Results (MRR@10=0.356) reproduced by [@lingwei-gu](https://github.com/lingwei-gu) on 2022-01-20 (commit [`1bbf0f2`](https://github.com/capreolus-ir/capreolus/commit/1bbf0f295b09774e2fb2a1db7dfddef88adec7be)) (Tesla V100 on Compute Canada)
diff --git a/docs/reproduction/config_msmarco.txt b/docs/reproduction/config_msmarco.txt
@@ -23,3 +23,4 @@ reranker.trainer.decayiters=1
 reranker.trainer.decaytype=linear
 
 reranker.trainer.loss=pairwise_hinge_loss
+reranker.trainer.decay=0.1
diff --git a/docs/reproduction/sample_slurm_script.sh b/docs/reproduction/sample_slurm_script.sh
@@ -12,7 +12,7 @@
 
 
 # Modify the following lines according to your setup process
-module load arch/avx512 StdEnv/2018.3 java/11 python/3.7 scipy-stack
+module load arch/avx512 StdEnv/2020 java/11 python/3.7 scipy-stack
 ENVDIR=$HOME/venv/capreolus-env
 source $ENVDIR/bin/activate
Original file line number	Diff line number	Diff line change
Expand Up		@@ -23,3 +23,4 @@ reranker.trainer.decayiters=1
		reranker.trainer.decaytype=linear

		reranker.trainer.loss=pairwise_hinge_loss
		reranker.trainer.decay=0.1