You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Thanks your wonderful work CEDR, it helps to understand the document ranking task a lot!
I tried to use this repo and followed the instruction to train a vanilla_bert with 1-fold and 2-fold data on the Robust04 dataset. However, I obtained the NDCG@20 result as: vanilla_bert_1fold :0.40704 vanilla_bert_2fold: 0.45290
it is much different from your release checkpoints in #18 : vanilla_bert_1fold: 0.42185 vanilla_bert_2fold: 0.47948
The hyperparameters are as follows:
Would you please share your setting of hyperparameters during fine-tuning the vanilla-bert ?
The text was updated successfully, but these errors were encountered:
Thanks your wonderful work CEDR, it helps to understand the document ranking task a lot!
I tried to use this repo and followed the instruction to train a vanilla_bert with 1-fold and 2-fold data on the Robust04 dataset. However, I obtained the NDCG@20 result as:
vanilla_bert_1fold :0.40704 vanilla_bert_2fold: 0.45290
it is much different from your release checkpoints in #18 :
vanilla_bert_1fold: 0.42185 vanilla_bert_2fold: 0.47948
The hyperparameters are as follows:
Would you please share your setting of hyperparameters during fine-tuning the vanilla-bert ?
The text was updated successfully, but these errors were encountered: