pretrain.sh

[YePG]

    --ckpt ${MTPATH}/mt.ckpts/esen/ckpt.exp.pretrain4 \

what is the ckpt.exp.pretrain4 ?
I run the code and get FileNotFoundError: [Errno 2] No such file or directory: './data/mt.ckpts/esen/ckpt.exp.pretrain4'

[ghost]

If this parameter is set while training a generator, its usage is to save model. So you can just try mkdir to create such folder.

[ghost]

( also the same in training retriever

[NCUIui]

RuntimeError: Output 0 of SplitBackward0 is a view and is being modified inplace. This view is the output of a function that returns multiple views. Such functions do not allow the output views to be modified inplace. You should replace the inplace operation by an out-of-place one.
执行预训练这个错误如何解决？谢谢

[yangkent114]

RuntimeError: Output 0 of SplitBackward0 is a view and is being modified inplace. This view is the output of a function that returns multiple views. Such functions do not allow the output views to be modified inplace. You should replace the inplace operation by an out-of-place one. 执行预训练这个错误如何解决？谢谢

I use Chatgpt &then I got the measure to fix the issue, the problem exits in transformer.py line 131 q *= self.scaling This error indicates that there is an inplace operation in your code that modifies Tensors referenced by multiple views.The solution is add q = q.clone() before q *= self.scaling