ValueError: matrix contains invalid numeric entries

[xiejialong]

I train your model on A2D sentences and take 24 hours on 2 3090GPU, but an error interrupted the train on epoch 27.
File "/home/users2/xjl/anaconda3/envs/mttr/lib/python3.9/site-packages/torch/autograd/grad_mode.py", line 28, in decorate_context
return func(*args, **kwargs)
File "/home/users2/xjl/workspace/MTTR/models/matcher.py", line 81, in forward
indices = [linear_sum_assignment(c[i]) for i, c in enumerate(C.split(num_traj_per_batch, -1))]
File "/home/users2/xjl/workspace/MTTR/models/matcher.py", line 81, in
indices = [linear_sum_assignment(c[i]) for i, c in enumerate(C.split(num_traj_per_batch, -1))]
ValueError: matrix contains invalid numeric entries

[wildwolff]

I meet the same problem, have you solved it?
Thanks!