Question about the train on my own dataset ！

[GiftNovice]

I run the training script. But there was no training started, and there were no errors reported, and it just ended，i dont know the reason 。In addition， Can two gtx3090 24G Gpus complete the training？ thanks

[jingyirubyli]

I run the training script. But there was no training started, and there were no errors reported, and it just ended，i dont know the reason 。In addition， Can two gtx3090 24G Gpus complete the training？ thanks

hi I have the same problem. have you solved it?

[pILLOW-1]

I have the same problem

[frank-xwang]

Hi, sorry for the late reply. Submitit is a tool for submitting Python functions for computation within a Slurm cluster. If you are not using a Slurm cluster, you may need to directly run the main_submitit.py (some small modifications may be needed) to launch experiments locally.

We used 64 A100-80G GPUs for model training. We have never tried to use 3090 GPUs for model training, I think you may meet the OOM error if you are using two 24G 3090 GPUs.