You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
I tried using axolotl with deepspeed to FFT llama3 8B on machine that has 1xA100 40GB and 1x4090 24GB
And it always uses only one GPU, is there some condition, that GPUs must be equal in VRAM, or they even must be identical models?
Beta Was this translation helpful? Give feedback.
All reactions