Visualization Rastrigin AccSGD AdaBelief AdaBound AdaDelta AdaFactor AdaHessian Adai Adalite Adam AdaMax AdaMod AdamP AdamS AdamW Adan AdaNorm AdaPNM AdaSmooth AggMo Aida Amos Apollo ASGD AvaGrad CAME DAdaptAdaGrad DAdaptAdam DAdaptAdan DAdaptLion DAdaptSGD DiffGrad FAdam Fromage GaLore Gravity GrokFastAdamW Kate Lamb LARS Lion MADGRAD MSVAG Nero NovoGrad PAdam PID PNM Prodigy QHAdam QHM RAdam Ranger Ranger21 ScalableShampoo ScheduleFreeAdamW ScheduleFreeSGD SGD SGDP SGDW Shampoo SignSGD SM3 SophiaH SRMM StableAdamW SWATS Tiger Yogi Rosenbrock AccSGD AdaBelief AdaBound AdaDelta AdaFactor AdaHessian Adai Adalite Adam AdaMax AdaMod AdamP AdamS AdamW Adan AdaNorm AdaPNM AdaSmooth AggMo Aida Amos Apollo ASGD AvaGrad CAME DAdaptAdaGrad DAdaptAdam DAdaptAdan DAdaptLion DAdaptSGD DiffGrad FAdam Fromage GaLore Gravity GrokFastAdamW Kate Lamb LARS Lion MADGRAD MSVAG Nero NovoGrad PAdam PID PNM Prodigy QHAdam QHM RAdam Ranger Ranger21 ScalableShampoo ScheduleFreeAdamW ScheduleFreeSGD SGD SGDP SGDW Shampoo SignSGD SM3 SophiaH SRMM StableAdamW SWATS Tiger Yogi
