Skip to content

v1.3.0

Latest
Compare
Choose a tag to compare
@ClashLuke ClashLuke released this 18 Dec 17:54
9a20be2
  • fixes: in 1.2.x (not 1.1.x), all optimizers were SGD; AdamW now runs AdamW again
  • heavyball.utils.disable_caution_scaling implements the behavior documented here
  • SOAP converges well again
    image