Skip to content

Commit

Permalink
turn optimizations back on
Browse files Browse the repository at this point in the history
  • Loading branch information
priyakasimbeg committed Sep 22, 2023
1 parent bf47c47 commit 97d1768
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -58,7 +58,7 @@ def __init__(self,
raise ValueError(f'Invalid weight_decay value: {weight_decay}')
defaults = {
'lr': lr, 'betas': betas, 'eps': eps, 'weight_decay': weight_decay,
'foreach': False, 'fused': False,
# 'foreach': False, 'fused': False,
}
super().__init__(params, defaults)

Expand Down

0 comments on commit 97d1768

Please sign in to comment.