Skip to content

Commit

Permalink
Fix duplicated keys
Browse files Browse the repository at this point in the history
Signed-off-by: Guyue Huang <[email protected]>
  • Loading branch information
Guyue Huang committed Dec 20, 2024
1 parent db29ad9 commit 9529b36
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion launcher_scripts/conf/training/nemotron/nemotron_340b.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -164,7 +164,6 @@ model:
fp8_amax_history_len: 1024 # Number of steps for which amax history is recorded per tensor
fp8_amax_compute_algo: max # 'most_recent' or 'max'. Algorithm for computing amax from history
fp8_wgrad: True
ub_tp_comm_overlap: True

optim:
name: mcore_distributed_optim
Expand Down

0 comments on commit 9529b36

Please sign in to comment.