Skip to content

Do ZeRO2 and ZeRO3 need gradient accumulation? #4118

Gy-Lu started this conversation in Development | Core
Discussion options

You must be logged in to vote

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
1 participant