-
Notifications
You must be signed in to change notification settings - Fork 2.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[WIP][Unified Checkpoint] Add split param and refactor code #9240
base: develop
Are you sure you want to change the base?
Conversation
…nto add_split_param
Thanks for your contribution! |
|
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## develop #9240 +/- ##
===========================================
- Coverage 53.09% 53.03% -0.07%
===========================================
Files 657 661 +4
Lines 106521 106771 +250
===========================================
+ Hits 56557 56622 +65
- Misses 49964 50149 +185 ☔ View full report in Codecov by Sentry. |
@@ -909,7 +983,160 @@ def unified_checkpoint_into_shards( | |||
return state_dict, shard_file, sharded_index | |||
|
|||
|
|||
def load_unified_optimizer_split_param(args, model, optimizer, resume_from_checkpoint): |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
这个函数是不是和load_unified_optimizer_locally大部分逻辑相似
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
目前初步开发中,后续会修改
…nto add_split_param
3abfe71
to
9bce15b
Compare
9bce15b
to
19071ef
Compare
…nto add_split_param
…nto add_split_param
ec6a76a
to
ae9ddce
Compare
PR types
New features
PR changes
Others
Description