Skip to content

Commit

Permalink
Merge branch 'master' into lekurile/bloom_v_check
Browse files Browse the repository at this point in the history
  • Loading branch information
lekurile authored Nov 20, 2024
2 parents 3e1a054 + 83e4364 commit e4cf472
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion deepspeed/runtime/zero/config.py
Original file line number Diff line number Diff line change
Expand Up @@ -311,7 +311,7 @@ class DeepSpeedZeroConfig(DeepSpeedConfigModel):
for efficient all_2_all_reduce comm
"""

mics_shard_size: int = Field(-1, new_param="mics_shard_size")
mics_shard_size: int = Field(-1, json_schema_extra={"new_param": "mics_shard_size"})

mics_hierarchical_params_gather: bool = False

Expand Down

0 comments on commit e4cf472

Please sign in to comment.