Skip to content

Commit

Permalink
minor
Browse files Browse the repository at this point in the history
  • Loading branch information
pengwa committed Mar 26, 2024
1 parent c1dfe37 commit f146042
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -518,7 +518,7 @@ def __init__(self, m: torch.nn.Module, logger: Logger, training: bool):
self._rank_info = f"[{self._rank}/{self._world_size}]"
self._pre_phase = Phase.INVALID

# Cannot infer it is for training or inferencing pupose from module.mode,
# Cannot infer it is for training or inferencing purpose from module.training,
# because it probabbly is not set correctly when this happens.
self._last_phase = Phase.POST_BACKWARD if training else Phase.POST_FORWARD

Expand Down

0 comments on commit f146042

Please sign in to comment.