Skip to content

Commit

Permalink
fix format
Browse files Browse the repository at this point in the history
  • Loading branch information
HeyangQin committed May 29, 2024
1 parent c7db180 commit 642e105
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions deepspeed/inference/v2/modules/heuristics.py
Original file line number Diff line number Diff line change
Expand Up @@ -34,6 +34,7 @@

from deepspeed.accelerator import get_accelerator


def instantiate_attention(attention_config: DSSelfAttentionConfig,
engine_config: RaggedInferenceEngineConfig) -> DSSelfAttentionBase:
"""
Expand Down

0 comments on commit 642e105

Please sign in to comment.