Skip to content

Commit

Permalink
update VLLM_COS_SIN_RECOMPUTE check
Browse files Browse the repository at this point in the history
Signed-off-by: Chendi.Xue <[email protected]>
  • Loading branch information
xuechendi committed Dec 16, 2024
1 parent d812acf commit f2e3803
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion vllm/worker/hpu_model_runner.py
Original file line number Diff line number Diff line change
Expand Up @@ -750,7 +750,7 @@ def load_model(self) -> None:
model_config is not None else None),
hidden_layer_markstep_interval)
recompute_cos_sin = os.getenv('VLLM_COS_SIN_RECOMPUTE',
'false').lower() == 'true'
'false').lower() in ['1', 'true']
names_for_rope = get_names_for_rope(self.model)
torch.hpu.synchronize()

Expand Down

0 comments on commit f2e3803

Please sign in to comment.