Skip to content

Commit

Permalink
HPUAccelerator: remove support in set_visible_devices_envs
Browse files Browse the repository at this point in the history
The way deepspeed sets it is not correct with all HPU instances
and may lead to incorrect behavior.
  • Loading branch information
nelyahu committed Aug 13, 2024
1 parent ffe0af2 commit 1a3c304
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion accelerator/hpu_accelerator.py
Original file line number Diff line number Diff line change
Expand Up @@ -298,7 +298,10 @@ def export_envs(self):
return []

def visible_devices_envs(self):
return ['HABANA_VISIBLE_MODULES']
# Current way deepspeed set this env var is not applicable with all HPU instances
# User has to follow instructions in:
# https://docs.habana.ai/en/latest/PyTorch/Reference/PT_Multiple_Tenants_on_HPU/Multiple_Workloads_Single_Docker.html
return [] #['HABANA_VISIBLE_MODULES']

def set_visible_devices_envs(self, current_env, local_accelerator_ids):
for env in self.visible_devices_envs():
Expand Down

0 comments on commit 1a3c304

Please sign in to comment.