Skip to content

Commit

Permalink
Merge branch 'master' into tohtana/fix_zero_init_patch
Browse files Browse the repository at this point in the history
  • Loading branch information
tohtana authored Aug 21, 2024
2 parents d555266 + b65ea50 commit ac3eb90
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion deepspeed/runtime/swap_tensor/partitioned_param_swapper.py
Original file line number Diff line number Diff line change
Expand Up @@ -121,7 +121,7 @@ def _configure_aio(self, ds_config):
dtype=self.dtype,
device=get_accelerator().device_name(),
requires_grad=False)
self.aio_read_handle.new_device_locked_tensor(self.buffers)
self.aio_read_handle.pin_device_tensor(self.buffers)
else:
self.buffers = get_accelerator().pin_memory(torch.empty(int(self.aligned_elements_per_buffer *
self.param_buffer_count),
Expand Down

0 comments on commit ac3eb90

Please sign in to comment.