Skip to content
This repository has been archived by the owner on Aug 7, 2024. It is now read-only.

[DISCUSSION] fix float8 all-gather in FSDP2 + TP: DTensor(WeightWithDynamicFloat8CastTensor) #326

Draft
wants to merge 10 commits into
base: main
Choose a base branch
from

tested successfully

7fbb867
Select commit
Loading
Failed to load commit list.
Draft

[DISCUSSION] fix float8 all-gather in FSDP2 + TP: DTensor(WeightWithDynamicFloat8CastTensor) #326

tested successfully
7fbb867
Select commit
Loading
Failed to load commit list.
Facebook GitHub Tools / Facebook CLA Check succeeded Aug 1, 2024 in 0s

Contributor License Agreement is valid!

View more details on Facebook GitHub Tools