Skip to content
This repository has been archived by the owner on Aug 7, 2024. It is now read-only.

[DISCUSSION] fix float8 all-gather in FSDP2 + TP: DTensor(WeightWithDynamicFloat8CastTensor) #326

Draft
wants to merge 10 commits into
base: main
Choose a base branch
from

tested successfully

7fbb867
Select commit
Loading
Failed to load commit list.
Draft

[DISCUSSION] fix float8 all-gather in FSDP2 + TP: DTensor(WeightWithDynamicFloat8CastTensor) #326

tested successfully
7fbb867
Select commit
Loading
Failed to load commit list.
Facebook GitHub Tools / Meta Import Checks succeeded Aug 1, 2024 in 0s

All checks passed, this Pull Request can be imported!

This check validates that the Pull Request can be imported to Meta internal infrastructure

View more details on Facebook GitHub Tools