Implemenation of IObinding in Mixtral MoE Parity Script#21153

Open

t-khaspear wants to merge 15 commits intomainfrom khalias/a

+788-21

Commits on Jun 19, 2024

added iobinding to moe mixtral benchmarking kernel
Your Name
committed

Commits on Jun 20, 2024

Update test_parity_mixtral_moe.py
wangyems
authored

Commits on Jun 24, 2024

Implemented iobinding for mixtral benchmarking
Your Name
committed
deleted an unnecessary line of code
Your Name
committed
deleted unnecessary code
Your Name
committed
Deleted unnecessary code
Your Name
committed

Commits on Jun 25, 2024

deleted white spaces in blank lines
Your Name
committed
added two tests: one for large cases and one for benchmarking cases
Your Name
committed

Commits on Jun 26, 2024

Created a new function to save the model and to to recognize the external data
Your Name
committed

Commits on Jun 27, 2024

Renamed the new function and added a new one to delete the model and the model data
Your Name
committed

Commits on Jun 28, 2024

Changed "mixtral_moe.onn" to model_path
Your Name
committed

Commits on Jul 2, 2024

DBRX parity script
Your Name
committed

Commits on Jul 10, 2024

sharding implementation
Your Name
committed

Commits on Jul 12, 2024

script changes
Your Name
committed

Commits on Aug 2, 2024

reshaped tesors for parity to match
Your Name
committed