SimplifiedLayerNormalization Fusion BFloat16 support for Llama-v2 on A100#18898

Merged

prathikr merged 18 commits intomainfrom prathikrao/layernorm-bfloat16

Feb 14, 2024

+29-2

Commits on Dec 20, 2023

first try
Prathik Rao
committed

Commits on Dec 21, 2023

add unit test
Prathik Rao
committed

Commits on Dec 22, 2023

remove redundant declarations and fix bug in unit test
Prathik Rao
committed
remove redundant grad registration
Prathik Rao
committed
restrict test to cuda
Prathik Rao
committed
check for bf16 inside test
Prathik Rao
committed

Commits on Jan 8, 2024

formatting
Prathik Rao
committed
ToBFloat16 -> MakeBFloat16
Prathik Rao
committed
IRv4
Prathik Rao
committed
revert shape change
Prathik Rao
committed
check for bf16 support before running test
Prathik Rao
committed
Merge remote-tracking branch 'origin' into prathikrao/layernorm-bfloat16
Prathik Rao
committed
lint
Prathik Rao
committed
limit tests to cuda
Prathik Rao
committed

Commits on Jan 17, 2024

formatting
Prathik Rao
committed

Commits on Feb 13, 2024