Adding cuda kernel (optimized for sm80) for block-wise 4b quantized float 16 GEMM. #18619
Azure Pipelines / Big Models (Stable_Diffusion Stable_Diffusion)
succeeded
Feb 29, 2024 in 13m 37s
Stable_Diffusion Stable_Diffusion succeeded
Loading