CUTLASS 2.11 now available!

[mnicely]

CUTLASS 2.11 is now available!

What's New in CUTLASS 2.11

CUTLASS 2.11 is an update to CUTLASS adding:

• Stream-K, which is a new general way to do split-K. It can not only improve performance, but can also significantly reduce the number of tile sizes that need to be profiled to find the best one.
• Fused multi-head attention kernel. It has two variants: one for fixed sequence lengths, and another for variable sequence lengths.
• Dual GEMM. It can run two GEMMs that share the same left input matrix in one kernel.
• Hopper improves double precision matrix multiplication by 2x compared to Ampere at iso-clocks. It is supported since CUDA 11.8.
• BLAS3 functions with Hoppers new double precision matrix multiplication instructions.
• ELL Block Sparse GEMM.
• Optimized Group Conv.
• Optimized DepthWise Conv.
• Scripts to fuse multiple back-to-back GEMM.
• FP8 data type definition and conversion routines.
• Updates and bugfixes from the community (thanks!). Big shout out to Meta's xFormers.

[Enter-tainer]

Maybe we should add a git tag for the 2.11 release? Currently we only have 2.10

[mnicely]

Hi @Enter-tainer, we will soon. We allow a two week window for users to report bugs