v2.6.0

Another nice little feature update! You now have the ability to ungroup the grouped query attention head component through a new config parameter ungroup_grouped_query_attention!

What's Changed

• Ungrouping GQA by @hannamw & @FlyingPumba in #713

Full Changelog: v2.5.0...v2.6.0