Skip to content

fix num_kv_heads sharding in uneven autoTP for Falcon-40b #9005

fix num_kv_heads sharding in uneven autoTP for Falcon-40b

fix num_kv_heads sharding in uneven autoTP for Falcon-40b #9005

The logs for this run have expired and are no longer available.