nv-accelerate-v100

fix num_kv_heads sharding in uneven autoTP for Falcon-40b #7739

Sign in to view logs

Summary
Jobs
- unit-tests
Run details
- Usage
- Workflow file

Triggered via pull request January 3, 2024 15:42

tjruwase

synchronize #4712

Yejing-Lai:lyj/fix_falcon40b

Status Success

Total duration 9m 54s

Artifacts –

nv-accelerate-v100.yml

on: pull_request