Skip to content

[Feature Request] Jagged batches support (NJT) for Transformer / SDPA inference #5800

[Feature Request] Jagged batches support (NJT) for Transformer / SDPA inference

[Feature Request] Jagged batches support (NJT) for Transformer / SDPA inference #5800

Triggered via issue November 7, 2024 17:41
Status Success
Total duration 2m 37s
Artifacts

labeler.yml

on: issues
Fit to window
Zoom out
Zoom in