Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix failing test_llm_metrics.py #509

Merged
merged 2 commits into from
Mar 9, 2024
Merged

Conversation

nv-hwoo
Copy link
Contributor

@nv-hwoo nv-hwoo commented Mar 9, 2024

  • Add whitespace to triton response outputs to avoid valid chars getting removed
  • Convert throughput unit from nanosecond to second

@nv-hwoo nv-hwoo requested review from debermudez and tgerdesnv March 9, 2024 00:38
@nv-hwoo nv-hwoo changed the base branch from main to feature-genai-pa March 9, 2024 00:38
@nv-hwoo nv-hwoo force-pushed the hwoo-fix-llm-metrics2 branch from b913d58 to 768a66a Compare March 9, 2024 00:44
@debermudez debermudez merged commit c8b55e6 into feature-genai-pa Mar 9, 2024
3 checks passed
@debermudez debermudez deleted the hwoo-fix-llm-metrics2 branch March 9, 2024 00:48
debermudez pushed a commit that referenced this pull request Mar 12, 2024
* Fix unit tests

* Add FIXME
debermudez pushed a commit that referenced this pull request Mar 13, 2024
* Fix unit tests

* Add FIXME
mc-nv pushed a commit that referenced this pull request Mar 13, 2024
* Fix unit tests

* Add FIXME
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

2 participants