Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[TensorRT EP] support TensorRT 10.2-GA #21395

Merged
merged 6 commits into from
Jul 18, 2024
Merged

[TensorRT EP] support TensorRT 10.2-GA #21395

merged 6 commits into from
Jul 18, 2024

Conversation

yf711
Copy link
Contributor

@yf711 yf711 commented Jul 17, 2024

Description

  • promote trt version to 10.2.0.19
  • EP_Perf CI: clean config of legacy TRT<8.6, promote test env to trt10.2-cu118/cu125
  • skip two tests as Float8/BF16 are supported by TRT>10.0 but TRT CIs are not hardware-compatible on these:
1: [  FAILED  ] 2 tests, listed below:
1: [  FAILED  ] IsInfTest.test_isinf_bfloat16
1: [  FAILED  ] IsInfTest.test_Float8E4M3FN
errors attached in the appendix

Commits have passed packaging CIs:

  1. nuget cuda 11
  2. nuget cuda 12
  3. python cuda 11
  4. python cuda 12

Motivation and Context

Appendix

TRT10.2 test failure on Windows TRT CI
TRT10.2 test failure on Linux TRT CI

@yf711 yf711 marked this pull request as ready for review July 17, 2024 21:54
@yf711 yf711 requested a review from a team as a code owner July 17, 2024 23:14
@yf711 yf711 changed the title [TensorRT EP] Skip two tests on TRT CIs to support TRT10.2 [TensorRT EP] support TensorRT 10.2-GA Jul 17, 2024
@jywu-msft jywu-msft requested review from chilo-ms and jywu-msft July 17, 2024 23:18
@yf711 yf711 merged commit bb76ead into main Jul 18, 2024
99 checks passed
@yf711 yf711 deleted the yifanl/skip_ut_trt10_2 branch July 18, 2024 19:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants