Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: Add INT64 Datatype Support for Shape Tensors in TensorRT Backend #7329

Merged
merged 15 commits into from
Jun 20, 2024

Conversation

pskiran1
Copy link
Member

@pskiran1 pskiran1 commented Jun 6, 2024

What does the PR do?

  • Updated shape tensor model generation scripts to generate models with INT64 shape input data type.
  • Renamed shape tensor model names to plan_*****<input_dtype>_<shape_input_dtype>.
  • Updated L0_trt_shape_tensors to test models with INT64 shape input data type.

Checklist

  • PR title reflects the change and is of format <commit_type>: <Title>
  • Changes are described in the pull request.
  • Related issues are referenced.
  • Populated github labels field
  • Added test plan and verified test passes.
  • Verified that the PR passes existing CI.
  • Verified copyright is correct on all changed files.
  • Added succinct git squash message before merging ref.
  • All template sections are filled out.
  • Optional: Additional screenshots for behavior/output changes with before/after.

Commit Type:

Check the conventional commit type
box here and add the label to the github PR.

  • build
  • ci
  • docs
  • feat
  • fix
  • perf
  • refactor
  • revert
  • style
  • test

Related PRs:

triton-inference-server/tensorrt_backend#91

Where should the reviewer start?

qa/common/gen_qa_dyna_sequence_models.py

Test plan:

  • CI Pipeline ID: In progress

Caveats:

Background

  • TensorRT version 10 and later supports the INT64 data type

Related Issues: (use one of the action keywords Closes / Fixes / Resolves / Relates to)

  • closes GitHub issue: #xxx

@pskiran1 pskiran1 added enhancement New feature or request module: backends Issues related to the backends PR: ci Changes to our CI configuration files and scripts and removed enhancement New feature or request labels Jun 6, 2024
@pskiran1 pskiran1 marked this pull request as ready for review June 8, 2024 19:33
qa/L0_trt_shape_tensors/test.sh Outdated Show resolved Hide resolved
qa/L0_trt_shape_tensors/test.sh Outdated Show resolved Hide resolved
@pskiran1 pskiran1 requested a review from tanmayv25 June 11, 2024 13:54
@pskiran1 pskiran1 merged commit d5eb467 into main Jun 20, 2024
3 checks passed
@pskiran1 pskiran1 deleted the spolisetty_dlis_6653 branch June 20, 2024 14:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
module: backends Issues related to the backends PR: ci Changes to our CI configuration files and scripts
Development

Successfully merging this pull request may close these issues.

2 participants