Skip to content

Commit

Permalink
[TensorRT EP] Clear constrain of trt plugin with different input type (
Browse files Browse the repository at this point in the history
…#19044)

### Description
<!-- Describe your changes. -->
Add heterogeneous support to skip this check for TRT plugin which has
different input tensor types



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
  • Loading branch information
yf711 authored Jan 9, 2024
1 parent ad6dd0a commit 574c7ca
Showing 1 changed file with 8 additions and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -56,6 +56,14 @@ struct TensorRTCustomOp : Ort::CustomOpBase<TensorRTCustomOp, TensorRTCustomKern

OrtCustomOpInputOutputCharacteristic GetOutputCharacteristic(size_t) const { return OrtCustomOpInputOutputCharacteristic::INPUT_OUTPUT_VARIADIC; };

bool GetVariadicInputHomogeneity() const {
return false; // heterogenous
}

bool GetVariadicOutputHomogeneity() const {
return false; // heterogeneous
}

private:
const char* provider_{onnxruntime::kTensorrtExecutionProvider};
void* compute_stream_;
Expand Down

0 comments on commit 574c7ca

Please sign in to comment.