Skip to content

Commit

Permalink
nit
Browse files Browse the repository at this point in the history
  • Loading branch information
yf711 committed May 29, 2024
1 parent bc91ce5 commit 5f4688e
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion docs/execution-providers/TensorRT-ExecutionProvider.md
Original file line number Diff line number Diff line change
Expand Up @@ -71,7 +71,7 @@ sess = ort.InferenceSession('model.onnx', providers=['TensorrtExecutionProvider'
## Configurations
There are two ways to configure TensorRT settings, either by [TensorRT Execution Provider Session Option](https://onnxruntime.ai/docs/execution-providers/TensorRT-ExecutionProvider.html#execution-provider-options) or [Environment Variables(deprecated)](https://onnxruntime.ai/docs/execution-providers/TensorRT-ExecutionProvider.html#environment-variablesdeprecated).

Here are examples and different scenarios to set TensorRT EP session options:
Here are examples and different [scenarios](./TensorRT-ExecutionProvider.md#scenario) to set TensorRT EP session options:

#### Click below for Python API example:

Expand Down Expand Up @@ -167,6 +167,8 @@ Ort::ThrowOnError(api.GetTensorRTProviderOptionsAsString(tensorrt_options,
</details>
### Scenario
| Scenario | TensorRT EP Session Option | Type |
| :------------------------------------------------- | :------------------------------------ | :----- |
| **Device and Compute Configuration** | | |
Expand Down Expand Up @@ -218,6 +220,7 @@ Ort::ThrowOnError(api.GetTensorRTProviderOptionsAsString(tensorrt_options,
> Note: for bool type options, assign them with **True**/**False** in python, or **1**/**0** in C++.
### Execution Provider Options
TensorRT configurations can be set by execution provider options. It's useful when each model and inference session have their own configurations. In this case, execution provider option settings will override any environment variable settings. All configurations should be set explicitly, otherwise default value will be taken.
Expand Down

0 comments on commit 5f4688e

Please sign in to comment.