From 06fe725f5dc679be660cd605a49e4e337388155e Mon Sep 17 00:00:00 2001 From: Hector Li Date: Mon, 6 May 2024 09:39:29 -0700 Subject: [PATCH 1/3] add error handling regarding to SSR issue --- docs/execution-providers/QNN-ExecutionProvider.md | 9 +++++++++ 1 file changed, 9 insertions(+) diff --git a/docs/execution-providers/QNN-ExecutionProvider.md b/docs/execution-providers/QNN-ExecutionProvider.md index 177fefc21dab0..0ebec11b8dd85 100644 --- a/docs/execution-providers/QNN-ExecutionProvider.md +++ b/docs/execution-providers/QNN-ExecutionProvider.md @@ -55,6 +55,10 @@ The QNN Execution Provider supports a number of configuration options. These pro |'basic'|| |'detailed'|| +|`"profiling_file_path"`|Description| +|---|---| +|'your_qnn_profile_path.csv'|Specify the csv file path to dump the QNN profiling events| + See [profiling-tools](../performance/tune-performance/profiling-tools.md) for more info on profiling Alternatively to setting profiling_level at compile time, profiling can be enabled dynamically with ETW (Windows). See [tracing](../performance/tune-performance/logging_tracing.md) for more details @@ -461,3 +465,8 @@ sess = ort.InferenceSession(model_path, providers=['QNNExecutionProvider'], prov ### Inference example [Image classification with Mobilenetv2 in CPP using QNN Execution Provider with QNN CPU & HTP Backend](https://github.com/microsoft/onnxruntime-inference-examples/tree/main/c_cxx/QNN_EP/mobilenetv2_classification) + + +## Error handling +### HTP SubSystem Restart (SSR) [ref](https://docs.qualcomm.com/bundle/publicresource/topics/80-63442-50/htp_backend.html#subsystem-restart-ssr-) +QNN EP wil return ENGINE_ERROR = 5 regarding QNN HTP SSR issue. Uppper level framework/application should recreate Onnxruntime session if this error detected during session run. \ No newline at end of file From 8f204a7cb63740fd9b529611d24d5d4cdabb4ed9 Mon Sep 17 00:00:00 2001 From: Hector Li Date: Mon, 6 May 2024 09:53:30 -0700 Subject: [PATCH 2/3] update --- docs/execution-providers/QNN-ExecutionProvider.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/docs/execution-providers/QNN-ExecutionProvider.md b/docs/execution-providers/QNN-ExecutionProvider.md index 0ebec11b8dd85..f43745052f5b9 100644 --- a/docs/execution-providers/QNN-ExecutionProvider.md +++ b/docs/execution-providers/QNN-ExecutionProvider.md @@ -468,5 +468,5 @@ sess = ort.InferenceSession(model_path, providers=['QNNExecutionProvider'], prov ## Error handling -### HTP SubSystem Restart (SSR) [ref](https://docs.qualcomm.com/bundle/publicresource/topics/80-63442-50/htp_backend.html#subsystem-restart-ssr-) -QNN EP wil return ENGINE_ERROR = 5 regarding QNN HTP SSR issue. Uppper level framework/application should recreate Onnxruntime session if this error detected during session run. \ No newline at end of file +### HTP SubSystem Restart - [SSR](https://docs.qualcomm.com/bundle/publicresource/topics/80-63442-50/htp_backend.html#subsystem-restart-ssr-) +QNN EP wil return StatusCode::ENGINE_ERROR regarding QNN HTP SSR issue. Uppper level framework/application should recreate Onnxruntime session if this error detected during session run. \ No newline at end of file From c6974ba8b27b69e4051b8e5b0dbd6b8b44bc2cb0 Mon Sep 17 00:00:00 2001 From: Hector Li Date: Mon, 6 May 2024 14:23:50 -0700 Subject: [PATCH 3/3] update --- docs/execution-providers/QNN-ExecutionProvider.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/execution-providers/QNN-ExecutionProvider.md b/docs/execution-providers/QNN-ExecutionProvider.md index f43745052f5b9..377d4f5a662fc 100644 --- a/docs/execution-providers/QNN-ExecutionProvider.md +++ b/docs/execution-providers/QNN-ExecutionProvider.md @@ -469,4 +469,4 @@ sess = ort.InferenceSession(model_path, providers=['QNNExecutionProvider'], prov ## Error handling ### HTP SubSystem Restart - [SSR](https://docs.qualcomm.com/bundle/publicresource/topics/80-63442-50/htp_backend.html#subsystem-restart-ssr-) -QNN EP wil return StatusCode::ENGINE_ERROR regarding QNN HTP SSR issue. Uppper level framework/application should recreate Onnxruntime session if this error detected during session run. \ No newline at end of file +QNN EP returns StatusCode::ENGINE_ERROR regarding QNN HTP SSR issue. Uppper level framework/application should recreate Onnxruntime session if this error detected during session run. \ No newline at end of file