[Performance] How does onnxruntime run in parallel mode?

[zwyao]

Describe the issue

In ONNX Runtime v1.18.1, it can set option with ExecutionMode::ORT_PARALLEL, it means ops will run in parallel mode, but i cant find any executors about multi-thread, it only have one sequential executor, am i wrong? How done onnxruntime run in parallel mode?

thanks a lot.

To reproduce

1. no step

Urgency

No response

Platform

Windows

OS Version

1.18.1

ONNX Runtime Installation

Built from Source

ONNX Runtime Version or Commit ID

master released

ONNX Runtime API

Python

Architecture

X64

Execution Provider

Other / Unknown

Execution Provider Library Version

No response

Model File

No response

Is this a quantized model?

Yes

Tasks

Preview Give feedback

No tasks being tracked yet.