Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Openvino ep ort 23.1 #17911

Merged
merged 25 commits into from
Nov 1, 2023
Merged

Openvino ep ort 23.1 #17911

merged 25 commits into from
Nov 1, 2023

Conversation

preetha-intel
Copy link
Contributor

Description

Integration to OpenVINO 2023.1

Motivation and Context

  • Alignment with latest OpenVINO Version.
  • Device name change from VPUX to NPU and Remove from supported list until official public support is available.

preetha-intel and others added 17 commits August 10, 2023 08:41
@preetha-intel
Add checks for session options and fix gsubgraph fallback exceptions
29953a3
@saharfraza
Bug fixed for small models
cea0d49
@saurabhkale17
fix lint issues
9531668
@sspintel
Add zero copy optimization on inputs for the CPU device
8175bb0
@saurabhkale17
change VPU name to NPU: doc and cmake changes
3904e49 
rename VPUX to NPU

add supported types npu

enable npu

rename vpu to npu

rename vpu to npu

rename vpu to npu

add NPU operator support

add NPU op support

disable python UT NPU

add resize and unsqueeze ops

unsqueeze op UT
@saurabhkale17
exclude NPU from readme
761a0e3
@sfatimar
Merge pull request #311 from intel/sp/cpu-no-copy
80b1246 
Optimize out input memory copies for the CPU device
@sfatimar
Merge pull request #313 from intel/saurabh/rename_vpu_sq
a24071b 
Rename Vision Processing Unit(VPU) to Neural Processing Unit. (NPU)
@saharfraza
commit data
b13522e
@saharfraza
Merge branch 'openvino-ep-ort-5.1-test' of https://github.com/intel/o…
5a70344 
…nnxruntime into openvino-ep-ort-5.1-test
@sfatimar
Merge branch 'openvino-ep-ort-23.1' into openvino-ep-ort-5.1-test
8909fea
@sfatimar
Merge pull request #316 from intel/openvino-ep-ort-5.1-test
cd38062 
Openvino ep ort 5.1 test
@saharfraza
Ops enabled for NPU
d55cf9f
@sfatimar
Merge pull request #317 from intel/sahar/npuops
f35ca2d 
Ops enabled for NPU
@sspintel
Change default NPU_COMPILER_TYPE to DRIVER by default
c1b345e
@sspintel
Remove VPUX external references
fe9f2dd
@preetha-intel
Handle exceptions for int input range
7bede9f
@saharfraza
Copy link
Contributor

@jywu-msft We have raised this PR for ov integration with 23.1

@jywu-msft
Copy link
Member

/azp run Linux OpenVINO CI Pipeline

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@jywu-msft
Copy link
Member

/azp run Windows ARM64 QNN CI Pipeline,Windows CPU CI Pipeline,Windows GPU CI Pipeline,Windows GPU TensorRT CI Pipeline,onnxruntime-binary-size-checks-ci-pipeline,orttraining-linux-ci-pipeline,orttraining-linux-gpu-ci-pipeline,orttraining-ortmodule-distributed

@jywu-msft
Copy link
Member

/azp run Linux CPU CI Pipeline,Linux CPU Minimal Build E2E CI Pipeline,Linux GPU CI Pipeline,Linux GPU TensorRT CI Pipeline,Linux OpenVINO CI Pipeline,Linux QNN CI Pipeline,MacOS CI Pipeline,ONNX Runtime Web CI Pipeline

@azure-pipelines
Copy link

Azure Pipelines successfully started running 8 pipeline(s).

1 similar comment
@azure-pipelines
Copy link

Azure Pipelines successfully started running 8 pipeline(s).

@jywu-msft jywu-msft closed this Oct 19, 2023
@jywu-msft jywu-msft reopened this Oct 19, 2023
@jywu-msft
Copy link
Member

/azp run WIndows x64 QNN CI Pipeline

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

jywu-msft
jywu-msft previously approved these changes Oct 19, 2023
View reviewed changes
@jywu-msft
Copy link
Member

/azp run Linux OpenVINO CI Pipeline

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@jywu-msft
Copy link
Member

/azp run Linux CPU CI Pipeline,Linux CPU Minimal Build E2E CI Pipeline,Linux GPU CI Pipeline,Linux GPU TensorRT CI Pipeline,Linux OpenVINO CI Pipeline,Linux QNN CI Pipeline,MacOS CI Pipeline,ONNX Runtime Web CI Pipeline

@jywu-msft
Copy link
Member

/azp run Windows ARM64 QNN CI Pipeline,Windows CPU CI Pipeline,Windows GPU CI Pipeline,Windows GPU TensorRT CI Pipeline,onnxruntime-binary-size-checks-ci-pipeline,orttraining-linux-ci-pipeline,orttraining-linux-gpu-ci-pipeline,orttraining-ortmodule-distributed

@azure-pipelines
Copy link

Azure Pipelines successfully started running 8 pipeline(s).

1 similar comment
@azure-pipelines
Copy link

Azure Pipelines successfully started running 8 pipeline(s).

@jywu-msft
Copy link
Member

/azp run Windows ARM64 QNN CI Pipeline,Windows CPU CI Pipeline,Windows GPU CI Pipeline,Windows GPU TensorRT CI Pipeline,onnxruntime-binary-size-checks-ci-pipeline,orttraining-linux-ci-pipeline,orttraining-linux-gpu-ci-pipeline,orttraining-ortmodule-distributed

@jywu-msft
Copy link
Member

/azp run Linux CPU CI Pipeline,Linux CPU Minimal Build E2E CI Pipeline,Linux GPU CI Pipeline,Linux GPU TensorRT CI Pipeline,Linux OpenVINO CI Pipeline,Linux QNN CI Pipeline,MacOS CI Pipeline,ONNX Runtime Web CI Pipeline

@azure-pipelines
Copy link

Azure Pipelines successfully started running 8 pipeline(s).

@jywu-msft
Copy link
Member

/azp run Linux CPU CI Pipeline,Linux CPU Minimal Build E2E CI Pipeline,Linux GPU CI Pipeline,Linux GPU TensorRT CI Pipeline,Linux OpenVINO CI Pipeline,Linux QNN CI Pipeline,MacOS CI Pipeline,ONNX Runtime Web CI Pipeline

@azure-pipelines
Copy link

Azure Pipelines successfully started running 8 pipeline(s).

@jywu-msft
Copy link
Member

/azp run Windows ARM64 QNN CI Pipeline,Windows CPU CI Pipeline,Windows GPU CI Pipeline,Windows GPU TensorRT CI Pipeline,onnxruntime-binary-size-checks-ci-pipeline,orttraining-linux-ci-pipeline,orttraining-linux-gpu-ci-pipeline,orttraining-ortmodule-distributed

@azure-pipelines
Copy link

Azure Pipelines successfully started running 8 pipeline(s).

@jywu-msft
Copy link
Member

/azp run Windows x64 QNN CI Pipeline

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@jywu-msft
Copy link
Member

/azp run Linux CPU CI Pipeline,Linux CPU Minimal Build E2E CI Pipeline,Linux GPU CI Pipeline,Linux GPU TensorRT CI Pipeline,Linux OpenVINO CI Pipeline,Linux QNN CI Pipeline,MacOS CI Pipeline,ONNX Runtime Web CI Pipeline

@jywu-msft
Copy link
Member

/azp run Windows ARM64 QNN CI Pipeline,Windows CPU CI Pipeline,Windows GPU CI Pipeline,Windows GPU TensorRT CI Pipeline,onnxruntime-binary-size-checks-ci-pipeline,orttraining-linux-ci-pipeline,orttraining-linux-gpu-ci-pipeline,orttraining-ortmodule-distributed

@jywu-msft
Copy link
Member

/azp run Windows x64 QNN CI Pipeline

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 8 pipeline(s).

1 similar comment
@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 8 pipeline(s).

@jywu-msft jywu-msft merged commit d87216b into microsoft:main Nov 1, 2023
64 of 66 checks passed
kleiti pushed a commit to kleiti/onnxruntime that referenced this pull request Mar 22, 2024
@preetha-intel @saharfraza
@saurabhkale17 @sspintel @sfatimar @kleiti
Openvino ep ort 23.1 (microsoft#17911)
2cd1ea8 
### Description
Integration to OpenVINO 2023.1


### Motivation and Context

- Alignment with latest OpenVINO Version. 
- Device name change from VPUX to NPU and Remove from supported list
until official public support is available.

---------

Co-authored-by: Sahar Fatima <[email protected]>
Co-authored-by: Saurabh Kale <[email protected]>
Co-authored-by: Suryaprakash Shanmugam <[email protected]>
Co-authored-by: sfatimar <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@sspintel sspintel sspintel left review comments

@sfatimar sfatimar sfatimar left review comments

@jywu-msft jywu-msft jywu-msft approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@preetha-intel @saharfraza @jywu-msft @sfatimar @sspintel @saurabhkale17