Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP]EP interface #18090

Draft
wants to merge 36 commits into
base: main
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from 3 commits
Commits
Show all changes
36 commits
Select commit Hold shift + click to select a range
cdb9676
draft interface hierarchy
RandyShuai Oct 25, 2023
2ddea77
commence interface namespace
RandyShuai Oct 25, 2023
5fffc82
add common folder
RandyShuai Oct 25, 2023
ff689b1
port code from PR 16718
jslhcl Oct 25, 2023
6c92fc7
Merge https://github.com/microsoft/onnxruntime into rashuai/EpInterface
jslhcl Oct 25, 2023
4794e3d
Merge branch 'rashuai/EpInterface' of https://github.com/microsoft/on…
jslhcl Oct 25, 2023
0d4d3d3
test_intreeEp.py works
jslhcl Oct 25, 2023
858f259
windows fixes
RandyShuai Oct 26, 2023
dbb9871
tune folder name
RandyShuai Oct 26, 2023
a732a85
tune kernel hierarchy
RandyShuai Oct 26, 2023
251a58b
define ITensor
RandyShuai Oct 27, 2023
e247fd8
add builder interface
RandyShuai Oct 27, 2023
021405f
postpone kernel creation
RandyShuai Oct 27, 2023
e433f5d
fix to make customEp2 running
RandyShuai Oct 30, 2023
4819293
add testing model
RandyShuai Oct 30, 2023
a2c247a
customize GetCapability() and Compile() in custom_ep2 and delete ort_…
jslhcl Nov 2, 2023
9b0f3b1
test for GetCapability and Compile for custom_ep2
jslhcl Nov 2, 2023
95e1fe6
Subgraph API support
jslhcl Nov 6, 2023
74c457d
add both in-tree and out-tree UT
RandyShuai Nov 6, 2023
4168d03
Merge branch 'rashuai/EpInterface' of https://github.com/microsoft/on…
RandyShuai Nov 6, 2023
3586734
drop dep on ort lib for custom ep
RandyShuai Nov 9, 2023
e440c88
use new graph API in openvino
jslhcl Nov 15, 2023
60161f2
Merge branch 'rashuai/EpInterface' of https://github.com/microsoft/on…
jslhcl Nov 15, 2023
572d5f3
align build args between ort and out-tree custom ep dll
RandyShuai Nov 16, 2023
8d0c804
Merge branch 'rashuai/EpInterface' of https://github.com/microsoft/on…
RandyShuai Nov 16, 2023
48dcc85
fix wide char path for win
RandyShuai Nov 17, 2023
7defe5d
add tensorshape interface
RandyShuai Nov 17, 2023
c04c1f2
align tensor hierarchy
RandyShuai Nov 20, 2023
839103a
support tensor sequence
RandyShuai Nov 23, 2023
1b1c069
move SubGraphDef into namespace interface and create OpenVINO EP from…
jslhcl Nov 28, 2023
5396642
move openvino out-tree EP
jslhcl Dec 9, 2023
539d679
update eigen checksum
RandyShuai Dec 12, 2023
5d450cb
openvino can be loaded and run as out-tree ep
jslhcl Dec 16, 2023
f8d6a70
Merge branch 'rashuai/EpInterface' of https://github.com/microsoft/on…
jslhcl Dec 16, 2023
970a3f2
openVINO as out-tree EP works on Detection model
jslhcl Dec 19, 2023
33a60f5
new member functions for EPv2
jslhcl Dec 28, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 12 additions & 0 deletions include/onnxruntime/interface/common/data_types.h
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
// Copyright (c) Microsoft Corporation. All rights reserved.
Fixed Show fixed Hide fixed
// Licensed under the MIT License.

#pragma once

namespace onnxruntime {

namespace interface {

}

}

Check warning on line 12 in include/onnxruntime/interface/common/data_types.h

View workflow job for this annotation

GitHub Actions / cpplint

[cpplint] include/onnxruntime/interface/common/data_types.h#L12

Could not find a newline character at the end of the file. [whitespace/ending_newline] [5]
Raw output
include/onnxruntime/interface/common/data_types.h:12:  Could not find a newline character at the end of the file.  [whitespace/ending_newline] [5]
12 changes: 12 additions & 0 deletions include/onnxruntime/interface/graph/graph.h
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
// Copyright (c) Microsoft Corporation. All rights reserved.
Fixed Show fixed Hide fixed
// Licensed under the MIT License.

#pragma once

namespace onnxruntime {

namespace interface {

}

}

Check warning on line 12 in include/onnxruntime/interface/graph/graph.h

View workflow job for this annotation

GitHub Actions / cpplint

[cpplint] include/onnxruntime/interface/graph/graph.h#L12

Could not find a newline character at the end of the file. [whitespace/ending_newline] [5]
Raw output
include/onnxruntime/interface/graph/graph.h:12:  Could not find a newline character at the end of the file.  [whitespace/ending_newline] [5]
12 changes: 12 additions & 0 deletions include/onnxruntime/interface/kernel/kernel.h
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
// Copyright (c) Microsoft Corporation. All rights reserved.
Fixed Show fixed Hide fixed
// Licensed under the MIT License.

#pragma once

namespace onnxruntime {

namespace interface {

}

}

Check warning on line 12 in include/onnxruntime/interface/kernel/kernel.h

View workflow job for this annotation

GitHub Actions / cpplint

[cpplint] include/onnxruntime/interface/kernel/kernel.h#L12

Could not find a newline character at the end of the file. [whitespace/ending_newline] [5]
Raw output
include/onnxruntime/interface/kernel/kernel.h:12:  Could not find a newline character at the end of the file.  [whitespace/ending_newline] [5]
12 changes: 12 additions & 0 deletions include/onnxruntime/interface/provider/provider.h
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
// Copyright (c) Microsoft Corporation. All rights reserved.
Fixed Show fixed Hide fixed
// Licensed under the MIT License.

#pragma once

namespace onnxruntime {

namespace interface {

}

}

Check warning on line 12 in include/onnxruntime/interface/provider/provider.h

View workflow job for this annotation

GitHub Actions / cpplint

[cpplint] include/onnxruntime/interface/provider/provider.h#L12

Could not find a newline character at the end of the file. [whitespace/ending_newline] [5]
Raw output
include/onnxruntime/interface/provider/provider.h:12:  Could not find a newline character at the end of the file.  [whitespace/ending_newline] [5]
Loading