[Build] Can't run dml with nodejs after building #23027
Comments
github-actions
bot
added
api:Javascript
I see it running, but that some nodes fall back to the CPU. Note that across the entire ONNX operator set, there will almost always be some operators that fall back from a primary EP to the CPU EP (as the CPU is the catch-all EP, and some EP's have requirements that make it impossible to support all operators, such as those that dynamically allocate variable sized output during execution based on the input tensor values, like NonZero). The operator kernel coverage is found here: https://github.com/microsoft/onnxruntime/blob/main/docs/OperatorKernels.md#dmlexecutionprovider Just a hunch looking at the name |
|
Well tbh i dont know how to do that, I just started with Tensorflow these days, this model is an object detection model created with the basic example from TF docs: https://www.tensorflow.org/tfmodels/vision/object_detection Then converted to onnx with : But thanks for the hint. I will take a look at what could be done! Also, after more tests, I noticed that DML is working but is making the performance worse than CPU usage. |
That implies heterogenous execution with memory copies between devices. If the graph ends up with multiple partitions, then it is actually slower bouncing back and forth between GPU<->CPU<->GPU<->CPU<->GPU... (hence the warning above). Skimming https://www.tensorflow.org/tfmodels/vision/object_detection, I see it uses ResNet50 as a backbone. Is there an existing ONNX model in the model zoo that works for your needs, like this ResNet50 file? Does it exhibit the perf characteristics you expect? |
Describe the issue
I'm following the docs here:
https://onnxruntime.ai/docs/get-started/with-javascript/node.html
and here:
https://onnxruntime.ai/docs/build/inferencing.html
I have successfully build the lib for usage with dml:
.\build.bat --config RelWithDebInfo --build_shared_lib --build_nodejs --parallel --use_dml --paralleland installed the lib from source into my project
But when I try to use it dml:
it gives a warning:
Urgency
No response
Target platform
Node.js
Build script
.\build.bat --config RelWithDebInfo --build_shared_lib --build_nodejs --parallel --use_dml --parallel
Error / output
Running InferenceSession.create with verbose return:
Looks like DmlExecutionProvider was enable but the lib fallback to CPU execution provider
What could be wrong here?
Visual Studio Version
No response
GCC / Compiler Version
No response
The text was updated successfully, but these errors were encountered: