Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Gh pages] Update QNN EP documentation (quantization/python APIs) #19435

Conversation

adrianlizarraga
Copy link
Contributor

@adrianlizarraga adrianlizarraga commented Feb 6, 2024

Description

Preview: https://adrianlizarraga.github.io/onnxruntime/docs/execution-providers/QNN-ExecutionProvider.html#running-a-model-with-qnn-eps-htp-backend-python

  • Adds QNN EP documentation:
    • Create a quantized QDQ model using python quantization utilities
    • Run quantized QDQ model on Windows ARM64 using python ORT APIs.
  • Updates QNN EP provider options
  • Adds list of supported ONNX operators
  • Provides instructions for using the new arm64 python wheel

Motivation and Context

The aim is to make it easier for users to try QNN EP.

@jywu-msft
Copy link
Member

thanks for this!
Should we add some requirements for the arm64 python wheel? I know there's been some confusion in the past on this. (x64 vs arm64 dependencies)
perhaps we can list the config we've tested on numpy == 1.25.2 or >=1.26.4, python 3.11, 3.12 (arm64)
on 8cx gen3 , known issue with installing onnx on arm64 etc.

HectorSVC
HectorSVC previously approved these changes Feb 6, 2024
Copy link
Contributor

@HectorSVC HectorSVC left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:shipit:

jywu-msft
jywu-msft previously approved these changes Feb 6, 2024
Copy link
Contributor

@HectorSVC HectorSVC left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:shipit:

@adrianlizarraga adrianlizarraga merged commit 519fa38 into microsoft:gh-pages Feb 6, 2024
6 of 7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants