Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can i quantize sigmoid activation (to QLinearSigmoid for example) in dynamic quantization? #19139

Open
mattam301 opened this issue Jan 15, 2024 · 2 comments
Labels
quantization issues related to quantization stale issues that have not been addressed in a while; categorized by a bot

Comments

@mattam301
Copy link

[Enter feedback here]
Since i am trying to quantize efficientnet using both static and dynamic methods, then i realize that only the static one quantize sigmoid activation into:
QuantizeLinear -> QlinearSigmoid_

But when i am trying to quantize using dynamic method, it turned out that sigmoid function cannot be quantized in default. As i read in quantize.py code, I cannot specify quant_format in DynamicQuantConfig, which seems lead to the above observation.

I wander what did i miss? Is there any reason why sigmoid cannot be quantized in dynamic method?
Thanks in advance


Document Details

@github-actions github-actions bot added the quantization issues related to quantization label Jan 15, 2024
@xadupre
Copy link
Member

xadupre commented Jan 18, 2024

Can you share the way you try to quantize your model and the error you get? That would help up to replicate and fix the bug if there is one.

Copy link
Contributor

This issue has been automatically marked as stale due to inactivity and will be closed in 30 days if no further activity occurs. If further support is needed, please provide an update and/or more details.

@github-actions github-actions bot added the stale issues that have not been addressed in a while; categorized by a bot label Feb 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
quantization issues related to quantization stale issues that have not been addressed in a while; categorized by a bot
Projects
None yet
Development

No branches or pull requests

2 participants