-
Notifications
You must be signed in to change notification settings - Fork 1
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Implement OneDiff optimization on T2I pipeline [50 LPT] #37
Comments
Hey i am interested in this bounty. |
This was referenced Aug 29, 2024
Hi, I am interested if this bounty is still open can I be assigned to this bounty? |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Overview
Following a successful research bounty into the OneDiff optimization algorithm, we've discovered that combining OneDiff with OneFlow can accelerate inference by approximately 60% while maintaining image quality. The only drawback is an increase in startup time from 2 seconds to 68 seconds. Given that a 60% reduction in inference time can significantly enhance network performance, we believe it's crucial to provide orchestrators with the means to enable this optimization.
Currently, the core AI team is occupied with major restructuring tasks, including the AI worker and pipeline generalisations, developing new pipelines for startups, and releasing client SDKs. Therefore, we are contacting the community to implement this vital optimization for us 🏗️⚡.
Required Skillset
Bounty Requirements
ONEDIFF
Environment variable, similar to the approach used for Deep Cache and Stable Fast optimizations. For reference, see the implementation here.Implementation Tips
How to Apply
Thank you for your interest in contributing to our project 💛!
Warning
Please wait for the issue to be assigned to you before starting work. To prevent duplication of effort, submissions for unassigned issues will not be accepted.
The text was updated successfully, but these errors were encountered: