New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

reloading checkpoint shards with each generation/image - why not keep it in VRAM #23

Open

fritol opened this issue Jul 21, 2024 · 1 comment

fritol commented Jul 21, 2024

using the unchanges controlnet workflow
why is it reloading checkpoint shards with each image generation
after it generates image it clears the VRAM

on the pic u can see two image generations
and loading shards each time

szghds commented Oct 29, 2024

This one is particularly annoying, with every image, the model has to be reloaded.It seriously slows down generation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment