Skip to content

loopback controlnet

Jump to bottom
s9roll7 edited this page May 18, 2023 · 1 revision

loopback + controlnet (sample 2)

  • Set Allow other script to control this extension True.

  • Configure the controlnet itself as you normally use it, set it to enable, then configure the preprocessor and mode settings

  • Create the initial image. Create a normal img2img image of the very first frame of the video and [Send to Img2Img]. You should set denoising strength to 0.7 or a higher value. Also, generate the image with the control net enabled. The first frame can be extract by following the steps.
    first_frame

  • Specify the same path in [Project Directory(optional)] and [Video File Path(optional)] as specified in the frame creation procedure above.

  • Make the following settings in [Mode Settings]

  • Change the denoising strength to a setting for video generation.

  • Generate
    lb_controlnet

  • During video generation, a controlnet cache is generated in project_dir to speed up the process. Therefore, the second time the video is generated, the generation time will be shorter. If you want to change the input videos, please change the project_dir as well, since it will be inconsistent with the cache.

Clone this wiki locally