Skip to content

v0.8.1 - Layers and ControlNet

Compare
Choose a tag to compare
@Mystfit Mystfit released this 22 Mar 10:19
· 96 commits to master since this release
  • Added support for ControlNet Diffusers models. Two examples have been provided, a model using both a normal and depth map and a model using canny edge detection. Check out their respective model DataAssets as an example for how to implement other ControlNet models.
    image

  • Added a new layer processing system for models to streamline the configuration of models that require different types of input images and converted all existing model DataAssets to use the new system. You can now also provide additional arguments for a Diffusers pipeline in the form of additional Python code that will be run at model initialisation time.
    image

  • Revamped the generation section of the plugin UI to more closely match the rest of Unreal Editor's UI.
    image

Known Issues:

  • Prompt weighting currently not working. The community pipeline that was used to implement prompt weights has not been updated to match the rest of the diffusers library in a while but there is a package that provides similar functionality that will be implemented in the next update of the plugin.
  • Layer previewing will not update in realtime if a layer is selected whilst another layer is currently being previewed. Hide the current layer first before switching.
  • Layers previewing will sometimes show a black image after generating an image. Try switching models or use the "Debug python images" option as a workaround.

Full Changelog: v0.7.2...v0.8.1