Skip to content

Creating your first image

Mystfit edited this page Aug 8, 2023 · 1 revision

To get started, open the main plugin UI from Windows->Diffusion Tools UI

image

There are two main sections that we need to pay attention to in order to create our first image, the Pipeline and Generation sections.

  1. Firstly, pick an Image Pipeline Preset. If when you click on Image Pipeline Preset no assets show up, then make sure that Show Plugin Content` is checked in the asset browser options.

image

  1. For your first image, pick the SD_1-5 preset. This will let us generate an image using the Runway Stable Diffusion 1.5 model.

image

  1. In the Generation section expand the Generation Options->Options section. Click the checkbox next to Positive Prompts to unlock the property and click the + button to add a new prompt to the array. Expand the prompt item in the array and set the prompt to an icy tundra. Add another prompt by clicking the + icon and create a new prompt of fluffy white clouds in a blue sky.

image

  1. Finally, click the Generate button in the upper right of the plugin window. If this is the first time that you're generating an image, the plugin will first download any required models before generating your image.

image

  1. Generate a few more image iterations until you see one that you like then right-click on the image thumbnail at the bottom of the plugin UI in the photo history roll. This will open a menu that will let you export the texture outside of Unreal as an image file.

NOTE: Each generated image will be automatically saved as a texture and an associated data asset. By default these are located in /Game/SDOutputs which should map to YourProject/Content/SDOutputs on disk. If you want to change the location these assets are saved to you can change the Texture Save Path property in Generation Settings.

Clone this wiki locally