How to train the color controlnet

[hcdnlxlrf]

@jinxixiang I used the downsampled image as the conditional input for training, and I also used the open-source training controlnet code of diffuser, but the color of the training result is out of control. Do you have any training skills?
thank you very much！

[jinxixiang]

sorry for the late response. Did you train the color control independently or alongside with sketch control?

[keminze]

sorry for the late response. Did you train the color control independently or alongside with sketch control?
Please tell me how to train. I tried to train the SAM palette and the rectangular palette separately, but the effect of the SAM palette is not good. It seems that the color cannot be controlled, but the segmentation control is pretty good. Rectangular palette doesn't seem to work. I don’t know what went wrong. Is it a problem with my prompt words? My prompt words were generated using the blip model.