Use ControlNet as the adapter

[WUMINGCHAzero]

Thanks for your great work! I notice that in the latest version, you use controlnet as the adapter for platte control. I have several questions about it:

1. In the case of the adapter, is controlnet better than t2i adaper?
2. the training of controlnet as the adapter:
   a) did you fix the sketch-controlnet and only train the platte controlnet?
   b) did you train the platte controlnet from sd1.5 checkpoint or use other checkpoint?

Thanks for your time. Hope to hear from you soon.

[jinxixiang]

Hi,

1. our motivation is to use SAM and color palettes to make it more stable.
2. (a) yes (b) we use sd1.5