How to use ControlNet models with Stable Diffusion

Sdílet
Vložit
  • čas přidán 28. 02. 2023
  • A guide to the models available with ControlNet, their pre-processors and examples of their outputs.

Komentáře • 31

  • @viralhype_
    @viralhype_ Před rokem +5

    I have absolutely no idea what is happening here.... but it was amazing and I watched it all in fascination.
    This channel will be huge, I'm sure.
    Currently 31 subscribers... 32 now 👍

  • @Puckerization
    @Puckerization Před rokem +13

    Thanks for this concise explanation on the ControlNet models. Great examples and very well explained.

  • @kyleuhlig1529
    @kyleuhlig1529 Před rokem +1

    I really enjoyed the way you laid this out with consistent examples across each model so the effect of each was more clear.

  • @fool9111z
    @fool9111z Před rokem +1

    The best tutorial of controlnet!😂❤

  • @gadwal
    @gadwal Před rokem +3

    This clears up all doubts about what ControlNet really is. I'd love to know more about the UI in A1111.

    • @gadwal
      @gadwal Před rokem +1

      This might help:
      (text)--->(img) is t2img, with controlnet it'd be (text)--->[control/"conform to this outline or shape or depth"]--->(img)
      img2img with controlnet is: (text+img)---->[control]---->(img)

  • @GG-ii1uc
    @GG-ii1uc Před rokem +2

    Good Examples, thank you.

  • @landmonitor-lsd5634
    @landmonitor-lsd5634 Před rokem +1

    Agree with the above comment - concise and valuable.

  • @B-water
    @B-water Před rokem

    Great !! Very good explanation.

  • @bloomandfly6687
    @bloomandfly6687 Před rokem

    Thank you very much. You deserve a new subscriber!

  • @vudang6799
    @vudang6799 Před rokem

    Thanks for the explanation of the different models. How do you use the preprosessed image in and original image in Midjourney? Do you upload and use the images as a reference image?

  • @dennishmiller
    @dennishmiller Před rokem

    Great job. Did you use both the preprocessor and model version of every technique for these examples? Can you use one without the other and/or can you mix and match? Thanks.

  • @niccolon8095
    @niccolon8095 Před rokem +4

    great video fam, do you know if its possible to export the calculation the models make? like if i wanted to export just the depth map or normal map it makes

    • @fofrai
      @fofrai  Před rokem +3

      If you go to the settings for the extension you can enable this. You need to save the "detected_maps".
      They'll then be available in extensions/sd-webui-controlnet/detected_maps

  • @rafael_tg
    @rafael_tg Před 8 měsíci

    Nice video man. Thanks. Is there a good model for adding furniture? E.g. I upload a photo of an empty living room, set the style in the prompt, and let the model keep the same room structure but add several furniture and decoration?

  • @woltzwurld6760
    @woltzwurld6760 Před 9 měsíci

    Thanks

  • @eyecandy8243
    @eyecandy8243 Před rokem

    what model and propmts did you use for the company Logos? like Burger King etc. im struggeling to recreate something similar : /

  • @frankschannel2642
    @frankschannel2642 Před rokem +1

    A time stamp as between the different models would have been helpful.

  • @kanall103
    @kanall103 Před rokem

    I have a "ControlNet" folder with "model" folder inside with pixar, monaliza, etc in pt. files how use it ?please

  • @wilcurran3377
    @wilcurran3377 Před rokem

    "30 something couple, so an older couple". Wasn't feeling old today... until

  • @Username_094
    @Username_094 Před rokem

    i have a mac m1 chip when i run control net it takes hours to get result any tips on how to speed it up?

  • @cr4723
    @cr4723 Před rokem

    Why don't you show the setting in the GUI? Does the video explain the preprocessor (canny) or the model (control_canny-fp16 [e3fe7712])?

  • @Dhruv1223
    @Dhruv1223 Před rokem

    where can i get the Le Res Depth Model for Control Net?

    • @fofrai
      @fofrai  Před rokem

      You can use the existing depth model, leres only gives you a different depth map to use with it

  • @IR19881
    @IR19881 Před rokem

    Hi, I have tryied everything and I never get something base on what I upload in AI. It always does what it wants. I have all the models, styles, everything but it just doesn´t do it.

  • @aleksandrekordzakhia4406

    Hi, Can't find ControlNet is it a plugin?

    • @fofrai
      @fofrai  Před rokem

      This video will help: czcams.com/video/uUizoFA7OYY/video.html

  • @worldscutestpuppies3221

    i can't change model in controlnet it only show none. can someone tell me pls

    • @fofrai
      @fofrai  Před rokem

      You need to download the models and put them in the right folder, see czcams.com/video/uUizoFA7OYY/video.html

  • @stunspot
    @stunspot Před rokem +1

    Man I really want to watch this but 1)the music is instant migraine-inducing. No way in hell I'm sitting through 20 minutes of that. 2) it took you three minutes to say "These are our two test images". No.