Control Net v1.1 is Amazing! Let's Install & Update, then Check Out the New Features and Settings
Vložit
- čas přidán 2. 06. 2024
- Let's install Control Net Version v1.1 and take a look at some of the new settings and features! There will also be a 2 min update guide if you already version v1.0
This video is a bit long but the actually install and update portion is a little over 7 minutes together. The rest of the video is explaining the features. I put chapters so you can jump to the part you're interested in.
I will quickly go over the new settings and features. For a more detailed guide on some of the models check out my Version 1.0 video here: • Master your AI Art Pos...
Here are the links you will need:
1. MikuBills Control Net for the extension installation - github.com/Mikubill/sd-webui-...
2. Illyasviel Control v1.1 Models on Hugging face to download the models - huggingface.co/lllyasviel/Con...
**Need to use control net with v2.1? Try Illyasviel's extension instead github.com/lllyasviel/Control...
Check out Control Net v1.1 Nightly Blob to see examples for all the models and updates - github.com/lllyasviel/Control...
WAIT A second, you don't have stable Diffusion???! Watch this video... • Updated Stable Diffusi...
Also check out my Control Net Depth Maps tutorial so you can fix hands and other body parts by downloading or making your own custom depth maps. • Let's Fix Those Hands!...
Chapters
-------------------------------------------------------------------------
00:00 Intro w/ SadTalker - What this video is about
01:05 Lets update our Extension from Version 1.0 to 1.1.115
01:32 Lets update our Models from v1.0 to 1.1
02:29 Drop your 1.1 models into your Control Net models folder
02:59 Add Multi Control Net
03:24 First Time Control Net users - Full Installation, Starting with the extension
05:23 Download the V1.1 Models
06:56 Put your models in Stable Diffusion / Extensions / sd-webui-controlnet / models
07:26 You're Done!
07:55 Where do you access Control Net?
08:58 Let's add Multi-Control Net
09:55 Settings Explained & New Features Preview - Starting With Canvas
13:34 Control Step Examples
10:23 IMPORTANT - Click Enable or....its not enabled
10:46 Pixel Perfect (Auto Rez Select)
11:15 Allow Preview (Boom Button)
11:44 IMPORTANT - Preprocessor & Models
12:21 "Amazing" art on Etsy
12:44 Control Weight
12:50 Starting & Ending Control Step (My attempt to explain it...)
13:36 Starting & Ending Control Step Examples
14:28 Preprocessor Resolution
14:50 Control Mode - Balanced, Prompt or ControlNet
15:20 Control Net Nightly Blob - Shows All model examples
15:46 Depth Model & Start of Models
16:14 Normal Maps (height Map, Bump Map) Model
16:46 Canny Edges Model
17:11 MLSD - Mutli Line Segmentation Detector
17:47 Soft Edge - Formerly known as HED
17:59 Semantic Segmentation (i.e. kind of like Nvidia Canvas)
18:39 Open Pose, NOW with hands and face maps
19:57 Tile Model "Script" can be used with Ultimate SD Upscale and VAE Tile
20:18 Synthesized Scribble (Captures outline)
20:38 Interactive Scribble Model (You Scribble on a Canvas) and Example
21:18 Latent Upscale example of Scribble Model
22:46 Examples for Upcoming Video - Tile Upscale up to 8196x8196
#ControlNet #Stablediffusion #StableDiffusionTutorial #A1111 #Automatic1111 #ArtificiallyIntelligent #aiart - Věda a technologie
![Eminem - Houdini [Official Music Video]](http://i.ytimg.com/vi/22tVWwmTie8/mqdefault.jpg)
i love the chapters in the video makes it really easy to watch and know what step to find at what point in the video
Glad to know it helps I’ll keep the chapters going. Taking a short break cuz I just moved but so much stuff popping up with the new sdxl. Gonna do a video when the new sdxl model works with control net.
14:15 LMAO that took me off guard
Very well done video! A lot of helpful information.
Thank you!
Thank you! Definitely appreciate the comment.
You explain everything so clear and concisely! Thank you so much! Unrelated to the video topic, but HOW do you have that dark theme when you launch Stable Diffusion? I thought it was the default theme, but mine was all white, which was too bright for me. And I already tried going to Settings -> User Interface -> Gradio Theme. I went through ALL the themes and still I can't get my theme to look like yours 😅Clearly I'm missing something because in other tutorials I've watched, people have that dark theme in Stable Diffusion. Any advice?
Thank you for the informative video. You mention control net does videos. Would you do a video on that?
anyone getting this error with controlnet recently, " RuntimeError: mat1 and mat2 shapes cannot be multiplied (154x2048 and 768x320)" used to work fine but recently none of the models work. Tile not working, gives me this error, used to be fine.
This ones a bit long but the actual installation part is only 5 minutes long and the update portion is less than 2 minutes. I added chapters so you can jump around to the parts your most interested in. I also forgot to mention that MikuBill's Control net doesn't seem like its compatible with v2.1 yet but you can install Illyasviel's control net extension which I will leave in the description.
1. MikuBills Control Net for the extension installation - github.com/Mikubill/sd-webui-controlnet.git
2. Illyasviel Control v1.1 Models on Hugging face to download the models - huggingface.co/lllyasviel/ControlNet-v1-1/tree/main
*Check out Control net v1.1 Nightly Blob to see examples for all the models and updates - github.com/lllyasviel/ControlNet-v1-1-nightly/blob/main/README.md
I am facing a strange issue where I choose a model to work on, such as realismEngine_v10, on Control Net, retrieve an image, and then choose canny in the model's preprocessor and write the prompt, but I receive an error. Is the model incompatible with the new Control Net model, or is there another issue? *Note that I have downloaded new models for Control Net such as control_v11p_sd15_openpose.
Deng i just released this video a couple of seconds ago haha, I was still doing the chapters. I think I know what it is though, Mikubill's control net doesn't work with Stable Diffusion v2.1 and your custom model is a V2.1 based model. Use a v1.5 model like deliberate or use a different installation of control net like Illyasviel's Control Net (i tihnk hes the creator) which I never installed myself but its the same exact install just a diff link in the extension's installer (this link github.com/lllyasviel/ControlNet ). I'm 90% sure that's it but if not you can also try deleting your old control net models. Go into Stable Diffusion / Control Net > Sd-webui-controlnet / Models and only keep the V11 ones. The easy way to tell is the v11 models are 1.45 gigs and older versions are about 5gigs. The new preprocessors don't work with those so take the old ones out so you don't choose them. Also try another model.
Man i have no idea how people with older hardware are doing this , i'm running near top of the line (i9-10gen, 4070, ton of ram) and im seriously struggling at some instances
Okay. So I need to install stable diffusion first. Okay.
I got a video for that 😀