NEXT-GEN MULTI-CONTROLNET INPAINTING! You’ve NEVER SEEN THIS BEFORE!
Vložit
- čas přidán 23. 02. 2023
- Recently the ControlNet extension for Stable Diffusion was updated with the ability to use multiple ControlNet models on top of each other, which is fantastic because this brand new neural network structure allows you to combine multiple special ai models, and create even better and more precise images than before! In this video, I will not only show you how to best utilize those models together but also give you some special inpainting tricks using ControlNet that I discovered while making this video and I’m sure that you’ve never seen these before! So get ready!
Did you manage to use the multi-controlnet inpainting tricks? Let me know in the comments!
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
SOCIAL MEDIA LINKS!
✨ Support my work on Patreon: / aitrepreneur
⚔️ Join the Discord server: bit.ly/aitdiscord
🧠 My Second Channel THE MAKER LAIR: bit.ly/themakerlair
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Runpod: bit.ly/runpodAi
Segmentation color spreadsheet: docs.google.com/spreadsheets/...
All ControlNet Videos: • ControlNet
My previous ControlNet video: • CHARACTER TURNAROUND I...
EASY POSING FOR CONTROLNET : • EASY POSING FOR CONTRO...
3D Posing With ControlNet: • 3D POSING For PERFECT ...
My first ControlNet video: • NEXT-GEN NEW IMG2IMG I...
#stablediffusion #controlnet #stablediffusiontutorial
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
WATCH MY MOST POPULAR VIDEOS:
RECOMMENDED WATCHING - My "Stable Diffusion" Playlist:
►► bit.ly/stablediffusion
RECOMMENDED WATCHING - My "Tutorial" Playlist:
►► bit.ly/TuTPlaylist
Disclosure: Bear in mind that some of the links in this post are affiliate links and if you go through them to make a purchase I will earn a commission. Keep in mind that I link these companies and their products because of their quality and not because of the commission I receive from your purchases. The decision is yours, and whether or not you decide to buy something is completely up to you.
HELLO HUMANS! Thank you for watching & do NOT forget to LIKE and SUBSCRIBE For More Ai Updates. Thx
Have you seen Corridor Crew's video "Did We Just Change Animation Forever?", that seems super worth experimenting with.
i have some cartoon characters , see my profile ....i tried training stable diffusion with this but it cant seem to replacate this...the training only seems to work with things it created itself ..am i doing something wrong or is it that my character is unique and it doesnt have enough reference...when i did kinda get it to worrk with i think astria...it drew it like a 5 year old ..if it is possible to train with your own 2d characters PLEASE make a video about that
Hi, could you share the excel file about color?
How did you enable the guess mode?
With so much "tuning" and manual work, it's pretty safe to say that these "generative" works are more human than anything else and demonstrates that these are just tools at the end of the day.
In this case very cumbersome tools for a pretty simple operation
@@dv6165 True, but only if we take it at face value, if you wanted to change an image from realisitc to , idk, helltaker style manually, it would take way longer. As with most tools it's a matter of use cases.
With Generative AI, you never get the image you wanted, but end with some image which looks pretty after a million random pushing of parameters.
Can you get deterministic result on the next attempt. NO.
It would be better if these models churn out 2k+ resolution as the upscaling is again a million guess on the parameter buttons 😔😔
@@user-zi6rz4op5l you essentially describe what a customer feels when he hires an artist or designer. what these tools do is they put you into a different role - not the artist but the art director.
This is getting so mind blowing now. There are just so many different possibilities for how to make a good image now. I almost feel like I need to take a step back for a bit, and think about what I would really like to create, then see what technologies are now available that could help me achieve this.
We Are Getting So Much Control So Fast.
I Honestly Don't Think even 6 month ago anyone thought we would have advanced thim much this quickly.
and it's exponentially growing. video is a month or two away (or less). then come the apps, the corporate control, the tightening laws on models, the underground trade, the bootleg versions blah blah. it will be fun to watch - we're in the wild wild west phase right now
This reminds me of when personal computers became available and a lot of us learned to program
I can see a quality difference in my output folder from just two weeks back! This is crazy.
I called it. 6 months ago I said that while it seems like this kind of tech should take a year, it would take half the time. There's just too many people grinding away at these tools simultaneously.
Just crazy.
Holy shit, so much progress in AI image gen in so little time, my dreams of doing my own graphic novels using ML are pretty much fully within grasp using these techniques. What a time to be alive!
I have been trying to do the things you have now solved for hours. Thank you for your experimentation and sharing. The fact that you and a couple of other guys on CZcams are feeding off each other and pushing this forward to simplify our efforts is really appreciated. Please keep up the good work.☺
Nice! You have the best Stable Diffusion / Automatic 1111 content on YT. Thank you so much for letting us know all this!
I've been looking at separate tutorials for the past few days, and even those combined didn't give me as good and precise information as this single video did... amazing! Very much appreciated!
That trick to crudely draw lines to generate edge lighting worked way better than I thought it would. How on earth does it bleed onto the nose like that? This is some wild shit!
This gives me an idea for an experiment: Comics made with multi ControlNets. One for the frame. Add characters in with OpenPose. Then segmentation for specific objects.
how would you draw the same character in different poses?
@@f0kes32 see previous video ;)
Charturner....(civitai)
I just madea Steve Urkel in the style of EC Comics (Tales from the Crypt) and I'm very weirded out. AKA it's awesome
@@wakegary what model for ec comics?
I find that all this shows that this tool can be used by real artists and create little by little an image, from background, to pose, all the way to the lighting
Awesome man!!! So much new I didn’t realise you could do!
For someone who had been playing with Controlnet from day one just to blend a foreground character perfectly to a desired background perfectly; this video is a treasure. I tried many combinations but never ever thought of that inpainting trick you showed. You are the absolute best dear friend. 👌💪👍👏🧡
have you managed to make it working? for me it change whole picture and "masked only" other hand make things incorrect.
awesome collection of tips, I've been loving playing around with controlnet lately. keep up the great work!
Can't wait WHAT A TIME TO BE ALIVE AND FIRST!!!
You never waste my time :D Thank you for the depth and detail.
Controlnet is amazing, and thanks to you I understand it more and more every day. Thank you from the bottom of my heart. Sincerely, your loyal subject
Great video, so many useful tips!
This video right here worth so much that I'm gladly going to join Patreon.
Now this is the level of control I was badly missing back in January!
WooooOOOooooW Good as always!
You r the best! This stuff is so cool! I can't stop to admire this new tool)
dude, i need to watch this video 10 times with some personal experimentations, this new multi control net is a masterpiece
Thankyou so much for all these helpful vids, maes this super easy to understand, really appreciate it
Fantastic collection of tips & tricks, nice work ;)
Interesting. I have not seen anyone talking about controlnet. So it’s great to see. Thanks.
Craaaaaazzzzzzy! Love it, You are the strongest
Wow! Thank you for sharing.
Best controlnet video on the net. Tnx NON-HUMAN !
Thank you so much! This was very helpful!
This is why I love SD because you have total control of what you want to do and how your image will be.
dude...what a treasure chest of a video!!
Absolutly amazing. Thank you.
Very informative and inspiring .Thankyou .
You sir are insanely talented. Thanks for sharing.
Thanks. Wow. Pretty cool stuff. So many possibilities 👍
Super useful, thanks!
Thanks for the epic tutorial! If there were only a photopea version of After Effects too.
Very cool seeing the multi-control net stuff.
Last few days I've been adding in support for interactive visualization of control net outputs as a pre-pre-processor. Since it's annoying poking at values without knowing what the outcome will actually be.
And I figure, if I'm doing that for fun, other people are probably doing this as well on the sd-webui-controlnet extension team.
Cause the capability is all there for feedback from the ControlNet preprocessor in A1111, just a matter of connecting up the hooks for it.
troll king 👑 no seriously, i love your video, your workflow tricks. I could watch you for hours 😁👍
wow bruh great discoveries and thx for the share
You sir are my hero!
damn, this was like 20 tutorials in one! Awesome content Mr. Aitrepreneur
You are the man! 🤖 thanks for the tips
Really good techniques.
Thanks K for the powerful knowledge, have a wonderful weekend! ^__^
Very nice!
Amazing. Probably the most impressive new features since Dreambooth.
"Because I'm a madman." Hahahahaha! Love you man, you're great!
Hah got there before this video :) It is very very cool!
That s insane !
I haven't tried the multiCN, but with a single CN if you use the hed model it's already good for changing the style of a single image, it works kinda like depth map but preserves the detail and lines of the image
whoa! Totally stands out from the other guys :) -- Great techniques!
15:41 That image is absolutely insane, i love it !
Nice tips and video,from brazil
fantastic!
Awesome tricks
Damn, the sketch lighting trick is pretty cool.
omg!!这真的太有用了！看一次可能都学不完里面的知识
great tip, appreciated
great tutorial~~
remember the time where txt2 image with 1.4 was the only thing we could do back then =D ?
I remember discovering disco diffusion and thinking it was magical! lol Things are changing fast!
Yeah, less than a year ago 😂
wow, i had no idea this was possible, that's insane...I gotta wrap my head around it, it's difficult even seeing you do it. lol
This is pretty cool. I love your videos. You could use more models other than just anime and cartoon.
You can Inpaint character on the background much easier: there is a tab for that - “inpaint upload”. Just use depth pic as a mask. No need to draw something, and result is much cleaner.
Fantastic tips! It would be awesome if you add checkpoints/timestamps to this video so I can quickly go to a spot in the video if I want to review a specific trick you showed off. Keep up the great work 😀
Bro you keep blowing my mind damn gj
Thats really cool. Could you talk about how to change an object perspective too? Say you want a front, top, side or isometric view of an object
Lets gooooo!
oh my goooooooooooooooooood!!!!!!!
deforum also added controlnet but i have not seen it covered yet. might be interesting.
that's insane how quick the AI tech is evolving
finally 3d texture workflow assistance...with precision
Good lord, this is moving so fast that I can barely keep up with all this new stuff.
You're really amazing. Thank you very much for your super useful videos, super understandable English, super interesting content. You're just a light in the stable diffusion darkness.
Its crazy. So much things to learn just for one feature. It is indeed the age of AI
This is great! Thanks for sharing 🙂
Do you have an idea on how to create an animated, let's say, sticker for any messanger using Stable Diffusion? That would be interesting.
Thank you for this! YOu are wonderful! by the way how to do the excel thing or is there any other program to see the segmentation list?
Now we just need a node-based flow plugin to make the rotoscoping easier.
Installed it yesterday, and boy... I'm still struggling to figure it out. If it's going to do what I think, wow... Why do all the cool toys have to come out when I'm on a deadline?!??!? It's a plot I tell you!
What if we use multiply controlnet and all of them with guess mode or without it? Is there any different?
Ooooooh HANDS !!!!
do you have an in depth vid on the inpaint trick you explained around 5:00?
Awesome video!... Could you please (in any control-net video) tell us which requirements about VRAM specially) should everyone need in order to run in local properly this addon?...I guess my rtx3070 mobile with 8gb is almost uncapable...
damm tnx man
The multi controlnets are now tabbed. Niiice
Your channel is awesome, but I am overwhelmed with so much info. Is there a newbie playlist to start from beginning to catch it up?
Lol finally. Guess mode is pretty much what Midjourney does by default
You missed the best sketch trick, were you use colors to add things or transform the picture. For that you need the same picture in controlnet and play around. Is way more powerful than the segmentation trick.
Would it be possible to use Multiple Hypernetworks With Multi-Controlnet?
To for example, compose an image with multiple different characters with specific outfits?
i think using 2 control nets, one with the canny or depth, and one with the pose, and playing only with the pose around and not changing the canny or depth, well make you control the characters movement while keeping the details, i assume this is true and if you can get this right, you can make a lot of images, and thus having an animation.
I hope they make it so all the multi controlnet menus are just under one single master controlnet dropdown. Having multiple controlnet 0-3 drop down menus is kinda gross looking imo
Edit: Looking at the recent pull requests, it looks like someone has implemented a tab system which looks perfect!
Great video! How to add two different characters to the same background?
Can you add chapters to your videos? Sometimes I want to come back to specific parts but I can't remember where they are
Really cool! But is it possible to combine photos, like shown in the video, but not originating from SD (for example a real photo of a background with a real photo of someone) ?
The awesome thing abput nerdimg put over new tech is the constant chamge and radical improvement. The downside is you literally cant keep up with tge change and improvement
awesome
where do we get some here do we get some lighting examplars ?
Using a XY plot would help finding the right denoise strength
I don't know if it's possible yet because I lost the overview of the newest developments. I have 2 trained models of 2 different characters. I want place both characters in one image with a chosen background. Both characters should be arranged with open pose. Then the whole image should be created with diffusion in one step so that the lightnings and the shadows are correct over the whole image. Is this possible yet? Maybe I must wait another week :)