CONVERT ANY IMAGE TO LINEART Using ControlNet! SO INCREDIBLY COOL!
Vložit
- čas přidán 8. 03. 2023
- Transform any image to lineart using ControlNet inside Stable Diffusion! So in this video I will show you how you can easily convert any previously generated color image to a black and white lineart version with ControlNet without leaving the auto1111 Stable Diffusion webui and then how to make it even better inside a free image manipulation tool website like photopea. So let's go!
Did you manage to convert your image into lineart? Let me know in the comments!
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
SOCIAL MEDIA LINKS!
✨ Support my work on Patreon: / aitrepreneur
⚔️ Join the Discord server: bit.ly/aitdiscord
🧠 My Second Channel THE MAKER LAIR: bit.ly/themakerlair
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Runpod: bit.ly/runpodAi
Photopea: www.photopea.com/
a line drawing lineart linework
Thanks to SergioPAL for Inpiring this video: / how_to_turn_any_image_...
All ControlNet Videos: • ControlNet
My previous ControlNet video: • TRANSFER STYLE FROM An...
3D POSE & HANDS INSIDE Stable Diffusion! Posex & Depth Map: • 3D POSE & HANDS INSIDE...
Multiple Characters With LATENT COUPLE: • MULTIPLE CHARACTERS In...
GET PERFECT HANDS With MULTI-CONTROLNET & 3D BLENDER: • GET PERFECT HANDS With...
NEXT-GEN MULTI-CONTROLNET INPAINTING: • NEXT-GEN MULTI-CONTROL...
CHARACTER TURNAROUND In Stable Diffusion: • CHARACTER TURNAROUND I...
EASY POSING FOR CONTROLNET : • EASY POSING FOR CONTRO...
3D Posing With ControlNet: • 3D POSING For PERFECT ...
My first ControlNet video: • NEXT-GEN NEW IMG2IMG I...
Special thanks to Royal Emperor:
- Merlin Kauffman
- Totoro
Thank you so much for your support on Patreon! You are truly a glory to behold! Your generosity is immense, and it means the world to me. Thank you for helping me keep the lights on and the content flowing. Thank you very much!
#stablediffusion #controlnet #lineart #stablediffusiontutorial
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
WATCH MY MOST POPULAR VIDEOS:
RECOMMENDED WATCHING - My "Stable Diffusion" Playlist:
►► bit.ly/stablediffusion
RECOMMENDED WATCHING - My "Tutorial" Playlist:
►► bit.ly/TuTPlaylist
Disclosure: Bear in mind that some of the links in this post are affiliate links and if you go through them to make a purchase I will earn a commission. Keep in mind that I link these companies and their products because of their quality and not because of the commission I receive from your purchases. The decision is yours, and whether or not you decide to buy something is completely up to you.
Just binged your entire playlist on ControlNet. That and Inpainting are truly like magic. Thank you so much!
Simple yet so effective. Controlnet is seriously magic.
Can't argue with that one :D
is it a website? I don't know how I get to it.
How u downloaded it?
I havnt had much time to dabble with controlnet but one of my first thoughts was making images into sketches as opposed to everyone turning sketches into amazing generated art... Great job as always...
I find mixing DepthMap and Canny lets you specify how abstract you want it to be. Pure DepthMap looks like more illustrated vector line art, but adding Canny makes it more and more like a sketch.
can you tell me the steps?
How do I get to this , screen/program?
I love this. Now we just need someone to change-up the ControlNet IMG2IMG pipeline so that you can use a batch folder in ControlNet specifically.
That way you could use a white blank background to make animated line art in batches instead of having to do it frame by frame again with this new process.
Exactly what I was looking for, thank you!
SD came out and was amazing. Then dreambooth. Now Controlnet. Can't wait to see what's the next big leap.
Would be awesome with an updated edition of this video now as there is so many new options with the comfyUI. Thank you for the video Aitrepreneur!
Very nice technique, thank you! Also you can tune canny's low/high thresholds to control the lines and fills
HELLO HUMANS! Thank you for watching & do NOT forget to LIKE and SUBSCRIBE For More Ai Updates. Thx
Wow! This is not working for me at all! I get a barely recognizable blob even though the standard canny line art at the end is fine. So I switched to your DreamShaper model. No good. Then I gave it ACTUAL LINE ART and it still filled a bunch of the white areas in with black. I also removed negative prompts that might be making a problem. No good. Then all negs. No good. I'm either doing something wrong or there's some other variable that needs to be changed like clip skip or something else. If it's just me... ignore it. If you hear from others you might want to look into it.
@@thanksfernuthin It is working for me. Maybe try this Lora with the prompt: /models/16014/anime-lineart-style (on civitai)
Maybe its a version issue or a negative prompt issue
@@hugoruix_yt995 Thanks friend.
Hey there.. big fan of your videos.. I got your channel recommendation from another YT channel and I thank him a thousand times that I came here.. love all your videos and the way you simplify things to understand so easily ❤❤❤
Hello humans? Lol
Love it! Can you show us how this would be used to convert lineart into a realistic image or painting? :)
Another amazing tip, thank you.
I need to test this of course but this might be another game changer. For someone with a little bit of artistic ability changing a line art image to what you want is A LOT easier than changing a photo. So I can do this, edit the line art and load it back into canny. Pretty cool.
U solved ti?
@@MrMadmaggot Nope!
Is keeping the denoising strength very low while inpainting with Only Masked the key to preventing it from trying to recreate the entire scene in the masked area? I've seen people keep it high and have that not happen, but it happens EVERY TIME I use a denoising strength more than .4 or so. Thanks in advance.
so cool!, thanks for sharing!
wow, it is amazing! But I have a question, here. My line art color is not black, it is very bright. Is there any way to make black color?
Amazing. Thank you. Sincerely, your loyal subject.
My god, this is crazy good!!!!!!!!!! 😱😱😱
Hey my k my ai overlord, how do you use openpose for objects? like say i wanted to generate a spoon but have it mid air at 90o?
Also, does it work for animals?
Hey Aitrepreneur,
thanks for this vid! I recently read about TensorRT to speed up image generation, but couldn't find a good guide how to use it. Would you be willing to make a tutorial for it? (or even other techniques to speed up image generation, if any)
This is exactly what artists are going to be using to speed up their workflow. Get a draft line art and work their style from there. Infinite drafts for people who struggle with sketch ideas.
Nah 90% artis is busy panicking ai take their job.
@@ribertfranhanreagen9821 this 🤣🤣🤣🤣
Awesome Awesome Awesome!!!!!!!!!!!!! You are the BOSS!!!
Happy to help ;)
I like it. Your vids are great
Glad you like them!
WOW,great!
Great Video
Very helpful! I'm interested in creating vector art for my laser engraving business. This is the closest thing I've seen that helps. Anything else you might suggest?
Thank you=subd!
Wow, this is exactly what I’ve been trying to do for weeks! It looks so simple, however, I only have an iPad so need to do it in a web up. Any suggestion? ❤️🇦🇺
I .. I haven't learned the last 10 videos yet. I need a full time job just to learn all these Stable Diffusion features.
I am noticing you have a set seed. Is this the seed from the generated image before?
If so, does that explain why this is much harder to get it to work well on existing images that were NOT generated in SD? Because I'm struggling to get something that doesn't look like a weird woodcut.
Dude where did yuou downloaded teh dreamshaper model?
Dang using this with illustrator will be a lot time saver
Would there be away to batch video frames like this ..
way supercool!
Is there any probability to create one line art forms using Controlnet. I hope next version will be bundled with this feature..
very cool, i'm trying to get "one line art" drawing, do you happen to know how ?
I still get some color in my image when i trg to turn it i to sketch is there a fix for that?
man control net is awesome i use it to colorize my drawings
@Captain Reason i use the canny model it preserves the sketch then i describe my character or scene. my sketch goes in the the control net and if i draw a rough sketch i add contrast. the scribble model does not work good for me atleast it creates its own thing from the sketch
What graphic card are you using? thanks
hello I met an error: RuntimeError: mat1 and mat2 shapes cannot be multiplied (154x768 and 1024x320)
Is there any way to solve this? Thanks
Hey, I would like to use Runpod with your Affiliate Link.
If I do Seed Traveling I've to wait about 1-3 hours on my Laptop. Thats long^^
So one question.. If I've found some good prompts with some good seeds.
Can I copy the prompts and seeds after I'm happy with them to Runpod and just make the Seed Travel their?
Will I get the exact same images with this way?
I think the models have changed because I followed this video to the letter and all I get is very very faint line drawings. I even took a screen shot of the example image here used and got exactly the same issue. There are more controllers on the more recent iteration of ControlNet, but everything I try results in ultra feint line images.
If you want to get the same results use the same model: dreamshaper_331BakedVae
I have the same problem. The line is not as clear as his.
I'm using Automatic1111 and installed Controlnet, but Canny model isn't available, how come?
That looks amazing but I have an issue, I have recently installed Controlnet and in the folder I have the model control_v11p_sd15_lineart but it's not showing in the model list ?
I had same issue i downloaded control_sd15_canny.pth file and put in models folder
3:33 For that it's better to pick a "solid color" adjustment layer.
I dont have the guidance start in the settings, what is wrong with mine?
Can the opposite be done? sketch , line art to image ?
thanks! i looked for a good way for hours and hours ... and everything what i needed to do is search quick on youtube ...
Can you tell me what I have to install to use this?
I swear when I try these mine just doesnt want to listen to me lol Mine Might be broken Granted I just use it to make my workflow better now even wht I have atm its still as strong anyway just not to the lvl of this lol now Knowing This I can make my line Art even better from Learning with using different brushes Man This makes things even Fun and Easier for me to test out different line art brushes for this Always enjoyable to see new Stuff being evolved just So Fascinating
I really love your work. Can you please make a video on "how to train lora on google colab". Some of us have cards with only 4gb vram. It would be really helpful.
Any idea how to do this in comfyui? Auto1111 is really slow.
Mine turns out quite light/grayish. the lines are also quite thin. Any tips?
Same here, no way I can obtain the same results! why is this happening?
You can try using the same seed he does in his img2img tab or changing it to see which lineart style you prefer. Every seed will make a different lineart style.
Where did u get that Canny model?
Hey i am not able to achieve the quality of linework you are able to achieve in this video. is it a good idea to experiment with different models?
If you want to get the same results use the same model: dreamshaper_331BakedVae
Can anyone assist me? I've installed Stable Diffusion but it gives me RuntimeError: CUDA error: CUBLAS_STATUS_ALLOC_FAILED when calling `cublasCreate(handle)` . Not sure what to do as my pc meets necessary requirements.
Can't get this to work it just results in a changed still colored image. I followed step by step and have triple checked my settings, I've only got it to work with one image no others. They all just end up being changed images from high denoising and still colored.
Any way to boost the contrast of the linework itself? I'm getting good details but the lines are near-white or very pale gray. Tried adding "high contrast" to my prompt but not much improvement.
i am getting the same thing
raise the denoising strength i missed that step :)
There's always photoshop.
The model you use seems to affect the outcome. I haven't tried the one he is using. And of course the input image you choose. Luck may be a factor as well. All of my attempts so far have looked absolutely horrible and nothing like the example here. Fun technique but nothing that I could use for anything if the results are going to look this bad. Anyway, it was interesting but now on to something else.
I just save it, bang it in Photoshop and I just use adjustment layers i.e. contrast, curves. Until I get good with stable diffusion I am doing this for now. For colour lines, try adjustment layer colour, then make overlay mode screen.
When I do it, I just get an error message (with no generated image) saying- AttributeError ControlNet object has no attribute 'label_emb". Does anybody have any idea what I could be doing wrong? please help!
It's all ok before Inpaint procedure. When I click generate after all settings and black paint on face the Web UI tells me: ValueError: Coordinate 'right' is less than 'left'
Solved. It was Firefox. But the Inpaint "new detail" works only f I select Whole Picture.
how do I get controllnet? or if it's a website?
So Instant Manga Panels? Nice!
Pretty much yeah :D
how can i do this in batch?
In theory, we could use this same method, with slight variations, to have full color characters with white backgrounds, so we can then delete said background in Photoshop and thus have characters with transparent backgrounds?
Why I follow the same Settings as the video tutorial. For large models, controlnet is also set up. The image I generated was still white, no black and white lines,
Where can I get this canny model?
What's this program called ?!
Hi, I replicated the steps on an image but the image came out with blurred lines like brush marks with no distinguishable outline. BTW, it took me nearly 4-5 minutes to generate on a macbook pro i9 32GB RAM.
U solved it?
@MAD MAGGOT Nope. I parked the project.
Hey K, what happen? did they delete your video again?
Haven't tried this yet but this might make it easier to cut (some) images from their background. Convert original image to line-art. Put both the original image and line art into photoshop (or equivalent) and use the magic background eraser to delete the background from the line art layer. Select layer pixels and invert selection. Swap to the layer with the original color image, add feather, and delete.
Is the reverse possible? line art to painting?
sure, just put the line art into controlnet and use canny. (txt2img) write a prompt etc
Wait, does this make colorizing manga really easy? I never thought of that before
What does the seed value say?
I only get a black image from the canny model... any ideas?
The title says any image, how can I apply this style to one of my own photos? Please
Yeah exactly, I tried with one of my own photos and it wasn't as good
Which app?
I followed this tutorial to the letter, but all I get is random lines, which I assume is related to Denoise Strength being so high. Can you try with a different model and see if this still works? Anybody got it to work?
If you want to get the same results use the same model: dreamshaper_331BakedVae
@@Argentuza Hi, I found the only link about dreamshaper_331BakedVae. It's on hugging face, but seems not a file for download. Where can find a usable dreamshaper_331BakedVae file?
i keep getting a completely different image can someone help me.
This is way more effective than anything i have tried with Photoshop.
which means you did not tried it because its not as good as that video makes it to be , he cherrypicked example image
@@krystiankrysti1396 not sure what your point here. but AI is does not mean Magic! you still need to edit the picture in Photoshop to ENHANCE the result to your liking.
Using controNet indeed saves me hell of a lot of time.
(do not forget, the burgers on the pictures NEVER look like what you really order !)
@@vaneaph well, i got it working better with hed than canny , its just if i would make new feature vids, id premade a couple examples to show more than one so people can also see fail cases
So, it requires a WHITE background?
I guess using it for comic book art is a little more involved or is it?
Plz how to download controlnet ?!
Not Working for me.
Which website
It looks great. But I follow your steps but it doesn't work anymore...Maybe it's because the different version of webUI and controlnet.
i tried using it on images i had already created and they came out not so great. does it only work with the same seed. is that why you have to create the image first and then send it to img2img
This is a great observation, I think you might be right because I'm having a rough go with real photography
Interesting Idea... I thought it is because he is using a different model than I do... Also in my case it does not turn out well. there are no wider lines like in the video and it looks bad.
I tried it with results from text2img... and the same seed, does not work. I am downloading the model now that he used... to check that out.
@@bobbyboe please let us know.
Update: I used his model and it is still not good, only thin ugly outlines, I updated all extensions, I used the negative prompt like he did (a user further down in the comments has achieved better results using it - I did't). I used rendered photorealistic figures.... I still wonder if there is some deeper reason in only using a picture-result from text2img and transfer that to img2img... which would make the whole thing useless for me.
gelişir gelişir
where is the link to this ai tool??
I found the first step unecessary. What's the point sending to img2img if you delete the whole prompt later on, just start from img2img directly then tweak any gen you have ? or any pic really
Don't forget that it's good to have the seed
@@TheDocPixel I think seed become irrelevant with a denoise strength of 0.95. Besides, if your source is AI generated then the seed is in the metadata; if it's any images from somewhere else there's no meta = no seed. So I don't get your point here
i wonder why i only have one cfg scale, not start and end like you, my controlnet should be up to date
edit: nvm, needed an update
it dont work, i got a totally different result
💪💪💪
It just seems to make a white image. Ive triple checked that I got every step right :/
Hi, do you do personal tutoring? I'd like to pay you for a private session
I don't knwo why but this isn''t working for me at all
Hi
and here i trained 2 embeddings all night long to do the same thing...
Ah.. well😅 sorry
@@Aitrepreneur no no, this will be excellent! Right after I get done with this Patrick Bateman scene...
@@Aitrepreneur Just tried to do this and I do not have a guidance start slider, only weight and strength.
Tattoo artists... Ohh I hate AI art! ... oh wait this fits into my workflow quite well.
a line drawing lineart linework
Has anyone tried this on a building/architecture photo?
First
ain't working for me, chief
Edit. I figured it out, the denoising is key.
help me human. not working for me
As a lineart artist, I am deeply saddened...
Yeah
Mine always looks like a grayscale or a fluffy model with shading. Its never lineart