Stable Diffusion - FaceSwap and Consistent Character Tips - Part 1
Vložit
- čas přidán 7. 06. 2024
- Master Fooocus and Stable Diffusion for Creative Image Generation! 🎨 In this Stable Diffusion video I go over some tips on consistent character creation and how to use FaceSwap and get better results. #Fooocus #StableDiffusion #DigitalArt #ImageManipulation #CreativeTools
This is part of my ongoing series of videos on installing and using Fooocus for Stable Diffusion. Fooocus is a great interface for using Stable Diffusion and is very easy to get started. It also will run on systems with only 4GB VRAM.
I am running on an i5 32GB RAM Nvidia 3070 8GB VRAM
If you find the video useful and would like to tip, CZcams does have the Super Thanks option. Those are greatly appreciated so I can have my coffee!!
☕ BUY ME A COFFEE: ko-fi.com/kleebztech
Also I am a verified creator with Brave and do accept BAT for users of the Brave browser.
Download Fooocus: github.com/lllyasviel/Fooocus
How to install Fooocus video: • Stable Diffusion - Dow...
Fooocus Beginners Guide: • Super Easy Stable Diff...
Fooocus Upscales and Variations: • Stable Diffusion - Foo...
Checkpoints and LoRAs the Basics: • Stable Diffusion - Che...
Fooocus Poses and FaceSwap - Image Prompts: • Stable Diffusion - Pos...
Zoom with Outpainting: • Stable Diffusion - Zoo...
Inpainting with Fooocus - Don't Regenerate, Fix!: • Stable Diffusion - Inp...
Background Replacement with Fooocus: • Stable Diffusion - Bac...
Fooocus Tips and Tricks (and AI Hands) • Overlooked Fooocus Tip...
Stable Diffusion - Styles in Fooocus - How do they work?: • Stable Diffusion - Sty...
00:00 Intro
00:43 Consistent Character Tips
05:15 FaceSwap
15:00 Inpainting with FaceSwap
19:00 FaceSwap with Styles
20:45 FaceSwap with Anime Model - Věda a technologie
If you find the video useful and would like to tip you can buy me some electricity for all these image generations. It is greatly appreciated! ko-fi.com/kleebztech
super good video as always! thanks!
Thanks again!
Very nice. Thank you! I would love to see a full workflow to create constent characters in where the person is not looking at the camera
Amazing!! Your videos are God sent
Thank you! Always love to hear that they help someone with ideas.
pretty good video! very useful tips
Hey great video, please also make a video about swapping products/ consistent products
Very well done video.
Thank you very much!
wonderful, thanks
Welcome!
I used a 2x2 grid, I went and had a reference pack i bought of photos of people from all different angles. Yiu viuld just as easily use a video or movie to get several angles of a person. Then I used ComfyUI to create a depth pass for the angles I wanted to use.
Weak variation (subtle) can give you the smile, keep the image reference, mix with variation and it will replace, use the prompt to direct the change, mouth and eyes, I could get other expressions doing the same trick
Yes in further testing I have been able to get decent results. You do have to lower the weight and stop at a little and it may not look exactly the same but very close.
HI. Can you make a full body texture video to use the same characters but with full body, like in artflow? Thank you
Thank you a lot for your help. Could you please make a video for body consistency?
If I find a good way I will but I really have not. I do find that using celebrities names like I mention for the face also helps with the body. Although not as well.
Exactly this is important as well
@@KLEEBZTECH that would be great! :)
👍👍😍😍
👍👍👍👍
to be honest when I do the grid the faces are get actually be significantly different. Also in the video, I think the size of the lips is rather different from one picture to the next.
I might have figured it out. Although, still semi time consuming, but with great results.. Go create a MetaHuman, for Unreal Engine 5. Problem solved.
I ran into the Problem, that the face swap messes up my hair. To be specific the orginal has long hair but it always crops some weird hairstyle around the face thats rather short. Any tipps?
Have you tried masking more or less of the area?
I have issue with high ram usage with fooocus, i have 16gb ram and rtx 3060. As soon as i run webui my ram will go to 80, while generating image it will use almost 100% of ram but vram will use about 18%.
Have you looked over this? Check out the stuff on System Swap. I have 32GB and when I run Fooocus it uses about 9-10 GB of RAM it seems since mine will go up to 16GB total used. github.com/lllyasviel/Fooocus/blob/main/troubleshoot.md
@@KLEEBZTECH already checked it but it doesnt seems to work, on my system how much does your vram memory goes up. For mw it looks like my ram do all the works and vram do a little work, since vram usage is about 20-30% only
Yeah mine uses 100% of my VRAM when generating. I assume you have looked at the CMD window to see if anything in there that might give you a clue? Any errors?
Is this a new download of Fooocus or something you may have made some changes to settings? Because another thing to try is a fresh download and see if it still does it. I have multiple instances of Fooocus downloaded myself since I do tend to mess around with things.
@@KLEEBZTECH i dnt change anything, i just dnt install on my c drive. I will check cmd if there is some erro or code not
what if i already have the face made and want to do a grid
Could try Faceswap to see how it does.
HI. How do you get a grid with the same face but different angles (frontal, left profile, right profile, three quarters) to use them to create storyboards with other characters with the mix image prompt and impaint,Because when I use them, they always look into the camera, they're all frontal, okay?
I have not found a great way yet. You can also try terms like character sheet.
@@KLEEBZTECH ok, can you tell me which prompt I need to write to have a grid with four photographs for four different face angles? thank
Using a grid reference and putting Canny can do it, but you will have to inpaint each face separetelly for the consistency after the first grid generation
@@zoezerbrasilio2419 We know that. With the mix, the question was another: what is the prompt to create a grid with different angles?
I recorded this which should help you get different angles. There is not a set prompt but the first part of this video will show how to get them. czcams.com/video/MntZa4qLwn8/video.html@@onlineispections
Amazing video. Just a question. When i use image prompt faceswap with inpaint together fooocus gives me an error. I use fooocus_colab ipynb with google, free version. If I pay 100 will I be able to do it without the error? My PC has a Ryzen 5 5600 and an RX 6650 XT, 16 gb ram 3200, solid disc, etc.
I would suggest looking on the GitHub discussions for fooocus. I haven't used it yet on colab. I just never had great luck with anything on there when I've used things in the past. I think I saw a discussion there or on Reddit about that very subject recently.
@@KLEEBZTECH There is another way to use fooocus without google colab? Thanks for the answer
@@KLEEBZTECH Another question, my graphic card isnt Nvidia, can I use it anyways or it has to be Nvidia?
rundiffusion.com and diffusionhub.io are places that you can run Fooocus online but I am not familiar with them. I do know some people use the paid Colab with good results but I really don't know a ton on that. You can run it without Nvidia but I have not tested to see how big of a performance difference there is but from reading on the Github page it will likely be about 3x slower than with Nvidia. There are instructions on the main GitHub page when you scroll down explaining what to do for AMD GPUs. Looks like you just need to edit the run.bat file. I actually just got access to an AMD card but have not been motivated to swap it out and try it yet to compare.
@@KLEEBZTECH Thanks!
Which is the best base model we can use for face swap? Can we achieve better results by combining two base models at the same time?
I have not done enough testing to determine if one is better than another when it comes to the checkpoints.
faceswap doesn't work if the image source is external, not an image generated from fooocus..?
It can but it might not work as well. Depends on the source image.
Can't seem to get an actual grid. I gave the same prompt
Check out the second video. I have more tips. czcams.com/video/MntZa4qLwn8/video.html
1:36 It still don't get clear to me what the seed really does... I guess keeping the same it goes to the log file and takes the same config as the other? It's like an ID? But what happens if you also put an input image? My principal issue e.g. is when I try to keep my face on images with other people and make an upscale (I already tried mixing upscale with face swap in debug options). I had one result that it seemed a little bit to my face but I can't keep the same face :(. Now I'm downloading Fooocus MRE to try image-2-image and more...
The "seed" in AI image generation acts as an initial starting point for the algorithm to generate images. Think of it as a unique key that determines the randomness of the output. It is just a number used to create the randomness. The same seed is useful for testing but otherwise random is usually what you want.
And for faceswap I find .9 or above and weight of .9 of above work better.
I just tried upscale fast 2x and worked! Using the same seed. But some errors in the eyes (like anime styled). I will try fixing it with inpaint...@@KLEEBZTECH
Yes fast upscale will not change the image since it is more of a traditional upscale.
What seed actually mean? Why u wanna keep it stable and when
The "seed" in AI image generation acts as an initial starting point for the algorithm to generate images. Think of it as a unique key that determines the randomness of the output. Using the same seed with the same generation parameters will produce the exact same image every time.
Same seed I find gives more similar face I find in this case.
how do i ask AI to remove something, sometimes he generates bunch of objects that were not in the promt, how to remove them? 🥺
Inpainting can be used for that. Depending on what you are trying to remove it can be a little hit or miss. You can't really just tell it to remove something though and need it to generate the area again. You can alter the prompts when doing it to help remove the items. I might make a separate video on that sort of thing soon. I do have videos that cover different aspects of inpainting but not specifically that.
To give an example, I created an image of a woman having coffee and it put two cups in front of her. I masked out one with inpainting to regenerate that area. Of course it usually added another cup in the same place. So I change the prompt to say empty table and with a few attempts it removed the item and generated an empty area in that spot.
@@KLEEBZTECH got it, thanks a lot!
I believe I've seen that if you use the inpainting faceswap you need to select "improve details" not "inpaint/outpaint". To me it seems that it creates more similar results. The "inpaint/outpaint" even produced garbage.
I get much worse results that way in all the testing I did. But I am always looking for a better way. When I would do it that way it did not blend things very well and was always obvious that the face was swapped.
But you got me looking into better ways of doing it. I did find that if you use the vary subtle after, it blends things in decently and maintains the look for the most part...
@@KLEEBZTECH good point, I'll try that, too
ANOTHER WAY.....is train a LoRa. But more work for sure....
That is for sure a good way if you can. Although I have one trained and don't get the best results. Of course the way it was trained has a big part of that. I have found a LoRA and FaceSwap can be a good mix.