Consistent AI Characters in any pose: Tutorial
Vložit
- čas přidán 26. 11. 2022
- In this tutorial, I go through step by step, how to create a consistent character for your comics, books and creative projects. (▰˘◡˘▰)
✨Free Written tutorial coming soon on:
promptmuse.com/consistent-ai-...
🖱️Step 1: / discord
You can use any Text to img generator you like, I just choose MJ :)
🖱️Step 2:
Thin Plate Motion Colab Notebook (For adding animation to your character's face)
colab.research.google.com/dri...
🖱️Step 3:
Out Painting (Creating your character's features, you can us inpainting for this as well)
colab.research.google.com/git...
Get your Hugging Face Security Token (Make a free account first)
Hugging Face:huggingface.co/
🖱️Step4:
Dreambooth (Training a model based on your character)
colab.research.google.com/git...
🥤If you want to buy me a coffee, I'd really appreciate it:
ko-fi.com/promptmuse
🕹️Many thanks to Sixhaunt for his pipeline, advice and information and for letting me demo his Genevieve model, he's doing amazing things for the AI community.
Please check his website out here:
xanthius.itch.io
#aiactor #ai #aiart #midjourney #stablediffusion - Jak na to + styl
Hi, there is a great help forum here github.com/yoyo-nb/Thin-Plate-Spline-Motion-Model/issues.....but if you are not having any luck please try this alternative method: huggingface.co/spaces/CVPR/Image-Animation-using-Thin-Plate-Spline-Motion-Model
the form no longer works :'(
Can you redo this where its completely on a local machine?
I accidentally had this on loud as I was out in public, some old guys head exploded as this was too much for his mind to comprehend. Data overload. Thanks for the great content
You are a gem!
@@Arkhkalos she accidentally added the "....but" into the link. just copy the important part and paste it into the address bar for it work.
It was nice to see such a complete, full workflow for using these new tools and putting them towards practical uses. Great video!
Love how you've broken down in easy-to-understand terms so many different tools here. This gives me real hope for the future of AI, where communities work together to build tools that work not just for techheads, but for anyone. You're fulfilling an important role in that chain, which is as a very experienced non-technical user explaining things to other non-technical folks who want to get started. That's a link often missing, so thanks!
This is another level, didn't expect to see something like this on CZcams at all. I am blown away! Please keep it up!
Holy moly, this is so good! Thank you for this genius research and development. So many people looking for this.
I was blown away just by the animation part alone. So many possibilities.
You are incredible. I, too, am obsessed with workflows but you're actually making videos about it and you're on another level.
one the best, most thorough tutorial vids i've ever seen. . . what a game changer!
Thank you for this incredibly detailed step-by-step guide. Exactly what I've been looking for. Thanks for distilling this convoluted process down and taking the time to put this tutorial together!
In all of this CZcams chaos, there are lights in the tunnel, your channel being one of them. Well articulated, no hokey lazy humor, deep demos and excellent instruction. If I had tons of money I would pour that into this resource, but alas, I'm here for the free teaching, so ahem, y'know. Keep rockin' AI artist sista!
Haha What a kind comment! I do it because I’m passionate about it. Also I love sharing the info and being involved in the community :) Thank you for your comment, it made my day !
I've been so addicted to learning and running my own stable diffusion I forgot there were other AIs out there. Going to have to try midjourney after I finish training my model. Nice to see alot of people getting interested in it.
Upvoted and subscribed. For the content of the video, for the lack of clickbait, for the written and easy-to-follow steps, for giving credits and visibility to people who helped you... This is quality content. Thanks a lot.
Holy shit, now this is how you do a tutorial. I was intimidated af at first seeing all of this, but you made it so easy to follow along with and I had a successful first go. Can't wait to see where I can take this! You earned a new sub. Can't wait for the next vids!
I have followed the video with attention, and I can say you are a great teacher.
Unfortunately today I did not learn how to create a character in ANY pose, but I have learned how to create a consistent character.
I hope in the future your videos will reflect the title's promise.
Thank you, PromptMuse!
This is the bright side of AI. Beautiful tools being explained by a competent and engaging person. Thank you for your hard work. It's channels like this that will teach the next generation to do amazing things.
I have been working on a personal story that went from book, to unity, to UE and I've always struggle with being one person doing everything. I guess that after 15 years of starting my journey, I've finally found my perfect ally in AI. I can clearly see the path ahead and how I can finally make my vision real... of course there is always a caveat... we just got a baby and I can't put the free time in the computer hahaha
Thanks for the tutorial, well explained and straight to the point! Subscribed!
This is a great tutorial! Can't wait to try it out myself. Thank you!
Finally! A video that doesn't assume I have any coding experience and goes slow enough for a numpty like me to follow step by step.
Wow. You are an awesome instructor. Thank you so much for putting this together.
This does NOT help my obsession with wanting to create more "cool stuff" :). You've put together the most complete workflow I've seen. It's a credit to your insights and passion and I'm really happy for you. It's becoming a bit of a crowded space of CZcamsrs already, but you're bringing something different and in my opinion, unique and better.
Thank you very kind. I haven’t been outside due to these obsessions, is the sky still blues ??? Thank you for the kind comment, really nice. Cheers!
She showed us, but lets give some love to Sixhaunt for putting it together. Can't have one without the other. Both are helping the community immensely
@@rne1223 Totally !! I wouldn’t of known this workflow without him!! Also he shared everything with me. A true asset to the AI community 🙏
She could have saved herself a lot of time and trouble by just filming herself, as she has the look of an AI character.
That is how it works by design tho
Wow, amazing video!!! Thank you for taking all the time to create a tutorial. You are doing an awesome job!
Your tutorials are inspiring. Keep the good work!
BRAVO! you are an amazing teacher! thank you very much for sharing those information in a very efficient way. I will try with a drawing, or a painting soon!
This is just brilliant! I've been using Stable Diffusion, but it looks like I'll have to get familiar with Midjourney, and come back for this awesome tutorial. Thanks!
Brilliant stuff! I'm a former art/media student who has had a bad spell of many years, resulting in a lack of creativity and slight depression. AI and videos like this have really kicked my creative energy back into 1st gear! I'm now making scripts for all kinds of projects, images and design, and now, thanks to you, even animations! Thank you so much!
Yes, love that for you. So much to look forward to in this space, this is just the start :)
So happy to see this comment, i've been having an ongoing discussion with a friend about AI and it's effect on creativity... My friend thinks i'll be the end of creativity, and i argue the opposite.
@@BlackMoridin Definitely the opposite. I'm still using it and creating stuff. To be honest, it is mostly for myself to create stories and characters. However, until now, I have never had an instagram page in my life. Now I'm running two channels and putting stuff in there. Also, have written an article for Medium, which I hope to publish soon. So, all in all, am doing much better than before regarding my creativity.
Great tutorials, jam packed with clear info.
love it very resourceful. NGL these kind of videos should go as viral imo
Glad to be able to say I was here at 4000-something subscribers! You are probably the best I’ve seen on YT teaching this stuff!
And also someone buy this girl a 3090!
Thank you for being here :) I hope you stay with me !
Phenomenal walkthrough and results!
This is amazing! Perfectly condensed useful information and really well explained! This is going to be one of the top channels on this subject! Glad to be here from (almost) the start of the ride, when we were not millions of subscribers yet! XD
Thank you so much!
Thanks for the high density informative content!
This was FANTASTIC! Thank you so much!
This was a really clever workflow. Great job.
just found your channel and wow i am impressed and THANK YOU so much for sharing. I really like your straightforward vids. Love from California !!
Hey, thankyou 🙏
Great video and thanks for making it easier for more people to get access to these tools. Your manner helps make a daunting "techy" activity actually doable. Well done!
Thank you ! I cannot even turn on a tv tbh haha
Wow! Again, excitingly helpful and informative! thank you!
I work in IT handling files with PHI. This stuff is so much more exciting. I am so amazed by your videos. Thank you so much!
thanks for sharing these techniques. it is a very clear tutorial
Great effort. I can see it take a a lot of focus on the steps. Thank you. ❤
Thanks for sharing! It's so well explained that I have no prompts for describing it😁
very complicated steps but they worth , thank you for that huge effort....and for this amazing tutorial
Awesome! Thanks a bunch for making the video, showing how to pull it all together :)
This is just the beginning. Insane
This is ingenious. Good job and thank you. Subscribed.
thank you so much my muse, amazing work
Incredible and so helpful 🙌💖💖💖 Thank you!
Wow, amazing tutorial and video, I liked it so much! 🥺😄👏
It's so useful because I'm making a virtual assistant, and the results are beautiful
Thank you very much for this tutorial. It has given me a an idea for something that I hope works out.
Thank you for a well explained and useful material.
Excellent video. Very complete and well explained. You are the BOSS.
I’ve watched several other videos trying to explain dream booth and just didn’t click for me. Thank you for this fantastic, concise and understandable tutorial!
Hello! I just started learning about AI generated images, and I have to say that your CZcams channel has been incredibly helpful in my learning journey. Thank you for all of the valuable information and insights you provide! In addition to the great content on your CZcams channel, I really appreciate that you are willing to allow a FAQ in the comments section. Not many CZcamsrs are open to this, and it has been a huge help for me as I am just starting to learn about the subject. I just wanted to let you know that this comment was actually generated by an AI, but it does accurately reflect my thoughts and appreciation for your CZcams channel. Thank you! :)
Very cool! Lots of great information simply and nicely explained. Thank you so much!
Bless you for this. BIG thanks.
that is the vid that will let me do AI, thanks!! workflow is gold
We’re in the early days of AI, this channel will likely have millions of subscribers with in the next 5 years.
haha thanks, I just do it as a hobby as it’s really interesting and the best way I learn is by teaching 😂 so it’s a win win! But, thank you !
In Planet earth they are not 5 millions of people smart enough to understand what this channel speaking about
@@blender_wiki lol
Totaly agreed! Simply because she is a great tutor! I will defenitly follow and recomend!
Millions of subscribers where AI now wants to learn how to render itself?
What an ingenious way of creating a consistent character. It's certainly a lot quicker and easier than the way I've been doing it. Great work and subscribed! Thank you!
Great tutorial! I wish i had run into this 8 months ago, wow! Your stuff is incredible. Have you seen what the Corridor Digital guys did for their animated show using diffusion?
I think what a lot of us are interested in is how to upload a posed image and have all those poses have the character rendered consistently using the reference images.
Sort of akin to tracking data for animation.
Did you have any luck figuring it out? I'm still having trouble!
@@Queenwraith nope.
I would imagine that this could work for that, just with a lot more steps? Like if you can fine-tune it to have an “idea” of your character, then you could use controlNet to make it make images of your character in whatever pose?
Though I would imagine that it would be possible-but-difficult for someone to make a model that would like, copy a character from one image and make it match another pose, instead of needing to fine-tune separately for each character?
I think I saw a tutorial on building a space shuttle that took less steps... but it was an amazing video and you did a great job presenting all that madness. Wow... I hope it's useful in a lot of ways after all that.
Another great video! I was trying to work out how to do something like this the other day haha.
Thanks Jamie, the pipeline was down to Sixhaunt - No one else has done it quite like this so far.
It’s very quick once the model is set up to just churn out consistent character prompts!
Thank you. That is A LOT of info but fortunately I can come back
Your tutorials are perfect
Wow... You are amazing, please keep it going
What a video!!! Thanks for sharing so much knowledge 🫶
Yeah, we will be making ai driven short films here soon and I’m all for it. I tried learning 3D modeling but had a terrible time trying to model a realistic 3D character.
Awesome way to do it! Thanks for sharing 👍
Very nice workflow!
Here are some tips (it has helped me for complex poses and it may not be the most practical but it helped me) with the clipstudio program I made the exact pose with the camera angle that I wanted, then I took it to photoshop and painted a little, I basic so that SD understands, then in SD with the cara model that I had trained, use img2img some mask and that's it, it might seem like a lot of work but it's actually quite fast.
¡Esto es muy creativo! Increíble
Do you think that we can convert any model to 3d model ? Someone made a 3d man which talked like a tiktok influencer (like you did but in 3d model)
Hey, yes for sure. Great question. David Holz (Head of Midjourney) said in a discord meet that they are working on releasing a 3D text conversion program next year 😁🙏
@@promptmuse wow sounds cool 😁 i hope we can animate the model with our face in real time 🔥🔥🔥 thanks for info
Omg thank you so much! I run these locally never thought using these tools together like this to get ref video!
Amazing video! Keep up the great work! So in order to create a image with several persons, all consistent character, I would just repeat the process for multiple persons, 'naming' each one and then import all into my local stable diffusion?
These tutorials are gold. I'd be really keen to see what happens when you use 2 to 4 models in a prompt. What does it look like when you ask stable diffusion to create a scene with multiple models interacting with each other?
This is Brilliant! Thank you for taking the time to explain the workflow clearly and precisely. Will Definitely give this a shot. I am thinking if I train a model using my own Pictures, then I can become anyone using the power of AI. I can create talking head videos of myself as an astronaut, a professional fighter, a Rockstar, a pirate etc. I think we are not too far from being able to create our own homemade AI-enabled animation short films. Soon we'll have motion tracking and such. What a time to be alive!
That is very cool. I’d love to see the finished results ! For sure, exciting times are here 👍
This is insane!!! In a good way of course, I have a Mac though….😅
thanks so much! turned great!
Cool... subbed. Been using AI Images for my RPG livestreams. So many cool things computers can do.
Most terrific lessons:)) thank you
Who else is amazed by AI yet at the same time feels like we've unlocked something forbidden and it is already way too late to prevent chaotic events from happening... our future seems crystal clear now
Out universe is full of unpredictable chaotic events. This is just a small blip. It will be okay 🙏
I'm amazed childhood ideas I feel like I'm slipping behind it's like Star Trek holodeck you're only limit as your imagination and it's probably a good idea if you have a degree art history I feel like being 37 years old I'm too old. Do you have to have a desktop or can I do this on my iPad
@@promptmuse Indeed, it will be okay in the long run. I'm still an AI enthusiast although I stopped posting my ai-generated visuals online ever since I realised how unethical Stablediffision deep learning models actually are... I feel guilty for contributing to the ai community lately, it's a conflicting situation since I am also an artist
@@promptmuse That's a dismissive and ingenuine response. Sure, blackholes are literal tears in space. catastrophic failures of reality to maintain time and reality in a way that's measurable or observable.
But that has NOTHING to do with what is happening in our lives right here and now on Earth. Sure if the entire history of humankind was erased, it would be a little blip and all would be fine, but that's in the eyes of God and infinity, not the eyes of us right here. It would be catastrophic for us for our world to collapse. And saying that that doesn't matter because...oh universe be big....nihilism...yadda its fine... isn't just ignorant its dangerous.
We can't ignore one dying or hurt person, because oh yeah, there are 8 billion more. We can't ignore our own planet because, the big old universe will get on fine without us. And we shouldnt ignore the potential horrors AI could cause....Just because it's fun to use...and yadda let's just say it will be fine when really it clearly won't be.
Ignorance of the inevitable is what makes it inevitable. Knowledge and resistance is the key to mitigating the issues we see coming.
My inner battle was won when I realized I'm like a songwriter.. I can't sing, I can't draw or paint, but my imagination is 1000mph and I deserve to have it imagined into reality:) if not just for my own sanity lol.
OMG thank yeeeeeeeeeee :O I saw CS bloom while I was in my senior year of phil and wanted to jump on the train and I just started my first semester of CS but it's already gotten so far ahead of what interested me back then. O-O so cool
Great video, topic focus, informational. 👍
Thanks for the tutorial. I was curious how to get persistent characters usind SD and this shows well the potential.
Very good demo and to the point. Subscribed.
Thank you so much!
Legend. Thank you.
Great job, you won a new subscriber.
Great tutorial! Thanks 👍
That's actually pretty cool.
Genius!
thanks so much!
thank you very much, this is so cool!!!! You're great!
You should have more subscribers, really great videos! I do think someone will make it drop dead simple to 3D convert a photo/ai photo making it simple to drop into animation software(lots of steps here). I've seen some newer platforms making an attempt at this but wondering what you and others here have seen...
Great explanation! There should be a service to just address this task in one shot. Upload 10 perspectives and emotions of a character, hit submit and done. 🙂
Very nice video and technique. I been working on something very similar but trying to get video/animation with stable diffusion.
Generating redheads was also the first thing I've done with diffusion lmao.
Soldier redheads, cyborg redheads, old-timey redheads, old-timey cyborg redheads, etc.
Speaking of which, try generating anything with "autochrome". I just wanted to use the camera effect, but it makes everything look old-timey too. Even the robots looked like some Edwardian made them.
It’s such a striking feature is it. Very celtic. I was sfollowing on from Sixhaunts model as he really inspired me.
I’ll have to try that feature, that sounds a great effect for some red headed Edwardian Queen’s 👍
Lovely vid and very clearly explained. New subscriber ♥
Good job, Amelia, good luck and freshy inspiration to you
Really useful. I subbed and no idea how I didn't find you before.
Thank you so much 🙏🙏 appreciated
It is a great work. Thank you for your sharing
Thanks for this super useful and easy to follow tutorial.
No problem! Thanks for the comment and watching!!
Thank you so much for this!
You are more than welcome 👍👍