Finally! Custom 3D Character Face Mocap
VloĆŸit
- Äas pĆidĂĄn 29. 06. 2024
- đ„ Quick and Easy Facial Mocap for Custom Characters from Character Creator
đ Dive into this tutorial where I guide you through how to use your iphone to control and create facial animations for your Custom Character from CC.
Download Links:
đCharacter Creator (Save 50% Before June 30th, Affiliate Link):
tinyurl.com/3bus5h2x
đHere are all the download links associated with the video:
promptmuse.com/mocap-with-cus...
00:00 - Introduction
1:00 Software and Plugins Required
2:05 CC To UE AutoSetup Tool Installation
3:57 Exporting your Character Creator Character
5:50 Converting Character To UE CC Rigs
06:20 Adding Level Sequence
07:20 Adding Metahuman
8:00 Setting Up Iphone ARKit
09:45 Recording From Phone to character
10:45 Baking To Keyframes
11:56 Copy and paste keyframes to custom character
13:20 Editing Keyframes
14:43 Adding Animation to characters body
18:44 Outro
đ€ FAQ Answered:
For Android users :
github.com/justdark/UE_Androi...
Iâve not tested this
â Support Me:
ko-fi.com/promptmuse
/ promptmuse
đ± Follow Me on Social Media:
Twitter: @promptmuse
Instagram: @promptmuse
Please tag me âȘ@promptmuse⏠in anything you create, I love seeing your creativity !
#customcharacters #facemocap #unrealengine #meta human - Jak na to + styl
All FAQ Will go here :)
Hi, another fantastic video. Question - how come you chose the UEFN animations and not the UE4 ones? Is it just because the UEFN skeleton better matched your custom character's?
Do you have a boyfriend?
Is this only possible on an Apple?
@@somedude5951 Technically as far as I'm aware Epic only developed for Iphones, but there is a version that has been developed by an independent developers. I haven't yet tested this so unsure of the results for android: github.com/justdark/UE_Android_LiveLink
Can I choose between front and rearcamera in the live face app?
0:21 It's difficult to notice, but if you pay attention, there's a woman talking in front of that beautiful kitten
YOU ARE AMAZING. Have not watched it yet... but EXCITED for this one. Thank you.
Hello and thanks for another very informative video !! You flow through all these steps like a ballet dancer and make it seem accessible to anyone. You are a very inspiring teacher !!!
Great workflow, I hope they make the plugin to export CC character directly as metahuman to unreal so that live link can be used directly without a need to keep another metahuman in between.
Reallusion, the creators of Character Creator (CC), offer an Unreal Live Link for their animation software, which is ideal for studios with larger budgets despite its high cost. Given Reallusionâs track record of rapid development and industry-leading innovation, itâs likely theyâll release a more seamless integration pretty soob, they move quick.
Having covered their products for years, Iâve observed that they consistently stay ahead of the competition and listening to customerâs.
You can also use the face app to record to slates, then directly to your character. But I do prefer previewing my animation on my character and retaking if Iâm not happy.
Some really nice integrations coming along soon my friend!
Prompt you're gorgeous, your kitten is BEYOND adorable, AND I'm excited to try this out. CC looks amazing. That character you created looks so cool. I also laughed at the viking's (Or dwarf's or whatever) dance.
This was so cool! Pretty awesome for multiple character setups :D
Hi! been a minute since i commented but wanted to say again i love that you are trying out these new toys and showing us! it's been very helpful for me and im sure others
Damn you're always bringing us cool updates ,can't wait to try this on a music video or future project. Thank you once again cheers
Thank you ! This was an excellent walkthrough
I just love you, love your work
Brilliant video - thank you!
This is awesome! Thanks for this đ
Prompt Muse, you are my inspiration!
Amazing video!!
That cute kitten completely stole my heart
Finally found out officially sheâs a girl. She is cute and some nice company !
nice dear really good teach........
it's so hard to focus with the cat playing in the background đđâ€â€
I do hope you know an adorable kitten playing with a toy in the background videobombs even the loveliest of Muses? I had to keep rewinding because I was so distracted! That said, awesome tute! Love this tech. You rock.
Cute kitty in your background.đ
Iâm 20 and want to make films about my psychedelic experiences, videos like this are blessings, canât wait to check it out
Amazing, good luck with your project. Whether you use this method or not thank you so much for your comment. Do you have a link to your films?
don't do drugs
@@orangehatmusic225 Psychoactive substances are definitely not for everyone, especially psychedelics. Personally Ive been blessed with an absurd capacity for stimuli, and have absolutely no issue interacting with them, regardless of dose ⊠I appreciate your concern, but Iâll gladly pass on your advice
@@orangehatmusic225 Psychoactive substances are definitely not for everyone, especially psychedelics. Personally Iâve been blessed with an absurd capacity for stimuli, and have no issue interacting with them regardless of dosage ⊠I appreciate your concern but Iâll happily pass on that advice.
â€â€
Great tutorial! I almost learned something, but your beauty kept distracting me. Guess I'll have to watch it again... for educational purposes, of course! đ
Glad to see you back, great video. I was wondering how you turned your real kitten into a stuffed toy 06:56 ...trying to fool us? :)
instant sub!
Nice !
Wow, awesome
Thank you ! đ„
OMG THANK YOU!!!!!!!!!!!!!
This is amazing. I really enjoy your videos. Is there a way to use this method to use 3d characters for live streaming of live videos on social media?
Love you and Love your work and Love everything here keep keep go on :)
Thank you so much for the support đ really appreciate it!!
â@@promptmuse I've seen your video now, and I've seen two cats too, I'm using all ways you doing it to for Short Stories or animations for games etc... keep go on Hun, still your the best.
Came here for the tutorial, stayed for the cat đ
very easy to understand.
Thanks so much!
That kitten is so cute â€
Came for the 3D, stayed for the kitten đ€Ł
IKR! I love seeing a happy kitten playing around.
Is there a way to control the animation with the keyboard? And my second question would be if there is a way to lipsync a face to a pre recorded audio?
0:20 đ who is the little guy behind you? so cute
Also, thanks for the incredible tutorial
Her officially name is now âkittenâ , wasnât sure what to call her for a while đ€Ł Thank you so much !
Excellent tutorial! Sorry if you mention it in the video, but I don't speak English and maybe I overlook it. But this works with Metahuman Animator? I mean the facial mocap that came out a few months ago, Since with ARKit we lose quality for speed. Greetings from Argentina! ^^
This is really cool :) would this also work with Metahuman Animator? so record the facial capture using the depth camera then bake the results to the control rig, if so that could be really cool as the Metahuman animator does really good facial traking.
Yeap, should do! Iâm gonna play with that today and get a proper confirmation but theoretically it should work absolutely fine.
@@promptmuse Thanks, im gonna have a look at this today too :) it could dramatically improve facial capture for CC4 character
Thank you very much. I like your tutorials. They are great đđ unfortunately i haven't an iPhone. My phone has an android os. Is there a way that i can use this method for a recorded video using android? Thank you đ
Thank you, in time 17:40 you bring the body animation to character.. nice , but the talking of this character how you did??.. another question: If I bring the animation of face from iclone to UE, in this case can I mix face animation with maketpalce animation?? Thank you in advance
kiiiiitty
Amazing video! Thankyou! Iâve just started this new channel using cc4 and Iclone and although I have mocap solutions itâs still easier and faster for me to use set motions in Iclone. Iâd love for some feedback on how to improve or maybe even make the transition to UE if that would help. (Iâll advise to watch the fallout video as that encompassed the vibe of the channel). â€
I just subbed, nice work ! What suit are you using Rokoko or PN or something else? I'll just put your link here if anyone wants to see your work : www.youtube.com/@bitmap_jack
I'm a big retro gamer, so this is right up my street haha.
@@promptmuse aww thanks so much! No suit at all, so my mocap solution is simply my oculus (meta quest) with software called glycon3d. It has finger tracking and all sorts and imports FBX directly to Iclone. That is until the channel takes off and I can buy a suit or at the very least some smart gloves. Thanks again! đđ»
The cat đ
Noob question: I'm learning how to get character bodies created the way I want and started animating. I'm a little confused on custom outfits though. How would I make an Egyptian suit of Armor, or Samurai with cybernetic parts. Seems programs like CC4 and others you can buy stuff that looks like it came from Gucci, but how does one truly design original outfits for characters? Do you have to model them in a 3d program? Cloths and clothing are really confusing me. Thanks!
Topic - Learn
Audience - Kitten
I'm cautious about buying anything these days because of monthly/yearly subscriptions. Is character creator forever, or monthly/yearly?
No, itâs a one off fee! Itâs probably about the only company that does that still! No subscription. But there is a free trial so try that before you invest, just to make sure itâs right for your needs etc ! Also there are student discounts and indie studio discounts if you fall into either of those brackets.
Also just to add, there are a lot of add ins into the package, like additional hair libraries etc (much like Daz) there are many plugins but the core program is character creator.
@@promptmuse Which bundle would you recommend?
Kitten!!! đđ
Thatâs her name now đ€Ł quite literally Kitten haha
@@promptmuse đ±đ I love it! đ
amazing, what about if you have a custom character? for example one eyed humanoid creature
Man, there must be an easier way at some point! This process is so time-consuming and labor-intensive.
only channel covers this properly.
Does it also work with CC3 ?
ooooo Not sure, I currently only have cc4 on my system (If anyone reading this could answer that would be amazing)
Yeah, I had the same question so would be interested to know đ
Is the CC/UE control rig for UE 5.4 and up, or could I use it in 5.1?
CC rig is compatible with 5.3 - 5.4 đ
@@promptmuse Aw. Well as I watched your video I realized I have a workaround. I tried adapting the project I started in 5.1 to 5.4 and a lot of things went haywire. So I'm thinking I'm gonna do the animations with this pipeline in 5.4, export as FBX and bring them into 5.1 for the final render (at least for the first episode since it looks like I intended in 5.1 already). So thanks a lot for showing this very efficient pipeline! đđ
Please, what is the name of the AI ââmodel of the cat in your background? It looks very realistic.
Realistickittenv5.safetensor
@@promptmuse â€
cool, Create a video tutorial on how to go live on CZcams using your own 3D avatar.
I've been testing out virtual avatars :) so might be in the pipeline!
Thanks, follow your channel for months already...
just a hint.. you can directly live link with a CC4 character.. it involves 5-10 minutes of blueprint adjustments... AND you need a remapping of the names of the morph targets ..
I am actually working on this in the next days ..
just let me know, if you are interested of the outcome
I think Reallusion provided the blueprint you mention for CC3/UE4 only. It looks like such blueprint is intensionally dismissed by Reallusion. So, not totally sure I would base any workflow on something manually arranged by me. I'm not an expert though :)
@@Simone-lb8zr got it to work.. I am using the CC-Rig with face livelink app on the iphone - in real time.. looks pretty nice... hope I can make a youtube video about it tomorrow.. its actually pretty easy, only a little bit time consuming..
@@lukarisisgaming Congrats first of all. Did you still have to manually modify the animation blueprint to make it work? I hope doesn't result in a too fragile setup.
11:22 There's no way i cant find face control boardđđđđ i can only see other two thingsđđđđ
At 11:20 in the video on the pop-up window, uncheck the filter by skeleton box and then you should be able to see all the control rigs available to you đ
You cannot hold a kitten without telling us it's name? I left a question on Patreon, are you still accepting questions on their?
âšđđȘđđźđđđâš
you look like Sandra Bullock
ok i love that cat, can i pet it,
She is a cutie !
tu contenido es genial! el michi tambiĂ©n! đ±
For android?
There is a bridge for android made by an independent developer. I havenât personally tested it, but I will find the link and paste it here for you as well as in the description for others.
Still no non apple free camera workflow for poor people đą
Hi Prompt Muse, I've got everything except an iPhone, I'm an Android guy.
Yeah so basically the technique requires money lol, If I am not wrong even Iclone is a paid software and UE5 doesn't run on medium ranged hardware either. The struggle of the indifferent haha
@drukcg yep... CC4 and Iclone are quite expensive. UE 5 is free but not that easy-to-use. Even all those AI are not really free. The free one has a limited use. Blender is a good solution but also not that super easy to use.
iphone only again(
Iâve dropped a link in the description for android. I have not tested it. Also some commented to say it worked from their iPad.
iphone...........đ
Iâve not tested this out yet, but I have found this for android : github.com/justdark/UE_Android_LiveLink
Spelling mistake, there not their
Mommy?