How to rig a Face in Blender
Vložit
- čas přidán 21. 07. 2024
- How to rig a character's face is one of the most requested videos I get, and I show you how to do it in this video. Using Blender and Nvidia Omniverse's Audio2Face, we can automatically create a list of blendshapes/shape keys and add them to your character.
Show me some support, please, with a SUBSCRIBE.
This can be all avoided if you just get Character Creator 4
bit.ly/3m3q5yo
This is because it is all set up already.
Since this is set up with blendshapes, we should now be able to import facial motion capture data into blender and apply that to our faces.
Get more Blender Addons
bit.ly/3HZfVIV
Character Creator
bit.ly/3m3q5yo
Download Nvidia Omniverse and Audio2Face
developer.nvidia.com/nvidia-o...
Markom3D Kitbash Set
bit.ly/3ADg5nI
markom3d.gumroad.com/l/THcF
markom3d.gumroad.com/l/KitBas...
+++++++++++++++++++
Donate - Paypal - paypal.me/markom3d
Discord - / discord
www.markom3d.com
/ markom3d
/ markom3d
/ markom3d
#blender #nvidiaomniverse #audio2face
00:00 Intro
00:10 Omniverse
00:23 Blender
01:17 Separate Mesh
02:28 Preparing the mesh
04:17 Audio2Face
06:12 Mapping character face
07:09 Exporting
08:39 Importing to Blender
10:08 Weight Transfer
12:30 You're done
When I tried making a character, this was the worst part. Do you think this has a place in your workflow?
So usefull!
Markom, I appreciate your effort in breaking down this process, but how do you auto lip synch to audio from where you end up at the end of this video?
@@kellyjohnson768 Audio2Face Nvidia Omniverse and iClone8
czcams.com/video/Sxi-GEJKksw/video.html
@@Markom3D please I used iclone 3dxchange to do the face rig and sent it to blender. It worked perfectly fine. But I tried to used the ifacial mocap addon in blender. All the shape keys came. I try to use my phone to do the facial expression. Only the head move but the facial expression not working. Can you please try.
This is so useful and valuable knowledge!!! Thanks bro!
This has absolutely blown my mind! I'm rethinking all the countless hours I've spent painstakingly creating shape keys for different mouth shapes and literally crying everytime a character had facial hair.
I am going to literally cry!! You sir are amazing!
The amount of work you put into this and to share it is phenomenal! I've never played around with any of the Omniverse tools but I'm definitely going to give it a try now.
yeah, there are quite a few interesting tools and I will be doing a series on them
Unnecessarily complicated stuff. This process does not put anything more reliable to the table, just a different complicated way to do the same, not to mention if something goes wrong on the way or if you need something more specific. Good tut, anyway, highly appreciated the effort you put into it.
Amazing work man. Been subscribed to you for a while. But this is a real winner. Love your content. Thank you for all you do
I appriciate that you are sticking around with me. I am trying to make better videos each time
Even though I don't know anything about rigging and character animation in Blender, your video is so short and cognitive that it's like I learned everything about rigging in 12 minutes! Anyway, thank you so much for these helpful videos! They help a lot!
you are more than welcome. Thank you for watching though.
Fantastic stuff man. Very specific tutorial for something I definitely needed to know. Thank you for your efforts. You’re awesome!
no worries mate. I am just trying my best at this point lol
You deserve billions of likes mate! All is done thank you sooooooooooooooooo much!!!!!!!!!
Great review, very clear. Thank you, good luck, everything, peace and health!
Thank you for everything that you do for this community! :D
The struggle is real, been trying stuff with it for weeks. Thx for the help.
It's fun finding these videos and then having to look for another video just to learn what key to hit for deleting.
Blend shapes are another arcane mystery to me. Thanks for this vid covering them.
no worries mate, you are very welcome
One of the best features of Softimage XSI was Face Robot. A built-in automatic facial animation tool that let you set up any face with 36 points, and just upload an audio file and a text transcript of the file and it would automatically animate the mouth to that sound. You could later go in and adjust each phonemes for more precise control. It may have also animated eye brows, blinking, etc as well. This came out back in 2005 or so and is still one of the things I miss about XSI and haven't seen anything as good since. It wasn't perfect, but if they had continued to develop it past XSI's demise in 2015, it could have been amazing by now.
You're a lifesaver my man, thank you so much for this
It's amazing I tried to do something like that exported from character creator and then to blender to create an animation for about 6 months
this is beyond epic tutorial omg! thanx a million!! 😁
Great video.
As a solo game designer/developer, working with anything that has to do with a character (the 3d modeling itself, weight paining, armature, animations, even the animation blueprints in UE4/5) makes me feel like it's the end of the world every single time.
I want something that will do all the work when I ask it, with no involvement from me, I just want to play around with gameplay mechanics and level design (which must come AFTER the character works).
Just brilliant! What more can I say? Oh yeah! THANK YOU! Thank you for sharing your knowledge. THANK YOU! Dg
This is amazing, thank you for your efforts
Thanks so much for making this!
This is so good! thank you!!
Thank you for sharing 🤘
Bro thats sick, thanks. higly appreciated.
Thank you, SIr. I love you. 😭
Awesome video my friend!
Thanks so much for sharing your hard work and knowledge with us.
I really appreciate it!
I hope you and your family have a great weekend
WOOOOOOOO!!!!!!!! 😃
Great to see you mate, and you are more than welcome
amazing! Thanks for sharing!
Fantastic !
Excellent. Thank you.
nice job man
argh...looks amazing...also looks like I need to install bootcamp or just buy a PC!
Thank you so much for this.
You are so welcome!
Absolutely amazing tutorial! Thanks for that. I am having some issues with the teeth though. Eventhough I added bottom teeth to the gum section and top teeth to the static part. When back in blender they do deform a lot, when I open the mouth you can see the mesh going crazy like a sticky gum in his entire mouth. Did you have any experience with that or a fix for it? Without teeth everything looks great though.
Thank you
amazing
You got your like!
Thank you so much for sharing this. The amount of effort would have made me quit a long time ago.
oh trust me, many times I wanted to but just pushed through it.
@@Markom3D well. Thanks for your perseverance. Its much appreciated.
really cool video, I managed to understand how to deal with the additional meshes such as the eyebrows and so on with the PROX UI step, which is great because any other video I found completely ignores it.
However I found that the "skinning" (I know those are blend shapes, but still...) of the teeth is quite off and I wonder why. I mean, I exported them as static objects so I don't understand why the deform in the first place, and on top of that the deformation is quite off. Do you have any advice to deal with that? Are you sure the PROX UI needs to be applied to the static meshes as well? Thank you!
Greate job , dude
Glad you liked it!
It's a great topic. Audo2Face is sick (going to be a timesaver to say the least)
I agree mate. I cant wait for it to get better.
I‘m not using blender but nice workflow mate 👌🏼
Thank youuu
I don’t like and rarely subscribe, but for this one, done and done.
Nvidia have created an addon for this to streamline the process, but they will release it in like a week. I did the user testing on it, and it does make life easier. I have a video already created and will release that when the addon is released.
Hi does anyone no how to make a character blink in omniverse create? I imported from cc4 to omniverse but the blink isnt working tho it works perfectly in cc4. thanks in advance for any help
hey buddy. I love your other video that teachers how to make the controls for the CC4 charactere. But I wanna now one the teach me hoe to make the pacial rigs with the controlers. This one in the end do not create the facial controlers. Do you have one for this?
Finally I found a cheat that really works
Is it easier with the new Omniverse Blender version? I'm having some difficulty getting facial hair to work.
I confirm. I run audio2face at my AMD RX580 ( Windows OS )
and I wish to run on my Mac OS
I am gonna testing, thx bro if this trick will be better then faceit, I am gonna used only just him
unfortunatly, I havnt used faceit, so I cannot compare
I was hoping to use audio to face for doing lip sync animation how do I go about making the character talk from this point... once I have this phase done with the blend shapes how do I bring in an animation from audio to face...
You can import the animation with a Script that can read the JSON file from Audio2Face.
I use the Script created by Josh Harle, you can download it from here:
czcams.com/video/uocQdPF_2Hc/video.html
I had to change the value of "bs_limit = 68" to the number of Blendshapes you have exported from Audio2Face. In my case, I put the number "bs_limit = 46" and it worked.
To export the animation (JSON File) I followed the first 3 minutes from this Nvidia tutorial:
czcams.com/video/8MSpfGkJEq4/video.html
To import the animation into Blender, I followed Josh Harle's tutorial from 14:00:
czcams.com/video/uocQdPF_2Hc/video.html
it would be awesome if you would make a full body warrior character rig with a skirt, long hair, weapon in a workflow from blender and audioface to UE5.
For the whole body (except of head) : With bones
And for the head: With shapekeys.
blender crushes when i import the mesh. Can anyone help me to fix?
I cant find a solution for hours.. When I add correspondence lines, you can see them in the list but, you cant see these lines in viewport shader. Why could that be?
How many belndshapes do we get following this workflow ?
this is cool for single users, nvidia limits it to free to use for one individual, if its more, then you'd need to buy a license
I was actually trying to figure out how to do this about a month ago. I have CC4, but also have other characters that don't have shape keys. These are the ArkIT keys right? I didn't even think about using the Nvidia stuff. This is a really nice way to get your shape keys for free, and without 2 days of work and creating them. Nice job
It took me about 4 soild nights of trying to get this working. I dont think anyone else has tried to do this either as most auto facial riggers are done with bones.
cool
Good Morning! Shame omniverse isn't available on Mac.
I am so f***ing confused about the workflow for face rigs. So can I, or can I not, use any tools in Character Creator to rig a face for a custom character? So you did all this work to make blend shapes automatically, which is great! Now can you send these blend shapes back to Iclone to use acculips or something? I bought a Big Medium Small Mech set that comes with a couple characters and I thought I could find a way to rig the faces for facial capture. Tried in February, gave up. Came back again to try with a new version of Audio2Face. I might give up again.
Markom,Great tutorial !!
Do you think I could use some aspect of this method (without omniverse),
to transfer Standard CC3 Visemes/Blendshapes to an Accurigged Character imported to Blender
so he could talk by importing Imotion+ files from Acculips animations in Iclone.
Right now Accurig is pretty useless for creating speaking Characters outside of Iclone.
Accurig is for rigging the body, and alot of people were asking what about the face. This is the work around to get a face setup with blend shapes. I dont know an easier outside of this.
@@Markom3D Just FYI , I found a solution for blendshape facial& lipsync animation on Autorig pro rigs using Daz characters. tutorial on my channel
Is omniverse blender free?
omniverse shuts down after pressing tongue mesh post wrap
Thank you for this amezing tutorial. I need help not sure why when i am importing final sket usd file back in blender using Omniverse. My blender is crashing. So I downloaded blender 3.4.0 version and it has that Omniverse option but my character mesh doest have any blend shape. Can you please help me?
does the main mesh have shapekeys, or none of them do?
@@Markom3D Initially mesh had shape keys as your mesh, had in the beginning and I deleted all the shape keys and later did the same process in omniverse as you have shown in the video and exported the file successfully but when importing again that exported file in blender through omniverse, the blender is getting crashed however when downloaded blender 3.4.0 from blender's official website, then I am able to open that usdskel file but there are no shape keys at all and when opening shame skel file in omniverse it is showing all the shape keys head in viewport of omniverse.
A lot of work for that. 😦
Thank you for video, I never would have explored Audio2Face and Omniverse without it. But it always crashes for me on step: 'Begin Post Wrap' (7:04)), I cannot export to Blender to check out the ARKit animations
Found it -- my mesh had some loose parts, loose vertices; removing them seems to have helped. In Blender, select you mesh and 'Mesh > Separate > By Loose Parts', if a new mesh separates out, that means there are some loose vertices to clean up.
I will like to see a full tutorial for a character animation and setting for cinematic in blender just a couple of seconds even 6 seconds is OK to see exactly step by step how is the concept I'm trying as well to do that for a project but I will love as well a tutorial
I have a few technoligies to help me along the way. I mainly use blender now just for modelling where all my animation is done in iClone8
That sussy face of that 3d dude model on the thumbnail
Im getting an error when it comes time to Blendshape Transfer- Index out of range- i spend a few hours on goggle hunting for answers and saw some stuff about scripting and skelanimation prim, and have zero idea what that means. Ive got a basic mesh parented with an armature and no blendshapes when i start- just the mesh. any ideas what im doing wrong?
having same issue here
Hi! I follow all steps but when I import the .USD with the Blendshapes, Blender closes immediately :c
My Blender version is the same from this video: Blender 3.4 alpha USD branch :(
I found that Blender does not close if the 3D model only has a one unique model with Blendshapes (If it has additional meshes, like Eyebrows, Beard, or Eyelashes, the program closes). I remove all the additional meshes, and the model imports perfectly. But it doesn't make sense because my 3D model has eyebrows and they won't move 😔 Does anyone else have the same issue?
UPDATE: I solved it. Audio2Face exports 2 USD files, so I used the first one that has all the blendshapes in the form of meshes (there are 92). I joined them with the "Join as Shapes" feature. After joining them, I ordered all the Blendshapes with a script, since the alphabetical order is not correct, they had to have the order of the 46 Audio2Face Blendshapes.
I was also able to rename all 46 Blendshapes with the script and they have the name as the model you showed :D
I hope someone can use this information!
Good, thanks.. But if you use the face it add-on, it'll be easier than this.
Whatever I do I can't seem to get the tounge teeth and eyes to go with the export from oniverse to blender :/
oh my issue was that when i have to go into the prox ui i didn't realize u had switched from selecting the normal import to the new "transfer character" versions that had been added aha.
update, everything seems to work great other than the eye blendshapes, they seem to break everytime I try to generate, like they export correctly but the shapekeys are all wonky.
1 more for algo
Do you need an RTX card for audio2face?
Yes, you need RTX.
So now that the blendshapes have been ported back from Audio2Face, does that mean that the morphs that A2F generates for speech will look much better when imported into Blender (or even Omniverse Create for that matter...or Machinima or whichever is used) for final render? This is worth me conducting another series of tests, with a custom CC4 character....🤔 Thanks for your efforts! They are never unappreciated!
so, technically no. The mesh density on the A2F head has quite a few polys, where I am going to assume your character will be alot less. We have just optimsed it for Blender, where Omniverse is another beast on its own
@@Markom3D Yeah, I see what you mean. I did a test where I imported the A2F male mesh into Blender 3.4 (as you said, trying to import the latest .usd into other versions of Blender won't work) just to see the difference between the A2F mesh and an imported cc4 mesh. Much lower poly count from CC4 thus creating that stiff upper and lower lip situation when creating the facial animation in iClone... Anyway. I wonder if applying a subdiv before exporting the CC4 character head into A2F might work. Have to remove the blendshapes before doing that though. And, the CC4 exporter won't export a higher poly model into iClone. Damn!
Yeah, but now it will be nice to attach blendshapes to actual face rig, or some controller panels, or something.
Becuase animating on sliders, well it's not gonna work at all.
You have something in Your tutorials about it? I mean I know how to do it, just asking.
And Yeah CC4 already has face morphs, but anyway We need to think to attach them to rig, the face rig from Rigify for example. Or to have them in UE, to mix with AutoRig Pro.
Does this work with non-human characters? :O
Can you download A BUAGTTI 3D MODEL😄 and rig it 😁and post🙃 its download link in your description in you next video
?!
just woke up in hospital.
all of this is free?
sure is
Can yo do one for daz?
It’s the same process.
@@Markom3D I was literally looking for your tutorial 2 days ago. This is a great help. Bout to throw down.
Nobody explains how they cut and mesh everything together. Everyone is to fast in the vids. Hard to keep up lol
Aw... it required an RTX card.
*sad 1060 noise*
Can I combine the result shapekey with the iPhone ARKit mocap application?
Like this one:
czcams.com/video/1kWkm6eyCck/video.html
Aw man I just bought FaceIt for a hundred bucks that does the same stuff
I have been trying to rig a face for 4 days. I have literally cried 3 times today. Is there someone who could literally walk me through step by step, what to press, where to press, what kind of file you are using, what are shape keys and do I have them in the character I am using? You guys all speak as if this is common knowledge and it is totally not. I really need to get this done. 30 hours, 15 videos, each ,more confusing than the previous. Please help
Sorry, but if I don't see the results first, then I probably won't watch the video.
Ty now go to sleep
you have to have an rtx card to work with audio2face don't you. I have black screen and can't do anything in it with my laptop geforce gtx