Real-time Full Body Webcam Mocap in Unreal Engine - Dollars MONO Tutorial
Vložit
- čas přidán 15. 07. 2024
- Get ready to explore real-time full-body Metahuman motion capture using just a simple webcam in Unreal Engine! You might be thinking, 'What do you mean by full body?' Well, I mean face, fingers, and body - so yes, you heard it right, it's all possible with a single, simple webcam!
Join me for an in-depth review & tutorial of Dollars Mocap Mono. We'll go through its features together and I'll show you how to use your own Metahumans!
Download links:
● Dollars MONO - Unreal Engine Plugin - Control Rig for UE MetaHuman
www.dollarsmocap.com/download
● Sample Project
drive.google.com/u/0/uc?id=1E...
● Dollars EGAO (Free Facial Capture)
www.dollarsmocap.com/egao
● Dollars MoCap Documentation
docs.dollarsmocap.com/categor...
-----------------------------------------------------------------------------------
Chapters:
00:00 - What's Dollars Mocap Mono?
01:21 - Sample Project
02:18 - Features (Video Options)
03:37 - Features (MoCap Modes)
04:43 - Features (Facial Capture)
05:26 - Stream and Sensitivity Settings
07:10 - Part 1 : How to use your own Metahumans? (Body Capture)
10:17 - Part 2: How to use your own Metahumans? (Facial Capture)
14:18 - Conclusion
-----------------------------------------------------------------------------------
#unrealengine #mocap #metahuman #motioncapture #webcammocap #realtimemocap #metahumanmocap #dollarsmocap #dollarsmono #unrealenginetutorial #unrealengine5 - Věda a technologie
![The moment we stopped understanding AI [AlexNet]](/img/n.gif)
This is strange. the downloads do not come in files with the file names in your video.
I've checked the updated files. Your downloaded files now look like this:
"Dollars", "Dollars_Metahuman", "Dollars_MONO"
The only change is the removal of the "DollarsMarkerlessUE" folder, and now this file downloads directly as "Dollars"
In the video, I showed how to copy the "Dollars" folder from inside the "DollarsMarkerlessUE" folder into the "Content" folder. But now, things are simpler. The file directly downloads as "Dollars", so all you need to do is copy the "Dollars" and "Dollars_Metahuman" folders into the "Content" folder. Hope this helps!
I knew about this program before, but I found out again because this video appeared in the algorithm. I was worried because I needed a motion capture program for Unreal live broadcast at a cheap price, but thank you so much for the CZcams algorithm. I'll continue to enjoy your good video! Thank you so much!
Thank you for your coverage for this app. I really am thinking of starting to mocap soon and these kind of reviews of different products and services gives me a good idea about my options and price range.
awesome to hear it's helping you! you're welcome and best of luck as you dive into mocap 👍
really great bro, got it working by watching the vid a few times!
Glad it helped! if you run into any issues give me a shout
Alot of companies are about to be put out of business. Most of us have been just trying to find some decent waist up mocap options. This including the face makes it beyond amazing. I purchased a license halfway through your video. Thanks!
Happy you liked it, good luck with your mocap projects!
Thank you for the explanation!
Thanks for sharing this amazing tool
Great job!
amazing lord, i love you for you tutorial i need this
thanks buddy, glad you like it!
I love the ability to shoot with a good camera and then doing the mocap in post.
Yes, the winner is video footage... much better results than a webcam and more suitable for mocap.
@@duz_gen That's good to hear. When you already have good camera gear, it's nice to be able to take advantage of its features.
sweet, perfect timing as I start building our first public game next week. Perfect software for indies. Definitely going to purchase it. Thanks for bringing this into my attention :)
You're welcome and best of luck with your game. Happy new year! 🎉
nice i like it good work
thanks man
Thank you for this insight! It would be also interesting to see how to integrate a custom made character (for exmaple in Character Creator 4) into this MoCap system.
Character Creator 4 offers an Auto Setup for UE which already includes the rig for body and face. I wonder if Dollars MONO MoCap system is able to work with this.
You're welcome! I think what you're looking for is here czcams.com/video/NDslO7iYeto/video.html
God bless you
💡🥳
can we record the capture for a metahuman and then record another one for another character ?
This is a great tutorial, thanks so much! The only bit I can't figure out is how to capture the mocap animations with take recorder and then get them onto my metahuman. How do you do this?
Glad you like it! You can use window > cinematics > take recorder
Please take a look at this: czcams.com/video/xqTqWk1jUQ0/video.html
Thanks for the video! This is very helpful. Did you do setting IPaddress etc for BP_DollarsReceiver?
You're welcome! No, I didn't. It's already set up, you don't have to manually enter the IP address for anything
good work but u can sync 3 camera in time for scan all pose from back and front and more camera for face reaction ?
It supports only 1 camera.
the blueprint inside the dollar metahuman folder is throwing a ton of compile error for me :/
hola cuando hago eso del minuto 8:54 poner el esqueleto metahuman luego me sale errores de compilaciones muchos sabes pk sera¿
wehen i put the folders into my project folder and i open the project they are not visibable... the programm is working but i cant find the folders in the content browser
thank for the tutorial , The creator of this plugin should try to place some type of smoothing or some type of control of the speed of the animation in real time to have more control of the nervous movements. I wish he implemented this, it would be even better.
Great suggestion, thank you! Let's pass it on @dollarsmocap
Any idea how to record an animation and finetune it? I got it on Take Recorder, but i cant edit it to perfect it. Any idea how to fix?
Is it possible to capture movement like playing guitar hanging on the strap? I mean when you're not 'playing' an invisible guitar, but really do precise movenets with your both hands and then add a 3d guitar into the scene?
It's good at tracking finger movements, as long as your webcam can see every finger. I'm not sure how well it would perform for activities like playing a guitar there could be potential problems.
gracias capo sos un genio!!!
Hey, muchas gracias, me alegra que te haya gustado. Saludos!
Hey your tutorials are amazing and very helpful for begginers like me 😄.
I have a question, How can i composite metahuman animation in real life footage ? Like some of the virtual influencers do? I tried to search on whole internet but not able to find any tutorial on it, it will he very helpful if you make one of those 🙌🙌🙌
Thanks! glad you liked it 🙌 so when you say "real life footage" are you talking about those super realistic scenes and virtual influencers like codemiko? drop an example, I'll totally check it out!
@@duz_genI meant footage(video) recorded on phone or camera, like filmmakers make CGI and VFX effects and merge it with raw video, one of the example is @lilmiquela
@@duz_gen I mean footage (video MP4 format) captured through phone or camera. Like filmmakers add CGI and VFX effects in raw footage. One of the example is @lilmiquela you can check her posts and reels.
My guess is that she uses real people in her pics and puts her own face on them with photoshop. If I were a virtual influencer, I'd do the same thing. Creating everything in 3D and making it look photorealistic? Tough job.
And check out her vids closely, those backgrounds aren't real spots, but 3D animations. She might be using Unreal Engine.
this is great, but there has to be a better way to set this up with your own metahuman than the process you described. if there's already a template project with it ready to go...no way to just migrate?
I was thinking about this idea while working on the video!😀 Tried changing a few files, thinking it should work but didn't get the result I wanted. Setting up body mocap is easy but when it comes to face mocap it takes a bit more time and seems a bit complicated. Perhaps dollars mocap might figure it out soon.
the thumbnail 🤣🤣🤣face fingers body 🤣🤣🤣
Does this mocap record information on spine? Or spin will be stiff?
Yes it does but the spine mocap data will be different depending on which mocap you choose because each mode captures the spine data differently.
Is it possible to tweak the capchered data to enhance the quality ? Can you maybe make a tutorial on this??
Editing metahuman animations in the sequencer is possible but not straightforward. I'll consider your suggestion thanks
Hello sir can we record animation for metahuman in sequencer using Dollars Mono, I'm having issue with finger stretching .....can you help me in this issue....i want to make cinematic stuff.
Hi, yes you can. Window > Cinematics > Take recorder
Take a look at this: czcams.com/video/xqTqWk1jUQ0/video.html
Try wearing gloves so you can create contrast between your fingers and background.
doing face animations and body animations separately has always made me very tired. i should definitely try this thanks
figuring out the best workflow can be a bit of trial and error. if you're using an iphone I recommend trying livelink + dollars mono. It's easy to set up and the results are pretty good
@@duz_gen I will try. thank you for the advice
@@duz_gen Can you make a video trying livelink + dollars mono?
can we use iPhone for Facial and Dollar for Body motions together ?
Yes, you can. Start by setting up a body mocap, then move on to a standard live link setup. If you want to get better performance for the body and head, just turn off the 'head rotation' option in the live link settings.
Can you make a video about it? I think Dollars' face mocap performance is lower than livelink. Body mocap with dollars and face mocap. It will be much healthier to do it with Livelink.
step by step still having issues, how come some of the folders I download (name ones you did) have different names?
I've checked the updated files. Your downloaded files now look like this:
"Dollars", "Dollars_Metahuman", "Dollars_MONO"
Actually, the only change is the removal of the "DollarsMarkerlessUE" folder, and now this file downloads directly as "Dollars"
In the tutorial, I showed how to copy the "Dollars" folder from inside the "DollarsMarkerlessUE" folder into the "Content" folder. But now, things are simpler. The file directly downloads as "Dollars", so all you need to do is copy the "Dollars" and "Dollars_Metahuman" folders into the "Content" folder. Hope this helps and let me know if you need help.
thats amazing! it worked, purchased license through your link idk if youre an affiliate but just in case, definitely helped content creation for me today!
@@duz_gen
So glad to hear that! I don’t have any affiliate links. Best of luck with your content creation!
Was there not an option to move the mouth line onto your mouth position on screen? That could improve the capture and matching of your speaking and mouth expressions, no?
The mouth line is automatically adjusted by software, no tweaking allowed. In the new version, 'facial capture sensitivity' has been added, which improves the effectiveness of facial capture compared to the previous version.
While im first opennig the dollars mono app, the Unreal is OFF in the application, what should i do?
same here what should i do?
@@itzarcade5141 found the solution, go to the settings in the app and check the box with unreal ip, hope it helps you
@@itzarcade5141 Found the solution, go to the settings in the app and check the box where it say Unreal, hope it helps
@@itzarcade5141 Check in the settings in the mocap app if you have checked the box where its says ,, Unreal,, hope it helps
Dollars mono now has pauses every 20 seconds in the free trial, do you use something else now or you just bought the full version? Thanks Btw, great video!
Thanks! I use the full version
Is there a way to get the facial mocap data into Blender?
I'm not 100% on this, but if you save your facial mocap data in BVH format, I think you can totally bring it into Blender.
How to download DollarsMarkerlessUE and metahumans?
"DollarsMarkerlessUE" now downloads directly as "Dollars". For metahumans, download the metahuman plugin from unreal marketplace.
What are your PC Specs to run UE that smooth ?
Nvidia 3090, ryzen 5950x, 64 gb ram. For setup and system requirements, please check at 14:52
Does anybody have an idea how I can record the animation in sequencer? Thank you for your help
i'm facing issue with finger streching
Window > Cinematics > Take recorder
Take a look: czcams.com/video/xqTqWk1jUQ0/video.html
I'm ready to kiss you, my friend, there is no limit to happiness, thank you very much, there is nothing in official documents about individual dollars folders, and files are downloaded without these folders. You are a great man, thank you a hundred more times.
Which version of the Unreal Engine are you using?
Latest version (5.3.2)
How does this work with Kinect? Facecap?
This one is for the webcams, but they have another software for Kinect called "Dollars DEEP"
bro you killed rokoko directly
Haha, i'm considering a vid on rokoko's mocap software to see if it's worth the $240/year price tag
More than that, I'll skip buying a super expensive Iphone at the moment
Can I save the mocap animation?
Yes you can. Window > Cinematics > Take recorder
Take a look at this: czcams.com/video/xqTqWk1jUQ0/video.html
Can i use it with blender?
Yes you can but there won't be any real-time integration. The only method for blender is to record the motion capture data as a BVH file and then edit the data in blender to create animations.
Bro, which camera are using for motion capture?
I'm currently using the Creative Live 1080p V2 but don't like its narrow view.
If you're looking for a wide-angle webcam, google it >> Spedal C920 Pro
@@duz_gen thanks bro
Whats the classical music name please
A Far Cry - Josef Suk, Serenade, Op 6
how to render this animation after mocap
Window > Cinematics > Take recorder
take a look at this: czcams.com/video/xqTqWk1jUQ0/video.html
Is it a one time payment system or is it a monthly payment or annual payment system of $99?
It's one time payment
@@duz_gen wow thanks
I also noticed a control rig for Daz 3D. Do you have a video going over it?
@@conciousnessofsteel6033 My channel mainly focuses on Unreal Engine so I don't have any content related to Daz 3D
its free !
Please show in iClone if possible
Hi, hope this helps czcams.com/video/SK10asjmwz8/video.html
Hello :) i was trying to bring the motion capture from your last Video: (Real-Time Motion Capture with a Cheap Webcam (or iPhone): TDPT - Unreal Engine 5 Tutorial) to the newes version of UE5 and bevor to UE5.3 it doesnt worked. the newes version just dont show the mop reciver plug in. Thats really sad because i like the new meta humans more and i wanted to use all of it in a lv i had created. I will now try to downgrade everything. All in all i have to say im a bit disapointed (not in you in general) Im a total beginner and i just want to start making movies, but its just so coplicate and it seems there is no good solution that is cheap. I have to say this version you present in this video actually doesnt look good, the metahuman looks strange and unnatural and shifts in the ground. The three D pose tracker from your last video looks promiseing, because i think it is because the cam is limiting the data for processing. To sad it doesnt fit in UE5.4. It is kinda strange that there is no good easy way to go with low effort. I dont get this. thx anyway let get back to work and downgrade everything ^^
Can you make a video in that you create a sceen with motion capture at a metahuman. Record this, change what you have recorded with a control rig and turn it in an animation that can be changed with a rig? Thank you very much
why cant companies just use cameras and software's instead of having us spend thousands of dollars on freaking suits that could be a waste of money in the future
MOVE AI has a camera-based motion capture app going for $500/month and that's for the standard dual-camera package. The problem is it's pricey and you'll also need cameras or iPhones, starting with 5 cameras would be a good start. People seem to like it but I haven't tried it yet. I'm curious to know if it's as precise as the traditional mocap suits