Automatic motion capture with Deepmotion and Blender

In this short video, DJ shows how he uses a new Deepmotion.com online service to turn a video of himself moving into an animated 3D character. To achieve this all you need is a smartphone with a camera to record yourself (or someone else) in motion and upload the video to 3d animate cloud on deepmotion’s webpage. You can get a free trial of Animate 3D here: deepmotion.com...
Animate 3D prepares an animated rig based on the video you upload. This is truly automatic motion capture! You can download the animations as fbx or bvh and import them to Blender or other 3d programs like 3dsMax, Maya, or Cinema 4D.
In this video DJ also shows the process of binding the rig with animations to a pre-made character from blender cloud (made by Andy Goralczyk). To do that you can use parenting with automatic weights. With only a few clicks you can have a 3d avatar repeating your moves!
Here are a few tips from Deepmotion on how to prepare the video to get best results:
- Keep the camera still and parallel to the subject
- Make the whole body visible
- Shoot the footage in neutral lighting and have a contrast between the subject and background
- The video can be maximum 60 seconds long and up to 50 MB size
- The character in the video should be the only thing visible and not occluded by any objects
- Wear possibly tight-fitting clothing (loose clothes that cover key joints might give worse results or errors)
This makes motion capture available for everyone and incredibly simple. With almost no skills in animation, you can make your 3d characters come to life! No mocap suit is required and you don’t even need any special markers for tracking.
#Mocap #BlenderAnimation #MotionCapture
👉 Facebook Group 👈
Join our group, a friendly space for Blender 3d enthusiasts and pros, to share tips, ask questions, and learn, learn learn! / 666797333683403
GREAT DEAL! 💸
Use the code 🏷️ GFACDMY 🏷️ while registering to get 💰 FREE 💰 $50 credits and render your projects - bit.ly/GarageFa...
If you're new to cloud rendering and would like to learn more, here's a great resource for you garagefarm.net...

[@pinklady7184]

This tutorial is priceless. Thank you for this video.

[@Samurai-no4wu]

Holy moly I was not expecting this tool to be as good as is it is. It's a good thing I joined late on this tutorial as by the time I tried it they also added support for facial animations

[@virtual_intel]

I'll add that we can go into the animation and edit it in Blender to correct anything needed to be corrected like the hands etc... prior to rendering it out. Cool tutorial overall and very helpful for folks. Curated!

[@EvilSapphireR]

Wtf this feels like a cheat code to animating. This is THAT good!

[@Gunner98]

Love how you jumped straight into the video. Did not waste a single minute of my time. Good job! 👍

[@buttusakka]

It's funking awesome 😳😳😳😳

[@DeskToyStudios]

great stuff! I had trouble transferring the animations while I was still learning blender so this is awesome to have :)

[@kirishimarize9210]

So... Are you a master of blender now?

[@shekiba.646]

I was confused. I used FBX bad. but finally I got BVH better. Thanks.

[@kristianmollermunar]

This is amazing!

[@kronos9913]

Thank you so much

[@badmintonminishorts3770]

czcams.com/video/owBiwcLSK_w/video.html

[@leliobasket]

hi!! can i do this with the human generator add on instead of the charecter ?

[@GokuVSAyuwoki]

Muy buen video simple y práctico . Seguí así no pares vas crecer mucho

[@moularaoul643]

Thank you so much!!!

[@badmintonminishorts3770]

czcams.com/video/owBiwcLSK_w/video.html

[@bumblebee6697]

Thanks you sir

[@spiritobscura]

LOL, the eye balls became the other balls. Nice tuto. Thanks for sharing.

[@FrancescoPaggiaro]

very powerful tool

[@CuteCottonBunny]

Really amazing tutorial, thank you very much 🙏💕

[@billygate4063]

can you please make a follow up video where you fine tune the animation, like your hand shapes when they touched, and fingers etc. great tutorial btw

[@Nil_Emperor]

Thank you for showing the whole animation process in a very nice shortcut way and by doing this if we set sequence after sequence then it is possible to make a short film. 🙂🙂

[@WindowOfFantasy]

very sweet thank you !!! OoO

[@Prixiechan_art]

Thank you so much I can't wait to try it! This will really save time especially for someone who is very busy like me.

[@BGqkl]

Website registration is troublesome and requires payment and approval

[@Dangooyam]

1:37 May i know how to insert that character ? And how can i use my own character ?

[@blackcrowe]

hi thx for the info

[@fulanxi6434]

I dont think it can transfer the character running or walking.....That is a big issue for studio.

[@mastereppsreturns6586]

After I animate the character on blender how do I make an MP4 green screen video out of that? Thank you for taking the time to read

[@testing6753]

Can this be used for tracking characters from tv shows where the view and motions may not be big and clear?

[@londblok]

Thank, tutorial it's veri good!

[@ghunsavinez]

that means alot to me thanks sir

[@Chron0sPersonal]

Thanks for the help but there is one question, if your still replying to this video, how did you only set the model to wire frame?

[@shamilmammadov8246]

I have tried to upload the video to deepmotion but it always stuck on 10-15%.

[@DeepMotionInc]

Thank you for reporting, please send your video and the problem to [e-mail] and we'll help you there.

[@SpikedSpy_]

what do I do if I can't move or edit the BVH rig if I set it to "Rest Pose" ?

[@Supergab85]

great! Once I recorded the animation can I export the FBX directly to unity?

[@DeepMotionInc]

absolutely you can export the .FBX, and the .GLB, and the .BVH

[@BornthrupiecesEntertainment]

I think it uses the standard bones, will try it out soon

[@thirasheela8334]

which type of mobile we want use for a facial motion capture pls comment mobiles name too pls bro

[@pekame]

iPhone X and above, there may be some android phones that work too

[@DeepMotionInc]

We just launched Face + Body tracking from a single video clip in Animate-3D v3.0: czcams.com/video/PGjqa3O6o1k/video.html

[@Frodoswaggns]

Can you modify the animations to be more accurate to the video after the upload?

[@studiofoots8143]

@@badmintonminishorts3770 Idiot

[@DeepMotionInc]

Yes you can polish the result animations in Blender.

[@cot-it-markdanieldacer8563]

bone heating fail problem

[@taranabidi6637]

Dude, nice video!! But I don’t have a green screen. Is there anything else I can do?

[@ionic_]

Use a curtain or something

[@JobayrFighter]

all is good, but size 50 Mb.....how is that with high quality ????

[@AmarjitSingh-po2bp]

hi wanted to know weather lip sync is possible in deep motion ?

[@khushisanghvi1456]

If we wanted to do real time then?

[@mr.playstationplayz.Official]

I can't sign in, it's stuck in signing in, could someone help me with the problem?

[@bigbalticbox]

Note for everyone: This program sucks ass when you aren't using a character model that is mirrored on both sides.
I'm using a custom mesh that is disfigured and unbalanced and every time I run the animation after applying the parent weight, the mesh just implodes slightly so every limb clips through itself.
No idea how to fix it so I've given up, but the advanced users can probably figure this out...

[@NipunShastri]

Any idea about body and facial motion both at same time?

[@DeepMotionInc]

We just launched Face + Body motion capture from a single video clip: czcams.com/video/PGjqa3O6o1k/video.html

[@NipunShastri]

@@DeepMotionInc That is awesome.!!

[@turo7173]

im trying to use the rig Rain but it's not working when I try to append. everytime i hit append nothing happens? nor do i have the same options as you under collections. what do i do?

[@fabianobersovszky6987]

Which has a better end result quality? DEEOTION Pro or RADICAL Pro? :D

[@HarrisonKillianAnimation]

Thank you for the amazing tutorial! Extremely helpful. Can I use this for hyper real facial animation on a photo real human character that I already rigged?

[@HarrisonKillianAnimation]

@@garagefarmacademy thank you so much

[@one1moreform]

Was that live

[@DragonMarksmen]

how did you simplify the mesh?

[@pbe33]

this is for capture motion and i can export to source filmmaker ?

[@Joe_334]

Am I able to make the animations, then port them into Unity, as a custom avatar?

[@Djinn667]

The sign up web page is not working.

[@back_in_2025]

how do i download it in a video file

[@pikachuraichu9833]

Can you please put a video on face capturing like you do in this video🙄 can it be done?

[@DeepMotionInc]

We just launched Face + Body motion capture from a single video clip. Welcome to give it try: czcams.com/video/PGjqa3O6o1k/video.html
Also look forward to a potential new tutorial from @GarageFarm.NET Academy for face capturing ! We really appreciate this tutorial video that is of great help to Blender users.

[@NayyarAbbas-sh1vw]

Can you use this with unity 3D and custom models?

[@misha6468]

Deepmotion doesn't track the hands and fingers, or you set up the animation like that?

[@DeepMotionInc]

@@garagefarmacademy To clarify - we don't track the hands, we procedurally generate hand motions so it looks natural. Hand tracking is a bit further away on our dev roadmap!

[@user-bs3jd2hj3z]

@@DeepMotionInc Do you already have finger tracking for now? I need some animations with hand interaction

[@SheheryarProductions]

@@DeepMotionInc Please add hand and finger track along with body please! That would help alot

[@honeybadger8264]

does this work on any mesh with armatures?

[@theboycalledcourage8269]

How do I make the movement loop?

[@TC3Dgraphicdesign]

The virus program gives an alarm when I enter the web page?

[@hwll.music.brasil5543]

Hi Brasil 🇧🇷

[@lacasamia9905]

If I already have the rig on my character, how can i replace it with the animation rig from my bvh rig animation?

[@misterformal2763]

@FOX CRAFT what if I like my rig

[@SomeoneIDKK]

Can it be with only a face

[@chittibabuable]

hey pls could you tell me why the position changes when i toggle to object mode from edit and when i change to edit mode it changes the way i changed and when i change to object mode it becomes different

[@chittibabuable]

sorry i am always so hurried to do something i did not see that you changed it to pose mode rest position and then you edited it BTW thx

[@raphaelmorgan2307]

is there a way to do this with faces? the character I want to make will usually not even be seen with her whole body but I want to animate her face

[@raphaelmorgan2307]

@@garagefarmacademy thank you! I'll make sure to watch it!

[@josimarfpsbrasil168]

como vc faz para deixa os bannes centralizados?

seleccione o esqueleto e entre no modo de edição

[@sondosa.9051]

Is it captureing fongers

[@ezadin8o12]

Is the green scree must be used while making the video

[@rodangles9645]

pudo usarlo con cinema ?

[@homerroofing1]

Yes... Now I don't have to spend $4k on a full body tracking suit.

[@gameralok132]

1Lakh viewers 😱😱😱😱

[@KotaDeLaSkytoss]

Subscribed due to T-Pose meme.

[@alessiominervini1175]

can i use an already made rig with hands and face rigged (that i will eventually animate myself) with the program?

[@conorsvfx]

@@garagefarmacademy I have a similar question. Can I replace the relevant parts of my armature with the animated rig while keeping my hands so I can animate them after?

[@DeepMotionInc]

You need to provide the essential joints in the following FAQ. However your rig can have extra joints for hands and feet. We will add some simple procedural hand animations to the hand rigs in the result .FBX / .BVH, you can however replace them with your own hand animation in Blender during the post processing. In general, for all the joints besides those essential joints we will keep them in neutral/bind poses.
blog.deepmotion.com/2020/11/19/animate-3d-custom-characters/

[@aravinthphone]

Thank you so much

[@AlberTesla1024]

Thanks a lot.

[@artimiss1238]

would the motion still work properly if you add kinematics to the armature?

[@victoramona9190]

czcams.com/video/MRKskWxln3g/video.html

[@loritossearo8802]

além do mas a qualidade da gravação ficou horrível

[@williamweidner5425]

It seems like a lot of these tutorials only capture one actor. Is there a tutorial for capturing multiple actors?

[@williamweidner5425]

@@garagefarmacademy ok.
one other question, can this software track finger motion? like can digits be added to the armature in order to live track hand motions?

[@DeepMotionInc]

We are working on multiple actors capturing. It will take some time.

[@DeepMotionInc]

@@williamweidner5425 Not yet, but on our radar

[@orbitalcatnip]

shame it uses already like 20 of your free credits a month for 1 motion
the tutorial is great though but for regular use you'd have to pay monthly for sure

[@diegolopezmontecinos7239]

where is the 3d view select option

[@unnikrishnank6474]

Can we do facial expressions? Requesting for the rply.🙏

[@jaroslawdzedzej]

I guess animate 3d doesn't have that feature yet

[@DeepMotionInc]

We just launched Face + Body motion capture from a single video clip: czcams.com/video/PGjqa3O6o1k/video.html

[@sofabiru6852]

🤗😇

[@digitalartworm]

The bvh is mangled on import....

[@kamillatocha]

i can get better mocap from 2 cameras and AI

[@tomasistudios2618]

every time I use dep motion the character is twisted beyond belief let alone use. Do you have any advice.

[@nanhechamps4913]

sir is it free

[@abhijitjagdishprakash4104]

Is the website shown at the beginning paid?

[@jerryohhh]

xbox 360 kinect are work in blender??

[@mutanazublond4391]

I have faceshift for you , if u want

[@Azizcool123]

I have learned that he is an adult male

[@funtv5693]

i heard D##K motion

[@loritossearo8802]

ou sou um retardado ou esse povinho que diz ensinar aqui via youtube fala e mostra as coisas rápido demas

[@holymowmusichd8229]

Can we import the character also in this software ??

[@Fleischkopf]

100 bucks per month and the time you can capture isnt even limitless? are you kidding me?

[@bentontramell]

We all know how this will be used.

[@ACABSTUDIOS]

monthly subscription. No thanks

[@setzerjr]

is no accurate at all

[@holymowmusichd8229]

can this software convert the final video to .webm or .mov with full transparency ?