iPhone X Facial Capture test PART 3 - FULL BODY
Vložit
- čas přidán 9. 01. 2018
- Test #3 using the iPhone X depth camera for facial animation capture. This time with the Xsens full body motion capture suit and a ghetto DIY moCap helmet!
Starring a WIP Beby Character "Cameo" from our game Bebylon!
Check out Ian's write up on upload for more details.
uploadvr.com/iphone-xsens-per...
Check out the previous tests for more info regarding the iPhone X capture process. • iPhone X Facial Expres...
* As before all the iPhone face capture data is raw, unaltered. The Xsens body capture data was post processed in HD, otherwise unaltered.
Some context:
These are a series of test I'm doing to find a fast pipeline for performance capture (Face and body) that we can use for our up and coming game Bebylon: Battle Royale. bebylon.world
#animation #unrealengine #motioncapture #iphone #xsens #bebylon #gamedev #arkit #ue4 #apple #realtime - Krátké a kreslené filmy
THIS IS THE COOLEST THING I HAVE SEEN IN MONTHS!!! YOU'RE A LEGEND.
Loving watching this progress. This will definitely be looked back on as a game changer.
not
@@chadangeles3856 look back now
Bro, you’re having way too much fun. 😂
Yeah, I'm stuck on building the helmet too. Most of the options out there look too thick and heavy. Thanks so much for these updates: really incredible work.
Amazing!!! 😀 nice to watch the evolution of beby❤️
Dude are hilarious! That out take was classic. Thank you for showing us GREAT POSSIBILITIES for mo cap....NOW go make another video and make us all laugh while learning doc!
Hi Cory, that is so nice and fun to watch your demo, good job, thanks.
Wow, it keeps getting better and better....
Best facial capture I have seen from all the vendors in the genre.
so dope, looks incredibly fun
This is so fun. Brilliant rig!
This is mindbending, you are by far the most underrated channel on youtube. I am here before this shit goes to the moon!
same here
now im thinking in maybe even create some caracter and get into this new metaverse thing
this is awesome afff. need one of these
If ever there was a single video to prove that VR is going to help unleash new forms of creative genius on the world, this is it! :)
Dude your awesome keep up the good work!
Very cool!! XSense and all these AR magical thing you did, very clever.
the idea of this technology possibly mixed with vr would be really exciting. Comboing the face tracking while wearing a vr headset would be complicated issue to resolve probably requiring a specialized headset just for the task, but that would be some awesome RP1 like experience.
Excellent work.
Your facial mocap solution using the iPhone X and ARkit seems to be so far the best and most straightforward out there, especially in combination with Unreal.. Is there any chance you can release your current custom toolset to fellow devs to work with? Polished or not, the results are outstanding and encouraging! Also, great project overall congrats on the Dev Grant!
Thanks! I'd like to put it out there but its a decent amount of time just to make an unpolished version available (its very hardwired to our game asset). I suspect in short time other devs will have a proper tool available and Its honestly pretty easy to do yourself if you have a character with the right blendshapes.
Ha ha, that was brilliant. I also love the idea of baby gangsters. I'm curious, did you get that idea from the original dancing baby?
lol, the OG dancing baby crossed my mind but long after I came up with the idea for the Bebies. Check out the origin story at the end of the website (www.bebylon.world) Its pretty funny and will shine a light on the immortal babies idea!
Love the backstory, maybe you can add the dancing baby as a bonus unlock or Easter Egg :) Looking forward to the game, it looks like it's going to be great!
Yes listing your kit - you LEGEND!
This is fantastic! I'm going to be checking into doing some of this myself, if I can afford it.
OMG!This is awesome!
This is AWESOME!
Wow 🔥🔥🔥
Thanks you for posting this. This is amazing software. How easy is it to put together and what is the ball park cost to accomplish what you just demoed?
Man this is awesome.
The animation of the actual character and clothing is so hard 🎯🤩
amazing. i knew you could use iPhone X for mo cap. its got depth camera same as Kinect right so more than possible.
Dude, you rock.
End expression when you dropped your iPhone X.
Baby was shocked. Like what happened.
I can't move my face, I can't move my face
Ha Ha Ha Super awesome!!!
You're no.1 in this way !
First man to enter the metaverse,big Respect 🐐🤜🤛
Awesome!
Wouldn't be the same without this spirited presentation
Hi, I have a question, you sold any tutorial of the motion capture in unreal? I need solve many problems in my motion capture's projects
Ahead of all of us. Holy shit.
Now watching in 2021
This is awesome - not long till virtual chat rooms will be filled with Avatars as emotive as this!
Noticed the temple - How many times have you guys been to Burning Man?
Last year was my first and I want to go from now on until I'm dead! Hopefully that means a lot more burning mans! My Dad gets credit for pulling me away from work for a week and the one who shot that temple photo.
Hi,
Really nice test.
So what about using Asus Zenfone AR for full body motion capture instead of using Xsens?
We can do that right?
What software did you use for rendering / visualizing COMEO - excellent quality and excellent presentation. Hats off.
Damn this company going to be big... this is one of the best movement ever
That is fucking great, Man!
Inspiring stuff! What did that Xsens suit cost?
Impressive
I think you will benefit from a 3D printed helmet... I am doing this exact thing using a bike helmet right now and it does get heavy at times.
Still better than face animation in Mass Effect Andromeda
It's like soooooo freaking cool! One question, the animation got from Maya is it real-time?
Its not setup as a full real-time scenario but its pretty easy to do. i.e. streaming the body and face data live into Maya or Unreal engine to drive a character.
Please i beg u ..please make a tutorial on doing that diy helmet.. pleaseee
Hey bro.. hows it going. Do you have an iphone app that works with the latest version of ue 4.24 with raytracing? Or a ue project that works with facecap?
Would be helpful to include a link to the items u bought and where u bought them
How did you capture body movement with high precision?
Have you got a videos would work showing your headgear breakdown. I have a GoPro gooseneck, but iPhone X max is too heavy. Maybe this would work- I'd love links to a breakdown of the products.
i see so much potential for Actor Software like " Mindshow"
Is the Xsens suit and software really that good. No jittery mocap data cleaning needed? How is the workflow between their proprietary software and Maya? Thanks!
Hello. I really like your videos. Where can I buy tools to make it? Thank you.
Hi, it looks so easy and is great! I have no cluehow to attach facial mocaps to a body animation from others… and I use c4d... any advise? congratulations!
Im not sure what animation formats C4D can import... but typically the data from the iPhone is just a bunch of zero to one values for each blendshape so you could probably format that into something C4D can import.
@@trickdiggidy Do you have a tutorial on how to set things up like the video? Or a place where I can buy this? IT LOOKS SO GOOD.
that s amazing！
Man this guy was was living in the metaverse before the metaverse became popular lol
Please put the code up somewhere! Minus the Beby character code of course! Please! Thanks
Will you release your iPhone X app for other devs to use? I'd love to use this for my next project.
i'd love too but i bet a bunch of other devs will get something out there before I have time to clean up my app.
@@trickdiggidy I would love to know if they did. If they haven't can I get your app? PLEASE!
How did you create the game taunt? And be able to "poof" assets in your hands.BTW love your content!!
the taunt was just the mocap data and I keyframed the asset visibility into the hands
Wish VRChat graphics would look this good.
HOW MANY GB NEEDS MY COMPUTER OR LAPTOP FOR RUNNING LIKE THIS? THANKS
While i'm sure your game will be great; have you considered you might have equal or more success developing the facial capture system! .. there's a race on right now for someone to successfully make a workable face capture system from the X.
motion capture for games!
How you capture your feet movement? Another sensor as on your hands?
yup, its under my sock
How long did it take you for animation cleanup to hit facial expression accuracy and fine-tune the full body mocap gestures (e.g. finger animation)?
what your seeing (aside from the hands) has zero cleanup, no manual anything, its the raw data from both the iPhone and Xsens suit. The hands I probably spent 15 min quickly key framing some poses so there was at least something there. I really need some capture gloves!
actually, for the Xsens body capture, they have a 1 button post process that automagically refines the data and that took, maybe 10 minutes to process for the entire take.
that is whooping fast!
Someone please explain how he achieved this !!!!
PLEASE DUDE, SELL this program, i would absolutely LOVE to try what you are doing!!!
Sell? SELL? ur an idiot. This needs to be free.
My question is how did he get the phones data live to the model while body tracking (tutorial pls)
In this case I captured the face data locally to the phone and assembled it after in Maya. But currently i have the face capture data streaming over wifi into the Unreal Engine which is way cooler and obviously faster! Both the xsens body suit and iPhone can stream into unreal engine using the same wifi AP.
so how do i do this? is there any tutorials?
s Hi good work where can i buy this complete mocap steup thanks
How much did the motion capture suit/program cost you?
Yo. In conjunction with iPhone face tracking. What is the cheapest way to motion cap for arms and hands for youtube videos?
Will you be able to do the same with ipad pro lidar camera??
hi bro
i have a doubt is that stick made you r it is Rig bro and one more iphonex will work only for facial expressions or full body like mocap bro can you plz reply me bro
if it posssible plz send me link in comt bro
how to connect iphoneX to iclone software
a small video bro plz
This is great, but... you keyed the hands right? You don't have finger capture with an Xsense MVN suit.
yup, the hands were the only key framed animation. Looking into capture gloves which I'm not terribly optimistic about having done a fist pass of research.
Yeah there really isn't much out there for fingers in concert with the body. Though the leap capture stuff is pretty incredible. If you look up leap hand capture, it's pretty cool.
Seems like just having a pose library you can trigger per hand would be effective too. Like puppeteering the hands.
Anyhow. Just reading my comment now and realizing I sound like one of "THOSE" guys. When I was really just curious. The work looks great man. Kick ass :D
I was thinking leap motion too as a temp post solution. Its sitting in a box on my desk tempting me everyday! The Brekel guy wrote an app I was looking into for leap capturing that seems like it will do the trick. I like your idea of puppeteering the hands, it would be much faster than manually key framing, not counting the initial setup time.
Exciting stuff. Keep it coming :D
I use perception neuron. Their hand capture is pretty good but the raw body mocap requires lots of cleanup
Cory, if you gonna make even just a couple of tutorials and add them to your chanel, it will blow up the views and subscriber!
Is there any way to get markerless facial capture cheaper? I don't want to buy an iPhone just for that.
This is very fucking cool
well apple didn't expected this
Yep lol
I just wanna watch a movie with this baby as the lead
which type of mobile we want use for a facial motion capture pls comment mobiles name
What's the price of that sweet suit he is wearing? I'd avoid bother Xsense for a quotation...
how does fingers are being trakcing? what are you suing for fingers?
I'm quickly key framing the hands just so there is something but I really really want to find a pair of capture gloves.
It really looks great except for the hands/fingers. The fingers don't respond to your gestures most of the time. I hope this will improve eventually.
Tutorial pleasee
SHUT UP AND TAKE MY MONEY.!
This suit track fingers also?
Metaverse ready
what is the name of the app of this face motion cap?
to make that mocap of the face, can it be done with an iphone 8? and is it necessary for the face id to work?
I think you need an iPhone X or any iPhone with the A9 chipset :)
yup
Poxa massa
6:10 LOOOOL
Круто!
Hello, what app are you using on th eiphone? thanks in advance
In this video it's a custom app I made, which is pretty much the same as what I use now which is Unreal's LivelinkFace app
Is this possible with ar emoji?
5:27 me after a good shower.
The default Livelink app constantly overheats and wont record higher than 30fps 90% of the time. Its pretty bullshit.
What is the name of the app ? This is awesome
His app is not available to the public. But there are similar apps out there like MocapX with a real-time Maya connection. czcams.com/video/3QB6fvDXXqw/video.html