New Characters Animated with Unreal Engine - iPhone - Xsens! BEBYFACE EP 6
Vložit
- čas přidán 21. 07. 2024
- Episode #6 has finally arrived and it's a Behind-the-scenes peek at some fun character projects in the works, all using the iPhone + @Xsens + @Unreal Engine Pipeline
CHAPTERS
0:00 Intro
0:28 What Happened - Skit
2:35 Project #1 Bebylon Shortfilm
4:01 Project #2 Xanadu
4:35 Xanadu Alien Test
6:11 Project #3 The Game
6:49 Weekend Project Baby Yoda
8:28 Baby Yoda mini-Spoof
11:00 Baby Yoda spoof breakdown
12:31 UE4 Delayed Wrinkle maps trick
#vtuber #animation #unrealengine #3d #ue4 #iphone #bebylon #gamedev #arkit #apple - Zábava
DUDE your content is that of 10 million subscribers, this technology implemented to the fullest is worth hundreds of millions
he is wayyy ahead of the game... they will catch up to him lol.
I just... have no words. I can't believe how awesome this is, and how little time it takes you!
You have created the HIGHEST QUALITY animations that I have ever seen come from one person!!! This is amazing!
Broooo this is most mind blowing thing I've seen. I just don't get how it hasn't more views. This is future.
your work is amazing ! that small studio will be a giant warehouse one day filled with all the latest alien technology.
thanks! and at the very least, we'll create a virtual version of that giant warehouse :)
Just discovered your channel today, really incredible work! Love the tips for UE and making of , I can't wait for more videos!
Inspiring work! Looking forward to your breakdown tutorial. Keep up the great work!
Xanadu will rule the Metaverse! You are way above the curve brother, your dedication and attention to detail is impressive.
Dude. Ultimate respect. I dabble in Unity but never approach your results. You deserve a contract. Keep up the amazing work.
Thanks Bob!
YOUR a BEAST! keep it up man. Very happy to see you posting again.
Thanks Daniel, I appreciate it!
Awesome Channel I see this growing a bunch in the future wonderful work !
Coming from 2021 where there are 3 Blu episodes out, seeing Blue in his conceptual stage is AWESOME!!!
Thank you xanadu for bringing content like this so wondefully crafted so early on. You will be known as the pioneer as this sort of thing.
Blown away. Love it!
Project 2!!!111
u're a genius! awesome work..kudos
😱🤯😃🔥i love this work man, and baby Yoda was awesome😆
i have seen xanadu on november 2021. This are some seriously impressive content.Maybe many people are not understanding the scene on meta verse. But this comment is to ensure I saw one of the earlier pioneers to do such augmented reality/virutal meta show
Would love to see a work flow video , or even where to get started?? Anywho keep up the good work !!
This is blowing my mind you really are making the future happen
crazy!!! love it so much!
Yes! Cory is back. LOVE this, more of this please!!!
I love all of it!! baby Yoda is gold!!! aliens are awesome! babies are the best! I don't know what to choose!!!
Can't wait for more babies, the style is SO cool!
Thanks Gina!
xanadu is dope! i love the overhead burn!
That’s insane... woooooow.. awesome
youre so talented its unreal, clearly an increidbly dedicated artist whos been crafting his work over the years. Gives me hella anxiety ill never make anything close
This is really great man!! I think it would be awesome to use one of these characters for a twitch channel. Nobody wants to see me play Warzone, but for sure would want to see a swaggy baby play.
I think there's a massive opportunity here for baby yoda gamer or the mini spoof series and if "cute'en'd" up a bit voice-wise, dropping any curse words (to make sure it can reach everyone and since he's so funny looking, doesn't need the cursing to make him so) it could be a hit, so much so of being it's own movie or actual mini series in corporation with Disney.
Having him grumble noises and such at the game was funny. Didn't care for the sidekick who showed up, it seemed obtrusive to the overall feel of what could have been and the trantrum at the end was a bit much but I digress, huge opportunity here given the right direction/scripting/etc. Definitely looking forward to seeing more of that!
Thanks for your thoughts Clint, I totally agree a real performer and the right bite-size concept could be continually hilarious! For the heck of it I reached out to the guys behind Rap Battles of History, thinking a battle between Baby Yoda and maybe Golem or Baby Groot could be a fun kickstart! no ping back yet.
@@trickdiggidy keep on them, would be good stuff! :D
this is amazing.
Man this is great
My mind is soooo blown rn 🙌🏾🙌🏾🙌🏾🙌🏾🙌🏾
I'm lost for words right now... I can't believe how early I am!!
I just don't understand the dislikes. I might be used to a different genre, but I recognize how amazing this is
That is awesome!!!
Baby Yoda & IG-11, the GREATEST dancers in the galaxy!! 😍💃🏻 Powered by Cory, brill! 👊🏽
Nice work
I like what you doing this is next level thing
Awesome work !! Now waiting for our genius to show us how to connect my iPhone 11 to UE (4.25.3)
I've downloaded & Installed UE... so will be waiting. Excited !!
get livelinkface ios app first. then you have to either make blendshapes yourself or buy a facial plugin that makes it for you.
can't wait for that blendshapes tutorial
I'd really, really love a breakdown tutorial pleaaaase, I want to do this same thing with the iphone but don't know how. Any help appreciated!
I'm with you on that. He said he would. Now just the wait 🤾♂
there are a few iphone ios apps that capture and export arkit blendshape data. also epics livelinkface plugin is free. hard part is making those 51 blendshapes
There are tutorials for Cinema 4D
My mind has literally melted out of my ears
🤣 don't worry i know a way to get it back in there... it's sketchy but it works ;P
@@xanaduBlu I’ll pay you in $MANA
u deserve more subs
Hi, great set up you got there! Love the idea of the space aliens, it reminds me of the A.I. Angel project - if you have seen that, can you give us your impressions of it?
Is it difficult to set up the iPhone + @Xsens + @Unreal Engine Pipeline ?
I just looked up the A.I. Angel influencer and yeh, looks there using a similar face cap. Not sure about the body.
Id say it's probably a bit painful to set everything up if you don't have a background in Unreal but everything you need is out on the net... mainly downloading the free face arkit project from unreal and breaking it down. The xsens is actually easy though and is pretty much plug in play.
It was fun to watch. Looking forward to more of your film making process. Could you show the iPhone and Morph setup and how you brought it into UE.
Thanks! The morph setup is really quite simple and typical for the iPhone workflow. I just made the morph targets in Maya using some wrap deformers, then cleaned them up using maya's sculpting tools (this is key to making the expressions look good, especially around the mouth) then just exported as an FBX into Unreal.
In the case of the Alien character, a lot of zBrush work went into a handful of the key morph targets to shape nice wrinkles, etc which then are exported as normal maps / wrinkle maps.
@@trickdiggidy I am a Reallusion's Character Creator User and it has its own Inbuilt 66 Morph Targets. So one job less to do. I had seen another UE user Cinematography Database experiment with iPhone and Use Blueprints to match the morph targets with that of iPhone. Just wondering where to start as I am a Newbie in UE.
@@vivektyagi6848 I would download their 'Face AR Sample' scene and check out the associated documentation. Also download their 'Live Link Face' app (Of course, assuming you have an iPhoneX?)
@@trickdiggidy Many Thanks for the tip. Thanks also for the iPhoneX tip :))
@@trickdiggidy I was thinking of doing this with using the new free unreal facelink plugin based on apple arkit. I have the basic blend shape obj's but still very inexperienced with blueprints and such. Do you know of oa good place to start with training, tutorials to get this up and running? I don't mind doing my own bledshapes using zbrush or maya or wrap3d, just have to get a clue where to start. thanks.
If I was a metaverse investor I would create a whole company for you
Great to see someone realizing my dreams come true. you're definitly the best i've seen so far. I'm not a 3D guy or english native so maybe my question will sound dumb to you. Do you use face cap or is it a proprietary app you make ? If it's your program, will you sell it in the futur ? maybe the secret of the perfect face animation is in the "iphone blend shapes" thing ?
Do you think in the futur it will be possible to combine your solution with virtual production like Matt workman is doing ? It will be a great production value for indie filmmaker
It is more intuitive and more organics for film technician like me.
the only thing missing is the realtime hands animation like "leap motion" and it will be a the perfect solution ! sorry i ask too many questions but it's so great to see the futur possibilities !!!
Yup Matt Workman is already doing the same stuff with his setup as you've probably seen. The app im using nowadays is just the Unreal Live Live face.
Really impressive as always! Keep pushing can't wait to see where it all goes. So you have face model with around 50 blendshapes. And then how are limits of the suit? Do you have issues with hands intersections with body, does gloves works? Could you do for example push-up in it? I wonder how far you can push it. Thank you!
Thanks Jan! All the characters have 51 blendshapes. As for the body, definitely intersections are an issue. Generally for these quick tests, I just do my best to keep my arms away from my body and I also over-exaggerate the retargeting to help keep the arms out. I would think doing a pushup would be fine though the key to the xsens suit is their post process which solves a lot of the issues typical of Gloves are the last big missing puzzle piece to this setup and hopefully I'll have some soon!
The Xanadu Alien show will definitely push the body capture so we'll both see how that goes soon enough! (I'm planning to show more of the early development stages)
@@trickdiggidy Thank you, can't wait to see that. I think it could be a new format for CZcams etc. to create virtual realtime characters. It could be amazing for all sorts of channels. But at the same time, I believe there is a huge amount of preparation and tweaking work. I feel you are the closest one to figure it out. We did also some work with Xsens, but couldn't imagine a realtime solution. We still had to do a lot of cleaning work even though it's a great piece of HW. I see you are in LA, if you would have time sometime It would be my pleasure to catch up and geek about the topic in person! :)
Fantastic!
I do have one question, you say the unreal is the best... but why? I do this same thing (lower value though, I don’t have the xsens or a good team lmao) but I do it in Unity with Daz characters and a custom rig I’ve built and it all seems pretty smooth to me. I haven’t gotten to the level of detail you have though, although I am also using asset store assets since I don’t have a team at all so hopefully this will be doable eventually as long as I purchase the right things.
However, back to the question....
What’s it that you prefer about unreal? The rendering in Unity is arguably about as good imo.
I’m just curious!
Fantastic work by the way, I’m glad you got that sponsorship cause this really is the future and someone needed to display it.
So many people even in OUR industry don’t even know this could be a thing as of today - good luck. 👌🏼
Thank man i appreciate it, and agree a lot of industry folks don't know how powerful this stuff has gotten already!
As for Unreal/Unity, I fully agree you can create your ass off in either, no excuses!! I intensively used and loved Unity back in the day and still miss some of the UI finesse.
What i've found doing this kind of fast iteration mocap / editing / rendering, is Unreal has set a lot of high bars that collectively make it sing for me. Much of it comes from the Unreal folks working hand in hand with hyper talented people in VFX & Film and a lot (if not all) of those features find their way to us little guys/girls, so we reap serious benefits.
The actual switch story is: my (co-founder) Ikrima came into the office one day 6 years ago and said were switching from Unity to Unreal. It was the day Epic announced releasing their engines source code for free to its users... and Ikrima's (being a master engineer) ability to bend the engine to our will, is worth its weight in gold and everything else!
On a separate note (even if I didn't use their Engine) I really appreciate Epic as a company and their genuine efforts put into supporting creative people and companies. It's a rare thing in my experience.
Cory Strassburger oh I guess stuff like the timeline functionality and all of that stuff Unity’s been copying lately right? Cause I feel like in the last few years Unity’s been catching up but ultimately yeah probably not ideal still. To be honest I’m nowhere as far as you guys are in yet so obviously I am asking to know what to expect. Unfortunately switching engines is not something I’ll be doing anytime soon but it’s still good to know.
Keep up the good hard work this is a super exciting project and I’m glad you’re putting in so much work into documenting it!
I do have one more question regarding the mocap stuff: last time I checked xSens suites didn’t publicly state their cost. Do you know if they plan on releasing a more indie friendly version or at least store in the future? The whole “contact us to figure out a price” model is very suspicious and not inspiring at all to me even though clearly their product is flawless. I’m just not very happy about having to contact someone to find out about something that should simply be stated on their website.
Anyway, great video as always I hope you’ll be back with some more soon! The alien is looking pretty dope 👌🏼
Btw, I also do agree unreal is great for devs and content creators. The future is bright thanks to these tools!
@@EnriquePage91 Thanks Enrique! And honestly I wouldn't worry too much about which engine you're using, cause we've both seen great work made in both. If you have inspiration to make something, use what you know and get better at forcing it to do what you want! Actually I think the toughest part is figuring out what story to tell and how to tell it well.
For xsens, I'm not sure of their plans, im generally not in any loop with them but It would awesome if they did considering the demand is growing. I also agree they do have a great product, since the day I plugged mine in years ago, i've not had one single issue...it just works every time i use it (knock on wood!!!) and the quality is always impressive to me.
How do you even create the voice changes to match your acucal voice? I mean it's like perfect in any pitch and stuff
it still surprises me how much pitch shifting can let you get away with!
Quick question about your rig and setup. The head rig you are using...is that part of the Xsens suit or is that something separate? Can you add a link to the gear you used?
the helmet is from www.mocapdesign.com/
Just a quick question, how many blendshapes are you using? As far as I know, ARkit/FaceAR for iphone only adds up to 50+ blendshapes. If I were to add in the Polywink sample file into unreal, does it fully support 157 blendshapes? Hope you can clarify this for me. Thanks in advance.
Hey Avron, I'm not sure what the blendshape cap is but I imagine it should easily import 157. My main beby character has the 51 Arkit blendshapes and maybe another 30-40 character faces and a handful of body shapes.
Você é incrível cara
So dope! i am curious is it possible to use character legally like baby yoda or you need ask a permissions or how legal part of it works?
where do u but the Facial Capture Helmet? can you put the link please
the helmet is from www.mocapdesign.com/
how can you do the fire hair like that
I want a skit where mustard is cut!
#2 Besttttttttttttttt
Do more breakdown, I love you ❤ ❤ ❤ ❤ ❤ ❤ ❤ ❤ ❤ ❤ ❤ ❤ ❤ ❤ ❤ ❤ ❤ ❤ ❤ ❤ ❤ ❤
haha, thanks for the love Mohamed. Breakdowns are on my list, but in that grey zone thats hard to get too!
What about x sense costume, 1 year ago it costs ~ $1000 and now they hide all prices. I want to try mocap for animation. Anyone knows cheap suits et. $1000-1800?
You also might look into a webcam / depth cam solution for the body capture. Definitely won't be as good as a suit but it's getting better everyday. and might at least get you going.
Either you're way ahead of your time or we're all living in the stoneage.
Does the facial performance capture app work for Android phone?
The particular facial animation setup I'm using is based on Apple's ARKit which requires an iPhone X/11's depth camera data for it to work.
@@trickdiggidy Hey Cory thanks for sharing the info.
Let me know if there's any alternative solutions for Android devices.
Project 2
牛逼！
what your setup pc
Bro why ain’t u famous yet
Sorry to ask, are you also a musician?
Why is this so underrated :((
I want to be a vtuber type streamer on twitch, I'm sure ppl like me would pay alot to be able to stream with characters this realistic
look up Ai Angel. Thats the best tech vtuber atm
Y'all are a bunch of babies! jeez
Please create full courses?!?
You have no idea what that means - simply hearting my comment. I think you are an absolute genius hack - exploring the future of entertainment. And I want a full course - I will not just buy the course - but buy all the equipment through your affiliate links if its somehow possible for me financially. It could be super profitable for you and super good for the future of entertainment and education and the metaverse in general.
Duudeeee please upload a tutorial on your workflow please!
I love you
Dude I hope you don't get sued by Disney too. Loved your version of gamer B.Y. I think legally this is considered a "parody" so technically you are in the clear regarding property etc. right?
Side note regarding the legal stuff. I'm not an attorney but the Meat Canyon channel on CZcams had one of their parody videos claimed by Warner Brothers. It was called "Rabbit Season" and got a lot of views for its twisted content. However, you'll see that it was strange that WB claimed ownership to such a twisted version of their character, Bugs Bunny. Anyways. Peace out.
I hope you sell some of these are NFTs, you'd be making millions and deservedly so!
50 year old baby's where very popular on alderaan i hear thats really why the planet was blown up/
You should create nft’s
i wish xsens wasnt so much damn money, i cant even afford vive trackers. Also i have an android and they dont have facial recognition software yet... BLEH
i really want to get involved in vtubing on the level you're doing it. so impressive
this was awesome, just keep away from baby's
exhausting, but very awesome
your work is amazing ! that small studio will be a giant warehouse one day filled with all the latest alien technology.