Plask.ai: AI mocap from Video (+ Blender workflow)
Vložit
- čas přidán 21. 07. 2024
- -------------------------------------------------------------------------------------
❖Get all CGDive courses for just $5.99 per month!❖
academy.cgdive.com/courses
Note: This is like Patreon but much better :)
-------------------------------------------------------------------------------------
NOTE: Plask was free at the time I made the video since it was in Beta. Now there is a limited free plan and a paid fully featured plan. Check plask.ai/ for details.
Links from the video:
❖Plask
plask.ai/
❖CGDive: The Vault (50% off with code: early50 )
toshicg.gumroad.com/l/cgdive_...
❖Rokoko
rokoko.co/CGDive
❖Retarget Helper addon:
gumroad.com/a/598294451/NNQRs
❖Better FBX addon
blendermarket.com/products/be...
RECOMMENDED PRODUCTS
❖Rig Anything With Rigify (coupon code "cgdive" = 20% off)
toshicg.gumroad.com/l/rigify
Alive! Animation course in Blender
www.p2design-academy.com/p/al...
❖The art of effective rigging in Blender (coupon code "cgdive" = 10% off))
www.p2design-academy.com/p/th...
❖Hard Surface Rigging In Blender
blendermarket.com/products/ha...
❖Auto-Rig Pro
blendermarket.com/products/au...
❖RBF Drivers
gumroad.com/a/348001395/XzWpB
❖Bonera
gumroad.com/a/99062899/oXuxm
her32756743edjhfkjhdfslkj
0:00 Plask.ai
0:39 Quick-start guide
1:07 Basic Usage
1:51 Extracting AI Mocap with Plask
4:34 More Features
5:42 Limitations & Troubleshooting
6:14 Exporting from Plask (fbx, glb)
7:57 Importing Plask Motion into Blender
9:06 Rest Pose Issue
10:09 Fixing the Rest Pose
13:39 Quick & Dirty Mocap Clean-up
14:19 Technique 1: Smooth Keys
14:49 Technique 2: Stabilize Motion
17:34 Retargeting in Blender
18:34 Blender to Plask Workflow
21:24 Plask: Retargeting setup
24:03 The Vault! - Krátké a kreslené filmy
NOTE: Plask was free at the time I made the video since it was in Beta. Now there is a limited free plan and a paid fully featured plan. Check plask.ai/ for details.
now the feature is gone
You’ve just dispelled the evil animation barrier cloud looming over all of us. This is insane. Thank you so much
I thought up an entire 3d animated short in my head yesterday, including camera movement and focus, lighting, and of course, character animation. It has some pretty complex sequences so without any sort of motion capture equipment I was unable to suck these plans from my head and into a scene without week(s) of work.
But now it looks like I'll be able to do it in a day! Raw mocap is messy, but will be absolutely perfect for previs purposes. Thanks a lot!
That's very cool. Would be nice to see what you come up with :)
Bro I'm so curious to see you scene...
@@AlbinThorburn Which scene and what do you want to see ? :)
The model from 1 minute onwards was a blast from the past! I remember years ago when I first started and was using this character in my ue4 games..What a throwback to memory lane! Awsome video as well
Holy damn man, the depth and thought behind the tutorials is incredible. Thank you so much 🔥
This is great what an amazing piece of ai software,this is all only going to get better!
Thank you so much for your video. I was waiting for it impatiently
Thank you for this, had a lot of problems with plask didn't think to smooth the key frames to fix the jitter, also adding the bone to an empty is a good work around as well I Was trying to do it manually, I may give it another chance now.
I knew this would be coming and I can't wait until there is a Blender addon that does AI animation automatically, using a "script" of stage directions that the user types in. I'm sure it'll be here one day. It seems like most of the necessary components for such an addon are already out there. They just need to be assembled together with a nice UI. Thanks for sharing! Exciting times!
You are a life saver! I’m planning to make a demo of a sci fi game based on a novel I wrote to pitch it to publisher I thought I gave myself too little time because in novel there is a lot of action of lot of characters, you just saved my project!😀
damn dude this mocap is clean asf
That empty constraint foot locking to ground plane technique was boss. Will add that to my Mocap clean up techniques and credit your video here whenever I use it. Thanks a billion bro! I been working on the clean up process myself, and been getting great results however your techniques make it far more accurate I believe. Less time consuming as well I think. Oh and the actions thingy is awesome I never really cared to create them, I remember learning years back about them though. For the retargeting purposes I been using the glb file format when I export from Plask. It seems to correct the FBX issue of poor rig compatibility out on Blender.
Awesome! I'll check out your videos.
I tried glb but it seemed to import the characters at a weird angle. So I stuck with the evil I know better (fbx) :P
Thanks for the review!! Your feedback means a lot to us 🙏🙏
Thanks for the cool app! Looking forward to seeing how it develops!
4:57 You didn't mention these filters. You select the bone and set the filter to maximum, it clears the motion and greatly reduces that Armature shaking
Where are the filters?
@@CGDive 4:57 The upper right part of the screen, below Transforms, you activate filters with the white slider, then you set their value between 0 and maximum. I'm not sure how Fomin is different from Beta.
@@llYuki0okami How did I miss this? :]
Nice find.
@@llYuki0okami I can no longer find the filter option in the latest update.
Insanely helpful video! Thanks man!
Thanks for sawing this, looking potentially interesting! :)
Thank bro I will successfully retarget animation to mixamo rig
And learn many things from your video
Great video. For anyone having retargeting issues: I am not sure if you mentioned this anywhere, but I just figured out that Plask sets your rest pose to whatever frame you are on while exporting. So it has the first frame as the T-Pose but it might not use that as rest mode if you are on a different frame. I spent hours in blender trying to retarget and literally just discovered this by accident.
Yeah, it's in the video. I think they made some sort of a fix for that on the plask side, didn't they? I haven't used the service in a while...
@@CGDive I don't know if there is a fix, I just know that the curser has to be on frame 1 for me for the rest pose to be a T-Pose. I only started Plask it last week. Thanks for making a great video though, learned a lot from this!
hermoso, gracias amigo
de nada, amigo!
Thanks this will help me with my animations
great video
Thank you so much bro It help very much
Fantastic 😍
HI, thank you so much for explaining Plask ai to me! I have a question, I am using th eblender addon you gave us to out my mocap animation onto a model of my own choice, but when I select the two armatures in the right order and then hit "Constraint to Armature" it does nothing, am I doing anything wrong, or did I forget a step?
The addon works based on Bone names. Both armatures need to have bones with the exact same names. In the example in the video, I got both armatures from plask so it works. My guess is that you are trying to connect armatures with different bone names which are not supported :)
If the bones do have the same names, then it could be a bug/problem. Please send me your blend file for inspection :)
This saves me thousands of dollars!!!
wow! Thanks Man!
Huge thankyou!!
Very interesting !
Awesome video (as usual!), I am checking out your cgdive_vault, nice alternative to patreon!
Thanks! Yeah, I have Patreon because it's popular but honestly, I don't like it that much. Meaning, I don't think the platform provides a great experience for people who are supporting me. This is much better!
@@CGDive Cool... I was on your patreon for awhile... just signed up on Vault. Workflows targeting Unreal has been lacking, you fill the void nicely!
@@jerrybradshaw5409 Thanks, Jerry!
awesome!
The bus stopped at 14:48 with a jerk. Then the jerk got off... LOL
Thanks for this very helpful tutorial!
LOL please don't continue that train of thought hahaha
Thanks for covering this, bro. 👍 Also, for a providing a good example of why so many women prefer to dance with EACH OTHER. (My wife doesn’t even ask me anymore.) 🤔☕️🎩🎩🎩✌️
hahaha, I can't dance to save my life. I actually thought that guy's dancing was alright :P
You… are AMAZING
Now Plask has T pose as first frame of the animation by default.
Every time i do from mocap to blender armature transfer i got problem with clavicle bones goes down, i manage to fix this, later transfer another mocap and again same problem and i dont remember how to fix it, i understand that i need to change mocap armature arms (no clavicle) to a pose as my character and set Current in rokoko addon, but im doing it.
awesome and cool
amazing
Thank You sooooo much
Nice
thx u,,its really help me..looking for tutorial face rigging compile with plask
I have a problem with fixing the rest pose issue. I already applied the T-Pose for the rest pose, but when I'm done baking the animation after retargeting process, the rest pose now has the same animation and not a T-Pose. Any ideas how to fix it? Thanks in advance!
Not sure what you mean, unfortunately. Sorry. You can try to ask on our Discord with images. That might be easier to understand :)
discord.gg/YFH5HUv
谢谢分享！
Thank you very much for this tuto.
what is the diffrence between a bind pose and your dance pose? Because I don't have `bindPose` with the Plask.ai last version. I have only `empty motion` and my pose extracted from my footage.
Yeah, I haven't used Plask recently so not sure what changed. The bind pose is basically a T-pose or an A-pose. A neutral default pose. It's useful for many workflows. If you export the character before applying a motion, it should be in that pose.
@@CGDiveAh, maybe it renames bindPose to empty motion now
Thanks for the video. Do you know of an easy way to retarget these animations to a rigify rig?
Yeah, check out my Retargeting Playlist. There is no need to watch all videos if you are familiar with retargeting in general. The Complete Guides to Rokoko or Auto Rig Pro contain info about retargeting to Rigify
czcams.com/play/PLdcL5aF8ZcJux9f5Bvb1QlByiHWTK3ICP.html
I have a question, is the option to Constraint the armature name in the Blender retarget add-on. Or would I need the "game rig tool"? Is the explanation for using the Retarget add-on in another video? Other than that, this video is amazing. I appreciate your response.
It should be in Retarget Helper. Did you try it?
Thanks for this. You don't explain how to install Retargeting Helper. I installed the addon in preferences but can't see it in the side menu
The addon is installed as any other addon. I just made a video about that.
czcams.com/video/4NnMn74uA6o/video.html
Did you install the Zip file?
Hello, at the end of the video, I saw that you used your own model to bind a skeleton and used it in software. Can this skeleton be the 3Dmax Bip bone system, or do I have to manually create a bone system myself ? THX ！
Not sure, sorry. Blender doesn't work with bip or any 3ds max tools directly.
@2:35 how do you edit the video length in the time line? I'm grabbing the edges and it's not working
Not sure why, sorry. You should get in touch with the app devs.
Hi there, thanks for everything you do for us ! Is there a way to use an autorig pro rig with plask ? Even with fbx importer it can't seem to work for me ... thanks !
Hi. What didn't work? Do you mean that that bone pairs don't get assigned automatically?
@@CGDive no, I mean, I export the entire rig generated by autorig pro and import it in Plask and it doesn't work ... Should i just export the armature generated by autorig pro ?
@@rgbstudio4881 oh, that won't work for sure. The ARP rig is too complex. What I'd do is use the default plask characters to get the motion, import it into Blender, and target to the ARP rig.
I have problem with scaling the armature, when i scale it and move it. And when i play the animation the armature reset the scale and position to the original imported position.. Do you have any suggestions?
You likely have Scale keyframes on the armature in Object model. Delete them, and you'll be able to scale it freely.
how do i install this retarget helper? i only get a folder full of .py files when i unzip it :/
You don't unzip it. Here is a video on how to install addons
czcams.com/video/4NnMn74uA6o/video.html
Hi, the extracted motion is weird it's not like in the video and it doesn't work with long videos...
"Weird" is not something I can analyze and offer help with :)
I haven't tested it will long videos, to be honest. I would suggest contacting Plask Support about that. They are very nice.
Bro retarget helper addon not downloading options, I want this button click but not working
not sure if I understand. The addon is here
gumroad.com/a/286676083/NNQRs
Are you unable to download it or use it?
Include as much information as possible, otherwise I can't help.
if you try to put this mannequin in another models body. Would the model still move because it has the mannequin in it
No idea what you mean :) How do you put a mannequin in another body?
Thanks! Looking forward to more advanced smoothing techniques. I tried plask with a simple profile walk animation. I took one cycle and brought it into blender and tried to make it loop. I spent an hour before giving up. Do you know how to do this? It would be very useful to make a collection of custom walks, runs, dances, etc.
The most basic step that you can take is to copy the first keyframe for all bones to the end of the cycle. That will give you a loop. But it will probably look unnatural so you'll have to edit the poses to make it look good.
I got a walk cycle working from my own video footage of me walking, and brought it on to Blender. It's not perfect, but it worked. You'll need to correct the legs swinging action though and head positioning, spine etc... As they turn out crooked due to the walk in the video being at an angle. The AI Mocap cannot extract the walk data aby other way but crooked if you wish the model to actually walk rather than walk in place.
You could get a tread mill though and that would create a far more accurate walk cycle using Plask's AI Mocap. As it would deliver you a far more stable walk in place video extraction. I'm going to invest in a good quality tread mill, or maybe try to create my own in the future just for these AI Mocap tools.
@@virtual_intel This channel has a lot of actual walks on a treadmill :)
czcams.com/video/cVjIqr8CTtQ/video.html
check it out!
@@CGDive I tried that. There was still a noticeable pop at the end that I just couldn't seem to fix.
@@binyaminbass Hey, I'd be interested to check out your file and see if I can fix it. I am planning to make videos about such problems so it could be a nice exercise and I could help you in the process. To get in touch: cgdive.com/contact
wow very cool stuff, and it seem to be totally free to use! but can the the animated rig be used commercially?
I heard they will introduce paid plans soon. But free plans will be available still.
How we take a motion of animales?? Please!
For animals? Plask can only extract human motion.
How to apply this data to my character? Is uploading character in plask is possible
18:34 is all I have to say about that.
it's interesting but there are a lot of such tutorials .. But very few tutorials on how to solve the touch with the fground. How to solve it?
You mean making the legs look stable on the ground, right? To make that look really well you need IK controls. Either retarget to an IK rig or use something like Rig on the Fly which can generate temporary IK easily, I'll have tutorials about that this year.
12:02 It says "Nothing to bake" what is the solution ?
Did you select the bones you want to bake?
this looks so cool the results are amazing. one question. why this ue4 mannequin has the knee join detached from thigh?
Are they? It's probably just the model...
@@CGDive hehe ye, if i compair with the default rig from ue4.
Importing this animation you just made here, to ue4, to work with the default ue4 mannequin, do we need to do another retarget for that? ( i think this one is missing the rootbones from the default one)
@@RDD87z I think the Plask skeleton is not compatible with the actual Mannequin. Some sort of retargeting will be needed, most likeley.
A few months ago, I started using plask AI MoCap after watching this series of videos. Recently, I wrote a blender addon: Inverse Lock Bone. It's helpful for MoCap which needs to lock the foot (and recalculate the location of the master/root bone). Hope it helps in some way.
Oh cool, is it available somewhere?
@@CGDive It's on the blendermarket, but I can email you a copy for free later, hope you like it.
@@CGSparrow thanks, I'll check it out on BM. What is it called?
@@CGSparrow ah, inverse lock bone, I guess. Will check tomorrow.
@@CGDive Your email? I will email you a copy for free for your great videos.
how to convert .fbx file to .vmd motion?
i want to try it on other models i have on blender
I am not familiar with vmd, sorry. I know it's part of the mmd stuff which I am not familiar with either. So happy googling and let me know if you find something :)
one more limitation i found that if i import a character with texture and uv details after exporting all uv maps detail are cleared
if you find any solution please let me know
Let's say I want to record an animation of me approaching a chair and sitting on it. How to calculate where in the room should I put the chair to match animation to the chair position in Blender?
Sounds too hard to calculate 😂
Plask is not that precise at this stage.
Probably too hard to calculate, but you could just modify the animation or where the chair is in the scene or something within blender instead.
Why did plask ai remove the image generation?
I believe they split it into two websites. So now plask is just for mocap and the other one is for image generation.
Plask won't generate mocap data from the videos I sent to it for some reason...
Thanks for the comment. I hope you understand that I can't do much about that :D
Either the video wasn't valid or the site is not functioning. Get in touch with the people from Plask!
how do i export it as a ycd??
No idea. 😆
Would you recommend this for a 2d video game?
Not sure. If you render a 3d character as a 2d sprite then it might be possible.
i have tried to export animation from plask to unity but the aniamtion aways get weird motion after, conver to humanoid, can you make tutorial?
Plask to Humanoud... OK, I'll make a note about it.
@@CGDive thx
Did you actually try the clear all rotations on that first model and then set it as tpose. Was just wonder if that would be faster vs that reimport of different model and then retarget
Clearing all transforms brings the rig to Rest Position. So that's not going to help 🙂
@@CGDive yeah but what pose is that actually. Since most rigs use either A- or T-pose. It's weird this had that awkward pose. So clearing rotation sets it to that fighter stance, that's really weird.
Perhaps especially when you use their app to rig an upload, it also starts in either a or T-pose. Kinda weird it exports in a different oose. But then again, perhaps that's due to how blender imports something
@@RomboutVersluijs not every app has the same concept of rest pose as Blender. So guess something gets mixed up in the export process. Glb actually exports the rest pose correctly but it had other problems. There may be a better workflow but that's what I found.
@@CGDive yeah that was sort of the same i was thinking of. Still wonder if that app actually exports a tpose or apose. But since you said glfb does have it. Could be couple other issues. I'm not familiar with how other apps interpret a tpose when importing a armature or rig
How to add textures pls tell
Not sure, sorry. Ask the app devs :)
It gets sad that i have all the materials needed to make a soft but when i get in front of it idk wtf im doing and i cant co up with
Keep it up. 3d is hard!
I upload my model, but my cloth didn't move with my model, why?
I have no idea what kind of cloth that is, sorry. Could be a million reasons.
Is it better to use 30 or 60fps video, and what resolution 1080-4k?
30 FPS, resolution is not essential. Read their documentation, it has a section about video setup.
@@CGDive I see. I checked their docs and dont see anything on outfits. Is there a best outfit to wear that makes the AI best capture joints?
@@EvolvedSurvival I'm not an expert but I think you should avoid loose clothing. Also make sure the color of you cloths is different than the background.
As Plask Ai is not free anymore can you plz recommend us an alternative for Plask. PLz
there is www.kinetix.tech/
I think it's still free but it may go the same path as Plask, we'll have to wait and see.
Plask still offers some free 30 seconds a day. That's not too bad. :)
why the f...my imported animation keep go back at the center when i play it???
No idea :) AI mocap does not create good results every time...
Hi, How to access the service?
from plask.ai/
Watch from 0:39
How we can retarget plask ai animation to mixamo rig
did you watch 17:34 ? Retargeting to Mixamo would be exactly the same. I have more in-depth tuts about retargeting with rokoko and Auto-Rig Pro .
@@CGDive when i am put animation on my rig in plask ai the rig move upward with wierd animation
I went to the websites but it was only pose or pictures not video why is that?
I haven't used Plask recently. The one I like right now is Rokoko Video
czcams.com/video/Mm75IuSB9mU/video.html
@@CGDive than you
How good is the head tracking? It’s not that obvious in the video.
It looks decent to me but I have to say that I haven't tested for that in particular. The service is free and fast. Test it :)
Pricing:
* 30 secs / day for free account.
* 150 a month for 60 monthly mins.
Yeah, they added a price tag. It was kind of expected.
I am retargetting a mocap made using plask to a rigify rig watching ur previous tutorial on rokoko retargetting
But the results are very poor the shoulders are bending too much the hands are crossing each other all the whole bended left side
I can't figure out the solution after watching the video 2-3 times
Can u plz help me in this or make a short video of retargetting plask motion to rigour
It will be a great help for me plz
Arms crossing means that the Rest poses are different :) Are you using Rokoko?
yeah I am using rokoko
I have changed the pose of the plask rig to A pose and use current pose while retargetting as mentioned in ur previous video of retargetting
@@CGDive
I can share the file in discord or anywhere u want
Plz help
@@coolhighlights1380 YT had flagged your comments as spam, sorry.
Yes you can share on Discord :9
can this work for downloaded rigs?
Depends on the rig you downloaded :)
@@CGDive Like character rigs?, PS , Is plask free?
Rokoko retargeting not working
Here is my tutorial about retargeting with Rokoko
czcams.com/video/Nyxeb48mUfs/video.html
Thanks for this video. Have you compared this with Movmi?
No, I think that's somewhere in my bookmarks tho. Have you?
@@CGDive Not yet but I shall try it soon
@@davidcripps3011 I tried it quickly after reading your comment. Take with a grain of salt since I only tested with two videos ... but Plask seems better (a lot better), at this point at least.
@@CGDive That was quick! I had the same initial impression
@@davidcripps3011 There is this as well:
cgtinker.gumroad.com/l/rotom
I haven't tried it yet.
in the susbcription program can we request a tutorial?
I'll say "no" to be on the safe side. You can request tutorials even without being a patron. I always take notes and I've made many tuts based on people's input. Input from patrons is prioritized slightly. But making there videos takes time. It won't be possible to make everything that you request within reasonable time 😊
@@CGDive oh okok thanks.. i really just want to learn skateboarding animation even just one doing an ollie
I can't get anything out of it. First i had 0 credits after account creation. Then next day i got 900. Now when i want to try it, it says "899 credits are required on this. You will have 1 credits remaining.". I click on extract and then this message pops up and i can only click cancel or upgrade: "You have 900 credits left. 899 credits are required on this. Upgrade to MoCap Pro to get more credits." wtf?
I haven't tried it since the credits were introduced. Not a good look if credits are not consistent.
@@CGDive I think the site is broken. I managed to get a capture when i did go somewhere way below the 900 credits in use. My 30 seconds became 3 seperated captures, but the 3rd one didn't wanted to work. I can't use all credits that i have got left. And with every capture, the less it let me use the credits i have.
@@MrGTAmodsgerman I'd get in touch with the app owners/developers.
Any idea guys why plask is so slow on chrome and its sometimes unresponsive page?
Do you have Hardware Acceleration option on in your browser?
@@CGDive where to see that? Im using chrome browser
@@CGDive thank you youre a life saver done tweaking h.a on settings!
@@FengWei149 did that solve the performance issues?
@@CGDive yes thank you!it is smooth but exporting take a bit long. But its ok now than before
Can you please make a tutorial on how to retarget plask ai animation to mixamo rig please please please please please please 🙏🙏 please
17:34 :)
For information, here is a « prehistoric » video about full-body motion-capture (1993...) :
czcams.com/video/7P3S1ttag_8/video.html
problem with export
(Warning
An error occured while exporting the model. If the problem recurs, please send us a message on our website.)
Please send them ea message on their website :P
But I did hear that they had an increase in traffic and that caused problems with the app. Try it again now.
Still same thing to me, from Italy. 1.40am on 24th of Feb, not working the Export feature.
Warning
An error occured while exporting the model. If the problem recurs, please send us a message on our website.
@@ernestomarchi2009 I can confirm but I can't do anything about it. I am just a guy who made a video about Plask. I expect it will be fixed soon but I can't promise anything.
So I have to stress a part of the error message you're seeing:
"please send us a message on our website."
:D
@@CGDive Yhyh I know don't worry. Was just to inform the community. Now they fixed it by the way.
Can you please make a video where we can animate our character like a video....
I mean it looks like a normal cartoon video...
Sorry, I don't understand what you mean by "normal cartoon video" :)
@@CGDive i mean that
I want to make a short cartoon video like a cartoon movie .. with colourfull environments, body movement and facial expressions...
Can you please make a video about that.
@@ShaileshBhargaw oh that would be a very big project and I don't have such plans for now, sorry 😔
@@CGDive if you have time then please watch any video of this youtube channel "Bhurji wale chacha"
... and please tell me how do i create this types of video...
Sht. I need any AI that can just create correct sprite sheet to animate 2d character.
They starting offering premium and limiting there Free part not to mention the site is super slow. You better off with freemocap...
Yeah, it's no longer free. If the site is slow, check your browser settings for something like "hardware acceleration." and turn it on.
Freemocap FTW :P
Heads up, the Image Line affiliate link is broken and needs to be updated.
Sorry, which one?
The kind of apps that look great but never get out of alpha stage.
Could be, we'll see.
If they keep it free in the current state, I'd be a happy camper actually :P
adobe will buy this in
3
2
1
frighteningly plausible :)
Except the log in system seems broken.
Except?
This looks extremely complicated compared to Pixcap
Can you give me your female rig you use in this video
blendswap.com/blend/23521 :)