Vroid - FREE Webcam handtracking !!
Vložit
- čas přidán 14. 11. 2022
- Track your hands with just your webcam…for FREE!!
A new, free webcam tracking app was released recently and I saw that not many people seem to know about it yet!
Links:
Link to the app:
booth.pm/en/items/4275972
VSeeFace:
www.vseeface.icu/#download
Our Discord, the VtuberLibrary:
/ discord
----------------------------------------------------------------------------
Music:
"Muffin Shuffle" by Streambeats
---------------------------MY SOCIAL-------------------------------
🐦Twitter: / theladyaska
Twitch: / ladyaska
Booth: ladyaska.booth.pm/
Ko-fi: ko-fi.com/lady_aska
Patreon: / ladyaska
#VTuberguide #Virtualyoutuber #ENVTuber #VroidStudioTutorial #VroidStudio #Vroid
#Vtuber tracking
Little head's up for everyone struggling to get the app to connect:
You have to manually add the DSSbodytracker app to your firewall exceptions.
(Control panel-> System and Security -> Windows Defender Firewall -> Allowed apps)
I also recommend this tracking more, if you can pare it with iphone or another camera (like your phone camera even), so that you get your hand tracking from the app, but the facial expressions through iFacialmocap or another application :)
hey so it still doesn't work, it keeps giving me the "Windows cannot acces the specified device, path, or file you may not have the appropriate permisions to acces this item" and I already did the firewall stuff
@@arctos_lupus8288 Ok, so when does this error exactly happen?
Sounds like a problem with your webcam (my hot guess).
@@LadyAska whenever I start up the program, I double click it, it tells me to run it.. and boom error
@@arctos_lupus8288 Ok, but does your webcam work fine outside of this program?
@@LadyAska it works fine
Consize and straight to the point. I like it.
This took me to long to find like nobody makes free hand tracking with webcam THANK YOU
If you want something more elaborate, I would suggest trying warudo too!
The problem is you have to give up face tracking for it. Imo, not worth it. Vseeface needs a hand tracking integration with webcam.
I totally agree.
This solution works best if paired with a phone, that takes over the face tracking.
You can either use an app to turn your phone into a second webcam or use Meowface/Ifacialmocap for Android/iPhone respectively.
But I would also welcome it, if VSeeFace just had their own hand tracking integration, like webcammotioncapture.
12seconds in. My brain went "MISTER BEAST!!!!!!"
thank you for the quick and easy tutorial
You are welcome! Glad it's helping :3
Thank you! It worked for me. Now I just need to get my expressions to work. Doesn't trigger sadness, happiness etc when I try to make the emotions with my face lol
I can give you a little hint already, but there will also be a video about thst in the future.
If you use your webcam for hand tracking already, you won't have another device to track your face (if you don't have a compatible iphone for tracking)
If you have any phone with a camera, thereare various apps out there, that can turn your phones canera into another webcam so to say, which you could then use as your seperate face tracking device.
They usually get picked up pretty well by VSeeFace too :)
@@LadyAska Thanks! I figured out a way to do it 🤗
This is awesome, thanks Lady A.
You are welcome! :D
Thanks for the wonderful video!
I am so happy that I was able to finally release one again this week! :3
Thank you, you helped so much! :)
Glad it helped! :D
Thanks for sharing Aska
You are welcome :D
Thank so much, Great tuto! it work verry well!
Awesome that it helped you! :D
That thing glows
its working thank you so much
Awesome, enjoy! :)
great tutorial!
Glad you found it helpful :)
Do you know how to open camera settings while in VSeeFace? In OBS it's easy to do, but in VSF? Like I want to adjust some setting, like Hz and exposure
I don't think you can change the camera settings at all, because VSeeFace is using your camera "as is", for the tracking.
At least I am not aware of such an option :)
Just tested DSSbodytracker with VSeeFace, but looks like the finger animation is like super slow animated in VSeeFace. Any Idea why ?
I suppose your PC can handle running these two programs together?
Besides that, I can only imagine it being a problem with the protocol itself, but all that would be on the developers.
I have problem with using it. My mode wrist looks warped when moving it. Not sure how to fix it. I notice you didn't have that problem with your model. Is your model VRoid Studio made or custom made using other software?
It's a standard Vroid model.
Was your model modified by any chance?
(I know of Vroids warped ankles, but the wrists were usually ok :/ )
Muchas gracias
thanks Lady Aska!!
You are welcome! Have fun! :)
Hi! Im having issues with VseeFace, im not getting the option for a virtual camera no matter what I do, DSS is working perfectly but VF is stuck on a T pose, any ideas?
So your only option would be your webcam, (which now is in use by the DSS tracker) and you are unable to change it to any other camera option (not even on startup)?
I never heard about that problem...if you don't use the DSS tracker, can you set a virtual camera before in VseeFace?
If yes, do that, as VF will save that option.
Then set up the Port, to receive the DSS tracker, as shown in the video.
TNK YOU!!!
Happy to help! :D
Does it work with VSeeFace if you import your own custom model? (Not make with VRoid. Made with Blender y´know?)
Or if it has two "skeletons" or "armatures"?
I couldn't test that yet, but I imagine that it either won't work or look more wonky as it was optimized for Vroid models.
Feel free to test it yourself, if you have a non Vroid model available and let us know how it went. :)
@@LadyAska It worked! But it looked horrible! I guess i gotta wait for a leap motion device :-D
@@iEL_Rivale Thank you for the follow up! :D
@@LadyAska You are welcome!
Hi! Thanks for the free hand tutorial! But it seems like VSeeFace stop the Audio Lip Sync when the OCS/VMC receiver is eneabled? (at least that's my case) Maybe you know a way to fix this? Thanks!
I didn't hear about this yet. Maybe you should ask the VSeeFace Developer about this one, because that wouldn't be good in general, no matter with which other application VSeeFace is paired then.🤔
This is her Twitter/X account and she is usually open to feedback.
twitter.com/emiliana_vt?t=UOvtZXGAwmI8qvFz64gfdA&s=09
@@LadyAska Thanks for the quick answer! Yes, I already contacted the Dev a few days ago, still no response yet... So this is a new bug? Haven't you noticed this when recording your tutorials? (just curious hehe)
Hi lady aksa. Thank you for the tutorials. The first downloaded application won't open on my pc. Any idea why?
Hello! Do you get any errors?
And did you unpack the app completely?
(without more information it will be really hard for me to help 😶)
Hey, so im struggiling a little bit, do i need both of the apps VFace and the other one, or just one for them? I dont really understand, its my first time so yeah 😅
Hello! So you would need this app shown in the he video and the VSeeFace app(also shown in the video)
The idea is that you only send the hand tracking over and that you will track your face over Meowface (android) or ifacialmocap (iphone) , that get also send over to VSeeFace.
(now that sounds even more complicated, doesn't it 😅)
@@LadyAska yea 😅😅 basiclly both apps?
Running into an issue where I select my OBS Virtual Webcam and my model in VSeeFace completely stops moving... I have the port setup complete, and the virdual camera in DSS is running... what am I missing?
Did it work before you switched to the virtual webcam?
I am asking, because the tracker is weirdly sensitive.
Which means first: your webcam has to be used by the tracker "first", which means, you have to open the tracker program first and VSeeFace, when you open it and it was set ro that webcam, will give you a message like "no webcam found".
Then start the tracker and see if it translates over.
In the pinned comment I also gave a little guide on how to work through the system settings, in case they block communication.
@@LadyAska Hi, I'm having tha same issue, tried everything in the comments and still not working:C
Hey Aska, is it possible to export the tracking data to Blender or other animation software?
Hello! I tried that, but so far no luck...my test was with Unity, with a plugin that could receive the data over OMC...but I couldn't get it to be imported specifically for animations.
So while the transfer from my tracking/posing etc. was successful, I couldn't "use" it after in any meaningful way.
If you have more luck, let me know :)
@@LadyAska Thank you for the quick reply!
I'll let you know if I manage to get it working.
I am a minimum wage worker i have been waiting for something like this forever! Oh i can't wait to install this and try it myself.
Then I really hope it does work for you! :)
See the pinned comment for additional advice, in case you are having trouble setting it up.
I have two questions: Q1: I could not make lipSyn like you correct I try my best I cannot any suggestion ? Q2: I found on VseeFace " load and paly auido" on General sitting But how it is work ?? can you please show me this
For the lip sync you need only your mic, to have the audio drive your mouth and not your actual mouth movement.
But if that isn’t for you and you want move your head and mouth like they move in real life, you would need a second cam.
Like a phone that you can use as a second webcam for example. :)
I never tried the load and play audio option. Where did you find that one? Thank you!
Ok, thank you so much fro your answer... if there is way to meet you please I need your email>> if cannot no any problem ..thanks :-)
i have add ddsbt to allowed apps already
i tried with obs running and closed,
i use my webcam, put 3333 number on both apps
but my model still in t-pose on vseeface
It could be a number of things.
Is the app at least working if it isn't paired with anything?
And do other apps work normal, when you pair them with VSeeFace?
(if you ever tried that)
It will be very hard for me to help you from here, sadly.
@@LadyAska it's not paired with nothing, i've not tried to pair other apps with vseeface yet, i'll try
Thank you, but the hand is shaking what is the solution during the move???
Try downloading the original project VRigUnity and see if you get better results.
Apparently this one is just a bad made copy.
(which I wouldn't know, if the original creator didn't reach out to me)
Thank thank you so much :-)
My avatar in Vseeface T-poses then never unlocks at that point :(
Try the app from the original developer instead, it's called "VRigUnity" and see if you got more luck with it.
I didn't know, that the software in this video was basically a rip-off, of another program.
@@LadyAska I'll look into that, thank you.
doesn't work for me, whenever I have face tracking enabled on vseeface, it crashes when I click wmc send
What are you using for face tracking? :)
I thought it was obvious that the webcam can only work with one thing (either the hand tracking or the face tracking), which means in this case, face tracking has to come from another camera (like a phone for example). I apologize that this wasn't clear.
If you are using another source for your face tracking already, give a look how much processing power is used for everything together and if that causes the problem.
(in which case I would just leave the hand tracking out for now, if you are streaming for example )
@@LadyAska I did'nt know the thing about one camera for one tracking, but even if I disable face tracking it still does not work. Does it work with like an Iphone 5 ?
can you possibly play vr games with this? just asking...
With the webcam tool?
No, it doesn't replace VR trackers or anything.
With the model itself? Yes!
Depending on the game you try to play, you have to use different methods to get to use it in VR.
can we use it in games such as Roblox and gorilla tag ??
Not that I know of unfortunately.
This is more for people who stream and want hand tracking on their Avatars.
You can't use it to replace VR trackers or the likes.
is there a way to mix this with vrchat?
Hello! Not that I am aware of sadly. :/
Really odd tip. Dont expose your sholders if your bigger. For some reason it thinks my left sholder is my left hand.
Thank you for the tip!
I saw some trackers would pick up on the background as well.
The more your hand can be made out from the rest of your body, the better, usually :)
is it safe? to download? cause it says it might put my computer as a Risk. 🙏
It's a free to use software made with available resources online, but all in all was only made by one guy.
Usually they have to put a warning up, that any software that is not specifically licensed , is a potential risk for your PC.
I recommend that, if you don't feel safe using it, don't use it.
I can't guarantee if the program will have any potential risk attached to it, I found it, tested it and told everyone about it and my PC didn't light up in flames yet or displayed any other trouble.
will this work on facerig?
If facerig allowes for the VMC protocol to be received, then yes.
I know VUP for example supports VMC.
I don't know about Facerig and you would just have to see, if you find a VMC option there.
It will work with the same port then and all :)
Can I make it 2d and not anime?
Probably not, at least not with this one, as it's pretty clear, that it only seems to work with the Vroid standard.
(Maybe with other 3D solutions too, but I haven't tested that yet)
But it won't work for 2D.
OBS virtual don't appers on camera options
Hello! I think you have to have OBS installed for it to appear (but not sure, since it was always an option for me)
Let me know if that solved the issue!
can i use for handtracking on vrchat?
I don't know enough about Vrchat yet, to know what is compatible or not, sorry 😅
suggest low graphics requiment software
VSeeFace can be customized to work on a "potato"-mode. Which means even a PC with less than optimal processing power should be able to run it.
If you are talking about low graphics requirements, I suggest looking into PNG-tubing.
As working with 3D models inevitably use more graphics power.
You are welcome.
@@LadyAska Where i can find this options
my mouth is flickering when when i add this but everything else work
That's why it's best to pair this, with a camera just for face tracking.
You can either use your phone as a second cam, with a phone to webcam app or based on which type of phone you have select one of the available tracking apps for it.
For Android I recommend Meowface and for iphone, ifacialmocap. :)
Thank you for the reply but I have a face camera with my setup. It vseeface works perfectly capturing my face. It’s just when I set up the hand tracking it gets jittery
i’m on ipad, can you make a tuto for ipad?
lHello! Can you explain to me what you mean? Like the ipad as a webcam?
@@LadyAska Because on iPad for me is pretty hard to use and idk how to do the face tracking or hand tracking on my iPad, I'm sorry if I'm bad at explaining
@@PARAPPATHERUBBER I’ll look into it.
I don’t have an iPad, but an iPhone.
If your iPad has the “unlock through your face” feature, you should be able to install a tracker on there and use it basically as a webcam.
BUT in this case I would suggest to use it as your face tracker and not for your hands. ( that would be kind of a waste 😅)
Do you have anything else, like a phone or a regular webcam, that you could pair with your iPad or are you in general more using it as a PC replacement. (Meaning you are running VSeeFace on there, instead of a PC)
@@LadyAska Oh okay thank you!
@@LadyAska I do have a PC I'll ask my dad to download it
and can i use it as webcam on discord???
There is a way to set your avatar up for Discord (instead of a webcam of yourself)
If you like, I can make a separate video about that and how to set it up. :)
@@LadyAska ok that gonna helps me thanks
Why is it so slow?
That could have multiple reasons.
The app isn't slow per se, as you can see in the video.
So maybe your PC is not able to handle it.
I am not the developer of this app, so I don't know if it does have some limitations for example.
It tells me that it could compromise the computer
I recommend getting the original version.
Without me knowing, this isn't the original version of the software.
Either way, this message is normal, as this program was made by an independent developer.
So for security reasons Windows wants to make sure, that you know that and that you understand the risk that theoretically comes with software like that.
(so in short: even if this isn't harmful, windows has to make sure that you take responsibility)
Here the link to the original software.
(also by an independent developer)
github.com/Kariaro/VRigUnity
The link is unvalid
Thank you, for letting me know.
Will check if there is an update to it, otherwise I will remove the video, if the program isn't available anymore. :)
(as said, I am just sharing the program, I am not involved in the creation)
I checked the link and its still working, so there must be a restriction for you, that has nothing to do with the validation of the link itself. Maybe try to acess it via a vpn
Not working for me 😢
What exactly isn't working?
Maybe we can figure it out.
Did you try the troubleshooting mentioned in the pinned comment? :)
@@LadyAska oh, it actually worked after 5 minutes, the hand tracker just gave me a late response
Deutsch? xD gutes tutorial
Ja, wissen nicht viele ;)
@@LadyAskaIch finde das hört man einfach raus was ja aber nicht schlimm ist.
This does not work...
is this a scam
What do you mean?
This is free software, that is not taking any of your information or money..
The thing I didn't know, when I recorded this video, is that this is not the person's original work.
It was an unfinished prototype of another developer, that this person took and released as his own.
The original software is still being developed and updated.
The original software is called "VRigUnity".
@@LadyAska my dad said it look like a virs and i trust everything my dad says so very sorry if i ofend you
virus*
@@AvaGirlGamingOffical No offense taken at all, since I am not associated with any of this. I was just wondering where you took the "scam" thing from, but I understand now, that you meant "virus".
Some Indie developer programs may look less polished, but that doesn't mean they are or contain viruses.
If you wanted to try it, better get the original developers work though, instead of this.
didnt work
Did you try the solution mentioned in the pinned comment? :)
@@LadyAska no i asked my friend now it works