Simultaneous Hand and Controller Tracking Setup

Join our in-person XR Hackathon in Berlin and win up to $25k in funding and prizes 👉🏽: www.xrcc.events/
In this video, we set up a Unity project to use both hands and controllers simultaneously. This is a new feature called multimodal which was released with the latest version of Meta Interaction SDK v62.
Meta XR All-in-One SDK:
assetstore.unity.com/packages...
Meta XR Interaction SDK OVR Samples:
assetstore.unity.com/packages...
Multimodal Documentation:
developer.oculus.com/document...
Are you serious about becoming an XR Developer?
Check out learn.immersive-insiders.com/
✅ XR Programming & Design Courses
✅ Private Discord community
✅ Optional 1on1 Coaching
✅ Interactive Live Classes
✅ and much more
🔔Subscribe to our channel to get started in AR/VR for Development, Business, Design, and much, much more: 👉 / @dineshpunni
🔻Let's connect!
Website: immersive-insiders.com/
LinkedIn: / univrsitas
🔻Let's collaborate!
If you have any questions leave them in the comments below,
for business inquiries contact us via e-mail: [e-mail]

[@immersiveinsiders]

UPDATE: Make sure to use the updated Meta All-In-One SDK v62 and then you can set this up with Unity Editor v2022.3 as well.

[@salsicha2]

Nice, Very good tutorial! thanks very much!

[@user-kd6lb7or9i]

how to solve this error:Unable to process a controller whose SampleRateHz is 0 now.

[@EnolaG]

Hi, is it possible to show just hands but also track the right or left controller and use it's position eveven if out of the hands? For example, when I want to attach an object to the controller and have it in my view at the specific positon.

[@immersiveinsiders]

Absolutely, even when you are they are not seen they are getting tracked. You can use use the OVR controller script to get the tracking data.

[@elefantopia]

Quest this is 3 only

[@byullmoon]

help me. i try to instal the sample package but i get authentication errors and it tells me that package is licenced and i dont have it's licence. what should i do

[@immersiveinsiders]

You can get free Unity licenses. unity.com/pricing#plans-student-and-hobbyist

[@steamgamer9]

I did exactly what you did, hand tracking works, but after disabling the Controller Tracking left & right, controller doesn't show at all. Also does this work on Quest 2?

[@martindbp]

Also wondering if this is Quest 3 only?

[@martindbp]

"Hardware compatibility
Quest 2 with Quest Pro controllers
Quest Pro, Quest 3, and all future devices."
So does not work with Quest 2 original controllers

[@steamgamer9]

Can you share the link to the page please? And thanks a lot for the reply!@@martindbp

[@matthewnemetchek1990]

How does one do this on unreal. I really want to figure it out. Please let me know if you know how

[@immersiveinsiders]

I don't think this is available on Unreal. Did not find any reference to it in the documentation.

[@matthewnemetchek1990]

Thanks for looking around
@@immersiveinsiders

[@daslolo]

The hand disappears a few seconds after I pick up the controller!
Is there a setting in the handset?
Or maybe it's v65 that broke it all...

[@immersiveinsiders]

Search for the OVR Hand Component and make sure the "Show State" is get to "Always"

[@daslolo]

​@@immersiveinsiders nope, it's just that quest 2 doesn't support simultaneous

[@immersiveinsiders]

@@daslolo Oh yes, sadly it's a hardware limitation. Quest 2 + controller from Quest pro would work.

[@daslolo]

@@immersiveinsiders too bad the Q2 unit count is 10x that of the Q3 because I'd so make a hybrid game and hand tracking in Q2 is weak at best

[@WmexD97]

Is it possible to do it in Unreal Engine?