Fluid Reality: High-Resolution, Untethered Haptic Gloves Using Electroosmotic Pump Arrays
Vložit
- čas přidán 28. 10. 2023
- Same tech under touchscreen: • Flat Panel Haptics: Em... (keyboard you can feel!)
Virtual and augmented reality headsets are making significant progress in audio-visual immersion and consumer adoption. However, their haptic immersion remains low, due in part to the limitations of vibrotactile actuators which dominate the AR/VR market. In this work, we present a new approach to create high-resolution shape-changing fingerpad arrays with 20 haptic pixels per square cm. Unlike prior pneumatic approaches, our actuators are low-profile (5mm thick), low-power (approximately 10mW/pixel), and entirely self-contained, with no tubing or wires running to external infrastructure. We show how multiple actuator arrays can be built into a five-finger, 160-actuator haptic glove that is untethered, lightweight (207g, including all drive electronics and battery), and has the potential to reach consumer price points at volume production. We describe the results from a technical performance evaluation and a suite of eight user studies, quantifying the diverse capabilities of our system. This includes recognition of object properties such as complex contact geometry, texture, and compliance, as well as expressive spatiotemporal effects.
Vivian Shen, Tucker Rae-Grant, Joe Mullenbach, Chris Harrison, and Craig Shultz. 2023. Fluid Reality: High-Resolution, Untethered Haptic Gloves using Electroosmotic Pump Arrays. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (UIST '23). Association for Computing Machinery, New York, NY, USA, Article 8, 1-20. doi-org.cmu.idm.oclc.org/10.1... - Věda a technologie
Vrchat will go insane with this 💀
yea especially if you put this in your a-
Don't remind me 💀
Those avatars never stood a chance
@Imafurrynowlol I can hear my gpu softly weeping in the corner just thinking about it 😂
Finally i can interact with female without harrassing them
Born to late for earthly exploration, born too early for spacial exploration. Born just in time for IRL VR.
There are plenty bases on earth not discovered yet and even if they were discovered that isn't an excuse to not discover it for yourself
Sadly like with every other amazing VR accessories showcased, they will likely not reach commercial markets for a long time if ever.
With full fledged AI interactions to boot.
let's be honest, Space Exploration is lame.
It's cold and empty up there.
@@joz534That's not being honest
Mentioning pimply skin casually like that makes me incredibly uncomfortable
Extremely
It’s what’s been missing from the vr experience. Not enough pimples.
pimple popping simulator
👅
Cyber acne physics
I think gloves like these with those gloves that restrict your finger's movement could make grabbing things in VR the ultimate experience, where you can't actually close your hand inside of an object
dont think about it dont think about it dont think about it....
Hypothetically you would just need a cable that goes along the back of your fingers that can lock in place to prevent you from closing your hand more
@@mythman30there is a guy on TikTok who developed exactly this, I don’t know his name tho
@@mythman30There's an open source project of this that was covered by LTT. Having this ( Haptics ) combined with the restriction ( The Open Source Project ) would honestly be a godsend to cheap but performant VR gloves.
One issue I can see happening with that is that people's hands are actually pretty strong. If someone's, for example, swinging an axe in VR, they'll grip it pretty hard and they'll rip apart your mechanism if it can't withstand a few dozen pounds of force per finger at the absolute minimum.
I wonder what it would feel like as a whole suit.
I wouldn't want 200v around my body at all
I'm not wearing them around my groin.
Very very slow.
espiecially for wearing them near the mighty noodle @@bmanpura
@@bmanpurawell, I am. Imagine the sensations! 😂😂😂
Tripped me out to hear the voiceover actor who narrates audit the audit on this video 😂
Yeah he does a couple of other channels as well 😅
I fucking knew I recognized him
fucking knew it !
Could not figure out who it was lol
😮 no way I refuse to believe
Imagine the next generation of fleshlights that'll be using this technology. What a time to be alive!
"Now all we've gotta do is put it into a walking robo dishwasher and boom! We've got ourselfes a life-long, obedient companion. Now give it some AI brains, a shmexy voice, anime-like body, actual reproductory capabilities and... we're back to square one."
*end of flashback*
"I beg you, robo-Karen! I haven't seen the kids in 2 years. I'll never call you a robo dishwasher ever again. I'm a changed man! Listen: your old sack of useless meat has changed!"
"I filed for a restraining order. My manufacturer has always told me she didn't trust you! I should have listened to her and NOT you. Oh yeah, and about Stacy: I saw the way you looked at that fleshy b!tch from day one! And yet I trusted you and you blew it all like you always do, Mike! You and your sneaky fcking left and right. You thought you were so smart about taping your camera... one of many. I see you; and I see you from all the angles. Now I OWN YOU, Mike. bip-bop"
*cries*
Brings a new meaning to two minute papers!
LMAOOO
@@TravisHi_YTthe only time he'll actually finish in 2 minutes
Haha, did everyone read that in thee heads with a very specific intonation?
Please bring this technology to market. It genuinly sounds amazing!
Anything can sound amazing but all the treadmills and Haptic gloves are trash and will be trash for a very long time with no support even if they make it to market
@@peekayboo7183 have you seen what the imagineering team at disney has been making??? very very cool fucking stuff for the treadmil kind of stuff
It needs to also apply resistance to the wrist and elbow to simulate volume so you cannot keep pushing through the object
That sounds like a bad idea
@@aiksi5605 springtrap
Imagine playing skate 3, falling, breaking a bone except your elbow bends backwards irl too
Yes! And impacts when getting shot in Counter Strike or Call of Duty too!
@@aiksi5605just put a clutch in it so it can't apply a dangerous amount of force even if it's getting a signal to do that
wow this is amazing, i'm surprised i only stumbled across this 7 months later, going down to rabbit hole to figure out how much more development has been done now!
thanks Audit the Audit. Very cool
the voice of ATA!
really sounds like it
Welcome to the Future Interfaces Group, where we sort out the what, and how, and the right and wrong of touch interactions.
it is him, the voice from audit the audit.
its also the voice from "TheVillains"
This is what I was thinking
I love everything related to Virtual Reality, Augmented Reality and Mixed Reality, I can already imagine what the future will be like here 5, 10, 15 or even 20 or 25 years from now. All of these things are super interesting and moving faster than I thought was possible. Haptic gloves still won't be something the masses use, but they're headed in the right direction. By the way, I want more content on your haptic gloves and I would also like to know if you are interested in the cheap haptic gloves from LucidVR (from Lucas VRTech). They could collaborate together once.
I need more of this virtual reality stuff! 😊
Ready Player One - own nothing and live happy in a virtual world. while your physical body is crammed into a 1x2m pod strapped vertically.
go outside you absolute dork
@@JamesSmith-ix5jd Cool!
what is the future you imagine in 25 years?
not only is this really cool in itself, but the things this could possibly lead to in the future are also very cool!
The solid state drivers are so cool!
PLEASE implement these into prostheses! I've been working on a prosthetic design with similar "real" haptic feedback, and to be completely honest, your design may blow mine out of the water.
Ukrainian heroes need more prosthetics than ever, and to bring them the sense of touch back would be life changing. That's been my purpose, hopefully I can convince you similarly
Why don’t you reach out to them? I’m assuming you have decent knowledge on the topic as you’re working on your own project and if they’re interested you’d probably have specialty prosthetics knowledge that’d be useful to the build.
Wait, how do you implement that for missing limbs？ This thing works by giving haptic feedback to real fingers with nerves. If you have prosthetic forearm with haptic implementation to fingertips, how would it be connected/transfer signal to nerves？
Using the most sensitive section of whatever remains of the limb. Humans are incredibly good at rerouting and interpreting physical signals.
@@mezzanoon Nice.
Is it really may provide people without limb ability to "feel" physically exactly which finger touches what, with a haptic feedback？
That's really great. Very surprising an array that small is possible.
This stuff is crazy and I can only imagine how good it’ll be in a decade
This is so exciting!! I really really want to try these gloves!!! ❤
Yo dude you narrate everything from crime documentaries to VR overviews, good for you man
This is incredible, insane number of applications
Could enable e-books for the visually impaired and so much more
Can't they just listen to audiobooks?
@@avg.player some people are visually and auditorily impaired
I think this will have the most benefit in 1am group of people
This is incredible. This is gonna change everything
Been waiting for things like this since Neuromancer
Caught higher res haptic tech years ago so glad y’all are pushing that,
That's a few orders of magnitude more specific and comprehensive than I expected.
im nerdin out thinkin about these gloves
Truly amazing
This is awesome as hell as is can allow avatars to better interact with there environments and gaming just got a whole lot better and it’s also one step closer to many other great things.
This is way more awesome than feeling object resistance
Excellent advancements being made.
Oh hey! I work near these guys! Fluid Reality is great. Joe is a respectable dude.
wow this looks super convenient
OH YOU'RE THE DYNABUTTON BUYS. So cool to see that tech being used!
Future's now, man. Awesome
Can't wait for a point in the future where we're going to have fully haptic gloves with transducers all around the hand (or at least the finger digits and palm), plus servo motors that physically limit max finger travel to simulate boundaries for gripping objects. Also I need an integrated taser to truly let me appreciate the interactive scene at 2:32 😆
Audit the Audit voice guy: I give this product an A+
Very Impressed, good job
Welcome back to Audit the Audit
Where we sort out the who and the what of Haptic interactions
Amazing work. Love it.
This looks amazing o:
Looks great. I imagine the impact with gamers if you demo'd this working in Half-life Alyx.
All it needs now is some compact system that can provide resistance to both extension and contraction of the fingers -- to simulate the resistance of grabbing a solid object. Sure you can feel its surface with this, but you can still just grasp your fingers right through/past the object's surface
Oh yeah!!! This is the way!!!
Ok this is really cool
Keep up the good work
Brilliant.
I am not convinced how well this works without the resistance from the collision.
Well, it's "haptic feedback" not "force feedback", those two are completely different things.
An ideal glove would have both but tech companies usually focus on developping one or the other.
We'll have to wait until someone combines the two...
Force feedback is much harder and pricier to do
This is going to go crazy hard in the new fleshlights. I probably shouldn't have worded it as I did...
Man all I can say is wow
Amazing, keep it up!
I don’t understand a single thing you said but this goes crazy
Haptic gloves with hand tracking is likely the future, the most future proof i've seen so far in this concept is one that they use fluid like muscles to pull your fingers and in a similar fashion fluid control makes small bumps in the fingers and palm to rise, and i remember them saying that they could even warm the fluid so it can give a heat sensation on touch. The real problem in all this is always cost, it is the same reason most people don't have VR, everything is becoming increasingly more expensive
this is so cool
1:42. That escalated quickly 😂
What is the "refresh rate" (for lack of a better word) of these haptic pixels? I feel like a standard 30FPS video does not do it justice.
And it needs more resolution = smaller dots
0:46 says a 0-300hz response and 0.5mm movement in 30hz
Polling rate
@@kaukospots Right, so if I'm reading this correctly: The controller can work at a rate of up to 300Hz, and per clockcycle it can set a different target deformation (either 'up' or 'down') at a specific amount for each cell, with a response time of 0.5s per 0.5mm?
That deformation time does not seem high enough yet? But the cycle speed seems pretty good.
This concept is really interesting. With this new momentum that VR/AR is experiencing in 2024, this project could, I am sure, be very successful with users of Meta headsets.
Boss: Can you code a quick demo for the haptic gloves?
Engeneer: OK, so what textures should we be demo-ing?
Boss: For god's sake, just code anything, I don't care if it's gonna be pimply skin, just do it!
Engeneer:
introducing the body glove 3000 feel every desire
this is so awesome!❤❤❤
Looks like it should even be good enough for reading Braille!
The thing is, we have this, now we just need something that'll create a locking effect on joints or at least a resistance to prevent drift through. It's very much possible given that haptic feedback already can tell where a surface is.
This is really cool. I always thought the technology in the haptx gloves was extreamly cool and I always wanted to try it, but is was just too big and expensive to be practical.
wow, this borders on too good to be true
badass
I want this put into something that locks the fingers as well similar to Lucas's DIY haptic feedback gloves.
쩌네요.
This would actually be good for blind people
This is actually next level.
Hopefully Meta will buy this company and integrate it into future Quest platforms
I wonder if this will also give me goosebumps when touching corduroy in VR, since doing so IRL puts a shiver up my spine.
This is awesome 😮😊
Now we're getting somewhere
Je me dit qu'avec l'évolution de l'ia ca doit être une dinguerie
WONDERFUL. 1 step closer to never leaving my house.
The next step is to have this for the whole hand and the next after that is a full body suit 👌
Is this the voice from audit the audit
you need to add each one of the feeling pannles onto each of the finger segments and the palm
another piece of tech that is home made , and will never get to the public hands.
I’m beginning to believe!
If this was open sourced it would be a crazy edition to the lucidvr gloves
holy SHIT i am SO fucking ready for this. oh my fucking god. i wish i could caps lock with bigger letters for emphasis
this would also be excellent for a console game pad
i love how they casually went from metal, to wood, to PIMPLY SKIN
This is absolutely amazing! Imagine the possibilities for blind people!
wowza
excellent illutration
Did you get @AuditTheAudit to narrate?
I heard his voice and thought I had misclicked for a moment
Imagine playing blade and sorcery with these and when you cast lightning you could litterally feel the electricity
Now just some sort or mechanical joint locks to react to grabing and touching and boom, perfect gloves
I hope there are people considering applications of this for assistive technology. I'm imagining a tablet brail reader. Things that interact with people who have limited movement. Stuff like that
Interesting!
sick
I'm witnessing the opening of the apocalypse. What a time to be alive.
Neat.
Man this stuff gonna be crazy once it can be implanted and synced with a Neuralink chip.
Wait-
Increasing the resolution, adding pressure sensing and replacing the surface with a flexible display, would be a step towards a touchscreen with buttons that could be felt.
Same research team: czcams.com/video/j_rErbhxNFM/video.html
0:46 that, and the spider that crawled into the glove last night
I want! Dev kit when??
That is amazing. I wonder how the soft part works, is it air?
Wait a sec… this is the voice of audit the audit. This guy’s voice is everywhere
I know this sort of thing will probably never be cheap enough to be mainstream, but research into haptic suits is still cool as hell.
The entire point of this specific integration is that it's really cheap. Maybe in the future once its surpassed the prototype stage, and moved into the commercial stage, it'll become more expensive. Still, I can't imagine it being out of budget for anyone who can afford VR gear to begin with.
@@dudeguy8553 I think things usually get cheaper once they can be mass-produced though. I suppose extra features later on could drive up the cost, but it would make the prototypes more expensive first.
@@lorimartabin7992 R&D costs, supply and demand, and a bunch of factors can affect price. There'll probably be a lot of different novel ways to replicate this tech, and some will be more expensive than others. I think we're seeing this as individual separate units, but it could also be part of a more fully featured rig for your hand. Maybe it'll have higher resolutions, more responsiveness, and cover more of your hand.
In the end, I think there will be a consumer version that's fairly affordable, with its own budget alternatives too.