How Holographic Doom Works on a Lightfield Display!
Vložit
- čas přidán 9. 06. 2021
- We test out creating holograms from our phone portrait photos and playing holographic Doom in the Looking Glass Portrait lightfield display! Now that this display is shipping to crowdfunding backers, we get our hands on one to test out the software for importing photos, OBJ models, and even unity games. Here's why this device finally feels like the kind of tabletop hologram we've seen in movies and science fiction.
Learn more about the Looking Glass Portrait at lookingglassfactory.com/portrait
Shot and edited by Norman Chan
Join this channel to support Tested and get access to perks:
/ @tested
Tested Ts, stickers, mugs and more: tested-store.com
Subscribe for more videos (and click the bell for notifications): czcams.com/users/subscription_c...
Twitter: / testedcom
Facebook: / testedcom
Instagram: / testedcom
Discord: / discord
Amazon Storefront: www.amazon.com/shop/adamsavage...
Savage Industries T-shirts: cottonbureau.com/stores/savag...
Tested is:
Adam Savage / donttrythis
Norman Chan / nchan
Joey Fameli www.joeyfameli.com
Gunther Kirsch guntherkirsch.com
Ryan Kiser / ryan.kiser
Jen Schachter www.jenschachter.com
Kishore Hari / sciencequiche
Sean Charlesworth / cworthdynamics
Jeremy Williams / jerware
Kayte Sabicer / kaytesabicer
Bill Doran / chinbeard
Ariel Waldman / arielwaldman
Darrell Maloney / brokennerd
Kristen Lomasney / krystynlo
Intro bumper by Abe Dieckman
Thanks for watching! - Věda a technologie
I love that one of the first things people try with new gadgets is making Doom run on it.
With 2d monsters! 😂
Almost all consumer tech gets tried out with porn but CZcams wouldn’t allow it.
Either that or a Turing machine
Well... way back when, I loved my MetaByte card -- it has stereo drivers so that you could run any 3d game in shutterglass 3d. 'twas amazing (you should see HalfLife)...
The bad part about this LookingGlass is that it needs that quilt and there's no "I know it's gonna suck, but let's render an OpenGL quilt here." (The resolution isn't too high, but you gotta render 48x perspectives per frame (!).
Unity is where it's at right now...
These would be really cool in a gallery for 3D artists to display their work.
As a 3D modeler I deffinitly feel drawn to this, so 100% agree
I guess it is kinda off topic but do anybody know a good website to watch newly released movies online ?
@Bentlee Fabian Thanks, signed up and it seems like a nice service =) I appreciate it!
@Ares Spencer You are welcome =)
Finally the future is near where we won’t look dumb trying to look around corners in shooter games.
I can still put the extra oomph in my punches or just make that jump if I just mash them buttons harder.
@@burtenplays Good advice but don't forget to shout "hi-ya" if you really want to juice those punches.
_'We'_
Got a mouse in your pocket or something?
Always disable 3rd person on your servers... Ban the dweebs!
When he peeked around the corner in Doom, without moving the controls, I lost it.
Thanks for letting Norm get his hands on your unit, Jeremy. It was fun to watch what he did with it.
😂
Make it a touch screen with haptic feedback and you've got the next gen of smartphones. Imagine pushing a button on screen, feeling it click, and seeing it retract. Popup messages would actually "pop", etc.
you could just make an app that does the same anyway
I previewed an early concept of one of these back around 1995 when working at an optical device company. The developers had the concept down and used a CGA resolution display to show a 3D molecule model. It was pretty cool and I wondered why it never really took hold since way back then. I wonder if its some of the same folks.
15:08
It's not just a "lenticular" display, which is very old tech. No, it's a light field, which means that even with one eye closed, you will still be getting depth information in terms of focus. You should try adjusting the focus on your camera while a still image is being displayed. You'll see that while foreground images get blurry, the background will come into focus. That's nothing that any lenticular display could ever accomplish. It's also why light fields are so promising for VR and AR applications - they make it so your eyes can actually focus naturally on objects like they would in the real world.
It is incredible how well the effect can be demonstrated on camera.
Love your face. Best of luck!
Pretty impressive, can’t wait to see later iterations
Wow that's incredible. Imagine 10 years from now all content is shot with 3D capable cameras and then consumed via 16k ultra high resolution television screens.
I got the Lume Pad, made with Lightfield technology and it makes picture and videos into 3d on the fly. Plus you can take 3d pictures and videos with it. I will be making 3d video games for it.
Great tech, I could see this scaled up to consumer TV'S in a decade and even having TV shows and Movies shot with depth cameras. Fantastic stuff
The company already sells a 4k monitor version but you have to contact them to get the price so... Costly. The benefit being that even higher definition means the glass element is thinner.
@@TalynStormcrowthe 65” is aimed at enterprise priced $50k. They have 16” oled version coming soon for $3k. The next generation of the Portrait is called the Go. Screen is a bit smaller but higher pixel density and much sleeker form factor. It’s $300 but you can get it for $230 early bird next few days shipping in June. This stuff really has to be seen in person to appreciate.
In case you’re here only to see Doom itself running: 15:00
As a 3D monitor and VR user to this day.....
***Early Adoption sweating intensifies***
I wonder if we can display 3D photos taken on the 3DS here.
This makes me wish games gave support to export your player or game models, with animations and stuff.
Because imagine exporting your Destiny character in their outfit, with gun twirlling and shooting animations against some backdrop (or any RPG or MMO with player fashion/customization). Then rendering it on your lenticular frame as like a movie slideshow. So as you walk by your little character is dancin or shooting on your shelf or desk.
I feel like having just one of these with customised animated content playing on it would be super super cool, alonside say figures on a shelf, or even as desk dressing like I mentioned.
So like, a bigger 3ds top screen? Neat
bruh 😂
This does like a great piece of tech - curious where it will go in the future. Could you try an animated film poster? I know there are people making some cool animated art prints, like the one for The Lighthouse.
An entire book that tells animated short stories on every page is what I’m envisioning
they have a 32 inch 8k one for businesses
It's just like the future version of a plasma ball. "Very cool uncle... what else does it do?".
I want 2.
This will be amazing with a properly rendered real time AI face or body to interact with them closer in the future. How to sell the idea? Your own holographic Cortana. You're welcome Microsoft.
How does the resolution compare to the Lume Pad? I felt that light field display had pretty poor resolution in 4V mode. Also, is there a way to play VR180 videos on this display, like from the Insta360 EVO?
me too am waiting for mine from the kickstarter campaign^^ cant wait to see my 3d models and photos on it
I would have loved to see this work with Light Field pictures from a Lytro camera. We did print some poster-size lenticular prints using pictures from one and the results were impressive for the time. Since the first two cameras never had video capability, I doubt it'd look as good as any of those short clips do.
Very neat device. I love og Doom. I have PC version and on Switch.
I love that Doom has become a measuring stick.
I've had this for a while, just running the default gallery. You did a much better job than they do of making it seem accessible and usable.
It took fifteen minutes for you to get to DOOM!
...But it was pretty cool. Thumbs up
Gotta get that watch time, y'know; they can't just show you headline content right off the bat; most people would leave after seeing what they came to see and nothing more.
@@ChozoSR388 I skipped through the whole thinking looking for DOOM. I would have watched the whole thing if it'd actually been about DOOM.
This is very exciting technology. Not ready yet for the dream of a fully 3d tv that includes perspective changes when you move but surely that will come. Being able to look around the corner in Doom is the most compelling thing i saw here. That's an actual addition, something you couldn't do before (out of vr). I suppose that could be mimicked with a camera adjusting your pov when you move your head but I've not seen that done.
If they ever make a TV with this kind of technology (which I strongly doubt) it'll be even more of a passing novelty than the 3D TVs you saw all over the place a few years back. A TV is something you watch from a decent distance away while completely stationary. Everyone would get sick of moving their heads around to see the effect after about five minutes. This would be useful for things like digital billboards though.
It's done now with stuff like Track IR. But the big thing is going to put these in VR Goggles so your eye can just interact with a light field not a flat image behind a fresnel lens.
This display technology will be used in upcoming smartphones and other devices most definitely. Very impressive.
doubt that…LG already experimented with this technology…not viable for the masses and everyday use. It’s a gimmick.
Summary: it can run DOOM. Anything can run DOOM. I bet scientist will figure out how to play DOOM with our blood cells or even atoms. Who knows?
It takes 16 billion crabs to run DOOM
@@TheAstronomyDude A dude gutted a pregnancy test and put in a chip that could run Doom.
It's not running doom, it's displaying doom being ran. :D
That will put a whole new view on powerups
I ordered two of them, they were suppose to ship two months ago... I hope they show up.
I really want to see tilt brush drawings in it!
Looks great for music visualization.
Imagine a racing sim rig with this tech used for it's display
Very straight forward explanation.
is the array of images it presents horizontal only? or is there a vertical component (can you move your head up and down as well as side to side)
Unfortunately only horizontal!
@@tested interesting, do you know if that is any different for the 8k model they've shown? a few years back there was a lightfield vr goggles demo that was given at siggraph that used a very similar rendering method
@@tested czcams.com/video/deI1IzbveEQ/video.html
Interesting tech but I can’t say It’s a must have yet.
i can´t wait for stuff like this to work in HD
I looked at the pre-order page and there is an add on for credits. Is there a charge for converting pics to hologram?
So apparently there's a charge for converting old 2d photos to 3d but portrait mode pictures don't have a charge
Now I want a no-glasses 3D display for my PC.
Looks like they have a 15" and 8K screen on the site too
*So that is a microlens array or only a vertical lenticular lens? And WHAT is that thick clear plastic part for? Is that literally only clear plastic acrylic with mirrors on top/bottom/sides laid on top of a microlens array and the LCD? Thanks in advance for correct answers!*
Is there an actual place I can purchase or download this Looking glass compatible version of Doom? I'm fortunate to have received mine already and I'm SUPER curious to see for myself what it looks like and how playable it is.
got it from here! hapto.de/download/LookingGlassDoom.zip
@@tested Thank you so much!
If you made the background black and turned off the lights bet it would looked super cool. Would make for a nightlight display.
I’m still waiting for mine to ship, I can’t wait to mess around with it
Same, I get why it got delayed, but I wanna play with it!!!
Do a review of this in VR so we can see the effect!
Side scroll games would be so cool on this display.
This would make the coolest gaming monitor
Finally Harry potter video photos are here. Been waiting for this. Can't wait till its cheaper and just for 5-10 second clips. Maybe Vine could put out a version.
I'd have that display Doom demos all day
Okay, but what's the software like? Can I drive it using open source software, or will I be stuck relying on this startup to make new drivers?
Looks like it's Mac and Windows proprietary software only.
Which is weird because the actual display is running Linux, I assume, from the raspberry Pi inside.
For some reason I really want to see Ridge Racer Type 4 running on this thing.
I think a Tempest style game like Thumper would be cool too.
This reminds me of the 3DS, just with a bigger display at a higher resolution. It's probably the same tech, it's just you are moving the depth of field with software than a manual slider like on the console.
the slider on the 3DS also just sets a software value that basically squashes the into-screen direction by some amount before it renders.
The difference is the 3DS is only 2 views (ie: stereo) at any one time - this is up to 100 views all displayed at the same time. So its significantly better and different tech
a head cam while using this would probably be a good demo
If it was a cube you could walk around and view from all sides...we could play Doom on that too.
This would be an amazing way to digitally distribute 3d or 2.5d assets. Figurines, shadow boxes, interactive art would all be amazing to see, especially if a touch screen could be added for interactivity. A collection of 3d modeled Gundam with touch controls to manipulate the view would sell me on a slightly larger and higher resolution version of one of these.
I'm not too keen on crypto nfts, but this might be a perfect use case for bringing them into the real world. An open source community for these devices and truly decentalized storage might make for an interesting future.
what kind of a setup would you need for volumetric video calling? coz i cant imagine an iphone being suited for it? and do did you or will you try it with android phones? to my knowledge this kind of sophistication is unique to the fruity gang?
It reminds me of looking glass in the newer Prey game. I'm sure this tech inspired the developers in the first place but most players probably never heard of it until they played the game.
Just looks like a large 3DS screen.
Kinda what I was thinking.
You really should check out the luma pad. It uses light field tech, in a tablet, and supports unity too. :-)
Doom demo is neat, but the hand and pistol look weird when you rotate the view.
I’d buy it for DooM alone but I’m still paying for physio on my thumbs since smashing it on the snes in ‘96.
Gamer hands club. ⚡👐⚡
when does the 4k 8K 55" TV versions come on with movies to support it or AI 3D Scaling
I have a Looking Glass Portrait - is there somewhere I can download this version of Doom? I can't find how to do it anywhere.
Doom. I love how it's always Doom.
I can totally imagine the year 2100 and the first thing they demonstrate in full dive VR is Doom.
Can't wait to get mine. They just delayed the second batch again due to the chip shortage. 🙁 My understanding is you can develop Unity/Unreal apps to run on it from a connected PC... (oh, Norm covers that later in the video.) _That gives me so many ideas._ ...besides just using it alongside Blender.
Phones are gonna be crazy in the future
Dug around on their site for a bit, looking for an answer. I'm on a PC, running linux. They mention many open source software programs but never clarify if their holosuite software is windows only. I suspect so, but I'd like to hope they support the open source community they draw upon.
Haven’t seen future tech like this since the 3DS…
You can't really tell over CZcams but this thing blows the 3DS out of the water
except this is a light field display it looks effectively like a window to an object people can see from different sides
Yes, the 3DS! I was thinking the same thing! Lol
@@TIDbitRETRO did u see my comment
What kind of keyboard are you using, Norm?
Keyboard is a Star Trek TNG themed custom from Norbauer that was made as part of a limited run!
@@tested Thanks!
Anyone know what keyboard he is using?
this would be good for a 3d model viewer on a desk owo
exactly, this is the first one that's priced low enough to be used that way. during cad modeling it could preview models before printing/machining
I can't seem to find this "viral" video of Doom playing on it.
Me either.
Turns out someone remade the first level of doom and coverted it to 3d, and then attached the api, and that's what's shown here. Not actually Doom...
You should try to use 3DS games on the screen since it already has depth info
What would be a cool idea, would be to take standard "3D" images - images taken at 2 separate viewpoints like how 3D cameras take their pictures/videos - and use AI to interpolate the rest of the frames needed to display this with all 48 pictures. There's new AI being showcased now that can make even a SINGLE 2d image 3D in a way(2 minute papers has some recentish videos about a couple of them!). There's a LOT of potential here if the average joe can put their pictures on here and have them turn 3D
Two questions: can it display cad models and can it display a website?
I can see this for viewing engineering models being a game changer and if it can display chrome you can play stadia on it 😁
I know you can export as a .obj and view it as Norm showed. I think there was talk of it having a direct Fusion 360 connection as well, but not sure still waiting to get mine.
I think it's something that I need to try before understand it's capabilities. But it works in portrait and landscape orientation? And the parallax makes this work for people with less than 2 eyes as well?
The effect is mostly inside and not outside?
It would be fun to use something like this with a Leap Motion. But having displays for one eye each like VR and some AR ideas seems to be the better approach.
But I doubt it would scale beyond this form factor since the parallax will be less.
What would be most interesting to me is how one could hack it. Like going beyond just the intended use of parallax and maybe take an artistic approach where some vires change the scene. Since you don't need a realistic model or animation. You could make all kinds of optical illusions where looking at a window straight let's you see through and any kind of angle blocks the light.
I believe their demoed a scene with a magnifying glass which managed to stun a lot of people.
The portrait (the main unit in the video), from my understanding, only works in portrait mode. So the display has to be vertical and you have to move your head left and right.
If you move your head up and down, or turn the display side ways and move your head left and right (which is the same optically as moving your head up and down while vertical), you do not get a parallax effect.
"The parallax makes this work for people with less than 2 eyes as well?"
The parallax will be visible by someone with 1 eye if they move their head. However I assume the effect they observe will be similar to what the camera is seeing in all of these videos, and thus what a user sees on a normal 2D video about the product.
"But I doubt it would scale beyond this form factor since the parallax will be less."
"Looking glass factory" have two larger models, one at 15.6inchs and the other at 32inchs. I can not vouch for the 3D-ness of these models due to parallax, but people in the CZcams videos I've seen looking at these displays seem impressed.
"What would be most interesting to me is how one could hack it. Like going beyond just the intended use of parallax and maybe take an artistic approach where some vires change the scene."
This should be relatively easy to do. One of the files you can upload to the looking glass portrait is a "quilt". It's just a collection of views from different perspectives. It's really easy for a user to understand and you can easily modify it to get the effect you want.
A previous display by Looking Glass definitely worked with both up and down as well as left and right movement at the same time, completely unlike any lenticular display I've seen. When I saw it I made sure to test this. I wonder if this newer version got simplified?
Great video Norm but re holographic gameplay, Dejarik level holo-tech, is the holy grail of Holographic gameplay :)
If someone was able to just sell a high definition lenticular lens that people can put on top of their own screens in combination with the software I think this technology would get ahead much faster due to everyone trying their own approach at making it better.
Bruh I thought the looking glass idea and even the name was only a thing in Prey. We are living in the future goddamn
Gonna need a far bigger screen before this becomes truly useful
*changed brighter back to the intended word bigger
they have a few models included 32 inch 8k one
How can you tell how bright it is when you're looking at a screen through a camera lens and another screen?
@@pumpuppthevolume Yeah I just had a peruse on their website and your right. But that display probably costs more than most people’s home TVs.
@@AsherBC well it's for businesses museums and so on ...not sure if it's ready and u need a really powerful pc if I remember right
@@AsherBC Yep. That is the madness. There is a semi-trend of people making gaming tables for roleplaying that use displays for "maps", and more. Thing is, there are like 3 options - 1) a costly, heat generating, TV, stuffed into the table, 2) Some of the new 7 color e-ink displays, and 3) some version of this volumetric stuff. So.. The first, like I said, is power hungry, and generates a mess of heat, so.. would work, but, not optimal. The second, if you are stinking freaking rich, you "might" be able to have them make a custom size, for some insane price, that would fit the table, otherwise, there are lots, and lots of 5" displays, but designed in such a manner that they can't be really tiled, even if you could afford to buy something like a 30"x30" grid worth of them (though, imho, for most cases, this would be the optimal solution, if you could get the damn things). And, 3) A large enough volumetric display to fit in the same profile, but.. that actually would take up as much, or more, room than option #1, probably also generates heat, and uses a mess of power, etc. Its also, as you say, expensive as hell, but at least "on the market", more or less. Its only advantage is that you could use 3D.
But, basically, all of the options are.. either not yet available at a sane cost, or not available at all, or.. just costly, either in starting cost, or in cost of using them "after the fact".
Honestly, I would much, much, much, prefer the e-ink solution, for two reasons- 1) it would work like existing battle maps, so you could "add" all your 3D tiles, figures, etc. on top, and it only uses power, other than the computer needed to update the display, and that could be a freaking thin, low power, tablet, only when you update the display.
But.. unless you have a wad of cash, none of them are "feasible" for normal people "yet", with the semi-exception of the "put a TV in it" one, and.. yeah....
Cool!
I wonder if this would work on the Lume Pad?
I'm not too tech savvy but still this is pretty cool 🤗
layered light, imagine a giant cube or rectangle in front of you soon.
What's the earliest iPhone that will work with this tech?
What keyboard is that?
Norm has a whole video where he builds that. It's very fancy.
You have got to show us that keyboard Norm. 😁
Would the old LYTRO files be compatible with this device?
It all depends on how compatible the depth map that came out of the Lytro camera is with their format. I'd love to see someone try it.
Wow DOOM really does run on everything
Can you make a little 3D demo to get a little better idea of what it looks like in VR?
Isn't there a direct-x adapter that would allow to play any game?
where to get that doom?
Regretting not backing... it was out of my price range. As a passive device it was too expensive. If I worked in 3d rendering, or engineering, it is an absolute no brainer.
As far as I know, it can work as a realtime display when connected to a computer (through Unity3D or Unreal Engine).
In standalone mode however, the integrated Raspberry Pi 4 can only show pre-rendered scenes.
It's a bit small for work I think (they have much bigger displays available, but costs several thousands dollars) but I'm curious to experience it for real and see what I can use it for (I'm a backer, can't wait to get mine !)
The Nintendo 3DS does something similar. This product is expensive as hell.
Hope to find a used one on Craigslist...
The 3DS uses a simpler, narrower FOV stereoscopic screen that is really a 800*240 res.
similar in the way a viewing a zoetrope through a slit is similar to watching a tv. this is leaps and bounds over the 3ds ability to imply depth.
You seem to have images like the one you see if you are able to make Magic Eye images work.
$250 US for a 3d lenticular animated display is not too bad. The hardest part will be getting your own images onto it and making it actually look good. Its rough at the moment, so unless you take light field photos or work in 3d cgi it just wont look quite right.
Oh god, it has the same name as the holographic display things from Prey 2017
Hmm imagine this.. Oculus Quest Ultimate using 96 viewing angles (twice the number of lenticular efx) to achieve this holographic effect technology in the near future. Is that possible or pointless because you can see 3d efx by moving your head left n right in virtual space inside Quest headset? Thx
I would like to see more gaming support! Some kind of strategy fps would be good cause of the peeking and depth of field
Also this is a good reason to keep looking for higher resolution screens (like 8k ones) to make this type of screen standard!!!!!!
so if you tilt it 90 degrees on its side the image becomes flat?
6:47 is that Dedouze art?