Apple Vision Pro's Hardware EXPLAINED!
Vložit
- čas přidán 16. 06. 2024
- I noticed a lot of people outside the AR/VR bubble talking about Vision Pro and especially their new hardware specs sheet. They got confused... a lot!
So I wanted to take the opportunity to EDUCATE the masses about every technology in as much detail as I can
Support Me: bradsmells.com/patreon
Main Channel: bradsmells.com/youtube
#Apple #VisionPro #spatialcomputing
0:00 Vision Pro Specs Confusion
1:49 Storage Capacity
2:08 Vision Pro Displays
4:02 Micro-OLED vs OLED
8:05 NOT MicroLED
8:51 Apple Displays vs Other HMDs
11:53 Color Gamut
12:35 Refresh Rates Explained
14:59 No Optics Specs?
15:56 M2 Compute Power
18:33 R1 Chip
22:23 Cameras
26:55 IMUs Explained
28:19 More Cameras
29:55 Audio
32:15 HMDs Replacing TVs
33:40 Battery
34:46 WiFi 6...
35:52 Input Devices
37:07 IPD Explained
38:39 Weight and Comfort...
41:45 Apple's Crazy Scanning Benefits
Finally, someone who actually has something meaningful to say about the topic. Great work!
seriously!!!!
I don't leave comments on YT often but this was the best vision pro video I've come across. Props
Thank you ^^7
I'm very glad you made this channel - thanks for your work and passion!
glad you enjoy it ^^7
I don't get why this isn't on the main channel but it's a CZcams algo win that it was served up and now I'm subbed to this one too.
Finally a deeper review of the tech rather than the usual consumer oriented ‘review’
Finally some information about the Vision Pro I’ve never heard before! Every other channel is repeating the basic obvious stuff.
Glad you like it!
This is incredible information yet you still made it very accessible for people out of the field. Thank you for this, it’s awesome!!
BEST Vision Pro breakdown video! Thank you for making this!
More useful than 95% of the reviewers talking about things they dont understand. Fantastic.
By far the best CZcams video I have seen on Apple Vision Pro specifications. Really nice work!
BRAD as an incumbent Vision Pro owner baby im gonna need u 2 keep serving this iconic content daddy love u
oh my god youre back
@@GladlyItsBradley i hope this is your wife trolling you lmao
@@Dindonmasker LOL 🤣
100% agree. 3D videos are very powerful for lost loved ones. I took one of my wifes family at dinner years ago (I invented one of the first stereographic VR cameras in 2014) and 3 years ago her grandma died. I recently showed her family that video in VR and in it their grandma interacted with me at the table with the camera so she got up close and personal. It really imapcted everyone. Tears flowed where a photo/video of their grandma never trriggered this.
Best video on Vision Pro specs on CZcams.
im gladly its a bradley video day!
Best, most comprehensive video on the Apple Vision Pro that I’ve seen yet, thank you for your hard work.
This is such a well-rounded explanation for AVP, love your content!
It makes me shed a tear to hear you talk about Oled-on-silicon without mentioning “one special company”. Sculley you really did us dirty.
I don’t understand
Is it valve?
They’re talking about eMagin. Who I will talk about in my next video
😢
Nobody cares what your tiny brain opinion is bch. Lol
Best in-depth and informative and non dumbdown version but articulated in a way that viewers can understand. Thank you.
Apple owes you a thank you or headset!
Remember when we thought Valve would be the company to deliver us the promised micro OLED future, Bradski? It feels like it was only a year ago.
Thank you for recording and sharing this!
Great video covering all the specs in depth, can't wait for your review when it launches!
Great to see this video! I saw the one about your ordering of the Vision Pro too but wasn't aware this was in a new channel. Looking forward to what's next and happy that you are taking care of your own mental health. Keep up your great work Brad!
This is the best explanation video I’ve seen on the Vision Pro, I learned a lot. Thank you!
You are great at teaching specific information in a way that most people can understand. I’ve been so interested in the specifics of the Vision Pro and other display tech, and you made a great vid for it. Thank you love the vid❤️
Awesome assessment with tons of clarifying information.
I’ve been tempering my excitement thinking the real thing can’t possibly live up to my initial impressions, but it’s definitely ticking back up to ridiculous levels.
Was excited for another avp video from ya Brad! Love your stuff
ty!
Amazing work, Brad. I learned so much.
Thank you for explaining in detail. I really wanted to know exactly what I'm getting myself into . ❤
Great explanation of the technology! Thanks!
This was such a good detailed explanation. Thanks
Worlds colliding!! Truly excellent video, Brad. I know a lot about the XR space, and I still learned a ton watching this.
Finally an actual deep look into the specs of this thing. Great video. Subscribed
Great stuff. I learned a lot. Thanks for posting.
This was a great video more of this please. Been listening to you for a long time this was great
You are my favorite source for any serious discussion of XR. Thank you!
I'm happy that you came here and talked about the details of the Vision Pro. I love hearing the nerdy details behind technology so keep it up!
I have never watched one of your streams before this one but why do I feel smarter now. Thanks for that!
Great info! Thank you.
I hope this and the following videos grow your channel. So stoked for this Apple moment to bring more people to enjoy your deep insights into the industry.
Great video Brad! The detail you gave here is exactly what I was looking for because some of these specs I had no idea what they meant. Subscribed and I’m a paid you tube subscriber so kudos to you
love this vid. very informative
So sick of companies pinching people on data size, sh*ts cheap, give up, or give us back an SD slot.
Finally someone that goes into the specs and details of the AVP. Well done man! Thank you for your time. Would be awesome to see you compare the AVP resolution and experience to others once it comes out.
the 50hz vs 60hz thing in NA vs. UK is literally because the AC power that comes into your house in NA is running at a 60hz sine wave, and not only do lights that run off wall power thus flicker with 60hz pulses, but also old CRT TVs were actually clocked by the power. the 60hz signal of the power provided the timing for the TV in how it scanned the electron beam across and down the screen. So, in the UK, the power runs at 50hz, which means the actual frame rate on TVs was 50hz instead of 60hz like in NA. So not only do lights flicker at different rates, but Video in NA runs at 60hz and video in the UK runs at 50hz. If you've heard the terms NTSC vs PAL, that's NA's 60hz standard vs. UK's 50hz standard for analog video, respectively. Crazy stuff
Excellent video Brad! Thank you so much! I’ll live vicariously through you because I can’t afford the AVP! Can’t wait to hear your review!
Thanks BlueBell! :D
@@GladlyItsBradley no, Thank you!
GREAT explanation. Thank you!
Glad it was helpful!
Really great video today! Looking forward to your hands on review. I can't wait to try one out at an Apple Store myself. Wonder what the sign-up process for that will be like?
Great video Brad, thank you!
Skipped past in my feed multiple times thinking it would just be a drawn out readout of the specs but glad I finally gave it a shot, this was incredibly informative and useful information! Thank you for sharing your depth of knowledge on the subject. I’ll be keeping an eye out for when you have it in hand and start posting your findings.
Thanks Brad
Great job on the breakdown. Refreshing to see someone actually explain things for people who aren't really aware of the differences in a simple way. CZcams needs more of this and less of the regurgitated specs just repeated to us.
Thanks for the video
Its my favorite VR youtuber!!!! ❤❤
uwu thank you
super helpful breakdown thanks
Excellent vid
I’m so glad you got a vision pro because I think we’ll get the full story good and bad for the prosumer. Thanks Brad! Great video.
This was a pleasant video to watch and very informative, probably one of the best videos I've seen discussing the technical specs of Vision Pro. I agree with most of what you've said, I've been looking into this headset myself for the past week or so after largely ignoring it before and it sounds like something that I'd have to see to believe. My experience with traditional VR headsets is that they don't treat pixel density as well as they should, it's an incredibly big deal, especially since I grew up with Apple Retina displays and my eyesight is incredibly good, such that even if there is no screen-door effect, the pixels on any existing headset can be incredibly distracting, especially on text. I'm definitely looking forward to seeing how Apple solves this problem, especially since they're pushing it as a spatial computing device that should be able to relay productivity apps from a Mac. If the text isn't as crisp and clear as my everyday 4K display I'm going to be pretty majorly disappointed, since the rest of the device's specs are very impressive. It'd be incredibly sad to see Apple skimp on the most important part of an HMD like this, especially after seeing you point out that higher-resolution Micro-OLED panels in this form factor already exist on the market.
The problem is, that you cant simply increase the sensor size. If you increase the sensor size, you need a smaller relative aperture for the same depth of field.
So the fact that they are using f2.0 aperture alone signals that its a small sensor.
There is no way around this, you get the same amount of light independent of the sensor size. As you need the same depth of field.
Just like if you moved into a full frame for APS-C, you need to stop down the lens more to get the same depth of field.
The only way around this is autofocus cameras, then you can have larger sensors & larger apertures as you no longer need the infinite depth of field.
But i assume that this would create massive problems in trying to 3D reconstruct the scene from camera data that is focused at certain distance, leaving parts of the image unfocused.
@@Nobody-NowhereWould you happen to know what is the current best Android smartphone that has the best low light 4K 60fps video recording via the main rear camera at 1x???
I want the least amount of noise in my low light videos.
@@PSYCHOV3N0Mprobably sony, apple or google
I preordered not really knowing much about the specs/hardware just that I love the Quest 2 and I wanted to try something more… this video really helped me understand what’s going on. Thanks man!
Apple Vision Pro isn’t “something more” 😄 it’s something less and more expensive.
Sure sounded like there was more @@ROCKETKNIGHT-ph7xp
@@ROCKETKNIGHT-ph7xp You're outright insane.
Great walkthrough of the hardware Brad!I am super excited to get mine on Feb 2nd....it's not PCVR..totally different experience is what makes the Vision Pro exciting compared to other headsets. I love them as well but Vision Pro is just gonna be super different. Exciting times!
29:30 Regarding privacy, HTC has a pretty good track record regarding how the data inside the HMD is kept private. From what they've said on Discord, the way the Focus 3 and XR Elite stores the environmental data for SLAM tracking, even HTC couldn't access that data to learn about the user's environment even if they wanted to.
That's how the Secure Enclave works on Apple platforms, too. The Secure Enclave is a type of Trusted Execution Environment (TEE), located inside of an application security processor, which is implemented by all Apple A-series and M-series processors, similar to the TPM of a PC. (The T2 security chip in late Intel Macs also implemented a Secure Enclave.)
The Secure Enclave allows you to execute code inside of it, hence the term "execution environment". This code will be isolated from the rest of the system, and will be allowed to manage a store of secret data that nothing else can access, not even other programs inside the TEE. The execution environment is "trusted" because only properly signed code will be allowed to access its secret data, and nothing else in the system can see or control what it is doing. Properly signed updates can be granted access to the same store of secret data as the previous version, but improperly signed updates or differently signed updates will not be allowed to do so, even if it is the same code.
Inside the TEE, you can perform processing that depends on this secret data, and then only provide the result of this processing to the host system, preventing any other type of processing from being done on the data, like data collection.
Qualcomm's equivalent of this would probably be TrustZone, which is likely what HTC is using in their headsets. Good on them.
TrustZone is typically used on Android devices to implement DRM like Widevine, because by storing the decryption keys inside of the TEE, you can use it to only allow videos to be decrypted if the device is still secure. If the device is deemed to not be secure, then it is impossible to use any external means to extract these decryption keys, or perform any decryption that relies on the keys, because the trusted code inside the TEE is the only thing that can perform that decryption, and it refuses to do so when your device is deemed to not be secure.
It is also typically used to implement fingerprint readers and other types of biometric authentication, because biometrics are sensitive data. On top of that, the encryption keys to the device are also typically sensitive data, which means that if all methods of unlocking the device are implemented inside the TEE, it will be impossible to compromise the device's security without properly unlocking it, short of vulnerabilities in the actual locking code.
It's an incredibly useful function that can be used for both good and evil purposes. Good if you are protecting the users of the devices against hackers, and bad if you are protecting the devices against their users.
thanks B!
I’m glad you changed your channel name it is a manifestation thing ✊. Great vid
Amazing video
I am excited for you to get your AVP and tell us all about it!
this channel rocks
ty
"3D display system" is an EXTREMELY generous marketing term given that all of the current consumer VR headsets out right now including the Vision Pro don't have adjustable focal distance (the ability to focus on objects at different distances)... All we have is the stereoscopy from the binocular overlap right now haha
I'd be interested to know what the binocular overlap of the Vision Pro is. Haven't seen it mentioned in my reading. It was one of the things that bothered me when I upgraded from the Quest 2 to the Quest 3. Mostly because it means that despite the edge to edge clarity of the pancake lenses, you still have to look straight ahead or you lose stereoscopy and the visual cutoff between the displays is glaring. There's lots of complaints on the Quest forums about "dark edges" on their Quest 3 display by peopple that don't know what they are seeing.
@@Joric78 Yep, will be waiting for the reviews on the Vision Pro from Brad and Norm from Tested to hear about that (and waiting for Apple's in-store demos to come to Canada...)
I own the Quest 3 as well and I can attest to the "dark edges" effect. It's a shame but I do still enjoy using the device.
Sometimes it just seems like we haven't innovated in VR over the past decade as much as we would have liked. I remember Michael Abrash (the Chief Scientist at Oculus) giving a talk during one of the F8 conferences way back in 2016 or something... He predicted we would have 30ppd displays and 140 degree FOV with adjustable focus in the next 5 years. I guess the Pimax Crystal is the closest to meeting the first two metrics but that product has it's own slew of issues
@@Joric78 isn't the overlap primarily dependent on your IPD over anything else? with large IPD meaning good overlap at the cost of smaller combined FoV while smaller IPDs have a larger total FoV and a smaller overlap. what factors other than IPD and distance from lens to eye can affect the overlap?
@@RavenTaleLive Optical stack angle when using dual displays instead of one flat display. It's a design decision. When they shifted to dual displays they extended the horizontal FOV at the cost of less binocular overlap.
@@Joric78 makes sense. thank you for the clarification!
Learned a lot
Dude- Apple shared the resolution per eye when Vision Pro was first announced! DO YOUR HOMEWORK. >4K per eye. Don’t have the exact specs but they mentioned them during the original launch video.😊
They said it has higher resolution than a 4k television per eye. Which is usually 16:9 aspect ratio. 3840x2160
But displays for vr are 99% of the time NEVER a 16:9 ratio. Are usually more square-ish
Yep. Those are most certainly numbers and words..... I learnded.
well done video
Love your headphones analogy
Great job Brad! Agree on Apple’s vague specs, good job on describing microOLED. Can’t wait for another video with Karl Guttag when you both actually have the Vision Pro in hand. Agree on multitasking, but remember it is still based on iOS NOT MacOS and multitasking is limited, which the simulator bears this out. The ‘R1’ chip is of more interest to me. HDR is an important feature, especially with its very high nits level. But more important is 10 or 12 bit dynamic range, that even other 24-bit microOLED display based head mounted displays have a problem with banding. Having a higher dynamic range will reduce the banding even with LDR content. Yep the WiFi 6 is a problem if you want to do any streaming, ESPECIALLY at 4K, but I believe it is still MIMO radios so this might still be better than everything over a single channel. Also the Quest 3 has a WiFi 7 ready based chipset. Gamepads are available and the DualSense trackpad is accessible in the framework. If you can still use dual gamepads, someone could in effect make hand controllers that use gamepad buttons/joysticks with hand tracking. If hand-tracking is as good as some have experienced, this could be a solution.
Stereographic video is interesting because it is another Apple reframing of a 120 year old process as “Spatial Video.” The problem is it is still a single plane that its illusion will be destroyed in 6DOF environment as soon as you move to the sides of the plane. I am working on 3, 2-pair concave camera system will be processed to a curved plane, giving the subject even more depth, which brings up a process that Apple has failed to show, and that is passthrough, transparent background, that should be very easy to create based on current depth sensing frameworks (used in the iPhone Pro ‘Cinematic Video’ mode) along with stereographic depth detection or even grey/color screen keying. Seeing examples in the Quest 3 can be quite stunning, now add all the sensors to ensure proper ground anchoring along with a camera system like the one I am creating and you will feel like you are in the room with your subject. Much more realistic (and far cheaper) than realtime 3D digitization.
Anyway, still A LOT of speculation on what will really be possible with the Vision Pro, which is why I am playing the “wait & see” game for now.
One way to reduce cost would be to manufacture hexagonal displays instead of rectangles. Hexagons would be the optimal shape for FOV in a headset, and they don't waste wafer area on corners you never see in the headset anyway.
they do this alredy
I just purchased some hearing aids as I am getting older and was shocked to be quoted between $7-12 thousand USD depending on the model and features. Imo the price of the Apple HMD is reasonable
Maybe use some AirPods Pro instead 😅
Everyone talking about it being too heavy but it’s genuinely incredible they managed to cram an entire computer with a glass and aluminum frame into a device that weighs 50 grams less than an Index
The fact the battery isn't in there makes this easy to believe...?
@@eon5323the index doesn’t have a battery. And yes, removing the battery was a good design decision. Rather have it on my hip than my face.
@@eon5323 definitely is. This is an entire laptop-class computer in a headset. Nobody has managed to pull something like this off before, and certainly not in this weight class.
To me the panel SIZE is the most imortant number, it can allow a huge field of vision. Cant wait for more manufacturers to use this panel.
I just realized if you read Apple's logo as just A, the R1 chip becomes AR1
must be some kinda plot twist(?)
I think the R probably stands for something like "reality". It's a spatial processing chip that can integrate data from many tens of sensors, including at least 12 cameras (as that's how many cameras are on Vision Pro). Some have speculated that this chip could also have been developed for self-driving cars, as processing sensor data is also incredibly important there. I wonder if Vision Pro might be able to integrate with a system like that and provide things like visibility of blind spots or HUD information. That would be incredibly cool.
Thanks for the video, I appreciate your insights and your thoughts on the Vision Pro. That being said, while I am happy with the level of the tech. I would not have any real use case for this headset. I have a Quest 2 and 3, I can use them for exercise, I can watch media, and play both PCVR games and standalone. I use my headsets at least once a day (for exercise) and then for other uses when I have the time or inclination for entertainment. The Vision Pro is not really designed for my purpose, as I am not looking for a computer replacement in an XR / VR / Spacial computing device. I hope many other people find a good use for it and it is a success because it will keep pushing the tech forward. As I believe that its existence even if it is a limited rollout will set the bar higher for the Quest 4 or similar headsets coming out in the next few years.
Incredible video! Had a couple questions about photon to photon latency. 12ms is roughly 1 frame at 90fps. Is it possible to get frame to frame parity with passthrough without post processing? Also, is there any advantage to running the cameras and displays out of phase as a way to reduce latency?
From what has been said by apple devs it sounds like the R1 does the image presentation, taking the output from the M2 and composing it ontop of the pass through such that if the M2 locks up your pass though continues without stutter.
But also at a HW level separation of the video stream from the chip that runs users space code to ensure that bad actors do t find an exploit to access the cameras
Also I'm kinda surprised they didn't talk that much about persistent AR content. Like placing a weather panel in your kitchen wall or a fake virtual TV that's anchored there and persists between headset reboots. I'm 99% sure I saw something like that in the developer documentation, so I'm not sure why they didn't show it off at WWDC. Maybe they're saving some features for visionOS 2 next year?
I know that *at least* Safari windows are persistent between reboots. But not sure if 3rd party apps can tap into that
They do persist and remember their locations based off difference spaces. They have a dev video discussing how it works. Not sure why it wasn’t public, probably to keep the magic for when people try it out.
in the listing where they mention trackpads they are referring to their Magic Trackpad. Apple has had exceedingly good trackpads for a while. I can only think they don't mention mice since their mouse sucks. Although it's also a trackpad when you are talking about the apple mouse, the top of the mouse is a trackpad. I swear they showed a mouse being used with the laptop desktop streaming use case.
Bradley, once again excellent work. Most intelligent person in this space on CZcams. I’ll listen to Brad’s opinion on any VR device over any other tech channel!!
Didn’t know about the pixel binning on the Quest 3‘s pass through cameras, I wonder if it would be possible to dynamically change the megapixels depending on lighting. For example if the environment is very well lit then use the full 16 megapixels for the best looking image, then when it gets darker use 6.5 megapixels. Apple already does this with their iPhones, you can only take 48 megapixel photos when lighting is good, darker environments and night mode photos are 12 megapixels. I hope this can be implemented since limiting pass through resolution to compensate for low light environments which are only part of the experience is a problem.
Ooohh!! I finally realized pixel density isn’t just the resolution, but the spaces between pixels.
Imagine if they included a driver for the quest pro controllers?
I worry a bit about the facial scan and sharing the device, one of these is enough money, its something that concerns me about the bigscreen too. How does a family share the headset, will we be able to order aftermarket swapable facial interfaces? How much difference does it actually make to the comfort?
As a designer using 3D software like Maya and Unreal engine, having no Mouse Support is pretty much a deal breaker for me. I'm very surprised and up till now was excited to use AVP for such work. But all 3D design software requires a 3 button mouse so you can navigate around the 3 dimensions efficiently.. Such a pity as surely they are missing a trick here to eventually be able to design natively in a 3D space. Defeats the whole purpose for me.
Have you seen the Spacemouse? Just curious.
I'm fairly sure that you're not going to be running 3D design software directly on Vision Pro, so obviously if you relay such apps from your Mac it's going to support all the same devices your Mac does, just on a new display. I'd love to see how that works, since running traditional windowed apps in a 3D environment has never been pulled off before. Windows Mixed Reality comes close with the ability to spawn virtual desktops and stream windows from there, but it's not the same as a compositor-level implementation, which seems to be what Apple has done. There are also some Wayland prototypes for Linux, but most of them are pretty barebones with pretty janky window management.
im surprised google hasnt released something like Android for VR so OEMs can make their own headset and just use the Play Store to distribute VR apps and stuff, kinda like Daydream but actually done well
I think they will try after they perfect it with Samsung's offering
Isn't the quest basically android already
@@liamcollinson5695 It is Android.
@@liamcollinson5695 no google involvement though
@liamcollinson5695 a heavily modified Android yes. You can sideload android apps but a lot of them won't work
What are your thoughts about the 2x6,5MP passthrough cameras. Do you think Apple have a gaze-driven AF like Varjo XR4 FE or a more "Standard" solution with fixed focus lens modules?
I feel autofocus passthrough is something Apple would try to market. Since their biggest competitor, meta: isn’t doing it yet
The Vive Deluxe Audio Strap would be amazing for this thing.
Hey Brad. When you get your Vision Pro and go to edit a video (as well as doing other multitasking), you should see how well it works with a wireless mouse and keyboard (or just keyboard with pinch gesture hand tracking in place of mouse). Since I first heard speculation about a apple headset years ago, I always thought they would heavily push using it in place of a workstation (with 3 32” monitors for example) that you could take on an airplane. That is something that a macbook pro can’t do, but VP would be great for. I was blown away when they announced it, that they didn’t show a buisiness man on an airplane typing away on a physical keyboard, with several spreadsheets and stock market crap all in front of him. I actually want to try this with the quest3 now. I edited a youtube video from 200 miles away, on virtual desktop using the quest controller… and it was pretty cool, and worked. But it could be so much better.
What about the storage sizes what is realistically needed
Hi Brad
Hey Brad thanks for the breakdown! Apple has been working on microled for a long time now-what could we expect if Apple upgraded the Vision Pro from micro-oled to microled? Does it make sense to compare the two in the context of headsets? Did you see the transparent OLED at CES this year?
Just a note, with its very precise hand-tracking capabilities, Vision Pro can probably turn any flat surface into a usable trackpad...
Yes. But also gaze controle is very good
@@hishnash I'm not sure how it will be for precision, but it's absolutely an exciting evolution
Texture is very important for trackpads. If you've ever used a Force Touch trackpad (or even the ones that came before), you'll probably have noticed the matte glass finish. That finish is tuned for a very specific coefficient of friction. Turning any random desk or shelf or table into a trackpad wouldn't meet Apple's standards.
Nice job, Brad. Sounds like Apple Engineering made some good trade-off decisions. You seem wise beyond your years. Bravo.
exciting times
Besides the lack of wifi 6E it does not seem to have av1 support either seen in specs.
A little bit too in-depth for me which I don't say often but nevertheless I appreciate all the information and will likely return to this video from time-to-time, chipping away at it and no doubt learning a great deal more than what other channels are putting out there. Thank you for all the work you put into creating this! 🎬👻