I was curious on how the LiDAR scanner and the TrueDepth cameras were different and how the TrueDepth camera worked, and found this article online explaining the differences and how they work together to map the surroundings of the wearer: https://www.eyerys.com/articles/how-apples-lidar-sensor-differs-one-its-truedepth-face-id
jinweiwong
It's astounding how many sensors the Vision Pro has, all serving different purposes and pointed at different directions. What I found interesting is how the eye-tracking works. The LED illuminators emit invisible light patterns that reflect off the retina and is detected by the IR cameras. This allows users to navigate through their environment just by looking at things. https://www.imveurope.com/article/could-imaging-enabled-eye-tracking-tech-drive-mass-adoption-virtual-reality#:~:text=Apple's%20eye%20tracking%20system%20projects,capture%20the%20reflected%20NIR%20light.
brianqch
@jinweiwong, Super interesting read! Thinks makes me think about how we can use eye scanning as a layer of security. Apparently, the Vision Pro also uses something called Optic ID, which matches your iris structure and its patterns. Here is more information about that if anyone is interested.
What is crazy to me is that Apple manages to create all these cool technologies even though the products have already been in development in other companies for quite a while. It seems like apple has some trick up their sleeves for innovation. However, I notice that a lot of these features are the same as other products already in the market (they've just been given a fancier name) which makes me believe that there might be a slow down to innovation in this field. Is this the case? What other new improvements can a company even make to VR/AR headsets?
aidangarde
The Apple vision provides seem to only show augmented reality, rather than complete immersion in virtual reality. This seems to be an easier implementation to ease people into using vr for productivity and leisure, but I wonder if Apple will release more products down the line that are more immersive. The apple product seems to be the first one that is more than just a gimmick (oculus is cool for gaming and novelty, but nothing ground breaking)
pranavkolluri
The Vision Pro really should be thought of as a VR headset that has very good passthrough. It's like a weird mix of the Quest 3 and a PSVR2 (namely the eye tracking which is very important for foviated rendering). Honestly though, I still don't actually see how this is better (ergonomically, socially, etc) than a couple displays or a nice TV. (and it doesn't play any games of note, which is historically the main draw of VR. If you've never tried sim racing for flight sims like MSFS. DCS World, or VTOL VR, it's like nothing else).
sparky-ed
I have tried the Vision Pro demo version, and I think it is great and astonishing to see how each visual effect blends very well and how it works great with eye tracking. Many say that this device is overpriced, and while I agree with some parts of it, I think it is crucial to understand that advanced eye tracking takes a lot of computation and being able to process only the area that the user is currently looking at is amazingly impressive.
I was curious on how the LiDAR scanner and the TrueDepth cameras were different and how the TrueDepth camera worked, and found this article online explaining the differences and how they work together to map the surroundings of the wearer: https://www.eyerys.com/articles/how-apples-lidar-sensor-differs-one-its-truedepth-face-id
It's astounding how many sensors the Vision Pro has, all serving different purposes and pointed at different directions. What I found interesting is how the eye-tracking works. The LED illuminators emit invisible light patterns that reflect off the retina and is detected by the IR cameras. This allows users to navigate through their environment just by looking at things. https://www.imveurope.com/article/could-imaging-enabled-eye-tracking-tech-drive-mass-adoption-virtual-reality#:~:text=Apple's%20eye%20tracking%20system%20projects,capture%20the%20reflected%20NIR%20light.
@jinweiwong, Super interesting read! Thinks makes me think about how we can use eye scanning as a layer of security. Apparently, the Vision Pro also uses something called Optic ID, which matches your iris structure and its patterns. Here is more information about that if anyone is interested.
https://support.apple.com/en-ng/118483#:~:text=Optic%20ID%20matches%20against%20detailed,the%20iris%20and%20surrounding%20region.
What is crazy to me is that Apple manages to create all these cool technologies even though the products have already been in development in other companies for quite a while. It seems like apple has some trick up their sleeves for innovation. However, I notice that a lot of these features are the same as other products already in the market (they've just been given a fancier name) which makes me believe that there might be a slow down to innovation in this field. Is this the case? What other new improvements can a company even make to VR/AR headsets?
The Apple vision provides seem to only show augmented reality, rather than complete immersion in virtual reality. This seems to be an easier implementation to ease people into using vr for productivity and leisure, but I wonder if Apple will release more products down the line that are more immersive. The apple product seems to be the first one that is more than just a gimmick (oculus is cool for gaming and novelty, but nothing ground breaking)
The Vision Pro really should be thought of as a VR headset that has very good passthrough. It's like a weird mix of the Quest 3 and a PSVR2 (namely the eye tracking which is very important for foviated rendering). Honestly though, I still don't actually see how this is better (ergonomically, socially, etc) than a couple displays or a nice TV. (and it doesn't play any games of note, which is historically the main draw of VR. If you've never tried sim racing for flight sims like MSFS. DCS World, or VTOL VR, it's like nothing else).
I have tried the Vision Pro demo version, and I think it is great and astonishing to see how each visual effect blends very well and how it works great with eye tracking. Many say that this device is overpriced, and while I agree with some parts of it, I think it is crucial to understand that advanced eye tracking takes a lot of computation and being able to process only the area that the user is currently looking at is amazingly impressive.