I tried Hololens 2. The actual rendered models were not this good. Lighting condition and surrounding environment significantly affected the render result. Maybe that is a research problem needed to be solved in the future. LOL.
WilliamLiuAtCPC
This will need realtime 3D reconstruction and 3D localization.
adityaramkumar
Microsoft, Meta and Apple among other companies are working towards making augmented reality possible through their headsets like Hololens, Oculus (currently VR, but they're rumored to be working on AR stuff too), etc. I think these are really interesting challenging problems, and nailing the graphics is crucial to make them a positive user experience. Among other things though, AR has challenges not only with graphics but also with vision (to figure out where to overlay images), optics, etc.
abhim00
This would be a crazy concept to have for any mechanical engineer
Staffxinyun-c
@o0WeiyuFeng0o adjusting the color of the rendered images to reflect the surrounding is a pretty hard problem in 2D, so it makes sense it's an issue in 3D(AR) as well, if not harder. I can imagine some sort of balancing using the surrounding light captured/calculated by the headset to make the lighting on the model look more realistic.
@adityaramkumar echo on the AR part. The most recent iPhones are starting to have the lidar sensor, which is a depth sensor. I believe it will be very useful in AR since we will be able to put models in the scene with much more accuracy. So I highly suspect Apple is going in the AR direction, which is very exciting!
I tried Hololens 2. The actual rendered models were not this good. Lighting condition and surrounding environment significantly affected the render result. Maybe that is a research problem needed to be solved in the future. LOL.
This will need realtime 3D reconstruction and 3D localization.
Microsoft, Meta and Apple among other companies are working towards making augmented reality possible through their headsets like Hololens, Oculus (currently VR, but they're rumored to be working on AR stuff too), etc. I think these are really interesting challenging problems, and nailing the graphics is crucial to make them a positive user experience. Among other things though, AR has challenges not only with graphics but also with vision (to figure out where to overlay images), optics, etc.
This would be a crazy concept to have for any mechanical engineer
@o0WeiyuFeng0o adjusting the color of the rendered images to reflect the surrounding is a pretty hard problem in 2D, so it makes sense it's an issue in 3D(AR) as well, if not harder. I can imagine some sort of balancing using the surrounding light captured/calculated by the headset to make the lighting on the model look more realistic.
@adityaramkumar echo on the AR part. The most recent iPhones are starting to have the lidar sensor, which is a depth sensor. I believe it will be very useful in AR since we will be able to put models in the scene with much more accuracy. So I highly suspect Apple is going in the AR direction, which is very exciting!