Mixed reality products and software combine aspects of both AR and VR, allowing users to interact with both physical and digital objects in real-time. Virtual reality relies on technologies that use screens to generate every pixel, creating a "virtual" world. Augmented reality takes views of the real world and "augments" the user’s field of vision with virtualized content.
Hours of research by our editors, distilled into minutes of clarity.
Tech companies like Apple, Meta, and Microsoft invest heavily in immersive technologies such as virtual, augmented, and mixed reality. While VR transports users to a fully digital space and AR adds digital elements to the real world, mixed reality allows interaction with both at once.
Devices like the Apple Vision Pro have helped doctors develop surgical plans for hip and knee replacements using software that provides 3D models and other tools. Virtual screens displayed by mixed reality devices can provide information related to surgical progress, a patient's vitals, and more.
The integration of smartphone features into watches, glasses, and even clothing suggests future technology may be geared towards working independently in the background. Mixed reality technologies are expected to facilitate this ambient computing world by seamlessly and proactively displaying real-time content without physical interactions solely in the real world.
More accessible devices and user-friendly tools have increased the adoption of these technologies, which provide interactive, 3D environments that facilitate natural human learning. In 2018, Walmart purchased 17,000 VR headsets to train over a million employees in areas such as customer service and Black Friday preparation.
The Virtual Fixtures platform was developed to improve human dexterity by merging physical and virtual objects with haptic feedback from an upper-body exoskeleton. Tight budgeting and significant equipment needs nearly cancelled the project, were it not for salvaging and repairing cameras and sensors from a smashed experimental parachute rig.
The headset enables users to interact with projected objects in augmented reality by combining Windows Mixed Reality with eye- and head-tracking sensors, a hand-operated controller, and a microphone that can pick up voice commands.
Soldiers involved in testing the Integrated Visual Augmentation System reported headaches, nausea, limited peripheral vision, and concerns about security due to the display backlighting, which could be viewed from hundreds of meters away. The difficulties led the Department of Defense to transfer the program's contract from Microsoft to Anduril Industries.
In 2021, astronaut Megan McArthur used a HoloLens to work alongside Earth-based engineers and make hardware replacements to the International Space Station's Cold Atom Lab, the first quantum science facility in Earth orbit. The facility cools atoms to near absolute zero to perform quantum chemistry experiments in a microgravity environment.
The technology enables presenters to step into virtual environments that incorporate 3D models and real-time data, providing more engaging and interactive forecasting. They have also facilitated the development of educational segments where meteorologists use virtual models to explain complex weather phenomena.
Mixed reality headsets can facilitate hands-on education by providing immersive guides overlaid onto their field of vision, showing users how to complete complex tasks.
Since our ancient human relatives began using stone tools to perform tasks, humans have harnessed scientific knowledge and new technologies to expand the boundaries of our understanding of the natural world. From quantum computing and microplastics to artificial intelligence and memory, explore these topics and more with our concise yet informative overviews and expert-curated resources.