Meta's Quest and other mixed reality devices can make learning new skills easier

Mixed reality devices can turn digital information into 3D experiences

Described as "wearing a theme park on your face," devices like Microsoft's HoloLens project images into users' eyes so that their brains believe virtual objects are actually there. The bulkiness and physical limitations of existing headsets are expected to lessen over time, mimicking the evolution of early headphones.

Mixed reality may help onboard manufacturing workers more efficiently

Mixed reality headsets can facilitate hands-on education by providing immersive guides overlaid onto their field of vision, showing users how to complete complex tasks.

Virtual and augmented realities are paving the way for a more immersive future

Tech companies like Apple, Meta, and Microsoft invest heavily in immersive technologies such as virtual, augmented, and mixed reality. While VR transports users to a fully digital space and AR adds digital elements to the real world, mixed reality allows interaction with both at once.

Medical professionals have experimented with using mixed reality headsets

Devices like the Apple Vision Pro have helped doctors develop surgical plans for hip and knee replacements using software that provides 3D models and other tools. Virtual screens displayed by mixed reality devices can provide information related to surgical progress, a patient's vitals, and more.

Watch the unveiling of Meta's Quest 3S mixed reality headset

Meta's social apps like Facebook and Instagram are the most high-profile part of its business, but the company has sought building out a hardware line of peripherals like the Quest headset, which combines virtual and augmented reality.

Watch how a mixed reality app transforms a space into a haunted house

"Hauntify" incorporates a user's physical surroundings into the gameplay. Available via the Meta Quest app store, the software utilizes the mixed reality device's cameras and sensors to map a user's environment, from which evil spirits that must be repelled appear to emerge suddenly.

Simulations incorporating mixed reality have improved trainee certification rates

Such software provides immersive, risk-free environments where students can manipulate digital re-creations to optimize the training experience without producing waste. One meta-analysis showed that MR in welding training boosted passing rates on certification exams by 41.6% versus traditional training methods.

Mark Zuckerberg demos the Quest 3 VR headset

Meta, back when the company was still known as Facebook, once tried and failed to launch a smartphone. With the arrival of the mixed reality era, the company decided to make another hardware play again—and this time, it's having better luck. Meta's aggressively priced Quest headsets offer VR for the masses, and here CEO Mark Zuckerberg shows off the new mixed reality experiences and more available with the latest version, the Quest 3.

Immersive technologies include virtual reality, augmented reality, and mixed reality

Virtual reality relies on technologies that use screens to generate every pixel, immersing a user in an entirely digital world. In contrast, augmented reality overlays digital content onto views of the real world. Mixed reality combines both to allow real-time interaction with virtual objects.

AI systems identify patterns involving physics and time through 'world models'

These realistic virtual environments, such as driving simulations seen in video games, allow these systems to "learn" properties about reality beyond what can be captured in samples of text, images, and videos. Training AI in these simulated environments can help develop "physical AI" for automated robotic systems. (Some readers may experience a paywall.)

Integrating mixed reality has made art galleries and museums more interactive and accessible

The technology bridges the gap between history and modernity in such spaces by attracting new, younger audiences while preserving cultural heritage through risk-free immersion. Mixed reality experiences, such as visiting reconstructed historical scenes or seeing virtual twins of lost paintings, can be programmed with software features for visitors with disabilities.

Limited battery life and increasing discomfort prevent extensive use of mixed reality headsets

Spending 24 hours wearing Apple's Vision Pro highlights some of the challenges facing MR technology, which are compounded by an increasing number of bugs when software is run in nonideal conditions. However, practical and entertainment benefits include placing multiple midair timers when cooking and experiencing immersive multimedia, such as astronomical flythroughs.

Watch a review of Meta's Ray-Ban smart glasses

Combining smartphone features with a luxury eyeglass brand, Meta's peripheral provides discreet recording, audio, and AI-powered functions. They represent an ongoing effort by the company to develop hardware for the augmented and mixed reality market.

Immersive technologies are increasingly being used in medicine, retail, and education

More accessible devices and user-friendly tools have increased the adoption of these technologies, which provide interactive, 3D environments that facilitate natural human learning. In 2018, Walmart purchased 17,000 VR headsets to train over a million employees in areas such as customer service and Black Friday preparation.

A 1992 failed parachute test provided the hardware for the first mixed reality system

The Virtual Fixtures platform was developed to improve human dexterity by merging physical and virtual objects with haptic feedback from an upper-body exoskeleton. Tight budgeting and significant equipment needs nearly canceled the project, were it not for salvaging and repairing cameras and sensors from a smashed experimental parachute rig.

Mixed reality devices and other wearables may usurp smartphones

The integration of smartphone features into watches, glasses, and even clothing suggests future technology may be geared toward working independently in the background. Mixed reality technologies are expected to facilitate this ambient computing world by seamlessly and proactively displaying real-time content without physical interactions solely in the real world.

Explore persistent 3D environments with Marble

Marble is a spatial AI system built by World Labs, a San Francisco startup focusing on world models (rather than large language models). Using a text prompt (or a single image or video), users can generate a "world" and move through it, edit it, or export it. The company and project are part of the broader spatial intelligence area of AI, where AI can simulate environments.

The medical uses of VR

Virtual healthcare simulations are bridging the gap between traditional classroom learning and real clinical experience, improving the safety, effectiveness and efficiency of healthcare services.

Watch a first-person demo of Microsoft's HoloLens

The headset enables users to interact with projected objects in augmented reality by combining Windows Mixed Reality with eye- and head-tracking sensors, a hand-operated controller, and a microphone that can pick up voice commands.

Mixed reality technologies may help treat depression

A study led by a team from Stanford University showed that MR can help people with depression by providing pathways to engage in activities such as digital board games and dancing. Participants saw reduced symptoms of depression that made their overall treatment plans more successful.

After 25 people used virtual reality headsets to practice flying with virtual wings—flapping their arms—their visual cortex responded to the wings almost as if they were real arms, treating them as body parts.

What is mixed reality?

Mixed reality is a technology that blends the physical and digital worlds, allowing virtual and real objects to coexist and interact in real-time. It combines elements of both virtual reality and augmented reality, enabling users to perceive and manipulate digital content as if it were part of their physical environment.

Sets incorporating immersive mixed reality have transformed weather reporting

The technology enables presenters to step into virtual environments that incorporate 3D models and real-time data, providing more engaging and interactive forecasting. They have also facilitated the development of educational segments where meteorologists use virtual models to explain complex weather phenomena.

Mixed reality technology helped make repairs to a quantum physics facility in space

In 2021, astronaut Megan McArthur used a HoloLens to work alongside Earth-based engineers and make hardware replacements to the International Space Station's Cold Atom Lab, the first quantum science facility in Earth orbit. The facility cools atoms to near absolute zero to perform quantum chemistry experiments in a microgravity environment.

Is using VR as a tool to enhance empathy ethical?

This research paper explores whether virtual reality should be used as a tool for improving our moral character — and, if not, what ethical alternatives could be.

Neuralink brain implants have enabled a paralyzed person to play video games

As one of twelve test subjects in Neuralink's PRIME study, Rob Greiner's implant translates his brain's activity into digital commands for the 'Battlefield 6' game. He can now also design 3D models and 3D-print objects using his thoughts.

An analysis on using VR to help train orthopedic surgeons

Virtual reality simulation provides surgical trainees with an immersive 3D experience that allows them to practice skills and operations in a safe yet realistic environment.

Nvidia Omniverse can be used to accelerate 3D workflows and explore creative ideas

This video explores different apps available within Nvidia Omniverse that artists can use to create cinematic, virtual worlds. Some of the tools are AI-powered, like a feature that converts spoken audio into a video of a character speaking.

When you complete a CAPTCHA on a website to prove you are human, you may be unknowingly training algorithms for self-driving cars, whose systems require training data to help identify crosswalks, bicycles, and other outdoor objects.

Large language models struggle to play video games, despite coding them easily

As of 2025, given clear tasks, specific feedback, and test results to learn from, LLMs have been successful at coding simple video games that resemble pre-existing ones. However, given the variety of games, the lack of training datasets, and the need for spatial awareness, which LLMs find challenging, some of these models experience greater difficulty navigating and "winning" games.

Playing music enhances the creation, storage, and retrieval of memories

Scans of the brains of individuals who play instruments have shown enhanced connectivity between multiple brain regions—visual, auditory, and motor cortices—and the corpus callosum, which connects the two brain hemispheres. These complex connections are strengthened through practice and then used in other activities that involve both logic and creativity. The brains of musicians also appear to give experiences multiple types of memory tags, such as audio, emotional, and conceptual, improving their processing.

Self-driving car companies like Waymo use lidar technology for navigation

By firing thousands of laser pulses in all directions, lidar systems construct 3D maps of a car’s surroundings, even in environments with limited lighting. The technology has also been incorporated into iPhones and the Vision Pro headset to improve camera focus.

One private school network prefers AI to teachers

Alpha School, a private school network that uses AI tutors and human "guides" rather than teachers, is expanding across the US. Its founder says that two hours a day with AI-powered software frees students to pursue their passions. Critics, including the Pennsylvania Department of Education, say the methods are untested.

Studies show AI tools can result in passive learning with less retention

Although ChatGPT, Google's AI overviews, and other similar software can save time, a study of more than 10,000 adults showed that reliance on them yielded work products that were more generic and included fewer facts than those produced solely by Google search. Weaker brain connectivity has also been observed when users write using AI.

How psychedelics can potentially reinvent learning

Critical periods, discovered in the early 20th century, describe a period when someone is incredibly sensitive to their environment, and any information learned can stick with them for life. Some researchers argue these states can be "reopened" via psychedelics, which put the mind into a malleable state that can potentially be used to treat conditions ranging from lazy eyes to PTSD.

Research suggests using AI for schoolwork may harm critical thinking skills

An MIT study finds lower brain engagement in students who used ChatGPT, resulting in consistent underperformance in neural, linguistic and behavioral levels. AI users struggled to recall their own essays, while the brain-only group showed the highest neural connectivity and satisfaction.

Tone Transfer recreates any piece of audio into instrumental recreations

Using machine learning models and Differentiable Digital Signal Processing, this tool can transform any 15-second sound clip into a flute, saxophone, trumpet, or violin reproduction. Researchers behind the open-source experiment hope the technology will enable musical creation through creative sound combinations.

Play a puzzle game where the speed of light is reduced to everyday speeds

In "Velocity Raptor," space and time warp as you make your way across a room of obstacles at "normal" speeds. Take advantage of these relativistic effects to solve puzzles involving clocks running at different rates and colors shifting as a result of your movement.

An AI-built pixel map reimagines New York City as a video game

Isometric NYC is a zoomable pixel-art map that renders the city in game-style perspective (think SimCity), helpfully clarifying the dense geography and architecture. The makers built the project tile-by-tile using satellite data and generative AI. Zoom into building-level views or out to see all five boroughs.

Listen to the 'world's first' song made by a quantum computer and AI

UK startup, Moth, collaborated with electronic artist ILĀ to create the world's first song using quantum-powered generative AI. The technology has the potential to help create more personalized content based on input parameters, such as music or dialogue in games.

Video games are helping to preserve cultural heritage sites, further archaeological study

When Carmen Sandiego swept onto the video game scene in 1985, the deluxe version of the game included historic photographs from National Geographic and music from the Smithsonian. Read this article to learn about the overlap between gaming and ancient architecture.

What pupils can reveal about a person’s thoughts and feelings

Eyes have long been said to be the window to the soul. In this article, a psychologist and pupillometrist explores research demonstrating pupils as a window into the mind. Pupils tell us how intensely someone is exerting mental effort, or even reveal what a person is imagining. Read this article for insight into the field of pupillometry and how it can offer insights into our psyches.

Optical illusions were a key component in animating the Muppets

Despite being fairly typical puppets, Jim Henson's Muppets often ventured out into the real world without any apparent humans controlling them. That's thanks to several ingenious optical illusions devised by Henson and his partners, including well-placed mirrors, platformed sets, and remote-controlled puppeting.

Scientists create contact lenses that give you infrared vision

Scientists have created lenses that use nanoparticles to convert infrared light into visible light, allowing human eyes to observe previously invisible parts of the electromagnetic spectrum. This technology may help colorblind individuals by converting colors they cannot see into wavelengths they can.

Explore Anthropic Academy, which provides courses on using Claude

The online courses include Claude Code in Action, which teaches software developers how to integrate Claude Code into existing workflows; Claude 101, to learn how Claude can be used to complete everyday tasks; and an AI Fluency series to help educators, instructional designers, and students learn to apply AI in academic settings.

Disney Research developed a haptic interface where you can feel a fireworks display

Disney’s “Feeling Fireworks” uses water jets and a latex screen to replicate fireworks for blind individuals. Such technology may also provide inclusive experiences for the deaf community, though as of 2024, there are no plans to implement them in Disney parks.

Explore Pompeii with an interactive map packed with 60+ key sites

This tool provides detailed information on major landmarks—from the Villa of Mysteries to the House of the Tragic Poet—and suggests themed walking routes based on visit length. A companion app adds virtual reconstructions and a full audioguide.

Quantum computers harness weird physics to explore unsolvable problems

Classical computers manipulate bits as either 0 or 1, but quantum computers use qubits to hold combinations of both, enabling new algorithms. This new approach could one day help with breakthroughs in medicine, chemistry, and AI.

Play Infinite Craft, an AI software-powered game

In this browser-based game, users combine the elements of earth, wind, fire, and water to create an infinite number of new elements. Try your best to make as many natural phenomena as you can as you build up to the multiverse.

Apple's latest invention

Apple may be working on a robotic smart lamp. Internally called ELEGNT, it's designed to respond to music, display emotion through movement, and even serve up reminders. A new research paper details how it could work—though Apple hasn't officially confirmed a release.