This article is Part 4 of a 9 Part series titled Immersive 101: AR for Marketing. You can download the PDF version here.
Our experiences are no longer simply real or imagined. Today, technology can change our experience of the world and introduce us to new worlds altogether. Augmented Reality (AR) and Virtual Reality (VR) are the most common forms of Extended Reality (XR), but there’s also Mixed Reality (MR). What does that mean? It turns out, Mixed Reality can mean different things to different people. But, after reading this article, you’ll have a better understanding of what they’re saying – no matter who they are.MIXED REALITY AND THE VIRTUALITY CONTINUUM
Extended Reality can be understood as spectrums in terms of the display technology and/or in terms of the nature and behavior of the virtual elements as well as how we interact with them. In both cases, unassisted vision lands on one end (no virtual elements) and Virtual Reality exists on the other end In the display spectrum, Augmented Reality would land in the middle, as it is a combination of the world as it appears unaided and the world altered and augmented with virtual elements. Another approach encourages looking at how users interact with an experience rather than merely how they view it. Virtual Reality environments are immersive and often interactive experiences like games and simulations that exist in their own virtual worlds, while Augmented Reality applications rely on the physical world to add value. Some criteria for whether an experience is classified as augmented reality, mixed reality, or virtual reality include the ability of virtual elements to react with one another as well.![Virtuality_Continuum Image Provided by CreatXR https://creatxr.com/the-virtuality-spectrum-understanding-ar-mr-vr-and-xr/](https://assets.builtbyrose.co/wp-content/uploads/2023/05/16204324/Virtuality_Continuum-1024x614-1.jpg)
Image Source
This “virtuality continuum” introduced by Paul Milgram and Fumio Kishino in 1994 is the touchstone of Mixed Reality. When companies or individuals use the term “Mixed Reality” they usually have a version of the virtuality continuum in mind, whether they realize it or not. However, these terms were introduced almost thirty years ago and the ways that these technologies have manifested since then leaves room for debate and discussion.One Term, a Dozen Definitions
In the emerging technology space, different companies define Mixed Reality slightly differently, and there is no single universally accepted definition. While they don’t all explicitly cite the virtuality continuum, they do all address MR as incorporating both virtual elements and interactions in a physically-grounded environment. For example, ROSE uses the following definition of Mixed Reality: “Mixed Reality (MR) allows real and digital elements to interact with one another and the user like they would in the real world. Mixed reality maintains a connection to the real world, similar to Augmented Reality, and therefore is not considered fully immersive. In a Mixed Reality environment, 3D content will react to the user the same way it would in the real world. You must have an MR device, like a headset or glasses, to view an MR experience making it less accessible than Augmented Reality.” However, Knowing how ROSE defines uses a term doesn’t always help if you’re talking with someone from Microsoft, Meta, Varjo, or any other number of Extended Reality companies. For example, Microsoft provides the following definition of Mixed Reality: “Mixed reality is a blend of physical and digital worlds, unlocking natural and intuitive 3D human, computer, and environmental interactions.” Meta defines Mixed Reality in more abstract terms, discussing what the experiences should feel like for users. While it’s not as quotable, it gets at the core values that consistently make up our shared understanding of Mixed Reality: A computer-assisted view of the physical world designed around a human user. With that in mind, let’s look at some examples of Mixed Reality and “Mixed Reality-like” hardware and experiences.MIXED REALITY HARDWARE
There are dedicated Mixed Reality devices. However, these days, most Virtual Reality devices are capable of experiences that arguably qualify as Mixed Reality. Similarly, some experiences available on Augmented Reality glasses and even mobile devices may constitute Mixed Reality-like experiences.Mixed Reality Devices
Dedicated Mixed Reality devices, like Magic Leap and Microsoft’s Hololens, were designed specifically for MR experiences and are the best (and least contested) examples of the technology.![Lynx-R1 Image provided by Lynx https://www.lynx-r.com/products/lynx-r1-headset](https://assets.builtbyrose.co/wp-content/uploads/2023/05/16204447/LynxR1_BK_2048x.jpeg)
Virtual Reality Devices
Most modern Virtual Reality devices are also “Mixed Reality” devices thanks to a technique called “passthrough.” This technique augments a live camera feed of the user’s surroundings instead of using a translucent or transparent display like AR and MR Virtual Reality devices don’t have transparent lenses that allow a user to see their physical environment directly. Instead, VR devices have a growing number of increasingly robust cameras. In addition to tracking, these cameras can reconstruct the user’s view within the VR displays and augment it to create a Mixed Reality-like experience on VR hardware. Companies like Varjo and Meta use the term “Mixed Reality” to describe experiences enabled via passthrough. Meta’s Quest line is a great example of how this technology is developing over time. Passthrough on the Quest 2 is black-and-white, grainy, and not very useful for most experiences. Passthrough on the Quest Pro is higher quality, color, and far more interactive.![Image (c) Varjo https://varjo.com/solutions/design-and-engineering/](https://assets.builtbyrose.co/wp-content/uploads/2023/05/05202231/Varjo_design_header_v2.jpg)
Augmented Reality Glasses and Mobile Devices
![Nreal-Air Photo provided by Jon Jaehnig](https://assets.builtbyrose.co/wp-content/uploads/2023/05/16204556/nreal-air-scaled.jpg)
Ever-Changing Technologies
While developments like passthrough make Mixed Reality-like experiences more viable on VR headsets, developments in connectivity and computing help to bring these experiences to AR glasses. Shifts like cloud and edge computing are making it easier for smaller devices to do more work by moving computing to remote servers. Changes in hardware and design also make XR experiences on mobile devices more powerful. A few years ago, simple AR on most mobile devices was impossible because of the lack of cameras and depth sensors. Between mobile devices designed with these experiences in mind and developments in software, this is rapidly changing.MIXED REALITY EXPERIENCES
Dedicated Mixed Reality headsets remain priced outside of availability for most consumers and most applications developed for these headsets accordingly fit into enterprise or academic use cases. However, Mixed Reality as it is offered through passthrough on VR headsets has opened the door more widely to MR consumer experiences.Medical Education
![GigXR-and-ANIMA-RES-Insight-Kidney-module Image provided by ANIMA RES https://animares.com/ https://animares.com/](https://assets.builtbyrose.co/wp-content/uploads/2023/05/16204603/GigXR-and-ANIMA-RES-Insight-Kidney-module.png)
Design and Training
![group-teleport-dollhouse Image provided by Campfire https://www.campfire3d.com/](https://assets.builtbyrose.co/wp-content/uploads/2023/05/16204627/group_teleport_dollhouse.png)
Entertainment
![I_Expect_You_to_Die Screenshot provided by Schell Games https://schellgames.com/portfolio/home-sweet-home](https://assets.builtbyrose.co/wp-content/uploads/2023/05/16204652/I-Expect-You-to-Die.png)
TOMORROW’S TECHNOLOGY, TODAY’S WORLDS
There is a debate about which experiences and devices really qualify as “Mixed Reality.” Many people see this tension as unnecessary, arguing that most average users don’t use these terms anyway. While the term is valuable to specialists today, it is interesting to wonder what will happen to it as technological advances bridge the gap between AR and MR.Read the rest of the Immersive 101: AR for Marketing series:
A Comprehensive Guide to Virtual Reality vs. Augmented Reality