Unit
- Mixed Reality (MR): A spectrum that blends real and virtual environments, where digital objects coexist and interact with the physical world in real time. Unlike virtual reality, MR does not fully replace the real world; instead, it anchors virtual content to physical surfaces and objects.
- Reality-Virtuality Continuum: A framework introduced by Paul Milgram that ranges from completely real environments to completely virtual ones. Augmented reality lies closer to the real end, while augmented virtuality sits near the virtual end. MR occupies the middle, where real and virtual are seamlessly integrated.
- Augmented Reality (AR): Overlays digital information onto the real world, typically through a smartphone screen or headset. Examples include navigation arrows on a street view or virtual furniture placed in a room. AR does not require the virtual content to be aware of the physical geometry.
- Augmented Virtuality (AV): A less common category where real objects are brought into a virtual environment. For example, a VR simulation might show a real user's hands or a physical prop inside the digital scene. AV is used in advanced training and design review applications.
- Key Distinctions: MR requires spatial mapping and environmental understanding, whereas AR often uses simple image targets or GPS. MR typically runs on dedicated headsets like HoloLens or Quest Pro, which offer inside-out tracking and depth sensors.
- Immersion vs. Presence: Immersion refers to the technical fidelity of the system, while presence is the psychological sensation of being in the virtual space. MR can achieve high presence by grounding virtual objects in real surroundings, reducing the disconnect users feel.
- Design Implications: Because MR blends with reality, designers must consider lighting, occlusion, and physics. A virtual ball should rest on a real table, cast shadows, and respond to real-world light sources. This requires advanced rendering and spatial understanding.
- Current Hardware Ecosystem: Major platforms include Microsoft HoloLens 2, Magic Leap 2, and Apple Vision Pro. Each offers different field of view, hand tracking, and processing power. Game designers should target the capabilities of the lowest common denominator for broad reach.
- User Interaction Methods: MR games rely on hand gestures, gaze, and voice commands rather than traditional controllers. Design for intuitive gestures like air tap for selection or pinch for grabbing. Always provide visual feedback for each action and accommodate users with limited mobility through alternative input modes.
- Performance Optimization: Real time spatial mapping and rendering consume significant battery and processing resources. Keep polygon counts low, use level of detail systems, and limit the number of simultaneous virtual objects. Test on target hardware early to avoid frame rate drops that cause motion sickness.
- Multiplayer and Shared Spaces: MR enables multiple users to see the same virtual objects anchored to real locations. Synchronization requires reliable cloud anchors and low latency networking. Design for asymmetric roles, such as one player seeing ghosts while another sees clues, to create engaging cooperative experiences.
Design Principle
Principle: Spatial Anchoring for Consistency
Definition: Virtual objects must remain fixed to real-world locations even as the user moves. This is achieved through spatial anchors that persist across sessions and device restarts. Without anchoring, objects drift and break the illusion.
Application: When designing a treasure hunt game, place virtual clues on specific real furniture. Use the device's spatial mapping to create anchor points at those locations. Ensure anchors are saved to the cloud so players can return later and find the same clues.
Quick Revision
- Mixed reality fuses real and virtual environments on a continuum from AR to AV.
- Unlike VR, MR preserves the physical world and anchors digital content to it.
- Hardware platforms vary in capabilities; design for the most common feature set.
- Spatial anchoring is critical for persistent and believable MR experiences.