Liu Zixiao

Liu Zixiao

Beyond Realities

Beyond Realities

Case Study on the Design of Cross-reality Interactions in Immersive Narrative Experience

Case Study on the Design of Cross-reality Interactions in Immersive Narrative Experience

10/1/23

10/1/23

Virtual reality, Immersive narrative, Cross-reality, Interaction design

Virtual reality, Immersive narrative, Cross-reality, Interaction design

Introdcution

Combining virtual environments with reality has emerged as a significant trend in virtual reality (VR) development. However, the problem of bridging the gap between virtual and reality in VR narrative experiences remains unresolved, limiting the potential for seamless transitions in highly immersive content. Based on previous literature, this paper proposes design methods for naturally crossing the virtual and reality in VR narratives. We designed an immersive narrative experience “Beyond Realities”, and implemented four cross-reality interactions in it: Portal Passthrough, Bystander Avatar, Object Passthrough, and Virtual Guidance. We conducted a preliminary study (n=11) to explore the impacts of cross-reality interactions on narrative comprehension and user experience. The qualitative results show that contextual cross-reality interactions (e.g., Bystander Avatar, Object Passthrough) could enhance the perception of the VR experience and maintain its consistency. Finally, we proposed design recommendations in the aspects of narrative content, interaction metaphors, and sensory cues, which contribute to understanding and improving the interaction for seamless switching between the real and virtual worlds.

Combining virtual environments with reality has emerged as a significant trend in virtual reality (VR) development. However, the problem of bridging the gap between virtual and reality in VR narrative experiences remains unresolved, limiting the potential for seamless transitions in highly immersive content. Based on previous literature, this paper proposes design methods for naturally crossing the virtual and reality in VR narratives. We designed an immersive narrative experience “Beyond Realities”, and implemented four cross-reality interactions in it: Portal Passthrough, Bystander Avatar, Object Passthrough, and Virtual Guidance. We conducted a preliminary study (n=11) to explore the impacts of cross-reality interactions on narrative comprehension and user experience. The qualitative results show that contextual cross-reality interactions (e.g., Bystander Avatar, Object Passthrough) could enhance the perception of the VR experience and maintain its consistency. Finally, we proposed design recommendations in the aspects of narrative content, interaction metaphors, and sensory cues, which contribute to understanding and improving the interaction for seamless switching between the real and virtual worlds.

Research Gap

Immersive narration experience is an uninterrupted and highly immersive environment, how to let audience seamlessly transition back to real world and remind them the physical situation?

Immersive narration experience is an uninterrupted and highly immersive environment, how to let audience seamlessly transition back to real world and remind them the physical situation?

Innovations & Highlights

  1. Based on current studies, we refined four cross-reality interaction methods to bridge the gap between the virtual and reality: Portal Passthrough, Bystander Avatar, Object Passthrough, and Virtual Guidance.

  2. We applied four cross-reality interactions in an immersive narrative experience “Being a Time Traveler”, with a bystander acting as an avatar in plots. We recruited 11 participants and conducted semi-structured interviews for qualitative evaluation based on the “Being a Time Traveler”. Our results show that four interactions improve the narrative experience.

  3. From the discussion of qualitative evaluation, we proposed design recommendations on the three aspects of narrative content design, interaction metaphors, and sensory cues to better support cross-reality interactions in immersive experience.

  1. Based on current studies, we refined four cross-reality interaction methods to bridge the gap between the virtual and reality: Portal Passthrough, Bystander Avatar, Object Passthrough, and Virtual Guidance.

  2. We applied four cross-reality interactions in an immersive narrative experience “Being a Time Traveler”, with a bystander acting as an avatar in plots. We recruited 11 participants and conducted semi-structured interviews for qualitative evaluation based on the “Being a Time Traveler”. Our results show that four interactions improve the narrative experience.

  3. From the discussion of qualitative evaluation, we proposed design recommendations on the three aspects of narrative content design, interaction metaphors, and sensory cues to better support cross-reality interactions in immersive experience.

Demo Video

ISMAR'24 Poster: https://ieeexplore.ieee.org/document/10765257

ISMAR'24 Poster: https://ieeexplore.ieee.org/document/10765257

Create a free website with Framer, the website builder loved by startups, designers and agencies.