Summary: Three skills are required for VR/AR UX Design. Design of immersive narratives for VR and AR means leveraging the are of Storyteller, Improvisation and Imagineering.
We’ve realized from our VR/ AR design projects over the past few years that 3D storytelling is central to the Interaction Design technique and how users experience immersive (virtual, augmented, mixed) realities. As you approach the user experience of Virtual Reality and mixed reality (we’ll refer to that as AR), you need 3 skills under your hat:
- Storytelling
- Improv
- Imagineering
The key is to learn from these traditions in theater, comedy and animation/entertainment and apply them to immersive experiences and VR UX Design. Let’s look at each of these in more detail and how they are relevant to 3D Interaction Design.
1. Storytelling for VR
What? Storytelling follows the structure found in oral tradition, books and movies. This is called a “Story Arc” (with a Beginning, a Middle and an End in it’s simplest form). Story orders understanding, like a user interface that indicates an action is required. Story is central to how our brains work. And it’s essential to any Holographic or Spatial UI.
Relevancy to VR/AR: Narrative acts as a task flow/ story flow “guidance” system. Use narrative to “unfold” your scene, or situate the user in the space or scenario. Narrative mechanics can help shape the experience for the user in an immersive environment. We believe storytelling is a design essential for VR/AR.
Example: Rick and Morty VR- Virtual Rick-Ality. Notice the clever use of onboarding in this piece.
The story starts in a familiar setting: the living room with a TV and DVD’s that the user inserts into a DVD player. Next, a clone of Morty (you the user) is introduced in the garage with the mission.
2. Improv for immersive experience
What? Improvisation is used in comedy and performance. Its key benefit is generating ideas or thoughts from a non-judgmental state of utilizing what’s in front of you, or incorporating. “Incorporating” means continuing with whatever comes up, and adding to it. “Yes, and..” is the classic catalyst question when prompting an improvisation.
Relevancy to VR/AR: Improv can help you act out a portion of the spatial UI you are prototyping. In fact, ‘walking the space’ as you build the story experience is a common VR UX design tactic.
Example: Wolves in the Walls, a children’s story adaptation. Notice the UX of this piece includes a very “improv” onboarding experience for the user…
The experience begins with the user as co-author literally of the world. The character “draws your hands”, you are gradually introduced to the world, to her world.
3. Imagineering for VR/AR
What? Imagineering is a Disney World approach to experience design. It is an intentional approach to creating engagement and delight. Imagineering gives you creative license to think “hyper-naturally” for VR/AR.
“Designers should strive to create magical hyper-natural interactions. As a start, consider adding magical powers to ordinary objects to enable users to fulfill their fundamental desires—including teleportation and omniscience” -Hae Jin Lee, Hololens Interaction Designer.
Relevancy to VR/AR: Imagineering can help you think creatively about narrative from a spatial and emotional standpoint. eg Disney’s brainstorming triangle is a valuable way to evaluate your VR/AR piece
Example: Job Simulator “exit burrito”–the way you close the game is by eating a burrito with the words “Exit” on it. Notice this “UI” fits logically and emotionally with the narrative of working in a kitchen or workplace food preparation area. Read how they imagineered the decision here…
Conclusion
Designing for VR and AR adds a new level of calculated creativity to your experience design. Using Improv, Storytelling, and Imagineering techniques, you can expand your repertoire of ways to help users interact with states, events, UI elements and the overall narrative.
Design in VR/AR requires you to align your UX/UI with the story. Think of narrative as a “UI” engagement tool. Storytelling as UI, we believe extends to any VR/AR experience (not just games or entertainment). Remember, as you design, use spatial thinking and walk the space as Disney did… Hint: Your low-fidelity prototyping will look more like an impromtu stage-based, story walk-through.
As you design VR/AR, Storytelling, Improv, and Imagineering techniques can aid you in designing using all the deliberateness that a usability discipline brings. Immersive media allows us to get outside the 2D box. The more you leverage these powerful skills, the more intentional and captivating your user experience will be for your users and the success of your VR/AR project.
