Week 2 lecture of the Mixed Reality course at RMIT University in Melbourne, Australia - given my guest lecturer M. Pell (http://www.futuristic.com) of The Microsoft Garage. From the textbook http://EnvisioningHolograms.com

1. Week 2 – The Envisioning Process
Mike Pell
The Microsoft Garage

2. Week 2 – The Envisioning Process
What is Envisioning, really?
Why am I presenting?
Key Insights
Examples of Envisioning
When to use Envisioning
Envisioning Techniques and Tools
Envisioning Example
Envisioning Exercise
Review and Critique
Questions

3. What is Envisioning, really?

4. Envisioning takes you from now…

5. …to a tangible imaged experience

6. Why do beautiful spaces have to be cold and lifeless?

8. What is a Hologram?

9. Classic Modern

10. ARTIFICIAL
REALITY
MIXED
REALITY
PHYSICAL
REALITY
AUGMENTED
REALITY
VIRTUAL
REALITY

11. Why am I presenting?

12. M. Pell
The Garage “Reality Room”

14. About M. Pell
1989 1993 2001 2014

23. Key Insights

27. People are always the key,
never the technology.

31. CONFUSION

32. FEAR

33. MIND BLOWN

34. OH YEAH !

36. The best envisioning tool
is our imagination

37. What do you see?

40. Examples of Envisioning

54. When to use Envisioning

56. WHEN TO USE ENVISIONING

57. ENVISIONING PROCESS

58. ENVISIONING PROCESS

60. FAST DESIGN

62. Envisioning Techniques
and Tools

63. ENVISIONING TECHNIQUES

64. NARRATIVES
Words matter. Verbally telling compelling stories is one of the
oldest and best ways to communicate your ideas quickly.
If you become proficient at this method and convey enough
detail, someone else will actually be able to convey it in many
other mediums just as you conceived.

65. Voice Memos
NARRATIVES
 Fast capture of ideas
 Disposable
 Cringe-worthy

67. PHOTOS
It’s amazing what your imagination is capable of when it
comes to filling space.
There’s nothing easier to capture the potential environment for
an experience than taking your phone out and taking a photo.
These scenes can be used for design mood boards, sketching,
prototyping or just as inspiration.

68. Camera
PHOTOS
 Fast capture of ideas
 Super high resolution
 Camera Roll as database

70. Microsoft PowerPoint
| MR Jam at Build M. Pell | Envisioning Holograms
PHOTOS
 Fast compositing
 Inking over photos
 Easily editable

73. SKETCHING
Ordinarily, there’s nothing faster than picking up a pen or
pencil and drawing your ideas out quickly on paper.
Unfortunately, it’s not that easy when dealing with 3D.
Other tools and techniques are actually better than the
traditionally fastest and easiest method.

74. Adobe Photoshop
SKETCHING
 Advanced compositing
 Type manipulation
 Unlimited layers

76. Mental Canvas
| MR Jam at Build M. Pell | Envisioning Holograms
SKETCHING
 Drawing with a pen
 Three-dimensional canvas
 Scene-based

78. VIDEOS
You can argue that videos are now the most popular way to
communicate anything these days.
Using some new tools can make it simple to create videos that
have holograms in them that illustrate ideas for experiences.

79. Camera/Videos
VIDEOS
 Fast capture of action
 Audio is important
 Videos as database

81. Mixed Reality Viewer
VIDEOS
 Live scene capture
 Hologram placement
 Video capture/export

84. ACTING
Of all the techniques and tools for creating breakthrough
experiences, it turns out that acting is the most effective.
Walking through the experience with props and other people
playing the role of hologram reveals so much about how it
should feel and behave, nothing comes close.
This is also referred to as “bodystorming” (like brainstorming)

85. Video
ACTING
 Fast capture of action
 Audio is important
 Videos as database

87. Adobe Audition
VIDEOS
 Sound effects
 Impactful audio
 Emotional triggers

89. 3D TOOLS
It’s everyone’s first thought to jump right into 3D modeling and
animation tools to prototype their experiences. Good idea :-)
The nature of what we’re doing requires some dimensionality
in the way we depict it. These tools bring the ideas to life,
whether in-device or real-time immersion.
Just be careful of the amount of time you spend here.

90. Google Tilt Brush
3D TOOLS
 In-device 3D painting
 Video capture/export
 Unbelievably fun

92. Adobe Dimensions
3D TOOLS
 Compositing
 Texture mapping
 Aligning to backgrounds

94. Microsoft Paint 3D
3D TOOLS
 Quick modeling
 Easy import/export
 Objects from Remix 3D

96. SandDance
a Microsoft Garage Project
3D TOOLS
 3D visualization
 Uses actual data
 Fast and fluid exploration

99. Microsoft PowerPoint
PRESENTATION
 Fast, precise, animated
 Inking over photos
 Easily editable

101. Tools like PowerPoint can easily inject 3D objects into empty photos like this

102. Unity + Visual Studio
CODING
 Designers + Devs
 Working Code Protos
 Real Code Wins

106. Spectator View
HARDWARE
 Hologram compositing
 DIY hardware/software
 Highly impactful

108. Envisioning Example
Idea-to-Prototype Technique

122. We are at the beginning…

123. Look how far cupcake technology has advanced

124. We don’t know what we don’t know

126. INCLUSIVE
Let’s design for everyone from the start.

127. Don’t have to look further than young kids to see the future

128. Envisioning Exercise

129. 30 min exercise
Quickly envision:
The future of casual gaming
while commuting

130. Review and Critique

132. Questions?
@_MPell_
MPell@EnvisioningHolograms.com
EnvisioningHolograms.com
Envisioning Holograms
The Techniques

133. Thank you