A talk from the Inspire Track at AWE USA 2018 - the World's #1 XR Conference & Expo in Santa Clara, California May 30- June 1, 2018.
Ramesh Raskar (MIT Media Lab): The Unspoken Challenges of AR & VR
http://AugmentedWorldExpo.com
8. Raskar | MIT Media Lab
Multi-ModeMulti-Format
IoT
Perception
Ergo,
Hygiene
Ethics
Gestural Language
9. Raskar | MIT Media Lab
Challenges in AR
World Input Process Output World
Camera,
Location
Sensors
Identify,
Track,
Abstract
Display,
3D Overlay
Interaction
MultiModal MultiFormat
IoT
Training
DataSets
Perception
Ergo, Hygiene
Ethics
Gestural Language
EyeGlasses
Laziness
Authoring
IoT
10. Raskar | MIT Media Lab
World Input Process Output World
Camera,
Location
Sensors
Identify,
Track,
Abstract
Display,
3D Overlay
Interaction
MultiFormat
IoT
Training
DataSets
Ergo, Hygiene
Ethics
Gestural Language
EyeGlasses
Laziness
Authoring
IoT
Challenges in AR
MultiModal
Perception
11. Raskar | MIT Media Lab
South Park - Jurassic Park
12. Raskar | MIT Media Lab
Photoreal Functional Realism
NonPhotoRealistic Camera, Siggraph 2004
13. Raskar | MIT Media Lab
Realism
Functional
Photoreal
Physical
Non-visual
Ferwerda 2003
14. Raskar | MIT Media Lab
Realism
Functional
Photoreal
Physical
Non-visual
Archaic neurosc +
perception
Few open datasets
21. Raskar | MIT Media Lab
Guerilla Marketing
FHM Magazine
22. Raskar | MIT Media Lab
Augmented Reality (AR)
World Input Process Output World
Camera,
Location
Sensors
Identify,
Track,
Abstract
Display,
3D Overlay
Interaction
MultiModal MultiFormat
IoT
Training
DataSets
Perception
Ergo, Hygiene
Ethics
Gestural Language
EyeGlasses
Laziness
Authoring
IoT
23.
24.
25.
26. Raskar | MIT Media Lab
“People are lazy”
Rob Lindeman, Benjamin Lok, Bill Baxter
Cognitive or Physical Exertion
Fatigue = Reduced Usage
27. Raskar | MIT Media Lab
Gesture Lexicon
Phone AR: No gesture
No Controllers
Natural Objects
Open Data Sets
28. Raskar | MIT Media Lab
Augmented Reality (AR)
World Input Process Output World
Camera,
Location
Sensors
Identify,
Track,
Abstract
Display,
3D Overlay
Interaction
MultiModal MultiFormat
IoT
Training
DataSets
Perception
Ergo, Hygiene
Ethics
Gestural Language
EyeGlasses
Laziness
Authoring
IoT
31. Raskar | MIT Media Lab
Mk Haley
Disney Imagineering
“My peers working with VR get frustrated with
women "ruining" the gear
because of mascara, foundation, or moisturizer on their face. Or
women being "difficult"
if they have ponytails or other hairstyles..
32. Raskar | MIT Media Lab
‘Glassholes’ Ethics
Info Asymmetry
Visual filter bubbles
‘Turn off sensors’
Eye tracking
33. Raskar | MIT Media Lab
Multi-ModeMulti-Format
IoT
Perception
Ergo,
Hygiene
Ethics
Gestural Language
35. Raskar | MIT Media Lab
Poor Man’s Palace
Augment the world, projectors and proxy geometry, controlling light every millimeter at every millisecond.
37. Raskar | MIT Media Lab
Acknowledgements
• Camera Culture Group, MIT Media Lab
• John Werner, Marco Jacobs, Mark Billinghurst, Sameer Rawal, Tim
Smith, Alvaro Cassinelli, Benjamin Lok, Rob Lindenman, Brett
Jones, Mk Haley,
• MERL
• Amit Agrawal, Ashok Veeraraghavan, Ankit Mohan, Jack Tumblin, Jeroen van
Baar, Paul Beardsley, Remo Ziegler, Thomas Willwacher, Srinivas Rao, Cliff
Forlines, Paul Dietz, Joe Marks, Darren Leigh
• Office of the Future group at UNC Chapel Hill
• Greg Welch, Kok-lim Low, Deepak B’padhyay, Aditi Majumder, Michael Brown,
Ruigang Yang
• Henry Fuchs, Herman Towles
• Wei-chao Chen
38. Raskar | MIT Media Lab
Challenges in AR
World Input Process Output World
Camera,
Location
Sensors
Identify,
Track,
Abstract
Display,
3D Overlay
Interaction
MultiModal MultiFormat
IoT
Training
DataSets
Perception Ergo, Hygiene
Ethics
Gestural Language
EyeGlasses
Laziness
Authoring
IoT
raskar.info/book
Slideshare.net/cameraculture
39. Raskar | MIT Media Lab
Unspoken AR Challenges
• Interaction
• Laziness
• Multimodal, Multi-format
• Spatial Augmentation
• Ambient Intelligence
– IOT
– Training Datasets
• Special Effects in Real World
– Poor Man’s Palace
– Upgrade the world
• Beyond HMD obsession!