Grégoire Cliquet gave a presentation on tangible interfaces and mixed reality at the Universität für angewandte Kunst Wien in May 2011. He discussed definitions of virtual reality, augmented reality, and mixed reality. He provided examples of projects from the READi interaction design lab, including SCOPE and Immersive Rail Shooter. Cliquet also covered major design issues for these new paradigms such as feeling, understanding, interacting, assimilating information, and privacy concerns. He concluded that augmented reality could expand the cyberspace into the real world but raised questions about how this may influence human evolution.
1. http://www.flickr.com/photos/gregoirecliquet/5603411030/
Grégoire Cliquet / L’Ecole de design Nantes Atlantique / READi design lab
+ Tangible Interfaces & Mixed Reality :
A step toward digital augmented environments +
Universität für angewandte Kunst Wien
May, 6th 2011
A step toward digital augmented environments / Universität für angewandte Kunst Wien / G. Cliquet / May. 2011
2. “datataquarium” / Laval Virtual 2009
Gregoire Cliquet
Director of the « READi interaction design lab »
L’Ecole de design Nantes Atlantique
Phd. in Engineering Science
Course leader in interaction design / H.M.I.
Real-Time 3d developer / Information visualization
A step toward digital augmented environments / Universität für angewandte Kunst Wien / G. Cliquet / May. 2011
3. http://www.flickr.com/photos/lecolededesign/2320698239/in/set-72157604076710360/
Interaction design @lecolededesign ?
10 years ;)
5 years curriculum : 1 Basics / 2 Undergraduate (Bachelor) / 2 Master’s program (Tangible Interfaces & Virtual Reality)
Interacttion design : About 100 students + 25 masters degrees /year
Prizes : Laval Virtual, Siggraph 2009 + IVRC 2009 & 2010
Interaction design @lecolededesign.com : Contents + Interfaces (Ui) + Interaction (Ux) + Services
A step toward digital augmented environments / Universität für angewandte Kunst Wien / G. Cliquet / May. 2011
5. “leARn” / Victor Manselon 2011 / http://www.pimentsrouges.com/
READi ? Tangible interfaces
From GUI to NUI the place & gestures as meanings of interaction
The disappearance of graphic interfaces/embedding intelligence into day to day objects
Natural User Interfaces for collaborative work
DIY / FabLab : When mass production turns to home-made production
A step toward digital augmented environments / Universität für angewandte Kunst Wien / G. Cliquet / May. 2011
6. http://www.flickr.com/photos/gregoirecliquet/3264184500/in/set-72157613484076021
READi ? Virtual Reality
x2 diploma in partnership with Arts et Métiers ParisTech
Virtual, Augmented and Mixed Reality to improve User Experiences
New applications, gameplays, services built with AR
Interactive and Immersive 3d as a universal language in the process of co-creation
Representing and interacting with / within data.
Laboratoire Présence&innovation LAVAL
A step toward digital augmented environments / Universität für angewandte Kunst Wien / G. Cliquet / May. 2011
7. ”IRS” / David Arenou / pfe 2010
Immersive Rail shooter / David Arenou 2010
Tangible Interfaces & Mixed Reality :
A step toward digital augmented environments
1. Definitions
2. Examples @READi
3. New paradigm in computing
4. Major design issues
5. Conclusion / Discussion
A step toward digital augmented environments / Universität für angewandte Kunst Wien / G. Cliquet / May. 2011
8. http://www.flickr.com/photos/loneyss/3187497169/sizes/l/in/set-72157612394649393/ Photo : L. Neyssensas
1. Definitions: Virtual Reality?
Jaron Lanier in 1985 for “computer-simulated environments”
Virtual Reality (VR) aims by using special devices to simulate physical presence :
stereoscopic display, haptic feedbacks, IR tracking…
Human into the Computer
A step toward digital augmented environments / Universität für angewandte Kunst Wien / G. Cliquet / May. 2011
9. http://www.flickr.com/photos/loneyss/5187428975/sizes/l/in/set-72157625294610619 / ( L. Neyssensas)
1. Definitions: Virtual Reality (example)
http://www.youtube.com/watch?v=XECqdtdY-Gc
VR4D “Virtual Reality For Design” / project (2010)
demo (video)
A step toward digital augmented environments / Universität für angewandte Kunst Wien / G. Cliquet / May. 2011
10. http://www.flickr.com/photos/gregoirecliquet/3554878032/in/set-72157618547738755
1. Definitions: Augmented Reality?
Thomas Caudell & David Mizellin 1990 to overlap digital information in real time above the real world
Augmented Reality acts as a filter between real space and human to enrich their experiences
Digital Information Everywhere
A step toward digital augmented environments / Universität für angewandte Kunst Wien / G. Cliquet / May. 2011
11. http://www.layar.com
1. Definitions: Augmented Reality (example)
Usefull to locate services and get extra information (context aware information) or even…
…to create new experiences (gamification ?)
A step toward digital augmented environments / Universität für angewandte Kunst Wien / G. Cliquet / May. 2011
12. ”Know How Augmented” / François Ballon 2011
1. Definitions: Mixed Reality?
Paul Milgram and Fumio Kishino in 1994 defined mixed reality as the merging of real and virtual worlds to produce
new environments and visualisations where physical and digital objects co-exist and interact in real time
Mixed Reality enables users to interact physically with augmented artefacts
Physical and Digital objects co-exist and interact in real time
A step toward digital augmented environments / Universität für angewandte Kunst Wien / G. Cliquet / May. 2011
13. http://rogiken.org/vr/english.html
1. Definitions: Mixed Reality (example)
http://www.youtube.com/watch?v=F63Iac2IIDo
KOBITO / Virtual Brownies (Society for the Study of Robotics / 2004)
demo (video)
A step toward digital augmented environments / Universität für angewandte Kunst Wien / G. Cliquet / May. 2011
14. 1. Definitions: Mixed Reality (@READi)
http://www.visionaries777.com/project-1/
SCOPE : Frantz Lasorne / 2009 / Objects (toys) mixed with video game / demo (video)
Immersive Rail shooter : David Arenou / 2010 / Space mixed with video game / demo (video)
http://portfolio.davidarenou.com/video-game/immersive-rail-shooter/
A step toward digital augmented environments / Universität für angewandte Kunst Wien / G. Cliquet / May. 2011
15. Reality-Virtuality continuum according to Milgram, Takemura, Utsumi and Kishino (1994)
”IRS” / David Arenou / pfe 2010
2. New paradigm in computing: VR / AR / MR ?
Various Realitie(S) related to their relationships with the “real” (perceived) environment
New paradigms in computing // Keyboard + Mouse + Screen = Obsolete !
A step toward digital augmented environments / Universität für angewandte Kunst Wien / G. Cliquet / May. 2011
16. Street Museum (London)
http://www.museumoflondon.org.uk/Resources/app/you-are-here-app/index.html
2. New paradigm in computing : Space & Time
Virtual Reality : Generates spaces & objects (simulation / past-present-future)
Augmented Reality : Enriches existing spaces & objects (extra information / past-present-future)
Computers which are based on time to calculate are able to generate space (Time Generate Spaces)
Time Shifted + Augmented Spaces = “another” reality / new means of expression (art)
A step toward digital augmented environments / Universität für angewandte Kunst Wien / G. Cliquet / May. 2011
17. ”IRS” / David Arenou / pfe 2010
3 major steps in the meanings of interaction
2. New paradigm in computing: meanings of interaction
From Direct Manipulation (B. Schneiderman / 1982) to Natural User Interaction
Follow the state of child’s evolution :
Mouse to Point and Click / Multi-Touch Surfaces / Tangible & Gesture interactions (manipulating & moving)
Find new metaphors to describe gesture and natural interactions (implying the body)
A step toward digital augmented environments / Universität für angewandte Kunst Wien / G. Cliquet / May. 2011
18. ”Stepping Garden” / P. Thebault / 2006
3. Major design issues : « Feel »
http://llllllllllllllll.org/stepping-garden/
Virtual Reality : Reinforce the feeling of being immerged into a virtual space (sens + emotions)
by extending implied senses : Proprioception / Kinesthetic…
Augmented Reality : How do I perceive that an environment, an object is augmented ?
It’s often much more interesting to observe people’s reactions more than the disposal in itself !!
A step toward digital augmented environments / Universität für angewandte Kunst Wien / G. Cliquet / May. 2011
19. ”Funny Planet” / l16.org (2007) / http://llllllllllllllll.org
3. Major design issues : « Understand »
How users know that they can interact, “anyware” ?
Affordance ? (Don. Norman) // How to these new Devices / Objects / Spaces will explain us their functioning ?
New ways to design meaningful and usable “augmented” objects and spaces (tangible interfaces)
A step toward digital augmented environments / Universität für angewandte Kunst Wien / G. Cliquet / May. 2011
20. ”IRS” / David Arenou / pfe 2010
http://www.ted.com/talks/john_underkoffler_drive_3d_data_with_a_gesture.html
3. Major design issues : « Interact »
Common Vocabulary / Grammar for this new means of interaction ? (From a device to another ?) / Obvious ?
Look to point & click (cf. SCOPE) or access to “help” in Kinect ( left arm to 45°)
Feedbacks ? Haptic ? (“Minority Report” is absolutely not an ergonomic experience !)
Reality even “augmented” is an experience need to be shared (http://mixedreality.tumblr.com/post/177049282/place-a-la-realite-mixte)
A step toward digital augmented environments / Universität für angewandte Kunst Wien / G. Cliquet / May. 2011
21. International Civil Flight Traffic Mapping in 1999 (B. Gerard, L. Briceno, B.A. Bui The Thuong / 2011)
3. Major design issues : « Assimilate »
Contextualize and adapt contents regarding to mobility
Find more explicit ways to present contents (graphically, cartographically… avoid list mode !!)
A step toward digital augmented environments / Universität für angewandte Kunst Wien / G. Cliquet / May. 2011
22. ”IRS” / David Arenou / pfe 2010
http://www.chrisoakley.com/the_catalogue.html (2004)
3. Major design issues : « Privacy »
http://www.chrisoakley.com/the_catalogue.html
How users can keep control on the system, on informations about their identity, life, habits ?
Who owns the data ? (Facebook ? Google ?) / cf. P. K. Dick…
A step toward digital augmented environments / Universität für angewandte Kunst Wien / G. Cliquet / May. 2011
24. http://www.lowtech.org/press/gfx/raid.jpg
4. Conclusion
The cyberspace offers new experiences that can’t be lived through screen, keyboard and mouse
Explore new meanings and propose new metaphors of interaction
A step toward digital augmented environments / Universität für angewandte Kunst Wien / G. Cliquet / May. 2011
25. http://www.syfy.com/caprica/
4. Conclusion
Augmented humanity ? considering the influence of environments on biological evolutions ?
Interaction design as a temporary solution ? (regarding time of evolution) ?
Hardware / “cheap” devices previously dedicated to VR (Camera Vision / Wiimote / Kinect… => Hacking !)
Middleware : Visual Scripting Languages (blocks): Virtools / Unity / Open Spaces 3d…
A step toward digital augmented environments / Universität für angewandte Kunst Wien / G. Cliquet / May. 2011
26. Demo « Immersive Rail Shooter » David Arenou / (L. Neyssensas 2010)
Thank You
Questions ?
g.cliquet@lecolededesign.com
http://www.lecolededesign.com
http://readi.lecolededesign.com
A step toward digital augmented environments / Universität für angewandte Kunst Wien / G. Cliquet / May. 2011