Introduction to Augmented Reality
â˘
22 likesâ˘10,259 views
Augmented reality (AR) combines real and virtual images, is interactive in real-time, and has virtual content registered in 3D space. The document traces the history of AR from early experimentation in the 1960s-1980s to mainstream commercial applications today. Key developments include the first head-mounted display in 1968, mobile phone AR in the 2000s, and consumer products like Google Glass. The document also provides examples of AR applications in various domains such as marketing, gaming, manufacturing, and healthcare.
Recommended
More Related Content
What's hot
What's hot (20)
Viewers also liked
Viewers also liked (20)
Similar to Introduction to Augmented Reality
Similar to Introduction to Augmented Reality (20)
More from Mark Billinghurst
More from Mark Billinghurst (20)
Recently uploaded
Recently uploaded (20)
Introduction to Augmented Reality
- 1. INTRODUCTION TO AUGMENTED REALITY: HISTORICAL PERSPECTIVES AND APPLICATIONS Mark Billinghurst First Augmented Reality School AR101 September 18th 2016 Merida, Mexico
- 2. â˘âŻ adsf We enjoy connecting to the world around us..
- 4. The Digital Divide â˘âŻScreens are windows into digital spaces â˘âŻSeparation between digital and physical world â˘âŻSeparation between people
- 5. Making Interfaces Invisible Rekimoto, J. and Nagao, K. 1995. The world through the computer: computer augmented interaction with real world environments. In Proceedings of the 8th Annual ACM Symposium on User interface and Software Technology. UIST '95. ACM, New York, NY, 29-36.
- 6. Graphical User Interfaces â˘âŻSeparation between real and digital worlds â˘âŻWIMP (Windows, Icons, Menus, Pointer) metaphor
- 7. Ubiquitous Computing â˘âŻComputing and sensing embedded in real world â˘âŻParticle devices, RFID, motes, arduino, etc
- 9. Virtual Reality â˘âŻImmersiveVR â˘âŻHead mounted display, gloves â˘âŻSeparation from the real world
- 10. Augmented Reality â˘âŻStar Wars - 1977
- 11. Augmented Reality Definition â˘âŻDefining Characteristics [Azuma 97] â˘âŻCombines Real andVirtual Images â˘âŻBoth can be seen at the same time â˘âŻInteractive in real-time â˘âŻThe virtual content can be interacted with â˘âŻRegistered in 3D â˘âŻVirtual objects appear fixed in space Azuma, R. T. (1997). A survey of augmented reality. Presence, 6(4), 355-385.
- 13. â˘âŻ Put AR pictures here Augmented Reality Examples
- 14. AR vsVR
- 16. Making Interfaces Invisible Rekimoto, J. and Nagao, K. 1995. The world through the computer: computer augmented interaction with real world environments. In Proceedings of the 8th Annual ACM Symposium on User interface and Software Technology. UIST '95. ACM, New York, NY, 29-36.
- 17. From Reality toVirtual Reality Ubiquitous Computing Augmented Reality Virtual Reality
- 18. Milgramâs Reality-Virtuality continuum Mixed Reality Reality - Virtuality (RV) Continuum Real Environment Augmented Reality (AR) Augmented Virtuality (AV) Virtual Environment "...anywhere between the extrema of the virtuality continuum." P. Milgram and A. F. Kishino, Taxonomy of Mixed Reality Visual Displays IEICE Transactions on Information and Systems, E77-D(12), pp. 1321-1329, 1994.
- 19. AugmentedVirtuality â˘âŻVR with windows into the real world
- 20. Ubiquitous Computing Continuum â˘âŻWeiser Continuum
- 21. Milgram â Weiser Continuum â˘âŻ Newman, J., Bornik, A., Pustka, D., Echtler, F., Huber, M., Schmalstieg, D., & Klinker, G. (2007, March). Tracking for distributed mixed reality environments. In Workshop on Trends and Issues in Tracking for Virtual Environments at the IEEE Virtual Reality Conference (VRâ07).
- 22. Metaverse â˘âŻNeal Stephensonâs âSnowCrashâ â˘âŻThe Metaverse is the convergence of: â˘âŻ1) virtually enhanced physical reality â˘âŻ2) physically persistent virtual space â˘âŻMetaverse Roadmap â˘âŻhttp://metaverseroadmap.org/
- 23. Metaverse Dimensions ⢠Augmentation technologies that layer information onto our perception of the physical environment. ⢠Simulation technologies that model reality ⢠Intimate technologies are focused inwardly, on the identity and actions of the individual or object; ⢠External technologies are focused outwardly, towards the world at large;
- 24. Metaverse Components â˘âŻFour Key Components â˘âŻVirtual Worlds â˘âŻAugmented Reality â˘âŻMirror Worlds â˘âŻLifelogging
- 26. MirrorWorlds â˘âŻMirror worlds are informationally-enhanced virtual models of the physical world. â˘âŻ Google Earth, MS StreetView, Google Maps
- 27. My House â May 2013
- 28. LifeLogging â˘âŻTechnologies record and report the intimate states and life histories of objects and users â˘âŻFitBit, Microsoft Band, Shine, etc
- 29. Gordon Bell:LifeLogging 1 TB to store 65 years of data
- 30. Narrative Clip â˘âŻWearable camera â˘âŻAutomatic picture capture - 2 pics/minute â˘âŻhttp://getnarrative.com
- 31. Summary â˘âŻAR has three key features â˘âŻCombines Real andVirtual Images â˘âŻInteractive in real-time â˘âŻRegistered in 3D â˘âŻAR can be classified with other technologies â˘âŻInvisible Interfaces â˘âŻMilgramâs Mixed Reality continuum â˘âŻMilgram-Weiser continuum â˘âŻMetaVerse
- 32. HISTORY OF AR
- 34. Pepperâs Ghost (1862) â˘âŻ Dates back to Giambattista della Porta (1584)
- 35. The Master Key (1901) â AR Glass â˘âŻ "It consists of this pair of spectacles. While you wear them every one you meet will be marked upon the forehead with a letter indicating his or her character. The good will bear the letter 'G,' the evil the letter 'E.' ⌠Thus you may determine by a single look the true natures of all those you encounter.â L. Frank Baum
- 36. Early HUD (1958) F16 â Head Up Display
- 38. First HMD â˘âŻPhilco Headsight (1961) â Remote Camera Viewing
- 39. Sutherland HMD â˘âŻ1968: Sutherland / Sproullâs first HMD system â˘âŻsee-through
- 40. Demo â Sutherland HMD (1968) â˘âŻ https://www.youtube.com/watch?v=NtwZXGprxag
- 41. USAirforce HMDs 1960 - 70âs: US Air Force HMDs (T. Furness III)
- 42. SuperCockpit Program 1970 - 80âs: US Air Force Super Cockpit (T. Furness III)
- 43. Modern Airforce HMDs â˘âŻ Honeywell Integrated Helmet and Display Sighting System (IHADSS) on AH-64 Apache attack helicopter in 1985
- 44. F35- HMD Demo (2014) â˘âŻ https://www.youtube.com/watch?v=Ay6g66FbkmQ
- 45. First Industrial Use â˘âŻEarly 1990âs: Boeing coined the term âAR.â Wire harness assembly application begun (T. Caudell, D. Mizell).
- 46. Academic Research Beginning â˘âŻ1994: Motion stabilized display [Azuma] â˘âŻ1995: Fiducial tracking in video [Bajura / Neumann] â˘âŻ1996: UNC hybrid magnetic-vision tracker
- 47. Development of the Field â˘âŻ1996: MIT Wearable Computing efforts â˘âŻ1998: Dedicated conferences begin (ISMAR) â˘âŻLate 90âs: Collaboration, outdoor, interaction â˘âŻLate 90âs:Augmented sports broadcasts
- 48. Development of Tools â˘âŻ1996 CyberCode (Rekimoto) â˘âŻFirst matrix code tracking â˘âŻ1999 ARToolKit (Kato & Billinghurst) â˘âŻOpen source tracking library
- 50. Mobile/Wearable Systems â˘âŻ1995 Navicam (Rekimoto) â˘âŻ Handheld AR â˘âŻ1997 Touring Machine (Feiner) â˘âŻ Backpack AR â˘âŻ GPS, see-through display
- 51. History Summary â˘âŻ1960âs â 80âs: Early Experimentation â˘âŻ1980âs â 90âs: Basic Research â˘âŻTracking, displays â˘âŻ1995 â 2005:Tools/Applications â˘âŻInteraction, usability, theory â˘âŻ2005 - : Commercial Applications â˘âŻGames, Medical, Industry
- 52. 2007 -AR Reaches Mainstream â˘âŻMIT Technology Review â˘âŻ March 2007 â˘âŻ list of the 10 most exciting technologies â˘âŻEconomist â˘âŻ Dec 6th 2007 â˘âŻ Reality, only better
- 53. 2009 -AR in Magazines â˘âŻEsquire Magazine â˘âŻDec 2009 issue â˘âŻ12 pages AR content â˘âŻMany Others â˘âŻWired â˘âŻColors â˘âŻRed Bull â˘âŻEtc
- 55. Google Searches forAR â˘âŻTwo factors drive rise in AR popularity in 2009 â˘âŻ Browser based AR, Mobile phone AR
- 56. 2008 - Browser BasedAR â˘âŻFlash + camera + 3D graphics â˘âŻ ARToolKit ported to Flash â˘âŻHigh impact â˘âŻ High marketing value â˘âŻLarge potential install base â˘âŻ 1.6 Billion web users â˘âŻEase of development â˘âŻ Lots of developers, mature tools â˘âŻLow cost of entry â˘âŻ Browser, web camera
- 57. Demo: GE SmartGrid Example â˘âŻ https://www.youtube.com/watch?v=vJO_AZkCL9U
- 58. 2005 - Mobile PhoneAR â˘âŻMobile Phones â˘âŻcamera â˘âŻprocessor â˘âŻdisplay â˘âŻAR on Mobile Phones â˘âŻSimple graphics â˘âŻOptimized computer vision â˘âŻCollaborative Interaction
- 59. ARAdvertising (HIT Lab NZ 2007) â˘âŻTxt message to download AR application (200K) â˘âŻSee virtual content popping out of real paper advert â˘âŻTested May 2007 by Saatchi and Saatchi
- 61. 2009 - Outdoor Information Overlay â˘âŻMobile phone based â˘âŻTag real world locations â˘âŻGPS + Compass input â˘âŻOverlay graphics on live video â˘âŻApplications â˘âŻTravel guide,Advertising, etc â˘âŻWikitude, Layar, etc.. â˘âŻiOS/Android, Public API released
- 62. Layar Demo (2009) â˘âŻ https://www.youtube.com/watch?v=b64_16K2e08
- 63. Google Glass (2011 - )
- 64. Epson Moverio BT-200 âŞâŻStereo see-through display ($700) âŞâŻ960 x 540 pixels, 23 degree FOV, 60Hz, 88g âŞâŻAndroid Powered, separate controller âŞâŻVGA camera, GPS, gyro, accelerometer
- 65. Hololens (2016) â˘âŻIntegrated system â Windows â˘âŻStereo see-through display â˘âŻDepth sensing tracking â˘âŻVoice and gesture interaction
- 66. View Through Hololens â˘âŻ https://www.youtube.com/watch?v=RddvMLwT__g
- 67. â˘âŻ Weak AR â˘âŻ Imprecise tracking â˘âŻ No knowledge of environment â˘âŻ Limited interactivity â˘âŻ Handheld AR â˘âŻ Strong AR â˘âŻ Very accurate tracking â˘âŻ Seamless integration into real world â˘âŻ Natural interaction â˘âŻ Head mounted AR Strong vs. Weak AR
- 68. Augmented RealityToday â˘âŻKey Technologies Available â˘âŻRobust tracking (ComputerVision, GPS/sensors) â˘âŻDisplay (Handheld, HMDs) â˘âŻInput Devices (Kinect, etc) â˘âŻDeveloper tools (Vuforia,ARToolKit) â˘âŻCommercial Business Growing â˘âŻGaming, GPS/Mobile, Online Advertisement â˘âŻ>$2 Billion USD in 2016
- 69. AR BusinessToday â˘âŻMarketing â˘âŻWeb-based, mobile â˘âŻMobile AR â˘âŻGeo-located information and service â˘âŻDriving demand for high end phones â˘âŻGaming â˘âŻMobile, Physical input (Kinect, PS Move) â˘âŻUpcoming areas â˘âŻManufacturing, Medical, Military
- 70. AR Business Today â˘âŻAround $600 Million USD in 2014 (>$2B 2016) â˘âŻ70-80+% Games and Marketing
- 72. Crossing the Chasm - 5-10 years http://www.gartner.com/newsroom/id/3114217
- 73. Market Projections cf. 2014 computer game market = $84 Billion USD
- 74. Forecast Number of Users
- 75. Pokemon GO Killer Combo: brand + social + mobile + geo-location + AR
- 76. Pokemon GO Effect â˘âŻ Fastest App to reach $500 million in Revenue â˘âŻ Only 63 days after launch, > $1 Billion in 6 months â˘âŻ Over 500 million downloads, > 25 million DAU â˘âŻ Nintendo stock price up by 50% (gain of $9 Billion USD)
- 77. Summary â˘âŻAugmented Reality has a long history going back to the 1960âs â˘âŻInterest in AR has exploded over the last few years and is being commercialized quickly â˘âŻAR is growing in a number of areas â˘âŻMobile AR â˘âŻWeb based AR â˘âŻMarketing experiences
- 79. â˘âŻ Web based AR â˘âŻ Flash, HTML 5 based AR â˘âŻ Marketing, education â˘âŻ Outdoor Mobile AR â˘âŻ GPS, compass tracking â˘âŻ Viewing Points of Interest in real world â˘âŻ Eg: Junaio, Layar, Wikitude â˘âŻ Handheld AR â˘âŻ Vision based tracking â˘âŻ Marketing, gaming â˘âŻ Location Based Experiences â˘âŻ HMD, fixed screens â˘âŻ Museums, point of sale, advertising Typical AR Experiences
- 80. AR Books â MarkerlessTracking
- 81. HIT Lab NZ ACMI Book Demo https://www.youtube.com/watch?v=DfzTFPsq224
- 82. Example: Haunted Book/AR Book â˘âŻ Camera hidden in lamp object â˘âŻ AR content seamlessly integrated into real book â˘âŻ Natural page turning/manipulation interaction Scherrer, C., Pilet, J., Fua, P., & Lepetit, V. (2008, September). The haunted book. In Proceedings of the 7th IEEE/ACM international Symposium on Mixed and Augmented Reality (pp. 163-164). IEEE Computer Society.
- 83. Gaming:Rock-em Sock-em â˘âŻShared AR Demo â˘âŻMarkerless tracking
- 85. Sales and Marketing â˘âŻConnect with brands and branded objects â˘âŻLocation Based Experiences â˘âŻ Lynx Angels â˘âŻWeb based â˘âŻ Rayban glasses â˘âŻMobile â˘âŻ Ford Ka campaign â˘âŻPrint based â˘âŻ Red Bull Magazine
- 86. Pepsi AR Experience (2014) â˘âŻ Video see-through AR in bus shelter â˘âŻ Bus shelter appears under attack
- 88. Assembly and Maintenance Š 1993 S. Feiner, B. MacIntyre, & D. Seligmann, Columbia University Š 1996 S. Feiner, B. MacIntyre, & A. Webster, Columbia University
- 89. Maintenance Systems â˘âŻNgrain â˘âŻhttp://www.ngrain.com/ â˘âŻTraining authoring tool â˘âŻModel based AR tracking â˘âŻScopeAR â˘âŻhttp://www.scopear.com/ â˘âŻRemote assistance â˘âŻImage based tracking
- 91. MedicalARTrials !⯠Sauer et al. 2000 at Siemens Corporate Research, NJ !⯠Stereo video see through F. Sauer, Ali Khamene, S. Vogt: An Augmented Reality Navigation System with a Single-Camera Tracker: System Design and Needle Biopsy Phantom Trial, MICCAI 2002
- 93. Interactive Museum Experiences "⯠BlackMagic "⯠Virtual Americaâs Cup "⯠410,000 people in six months "⯠MagicPlanet "⯠TeManawa science museum "⯠Virtual Astronomy "⯠Collaborative AR experience "⯠ARVolcano "⯠Interactive AR kiosk "⯠Scienceworks museum, Melbourne
- 95. Demo: Digital Binocular Station https://www.youtube.com/watch?v=mqLAKBX0om4
- 96. CityViewARApplication â˘âŻ Visualize Christchurch before the earthquakes
- 98. Example: Holoportation â˘âŻ Augmented Reality + 3D capture + high bandwidth â˘âŻ http://research.microsoft.com/en-us/projects/holoportation/
- 100. Summary â˘âŻAR technology can be used to develop a wide range of applications â˘âŻPromising application areas include â˘âŻGames â˘âŻEducation â˘âŻEngineering â˘âŻMedicine â˘âŻMuseums â˘âŻEtc..