Recommandé
Recommandé
Contenu connexe
Tendances
Tendances (20)
Similaire à Philipp Nagele (Wikitude): Context Is for Kings: Putting Context in the Hands of AR Developers
Similaire à Philipp Nagele (Wikitude): Context Is for Kings: Putting Context in the Hands of AR Developers (20)
Plus de AugmentedWorldExpo
Plus de AugmentedWorldExpo (20)
Dernier
Dernier (20)
Philipp Nagele (Wikitude): Context Is for Kings: Putting Context in the Hands of AR Developers
- 1. May 2018 Philipp Nagele, CTO Context Is for Kings
- 2. May 2018 Philipp Nagele, CTO Context Is for Queens
- 3. Philipp Nagele, CTO Previous • Product-Manager at Verisign, USA • Director PM at 3United (sold to VRSN) • Product& Innovation Manager at T-Mobile
- 4. Wikitude at a Glance 4 #1 independent AR development platform Serving 100,000+ developers & enterprises 25,000 apps & 1 bn installs powered by Wikitude
- 5. Enabling AR the Wikitude Way 5 AR Development Platform that works across OS boundaries. • A single Content API that works across Android, iOS and UWP • Utilizes the full power of the respective OS platform • Can run on a broader set of devices compared to single OS platforms 1 AR Development Platform that easily integrates into enterprise environments • JavaScript and web APIs are the prevalent way to interconnect in- house systems • Wikitude’s tooling is accessible through APIs for a high degree of automatization and scalability 2 AR development platform that looks at AR holistically and does not only try to solve a single business problem • Multiple ways of interacting with the real-world • Unique combination of technologies to cover a wide variety of AR use-cases 3
- 6. 6 “There’s no point building an AR App unless it interacts with the physical world in some way.” Matt Miesnieks, 6d.ai Image © 6d.ai
- 7. context 7 set of circumstances or facts that surround a particular event, situation
- 10. Geolocation AR Example Video: RecarGO | IceAge 10 LBS Gaming Placing graphical 3D elements on geo-coordinates, empowering interactive, location-based gaming concepts and treasure hunts for broad retail promotions Logistics and Indoor Locations Guide personnel dynamically through the warehouse, locate and visualize products and appliances and increase productivity in your logistics processes Tourist Guides Visualize Points of Interest, link landmarks to digital content sources and provide an interactive city guide to tourists and locals at the same time
- 12. 2D Image Recognition Example Videos: TIME Magazine | Mirage | MediaMarkt 12 Augmented Commerce Interact with catalogues, brochures and flyers for a revolutionary new home-shopping experience and direct link into a mobile commerce flow Interactive Sales Present products and features in a new, innovative and interactive style and bring sales presentations to a brand new level Augmented Print Allow customers to engage with printed content in a personalized, interactive way, update content in real- time and introduce new advertisement forms
- 14. 3D Markerless AR Example Videos: Marvel | ScopeAR | Franklin Institute 14 Remote Maintenance & Work Instructions Provide dynamic step-by-step guides at your workplace, offer remote support through augmented live annotations and increase productivity for your workforce Home Planning and Decoration Plan private or professional environments, visualize furniture and items dynamically and store your work for later use Augmented Entertainment Place all kind of entertainment content, game characters etc. in real life, make them interact with their surrounding and design exciting use-cases for single or multiple users.
- 16. Object Recognition Example Videos: CN2 | Palfinger | Disney 16 Documentation & Instructions Link multi-language documentation to a physical object, display a personalized set of data and enable dynamic guides and instructions Interactive Toys Connect toys to a mobile companion application, interact / fight / engage with your favorite toy and create a revolutionary new playing experience. Internet Of Things and Live Monitoring Show IoT and Monitoring Data in real-time, link sensor- data with advanced visualization and create dynamic guidelines for problem analysis and resolution
- 17. Components of an AR/VR/MR system 17 Sensing Computing VisualizeProject Hardware Software
- 18. On the way to the Perfect Illusion 18 Sensing Computing Visualize Project Mono Cameras Stereo Cameras HDR Cameras Depth Cameras Radar Sensors Lidar Sensors Location based Tracking Marker Based Tracking Monocular Vision SLAM Sensor Fusion SLAM/VIO Advanced Dense SLAM Global SLAM “AR Cloud” Recognizing pre-defined images objects Plane detection Understanding arbitrary shapes Segmentation of objects Recognizing pre-defined shapes Semantical scene Full mesh of surrounding Understanding of material Smartphone Displays HMD Untethered full FoV Smart Lenses Brain-Bridge Smart Glasses Lag-free rendering (60fps+) High-quality 3D models Artificial motion blur Apply atmospheric effects Adaptive light rendering Physics engine Spatially-coded Sound Tactile Feedback Event Cameras
- 19. 19
- 20. 20
- 22. 2 2 Desktop Mobile Augmented Reality Information Context Relevance + =
- 25. Wikitude Platform Architecture 2018 Unity Plugin Cordova Plugin Titanium ModuleXamarin Component Compute Engine Core Components Sensor Management ARMv7 optimizations ARMv8 optimizations GPGPU optimizations Intel x86 SSE optimizations Image Recognition Cloud Recognition SLAM Engine Object/Scene Recognition ARCoreGeo AR Plugin Manager Calibration Manager NativeAPIs C#API (Unity) JSAPI C++API ARKit Other Camera Plugins Computer Vision Plugins Plugins API Native SDK Components Camera IMU Depth Sensor Render Manager OpenG L Metal Vulkan WebView 2D/3D Augmentations 3D Rendering Ionic Plugin React Native Plugin Adobe AIR 3rd party components
- 26. SDK 8 in a Nutshell 26 ● New internal SDK architecture (Universal SDK) ○ Native platforms based on Universal SDK ○ Unity Plugin rewrite based on Universal SDK ● Windows Support - UWP (Native APIs) ● Unity Live Preview for macOS and Windows ● Instant Tracking: Save Instant Target/Load Instant Target ● Extended Tracking mode for Object Recognition ● Instant Tracking: Improved stability and performance ● Object Tracking: Improved stability and performance ● Tap to focus and Exposure APIs ● Bug Fixes CONFIDENTIAL
- 27. Object and Scene Recognition 27 Object & Scene Recognition This feature expands Wikitude’s object recognition technology covering a wider range of objects, scenes and AR use cases ● Significant upgrade to Wikitude’s recognition and tracking engine for objects ● Enables recognition of large objects, scenes and rooms ● Introduces an entirely new and improved recording process of objects using images instead of videos ● Delivers more accurate maps, better support for symmetrical/mirrored faces ● Maps can be updated with single images or carry different versions of an object to increase recognition rate (e.g different lighting, positions, etc) CONFIDENTIAL
- 28. Instant Tracking Save & Load Map 28 Save Instant Target/Load Instant Target This feature allows developers to go beyond ARKit and ARCore by allowing a save and load function of AR experiences ● Save Instant Tracking maps (instant target) for later usage ● Load previously recorded Instant Tracking maps ○ Loaded maps can be extended (grown) on the fly ● Easier sharing of AR experiences between users CONFIDENTIAL
- 29. Unity Live Preview 29 Unity Live Preview ● AR-View within Unity editor ● Easier development and faster prototyping for Unity-based projects ● #1 feature request from Unity developers ● Use the Unity Remote feature to test Instant Tracking directly from your PC ● Can be used with WebCam or or remote cameras (e.g. phone) CONFIDENTIAL
- 30. Native APIs For Windows 30 Windows Support ● Native APIs for Universal Windows platform (Windows 10) Tablets, Phones, PCs ● Based on new Universal SDK ● Intel™ based devices only ○ Majority of targeted devices is Intel based ○ Availability of ARM-based Windows 10 devices are very limited (e.g. Lumia Phones) ● JavaScript API for UWP following later CONFIDENTIAL
- 31. Extended Tracking for Objects 31 Extended Tracking for Objects ● Use Extended Tracking with Objects ● Initialize the AR experience by scanning an object and continue to see augmentations even without the object in the camera view CONFIDENTIAL
- 32. Camera Manipulation APIs & Others 32 More Camera Manipulation APIs ● Tap to focus ○ Focus of camera can be set dynamically ● Exposure API Area for Exposure can be set Other noteworthy changes ● Support for Android Studio 3.x and Gradle 3 ● Update for ARCore 1.2 CONFIDENTIAL
- 33. Enabling AR Cloud the Wikitude Way 33 Precise Visual Localizatio n Enable Collaboratio n Store experiences persistently Sync and Share Content • Enabling privately controlled ‘Micro-Clouds’ • Tailored AR Cloud-configurations specifically for actual needs and requirements • Privately managed and controlled content and data • Optimized for high security, high-availability and scalability AR Multiplayer Game AR Meeting AR Factory • Immersive AR Games for multiple players • Players can interact with their environment as well as with their buddies • Living room as private ‘Micro-AR Cloud’ • Engineers, creatives etc. join an AR meeting room (remotely or in person) • All attendees contribute to the overall content creation • Meeting room as private ‘Micro-AR Cloud’ • AR-assisted production and manufacturing • Workers receive step-by- step guides for collaborative tasks • Factory as private ‘Micro-AR Cloud’
- 34. Wikitude AR Cloud Demo 34 AR Cloud Demo Video * Live demo use-cases based on Wikitude SDK 8 (GA Q2’18)
- 35. Thank you Visit us at booth 413!