Achieving the best possible mixed reality performance on mobile platforms, such as head mounted displays, requires careful selection and optimization of three distinct elements; the depth sensor, computer vision software, and the processor. There are numerous characteristics and operating parameters associated with each element. Depth sensors and processors must provide high performance while not consuming too much power. Computer vision software needs to work in dynamically changing environments. A detailed examination of all the various characteristics of each key element will ensure the best possible mixed reality experience.
Augmented World Expo (AWE) is back for its seventh year in our largest conference and expo featuring technologies giving us superpowers: augmented reality (AR), virtual reality (VR) and wearable tech. Join over 4,000 attendees from all over the world including a mix of CEOs, CTOs, designers, developers, creative agencies, futurists, analysts, investors, and top press in a fantastic opportunity to learn, inspire, partner, and experience first hand the most exciting industry of our times. See more at http://AugmentedWorldExpo.com
2. About VanGogh Imaging
• Passionate focus on 3D computing for over 5 years
• Experts in using 3D depth sensors
• Developing innovative 3D computer vision implementations
• Processor optimization on mobile devices
• Strong R&D team recognized by industry leaders
• ‘Best-in-Class’ MR computing platform licensed by large OEMs
• Innovative approach to achieve ease of use and reliability
• ‘Hand-scan’ 3D models
• 3D sparse tracking
Enterprise AR at AWE 2016June 1, 2016 2
4. Enterprise AR at AWE 2016June 1, 2016
What is Mixed Reality?
Seamlessly combines
real and virtual objects
or scenes.
4
Object MR
Example
5. Enterprise AR at AWE 2016June 1, 2016
What is Mixed Reality?
Seamlessly combines
real and virtual objects
or scenes.
5
Scene MR
Example
from Canon
6. Our Vision For Enabling The Future of MR
• Easily deploy Mixed Reality solutions
• Solution provides fast MR realization on multiple select platforms
• Leverage best-in-class HW
• Use the best 3D sensors
• Optimized on key processors
• Cross-Platform
• VR HMD for real objects in virtual environment
• AR HDM for virtual within real environment
• Projector for projecting virtual on real background
• IoT for specific tasks
• Mobile Devices
Enterprise AR at AWE 2016June 1, 2016 6
7. MR Ecosystem
Key Enablers of MR
- 3D Depth Sensor
- 3D Computer Vision
- Processors
- Displays
Enterprise AR at AWE 2016June 1, 2016 7
8. Enterprise AR at AWE 2016June 1, 2016
History of 3D Depth Sensors
8
2011 to Present Going Forward
Sensors Microsoft Kinect, PrimeSense, Intel RealSense Microsoft Kinect2, RealSense, Orbbec3D,
Mantis Vision, PMD
Resolution VGA XGA
FPS 30 60
Range 3 meters 8 meters
Cost expensive very low cost
Size large form-factor tiny form-factor
Dark Surfaces problem no problem
Accuracy 3 to 10 mm 1 to 3 mm
Usage gesture, scene & object capture AR/VR, smartphone, robotics, UAV, IoT
9. History of 3D Computer Vision:
2011 to Present
Open Source Libraries → Unreliable and Inefficient
• 2D Image Processing - OpenCV
• 3D Processing - PCL
Gesture Recognition (e.g., Kinect) → Fairly Reliable
Basic SDK from 3D Sensor Companies → Inefficient and Difficult to Use
• Capture and tracking (SLAM)
• Works in static environment
• GPU or cloud-based processing
• <30 FPS tracking
• IMU dependency
Enterprise AR at AWE 2016June 1, 2016 9
10. Future of 3D Computer Vision:
AR/VR-Specific 3D Computer Vision Platform
Capture
•Easily and naturally capture real world as a 3D Model
•Handles changes, occlusions, and movements
Tracking
•Tolerates lighting changes, occlusions, and movements
•Rigid and non-rigid objects
•Less dependent on expensive IMUs
•Pixel accurate, no jitter
Runs on Any Platform
•Smartphones, laptops, VR HMD, AR HMD, Projector, UAV, IoT
Enterprise AR at AWE 2016June 1, 2016 10
● Photo-realistic
● Accurate
● Power efficient
● Supports DSP & image processors, e.g., Movidius
● >90 FPS
11. Conclusion
Key Technologies Already Exist to Take AR/MR Mobile
•Advances in sensors will quickly solve mobile real estate requirements
•Software elements for capture, tracking and display already optimized for mobile chipsets
Enormous Potential for Enterprise Adoption
•Ability to provide remote guidance to all aspects of field work, e.g., maintenance, sales
•Will revolutionize all facets of training
•Visualization of objects with fast, accurate capture
•Dramatic improve way customers are serviced
AR/MR Will Create New Ways to Solve Problems
•New and more effective work processes to reduce cost and increase revenue
Enterprise AR at AWE 2016June 1, 2016 11
12. Enterprise AR at AWE 2016June 1, 2016
kenleeigt
klee@vangoghimaging.com
Thank You. Visit Our Booth #218 for Live Demos
Ken Lee
VanGogh Imaging, Inc.
1616 Anderson Rd
McLean, VA 22102
USA
(703) 626-8521
12
