Vuforia™, the leading AR platform, supports smartphones, tablets and digital eyewear including VR viewers and optical see-through devices. In this session, David Beard will provide a technical tutorial on how to build a Vuforia™ app for HoloLens.
Augmented World Expo (AWE) is back for its seventh year in our largest conference and expo featuring technologies giving us superpowers: augmented reality (AR), virtual reality (VR) and wearable tech. Join over 4,000 attendees from all over the world including a mix of CEOs, CTOs, designers, developers, creative agencies, futurists, analysts, investors, and top press in a fantastic opportunity to learn, inspire, partner, and experience first hand the most exciting industry of our times. See more at http://AugmentedWorldExpo.com
6. 6
PLATFORM COMPONENTS
Vuforia Engine Cloud ServicesTools
Supported Devices
• Phones & Tablets - Android &
iOS
• Eyewear - Samsung Gear VR,
Epson-BT 200, ODG R-6/7
• Support for Unity, Xcode,
Android Studio
Target Manager
• Create & Manage databases for use
on device or cloud
Vuforia Object Scanner
• Scan objects such as toys to create
Object Targets
Eyewear Calibration
Vuforia Cloud Recognition Service
• Allows use of cloud reco database
with up to 1 million targets
Vuforia Web Services
• RESTful APIs to manage cloud-based
target databases
7. 7
• Support for Windows 10 ( coming soon )
– HoloLens
– Microsoft Surface
– HP Spectre
• Easily deploy apps across devices
VUFORIA UWP SUPPORT
8. 8
Creates 3D meshes of
Spatial Surfaces
HoloLens
Spatial Mapping
• Reconstructs physical surfaces
• Maps to Spatial Coord System
• Localizes the user and surfaces
10. 10
Vuforia for
HoloLens
• Recognize images and objects
• Know their precise location
• Accurately register content
Recognition and Pose
Registration for HoloLens
12. 12
Vuforia enables HoloLens apps to recognize things and know where they are
• Uniquely identify images and objects
• Know where they are in the environment
• Precisely register content
Supported by
• Vuforia Extended Tracking
• C# API in Unity and Visual Studio
• On Windows 10 Devices
VUFORIA + HOLOLENS
14. 14
1. Configure the scene for AR
2. Add targets and digital content
3. Position on CAD proxy model
4. Configure build package
5. Build for Windows Store
WORKFLOW OVERVIEW IN UNITY
Hello everyone. My name is David Beard, I’m a senior product manager for the Vuforia platform and our developer evangelist.
My role is to help developers learn how to create AR/VR app using Vuforia, and on the best practices for designing mixed reality experiences.
I’d started with Vuforia over 5 years ago as an engineer and am currently on the product management team, responsible for tools workflows.
Today I’m going to be discussing how Vuforia can be used with HoloLens to create new types of apps in Unity
I’ll give you an introduction to the features of Vuforia and HoloLense
And then I’ll show you how to create a HoloLens app that uses Vuforia in Unity
Vuforia is PTC’s Augmented Reality platform.
It is an SDK that enables your apps to see things in the real world and then interact with them. We’ve done this by taking very sophisticated computer vision technologies, building them ground-up for mobile platforms, and making these technologies accessible through an easy to use API and developer workflows.
…so that ANY app developer can quickly and very easily enable their apps with vision functionality.
Vuforia provides a very simple API. It tells developers what it sees and where it sees these objects precisely in the camera’s FoV…allowing you as developers to then render content accurately on or relative to the object
Today with Vuforia you can see a number of things
Images – these are every day images like magazine covers, product packaging, brochures
Objects – rigid like toys and appliances – objects with little or no articulating or moving parts
Text – we have text recognition for roman characters, such as English language words
And finally with our Smart Terrain feature ….. meshes of an unknown environment…Vuforia can look at a table and will return the table surface and the props on the table in a mesh on top of which , you can overlay content…so you can drive a virtual car on a table that avoids a vase or a stack of books…or falls of the table. With Vuforia smart Terrain, we provide apps the awareness and intelligence to interact with their immediate environment
SDKs
We offer the flexibility to program with Java, C++/Objective C or with Unity
About 85% of our developers use Unity because it provides an easy to use visual authoring workflow
Vuforia is the most widely used AR platform in the world.
10's of thousands of apps have been created, by 100s of thousands of developers, resulting in 100s of millions of app installs.
Platform Review
There are 3 main components to the platform
The client side Engine
Android and iOS devices
Smart phones and tablets
Digital Eyewear
Tools to create and manage targets
The Target manager is an online tool for creating, evaluating and managing targets
You can create both device databases, which are embedded in your app, or cloud databases that are accessed using a web service
The Object scanner tool is used to create Object Targets
Eyewear calibration tool is for generating custom eye calibration profiles for users of optical see-through eyewear
Cloud services enable you to deploy targets to your apps from a web service online. This service can support up to 1 million target images and delivers the same kind of trackable data as a device database.
Cloud Recognition is on online image recognition service – you can query this service from your app
Cloud Recognition also supports the Vuforia Web Service REST API which enables you to interface with the service from your own Content Management System
Spatial surfaces are located and discoverable within the Hololens spatial coordinate system
Transition to Demo w/ Preview
Now lets take a look at how to build a Cardboard VR app that uses Vuforia to achieve a new level of engagement … let me show you the app that I’m going to be building..
On-Device Demo
