The talk presents the main features of the latest version of the ARMedia SDK with a focus on the 3D object tracking capabilities from a developer's perspective. The whole process involved in the creation of 3D trackable data will be discussed using both CAD-based and photogrammetry-based approaches, showing the strengths and weaknesses of each with reference to real-world use-cases. Finally, the brand new multiple-objects tracking feature will be demonstrated with reference to a car-tracking scenario.
Alessandro Terenzi (Inglobe Technologies) Developing AR Apps with the ARMedia SDK
1. Developing AR Apps With The
ARMedia SDK
ALESSANDRO TERENZI
CTO @ INGLOBE TECHNOLOGIES SRL
#AWE2016
Augmented World Expo - Europe - October 18/19 Berlin (Germany)
3. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
INTRODUCTION
• The Company: Inglobe Technologies / AXED Group
INFORMATION
MANAGEMENT
DIGITAL
PRODUCTION
MANAGEMENT
CONSULTING
4. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
INTRODUCTION
• The Team: 80
• 35: Engineering
• 29: Digital Production
• 16: Consulting
5. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
INTRODUCTION
• ARMedia: Company’s Brand for…
• Augmented Reality
• Virtual Reality
• Perceptual Computing
6. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
INTRODUCTION
• The Offer:
• ARMedia Plugins: 3ds Max, Maya, Cinema 4D, SketchUp, …
• HyperSpaces: General Purpose Authoring Platform
• HyperIndustry: Authoring Platform for the Industry
• ARMedia SDK: Software Developers
• Custom Solutions…
7. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
INTRODUCTION
• The Market:
• Architecture, Engineering & Construction (AEC)
• Healthcare
• Manufacturing
• Aerospace
• Automotive
• Cultural Heritage
8. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
INTRODUCTION
• The Clients:
• 40 Countries
• 2.000+ Customers
• 50.000+ Registered Users
10. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
SDK: CHANGE LOG
• Version 1.0 (June 2014): Object Tracking
• iOS/Android/Unity3D
11. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
SDK: CHANGE LOG
• Version 1.1.0 (June 2015):
• + 360 Panorama Viewer, 3D Viewer, “Motion” Tracking
• + more “ways” to load 3D models…
12. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
SDK: CHANGE LOG
• Version 1.0 (June 2014): Object Tracking
• iOS/Android/Unity3D
13. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
SDK: CHANGE LOG
• Version 2.0.0 (March 2016):
• + Planar Tracking
• + Location Tracking
14. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
SDK: CHANGE LOG
• Version 2.1.0 (October 2016):
• + Performances Improvements
• + APIs Documentation
• + Multiple Object Tracking
• + Improved & Simplified Trackable Data Creation
NEW!
21. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
SDK: WHAT’S NEW?
• Multiple Object Tracking
• Object?
• Multiple?
22. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
SDK: WHAT’S NEW?
• Trackable Data Creation Process (Objects):
1 (*.JPG)
23. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
SDK: WHAT’S NEW?
• Trackable Data Creation Process (Objects):
2 (PSZ)
24. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
SDK: WHAT’S NEW?
• Trackable Data Creation Process (Objects):
Have CAD model or reconstructed mesh?
OBJ, MTL, PNG/JPG
25. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
SDK: WHAT’S NEW?
• Trackable Data Creation Process (Objects):
3
26. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
SDK: WHAT’S NEW?
• Trackable Data Creation Process (Objects):
3
27. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
SDK: WHAT’S NEW?
• Trackable Data Creation Process (Objects):
3
28. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
SDK: WHAT’S NEW?
• Trackable Data Creation Process (Objects):
4
29. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
SDK: WHAT’S NEW?
• Trackable Data Creation Process (Objects):
5
30. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
SDK: WHAT’S NEW?
• Trackable Data Creation Process (Objects):
6
31. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
SDK: WHAT’S NEW?
• Trackable Data Creation Process (Objects):
7
32. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
SDK: WHAT’S NEW?
• Trackable Data Creation Process (Objects):
8
33. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
SDK: WHAT’S NEW?
• Trackable Data Creation Process (Objects):
9 (ZIP)
34. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
SDK: WHAT’S NEW?
• Trackable Data Creation Process (Objects):
10
(ZIP) ARMedia Toolset
38. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
SDK: APIs
• License/Application Keys
• Every single app must have a valid license key, generated on
the Developer Portal
• The role of the bundle identifier…
• Set using the SDK APIs…
39. #AWE2016
Augmented World Expo (EU) - October 18/19 Berlin (Germany)
SDK: APIs
• Tracking Module
• Just tracking APIs (and related events)…
• Camera capturing (not mandatory)
• Just need an OpenCV::Mat object
• Modularity:
• Capturing (Input)
• Rendering (Output)
