Ce diaporama a bien été signalé.
Nous utilisons votre profil LinkedIn et vos données d’activité pour vous proposer des publicités personnalisées et pertinentes. Vous pouvez changer vos préférences de publicités à tout moment.
Digital Eyewear SDK Overview
Augmented World Expo, May 27, 2014
Patrick O’Shaughnessey
Founder and Chief Developer
@patche...
Patched Reality
Custom Augmented Reality
and Digital Eyewear Solutions
http://patchedreality.com
Patched Reality
Using Best-in-Breed Technologies
http://patchedreality.com
Video and Slides from AWE 2013
http://bit.ly/SDKTutorialAWE2013
Mobile AR SDKs Short List
SDK Purpose Tracking Platform Graphics Cloud GP
S
License
Qualcomm
Vuforia
2D Images,
Cylinders,...
Mobile AR SDKs Short List
SDK Purpose Tracking Platform Graphics Cloud GP
S
License
13th Lab
Point Cloud
2D Images,
3D,
An...
Eyewear Reviewed
Google Glass
Optinvent ORA-1
Vuzix M100
Epson Moverio BT-200
Programming Environment
3rd-Party SDKs
User Interaction, Tracking, Rendering
Vendor SDKs
Hardware Support, UI Paradigm
OS ...
Eyewear Vendor SDKs
SDK OS Features in SDK Input
types
Display Cost
Vuzix M100 Android 4.04 M100 Emulator
(Std Android SDK...
3rd Party SDKs
SDK Eyewear
Platforms
Eyewear
Specific Features
Programming
Environment
License
Metaio BT-200 Stereo AR
See...
3rd Party SDKs
SDK Eyewear
Platforms
Eyewear
Specific Features
Programming
Environment
License
Catchoom Glass Image Search...
Native Development On Ramp
1) Set up Dev Environment
• Android Developer Kit (ADK) or Android Studio
• Eyewear vendor SDK
...
3rd-Party SDKs
User Interaction, Tracking, Rendering
Vendor SDKs
Hardware Support, UI Paradigm
OS SDK
Standard Mobile Dev
Google Glass
Google Glass
Google Glass Development
Pick an app paradigm:
1. Native GDK based (APK)
• Ongoing Task - “Live Card” on timeline
• Immers...
Google Glass – Mirror API Setup
1) Create Google App Engine instance
2) Create Google APIs Console project
3) Enable the G...
Google Glass – GDK Setup
Google Glass GDK – Voice Trigger
Google Glass GDK – Voice Trigger
Google Glass GDK – Voice Trigger
Google Glass – Swipe Gestures
Google Glass GDK – Card
Use created view in Activity or CardScrollView
Google Glass GDK – Card
Vuzix M-100
Vuzix M-100
Vuzix M100 - Setup
1) Purchase SDK license and register a user id
2) Install Smart Glass Manager on Android
Phone
– provid...
Vuzix M100 – Smart Glass App
Vuzix M100 - Emulator
Vuzix M100 - Gestures*
Android Sensor API with a sensor type of 15.
Gestures returned in event.values[0]:
1 = left (swipin...
Vuzix M100
Some current limitations to note:
– No Google Play Services
– No Location provider for GPS
– Gesture sensor is ...
Epson Moverio BT-200
Epson Moverio BT-200
Epson Moverio BT-200 Setup
Super easy to get up-and-running:
1) Use touchpad to turn on USB debugging
2) Add vendor ID to
...
Epson Moverio BT-200
Some currently known limitations to note:
– GPS Location Provider issue
– No Google Play Services
– A...
Optinvent ORA-1
Optinvent ORA-1
Optinvent ORA-1 Setup
Easiest to get up-and-running:
1) Use touchpad to turn on USB debugging
2) Optional – Download SDK f...
Optinvent ORA-1
Optinvent ORA-1
Some currently known limitations to note:
– Gyroscope gravity vector issue
3rd-Party SDKs
User Interaction, Tracking, Rendering
Vendor SDKs
Hardware Support, UI Paradigm
OS SDK
Standard Mobile Dev
metaio + Epson Moverio BT-200
Stereo See-Through AR!*
* Content appeared farther away than target
metaio + Epson Moverio BT-200
Stereo See-Through AR!*
* NOTE: Not available yet via Unity plug-in
Wikitude + Epson Moverio BT-200
Stereo See-Through AR!*
* Content appeared shifted left and down
Hand-eye Calibration
Wikitude – Compiling Examples
Make sure to uncheck “Force error…”
Wikitude + Vuzix M100
Video-based AR
FOV2Go + Unity + Moverio BT-200
Stereo VR!
FOV2GO
FOV2GO
OTG Platforms - Gesture Input
OTG Platforms - Gesture Input
OTG Platforms - Gesture Input
Catchoom
Cloud-based Image recognition
Wearscript for Google Glass
Wearscript for Google Glass
1) Install APK’s and Authenticate
curl -L http://goo.gl/nRjW6y > install.py
&& python install....
Wearscript for Google Glass
Wearscript for Google Glass
Wearscript for Google Glass
See through AR
Layar for Glass
1) Download Layar for Glass .APK
2) Install via ADB
3) Author content in Layar using Creator or
Layar Deve...
ARPA Glass SDK
ARPA Glass GPS SDK
Watch this Space!
Thank You!
Patrick
O’Shaughnessey
@patchedreality
patrick@patchedreality.com
http://patchedreality.com
Prochain SlideShare
Chargement dans…5
×

Augmented World Expo 2014 Wearable SDK Overview

4 383 vues

Publié le

An overview of the available digital eyewear, including Google Glass, Vuzix M100, Epson Moverio BT-200, and Optinvent ORA-1, and the SDK's and development environments available for each.

Publié dans : Technologie
  • DOWNLOAD FULL BOOKS, INTO AVAILABLE FORMAT ......................................................................................................................... ......................................................................................................................... ,DOWNLOAD FULL. PDF EBOOK here { https://tinyurl.com/yyxo9sk7 } ......................................................................................................................... ,DOWNLOAD FULL. EPUB Ebook here { https://tinyurl.com/yyxo9sk7 } ......................................................................................................................... ,DOWNLOAD FULL. doc Ebook here { https://tinyurl.com/yyxo9sk7 } ......................................................................................................................... ,DOWNLOAD FULL. PDF EBOOK here { https://tinyurl.com/yyxo9sk7 } ......................................................................................................................... ,DOWNLOAD FULL. EPUB Ebook here { https://tinyurl.com/yyxo9sk7 } ......................................................................................................................... ,DOWNLOAD FULL. doc Ebook here { https://tinyurl.com/yyxo9sk7 } ......................................................................................................................... ......................................................................................................................... ......................................................................................................................... .............. Browse by Genre Available eBooks ......................................................................................................................... Art, Biography, Business, Chick Lit, Children's, Christian, Classics, Comics, Contemporary, Cookbooks, Crime, Ebooks, Fantasy, Fiction, Graphic Novels, Historical Fiction, History, Horror, Humor And Comedy, Manga, Memoir, Music, Mystery, Non Fiction, Paranormal, Philosophy, Poetry, Psychology, Religion, Romance, Science, Science Fiction, Self Help, Suspense, Spirituality, Sports, Thriller, Travel, Young Adult,
       Répondre 
    Voulez-vous vraiment ?  Oui  Non
    Votre message apparaîtra ici
  • Indeed great slides, Patrick. I wish I had come across these earlier since you so nicely document all the challenges which took me so long to discover for myself. I have here an Epson BT-200 and calibration is indeed a pain. And I found out the hard way that stereoscopy with marker tracking is not supported in Unity.
       Répondre 
    Voulez-vous vraiment ?  Oui  Non
    Votre message apparaîtra ici
  • Great slides Patrick. Is there sample code available?
       Répondre 
    Voulez-vous vraiment ?  Oui  Non
    Votre message apparaîtra ici

Augmented World Expo 2014 Wearable SDK Overview

  1. 1. Digital Eyewear SDK Overview Augmented World Expo, May 27, 2014 Patrick O’Shaughnessey Founder and Chief Developer @patchedreality patrick@patchedreality.com http://patchedreality.com
  2. 2. Patched Reality Custom Augmented Reality and Digital Eyewear Solutions http://patchedreality.com
  3. 3. Patched Reality Using Best-in-Breed Technologies http://patchedreality.com
  4. 4. Video and Slides from AWE 2013 http://bit.ly/SDKTutorialAWE2013
  5. 5. Mobile AR SDKs Short List SDK Purpose Tracking Platform Graphics Cloud GP S License Qualcomm Vuforia 2D Images, Cylinders, Markers, Text NFT+Ext, Cylinder, Marker, Text iOS, Android Unity3D & Alt. yes no Free $99- 499/mo Cloud Metaio SDK 2D Images, 3D, GEO, QR NFT+Ext, GPS, 3D, SLAM iOS, Android, Eyewear Unity3D & Proprietary yes yes $0-5,500 $235- 680/mo Cloud Total Imm. D’fusion 2D Images, Faces NFT, Face iOS, Android Dev: MS only Proprietary no no $0-7,800 Wikitude SDK 2D Images, GEO GPS, NFT iOS, Android, Blackberry, Eyewear HTML, Proprietary yes yes $0-2,300 Layar SDK 2D images, Geo NFT, QR iOS, Android Proprietary yes no $3,250/ap p/yr + $60/page
  6. 6. Mobile AR SDKs Short List SDK Purpose Tracking Platform Graphics Cloud GP S License 13th Lab Point Cloud 2D Images, 3D, Anywhere NFT, 3D, SLAM iOS, Android Unity3D & Alt. no no 0-$5,000 HP Aurasma SDK VFX, Videos on 2D Images NFT iOS, Android Proprietary yes yes Per click Obvious Engine 2D images, Cylinders NFT, Cyl. iOS, Android Unity3D & Alt. no no $8000/ap p/plaform String Framed 2D images Framed Image iOS Unity3D & Alt. no no $499 - $8000/ap p/year Orbotix Robotic AR Sphero iOS, Android Unity3D no no Free catchoom 2D Images NFT iOS, Android Proprietary yes no $0-2000 +$135- 835/mo
  7. 7. Eyewear Reviewed Google Glass Optinvent ORA-1 Vuzix M100 Epson Moverio BT-200
  8. 8. Programming Environment 3rd-Party SDKs User Interaction, Tracking, Rendering Vendor SDKs Hardware Support, UI Paradigm OS SDK Standard Mobile Dev
  9. 9. Eyewear Vendor SDKs SDK OS Features in SDK Input types Display Cost Vuzix M100 Android 4.04 M100 Emulator (Std Android SDK) Gesture (*) Voice (*) Camera Buttons Sensors (*) 428x240 Offset Monocular Opaque $999.99 hw + $199.99 for SDK Google Glass Android 4.4.2 Gestures Voice Camera UI Widgets Mirror API Touchpad Voice Camera Sensors Wink 640x360 Offset Monocular Transparent $1,500 hw Epson Moverio BT- 200 Android 4.0.4 Tablet UI Hand|Head sensors 2D|3D view Display Control Touchpad Buttons Sensors x2 Camera 960x540 Inline Stereo Transparent $699.99 hw Optinvent ORA-1 Android 4.2.2 Bluetooth Client Bluetooth Server Touchpad Camera 640x480 Inline | Offset Monocular Transparent $949.00 hw
  10. 10. 3rd Party SDKs SDK Eyewear Platforms Eyewear Specific Features Programming Environment License Metaio BT-200 Stereo AR See through AR Geo POI AR Native Android $0-5,500 $235-680/mo Cloud Wikitude BT-200 M100 Glass (**) Stereo AR See through AR Geo POI AR Native Android + HTML+Javascript $0-2,300 Wearscript Glass AR Camera Sensors Eye tracking (*) Arduino (*) HTML+ Javascript In PC browser Free Open Source ARPA Glass Image Recognition GEO POI AR Native Android $1,495 * Requires additional hardware ** Broken in XE17, so couldn’t review
  11. 11. 3rd Party SDKs SDK Eyewear Platforms Eyewear Specific Features Programming Environment License Catchoom Glass Image Search Region of Interest Selection Native Android $120/mo - 100 images $340/mo - 1K images $680/mo – 10K images Layar Glass Video AR Panoramas GEO POI AR Layar Creator or Web Service API $60/page OTG Ari Glass, BT-200, M100 Hand Gestures Native Android $0 trial $120/yr/app 25K DL $240/yr/app 250K DL* Enterprise /OEM varies
  12. 12. Native Development On Ramp 1) Set up Dev Environment • Android Developer Kit (ADK) or Android Studio • Eyewear vendor SDK 2) Enable debug mode on eyewear 3) If necessary - Add vendor ID to ~usr/.android/adb_usb.ini 4) Optional - Download 3rd-Party SDK 5) Optional - Install and run samples
  13. 13. 3rd-Party SDKs User Interaction, Tracking, Rendering Vendor SDKs Hardware Support, UI Paradigm OS SDK Standard Mobile Dev
  14. 14. Google Glass
  15. 15. Google Glass
  16. 16. Google Glass Development Pick an app paradigm: 1. Native GDK based (APK) • Ongoing Task - “Live Card” on timeline • Immersion – Runs outside of timeline 2. Mirror API (web server based) • Manipulate cards on timeline
  17. 17. Google Glass – Mirror API Setup 1) Create Google App Engine instance 2) Create Google APIs Console project 3) Enable the Google Mirror API in Services 4) Create OAuth 2.0 Client ID 5) Get a Quick Start project and add API secret 6) Deploy project to cloud using App Engine Launch GUI or command-line
  18. 18. Google Glass – GDK Setup
  19. 19. Google Glass GDK – Voice Trigger
  20. 20. Google Glass GDK – Voice Trigger
  21. 21. Google Glass GDK – Voice Trigger
  22. 22. Google Glass – Swipe Gestures
  23. 23. Google Glass GDK – Card Use created view in Activity or CardScrollView
  24. 24. Google Glass GDK – Card
  25. 25. Vuzix M-100
  26. 26. Vuzix M-100
  27. 27. Vuzix M100 - Setup 1) Purchase SDK license and register a user id 2) Install Smart Glass Manager on Android Phone – provides keyboard and touchpad 3) Use Smart Glass Manager to Enable Debug mode 4) Download SDK to use emulator 5) Add vendor ID to ~usr/.android/adb_usb.ini
  28. 28. Vuzix M100 – Smart Glass App
  29. 29. Vuzix M100 - Emulator
  30. 30. Vuzix M100 - Gestures* Android Sensor API with a sensor type of 15. Gestures returned in event.values[0]: 1 = left (swiping backward) 2 = right (swiping forward) 9 = near (moving perpendicular toward the sensor) 10 = far (moving perpendicular away from the sensor) Generates key events as well: 1 = KEYCODE_DPAD_LEFT 2 = KEYCODE_DPAD_RIGHT 9 = KEYCODE_ENTER 10 = KEYCODE_ESCAPE *Stick to buttons or Smart Glass app for now
  31. 31. Vuzix M100 Some current limitations to note: – No Google Play Services – No Location provider for GPS – Gesture sensor is overly sensitive IMO – Voice commands limited to home screen
  32. 32. Epson Moverio BT-200
  33. 33. Epson Moverio BT-200
  34. 34. Epson Moverio BT-200 Setup Super easy to get up-and-running: 1) Use touchpad to turn on USB debugging 2) Add vendor ID to ~usr/.android/adb_usb.ini 3) Optional – Download SDK 4) Write application using Android Tablet UI
  35. 35. Epson Moverio BT-200 Some currently known limitations to note: – GPS Location Provider issue – No Google Play Services – Alignment issues with AR SDKs
  36. 36. Optinvent ORA-1
  37. 37. Optinvent ORA-1
  38. 38. Optinvent ORA-1 Setup Easiest to get up-and-running: 1) Use touchpad to turn on USB debugging 2) Optional – Download SDK for Smartphone Communication via Bluetooth 3) Write application using Android Tablet UI
  39. 39. Optinvent ORA-1
  40. 40. Optinvent ORA-1 Some currently known limitations to note: – Gyroscope gravity vector issue
  41. 41. 3rd-Party SDKs User Interaction, Tracking, Rendering Vendor SDKs Hardware Support, UI Paradigm OS SDK Standard Mobile Dev
  42. 42. metaio + Epson Moverio BT-200 Stereo See-Through AR!* * Content appeared farther away than target
  43. 43. metaio + Epson Moverio BT-200 Stereo See-Through AR!* * NOTE: Not available yet via Unity plug-in
  44. 44. Wikitude + Epson Moverio BT-200 Stereo See-Through AR!* * Content appeared shifted left and down
  45. 45. Hand-eye Calibration
  46. 46. Wikitude – Compiling Examples Make sure to uncheck “Force error…”
  47. 47. Wikitude + Vuzix M100 Video-based AR
  48. 48. FOV2Go + Unity + Moverio BT-200 Stereo VR!
  49. 49. FOV2GO
  50. 50. FOV2GO
  51. 51. OTG Platforms - Gesture Input
  52. 52. OTG Platforms - Gesture Input
  53. 53. OTG Platforms - Gesture Input
  54. 54. Catchoom Cloud-based Image recognition
  55. 55. Wearscript for Google Glass
  56. 56. Wearscript for Google Glass 1) Install APK’s and Authenticate curl -L http://goo.gl/nRjW6y > install.py && python install.py 2) Scan QR Code at api.wearscript.com 3) Auth with Google and Github 4) “Okay Glass” … “Wear a Script” 5) “Playground” 6) Edit HTML and Javascript in Playground 7) Rinse and Repeat
  57. 57. Wearscript for Google Glass
  58. 58. Wearscript for Google Glass
  59. 59. Wearscript for Google Glass See through AR
  60. 60. Layar for Glass 1) Download Layar for Glass .APK 2) Install via ADB 3) Author content in Layar using Creator or Layar Developer API (on server) 4) “Okay Glass”… “Scan this” - Takes a static picture and pulls content
  61. 61. ARPA Glass SDK
  62. 62. ARPA Glass GPS SDK
  63. 63. Watch this Space!
  64. 64. Thank You! Patrick O’Shaughnessey @patchedreality patrick@patchedreality.com http://patchedreality.com

×