Tracking objects in video with Natural Feature Recognition. Daniel Wagner is working as a researcher at Graz University of Technology on truly mobile Augmented Reality. His current research interests are real-time graphics and real-time tracking for augmented reality on mobile devices. He is the head of the Studierstube Handheld AR project and developed the well-known “InvisibleTrain” and “Virtuoso” projects. Daniel holds a Master in computer science from Vienna University of Technology and a PhD from Graz University of Technology. http://studierstube.org/handheld_ar/

1. Smart Cameras for
Augmented Reality
on Mobile Phones
Daniel Wagner

2. Smart Cameras for Augmented Reality DANIEL WAGNER
on Mobile Phones wagner@icg.tugraz.at
Slide 2
What is Augmented Reality
Combines
Real and Virtual in 3D
In Real time
Real-time
Interactive

3. Smart Cameras for Augmented Reality DANIEL WAGNER
on Mobile Phones wagner@icg.tugraz.at
Slide 3
What is not Augmented Reality?
Location based services
Barcode detection (QR-codes)
Augmenting still images
Special effects in movies
Sony Eye-Toy

4. Smart Cameras for Augmented Reality DANIEL WAGNER
on Mobile Phones wagner@icg.tugraz.at
Slide 4
Augmented Reality on Mobile Phones
Low cost, widely spread platform
Billions of phones deployed
People know how to use them
Strong demand from commercial side
Huge chance for AR!
Target practical applications
T t ti l li ti
Easy to use
Quality graphics
Robust tracking
15-30 Hz overall frame rate

5. Smart Cameras for Augmented Reality DANIEL WAGNER
on Mobile Phones wagner@icg.tugraz.at
Slide 5
The Handheld AR Group
Graz University of Technology
Institute for Computer Graphics and Vision
Virtual Reality Group
Handheld AR Group
2 post-docs, 3 PhD students &
several master students
Recently started a Christian Doppler Lab
Working with industry on making AR practical on low
end devices
http://studierstube.org/handheld_ar

6. Smart Cameras for Augmented Reality DANIEL WAGNER
on Mobile Phones wagner@icg.tugraz.at
Slide 6
The Invisible Train (2004)

7. Smart Cameras for Augmented Reality DANIEL WAGNER
on Mobile Phones wagner@icg.tugraz.at
Slide 7
Virtuoso (2005)

8. Smart Cameras for Augmented Reality DANIEL WAGNER
on Mobile Phones wagner@icg.tugraz.at
Slide 8
Navigation Concept Work

9. Smart Cameras for Augmented Reality DANIEL WAGNER
on Mobile Phones wagner@icg.tugraz.at
Slide 9
Augmenting Business Cards

10. Smart Cameras for Augmented Reality DANIEL WAGNER
on Mobile Phones wagner@icg.tugraz.at
Slide 10
Sketch Based Game (Work in Progress)

11. Smart Cameras for Augmented Reality DANIEL WAGNER
on Mobile Phones wagner@icg.tugraz.at
Slide 11
Natural Feature Tracking

12. Smart Cameras for Augmented Reality DANIEL WAGNER
on Mobile Phones wagner@icg.tugraz.at
Slide 12
Pertubing the real World

13. Smart Cameras for Augmented Reality DANIEL WAGNER
on Mobile Phones wagner@icg.tugraz.at
Slide 13
X-Ray Vision

14. Smart Cameras for Augmented Reality DANIEL WAGNER
on Mobile Phones wagner@icg.tugraz.at
Slide 14
Table Top Games

15. Smart Cameras for Augmented Reality DANIEL WAGNER
on Mobile Phones wagner@icg.tugraz.at
Slide 15
Conclusions
Mobile phone AR is on its way into
practical use
Software is fast and mature
Rendering not a real issue anymore
Tracking starts to catch up with PC systems
g p y
Strong interest from commercial sides
The future for AR on phones looks g
p great!

16. Smart Cameras for Augmented Reality DANIEL WAGNER
on Mobile Phones wagner@icg.tugraz.at
Slide 16
Thank you for listening!
More material at: http://studierstube.org/handheld_ar