1. Augmented
Reality
Christoph
Becker,
Hauke
Schaper
The slides are licensed under a
1 Web
Technologies
–
Prof.
Dr.
Ulrik
Schroeder
–
WS
2010/11 Creative Commons Attribution 3.0 License

2. Video:
IntroducKon
to
AR
2 Web
Technologies

3. Overview
 Our
talk
covers:
 History
 DefiniKon
of
Augmented
Reality
 Types
of
Augmented
Reality
 Frameworks
-­‐
Example:
Layar
 StandardizaKon
Issues
 Concerns
about
Augmented
Reality
 Imagining
an
Augmented
Reality
Future
3 Web
Technologies

4. History
 1968:
Ivan
Sutherland
develops
first
AR
System
 see-­‐through
Display
 movement
tracker
 real
Kme
 1992:
Tom
Caudell
and
David
Mizell
introduce
the
term
Augmented
Reality
 1995:
Jun
Rekimoto
et
al.:
Navicam
 DetecKon
of
markers
 context
sensiKve
informaKon
4 Web
Technologies

5. History
(2)
 1996:
Jun
Rekimoto:
2D
matrix
marker
 Six
degrees
of
freedom
(6
DOF)
 1997:
Steven
Feiner:
Touring
Machine
 First
mobile
augmented
reality
system
 1999:
Hirokazu
Kato:
ARToolKit
 First
framework:
Windows,
Linux,
OS
X,
Symbian,
Android
,
iOS,…
5 Web
Technologies

6. DefiniKon
 Ronald
Azuma,
1997:
Augmented
Reality
 combines
real
and
virtual
 is
interacKve
in
real
Kme
 registered
in
3D
 Paul
Milgram
and
Fumio
Kishino,
1994:
Reality-­‐Virtuality
ConKnuum:
Mixed Reality
Real Augmented Augmented Virtual
Environment Reality (AR) Virtuality Environment
6 Web
Technologies

7. Two
Types
of
AR
Trend
our
focal
point
Differences Visualiza.on
Approach Informa.ve
Approach
Main
focus Made
(Virtual)
Reality InformaKon
Provide
UI 3D
object
overlay NavigaKon
(or
browsing)
(rendering
and
registraKon) with
related
informaKon
and
interacKon
Requirements Graphical
performance
& Mash-­‐up
capability
compuKng
power
Target
Devices Desktop
(or
higher) Smartphone
(or
lower)
System
type Isolated
system Networked
system
Augmented
Target 3D
object PosiKon,
relaKonship,
..
ApplicaKon
Type AR
3D
game, AR
informaKon
browsing,
AR
adverKsing, AR
based
NavigaKon,
AR
based
e-­‐learning, locaKon
overlays,
Medical
AR, geoinformaKon
services,
AR
based
Technical
Support Gaming
Jonghong Jeon, Considerations of Generic Framework For AR on the Web, 2010
7 Web
Technologies

8. AR
major
categories
 GeolocaKon-­‐based
AR
 Sensors:
GPS,
compass,
Klt
 Object
recogniKon-­‐based
AR
 With
or
without
markers
 DisKnguishing
mark
 HowTo
determine
the
parts
of
the
world
to
augment
 Common
mark
 Everything
is
about
context
 What
the
user
wants
to
see
 Where
to
display
addiKonal
informaKons
8 Web
Technologies

9. AR
Frameworks
AR
Toolkit
AR
Type GeolocaKon GeolocaKon Geo/
Marker/ Marker
Image
recogniKon
Pla>orms Android,
iPhone iPhone,
Android, iPhone,
Android Win,
OSX,
Linux,
Symbian,
Bada Flash,
Symb.,
iPhone,
Android
New
apps Incl.
as
Layers Incl.
as
Worlds/ Incl.
as
Channels Stand
alone
Stand
alone
Charging Free/paid Free/paid Free/paid GPL
3D
content• •
animated/staKc •
interacKve
animated/staKc •.md2,
.obj •
OpenGL
POIs/content •
.l3d
Developers Wikitude/
Dev Junaio/
Dev
server
Loca.on server server
API
language any
Service standalone:
Java PHP,
ASP.Net
C# C,
C++
returning
JSON
9 Web
Technologies

10. Example:
Layar
GeolocaKon
based
Augmented
Reality
Browser
 Displays
real
Kme
informaKon
into
live
video
stream
 Available
for
iPhone/
Android
 +2
000
000
user
 +3500
Developers
 +900
Layers
 Layer
=
real-­‐Kme
informaKon
E.g.:
finding
ATMs,
restaurants,
games
 Free
API
to
develop
layers
 Paid/
free
 1
600
000
augmented
objects
per
day
10 Web
Technologies

11. Layar
features
 Overview
of
the
Layar
features
 POI
publishing:
informaKon
concerning
special
locaKons
 3D
Objects
can
be
placed
everywhere
 interacKve
animaKon
 Audio:
Assign
audio
elements
to
POI
 Proximity
triggers:
 acKon
is
triggered
if
user
is
in
range
 AuthenKcaKon:
Personalized
service
11 Web
Technologies

12. Layar
Plalorm
 Architecture
Overview
http://layar.pbworks.com/w/page/7783214/Layar-Platform-Architecture-Overview
12 Web
Technologies

13. Development
of
Layers
 Manage/Create
new
Layers
using
Layar
web-­‐interface
 Create
a
webservice
with
a
DB
containing
geo-­‐coded
POIs
 Responds
to
GetPOIRequest Request:
htp://devAPI.example.com/getPOIs/?countryCode=N
(HTTP
REST) &lon=4.887339
&radius=6245&lat=…&accuracy=100
&Kmestamp=1249226148713
&userId=…
&developerId=…&layerName=snowy4
&SEARCHBOX=office
 Respond
is
JSON
list
of
POIs
Top
level
JSON
Response: Hotspots:
{"hotspots":
[…], {
"distance":
100,
“type”:
0,
"layer":
"snowy4“, "atribuKon":
"The
LocaKon
of
the
Layar
Office",
“errorstring”
:
“OK”, "Ktle":
"The
Layar
Office",
"lon
"
:…,
"lat
"
:…,
…} "
acKons":
[…],
…}
"
 Create
Interface
for
User AcCons:
"
acKons":
[
to
interact
with
POIs {"
uri“:
"
htp://example.de“,
“label
“:
“Open
Site
"},
{"
uri“:
"
video://splintercell.com/explosion.3gp“,
 HTML,
JavaScript,
CSS
“label
“Watch“},
]
13 Web
Technologies

14. Development
of
Layers
(2)
 Nice
stuff
 REST
acKon
 Background
HTTP
request
to
your
server
Reload/
update
POIs
 Flexible
POIs
refresh
rates
 Needed
for
moving
POIs
 AnimaKons
 Texture
animaKons,
rotate,
oscilliate
 Tools
to
get
started
 PHP:
PorPOIse
 A
PHP
based
POI
server
(XML
or
MySQL)
 .NET:
LayarDotNet:
 C#
implementaKon
of
the
set
of
objects
used
in
the
GetPointsOfInterest()
 HOPPALA!
AugmentaKon:
 CMS
to
develop
within
the
browser
14 Web
Technologies

15. Augmented
Reality
and
the
Web
 No
standards
for
AR’s
key
feature:
 Access
to
sensors/video
stream
 Dedicated
App
are
needed
 Not
available
for
a
wide
range
of
mobile
devices
 Development
for
many
plalorms
higher
development
costs
 No
standard
AR
data
format
 Any
webdata
could
be
potenKal
data
resource
 OpenData
and
mash-­‐ups
could
mean
richer
services
15 Web
Technologies

16. StandardizaKon
 W3C
Workshop
“Augmented
Reality
on
the
Web”,
2010
 Results:
 AR
content
markup
&
format
 Example:
OpenARML
(Wikitude)
 AR
data
format
-­‐
POI
(images,
text,
3D
models,
URIs)
 RepresenKng
3D
interacKve
AR
content
 Device
API
:
Camera
API
(to
control
Live
Video),
GeolocaKon
API
 RegistraKon
&
3D
object
integraKon
(with
HTML5)
 InteracKon
&
Event
Processing
(with
HTML5)
 Standardized
access
to
devices
extra
sensors
is
crucial
 Standardized
Data
Formats
to
allow
mash-­‐ups
of
services
16 Web
Technologies

17. Concerns
 Privacy
 Customized
AR
(ads)
 filtering,
blocking
 Graduate
social
networks
(family,
business,
public
domain)
 profiles,
privacy
tags
 IdenKty
 User
data
for
free
service
 protect/
publish
personal
data
 Cluter
 AR
should
enhance,
not
distract
 data
mining,
inference
engines
 filter
and
idenKfy
most
relevant
informaKon
17 Web
Technologies

18. Video:
AR
in
the
future
18 Web
Technologies

19. Further
InformaKon
 Paul
Milgram
,
Fumio
Kishino
:
A
Taxonomy
of
mixed
reality
visual
displays
htp://etclab.mie.utoronto.ca/people/paul_dir/IEICE94/ieice.html
 Steve
Mann:
Mediated
Reality
with
implementaKons
for
everyday
life
htp://wearcam.org/presence_connect/
 Layar
Wiki
htp://layar.pbworks.com/w/page/7783228/FrontPage
 W3C
Workshop:
Augmented
Reality
on
the
Web
Paper
June
2010,
Barcelona,
htp://www.w3.org/2010/06/w3car
19 Web
Technologies

20. Thank
You!
20 Web
Technologies