5. Concept
Augmented
reality
face
recogni2on
for
mobile
devices…
Real
world
augmented
with
extra
informa2on,
by
using
a
camera
5
6. Concept
Augmented
reality
face
recogni2on
for
mobile
devices…
Real
world
augmented
with
extra
informa2on,
by
using
a
camera
Extra
informa2on
will
be
about
people,
by
recognizing
their
faces
6
7. Concept
Augmented
reality
face
recogni2on
for
mobile
devices…
Camera
of
smartphone
will
be
Real
world
augmented
with
extra
used
to
accomplish
goals
informa2on,
by
using
a
camera
-‐>
Extra
informa2on
on
screen
Extra
informa2on
will
be
about
people,
by
recognizing
their
faces
7
8. Concept
Augmented
reality
face
recogni2on
for
mobile
devices…
Camera
of
smartphone
will
be
Real
world
augmented
with
extra
used
to
accomplish
goals
informa2on,
by
using
a
camera
-‐>
Extra
informa2on
on
screen
Extra
informa2on
will
be
about
people,
by
recognizing
their
faces
Extra
informa2on
will
be
taken
from
social
networks
…
with
social
network
informa2on
8
10. Scenarios
Problem:
Need
to
point
mobile
device
to
face
è Where
will
you
use
it?
Need
to
find
scenarios
for
app!
10
11. Scenarios
1. Get
contact
info
2. Create
a
face
based
contact
book
3. Quick
access
to
slides/publica2ons
by
recognizing
speaker
4. Quick
access
to
social
network
informa2on
5. Solu2on
for
prosopagnosia
Or…
6. Find
out
the
name
of
that
cute
girl
in
the
bar
11
14. Related
work
• Viewdle
Social
Camera:
– Detects
facebook
friends
in
photos
• Animetrics:
– Face
detec2on
+
percentage
of
match
– Focused
on
government
use
• Facebook
autotag
– Automa2cally
tag
faced
in
uploaded
pics
14
15. Related
work:
More!
• Project
by
Parra,
Klerkx
and
Duval
• Science
2.0
• Mobile
social
discovery
tool
• Based
on
QR
codes
è
Not
successful
15
16. Related
work:
Niels
Buekers’
Thesis
• “Social
annota>ons
in
augmented
reality”
• Head
mounted
display
è
Not
op2mal
• Face.com
API
• Difficulty
to
create
UI
16
22. Technical
informa2on:
Face
recogni2on
• Viewdle
iOS
api:
???
• Betaface:
– Windows
only
– Not
tested
on
iOS
– Only
paid
• Piipai
– Acquired
by
Google…
22
23. Technical
informa2on:
Face.com
• Free
(rate
limits)
• Private
namespace
• HTTP
get
and
post
• iOs
library
• Very
well
documented
API!
23
34. Paper
prototyping:
Itera2on
1
• 11
test
users,
from
18
to
23,
4
iPhone
users
• Execute
tasks
in
all
3
UI’s
• Results:
UI1
UI2
UI3
Preference
0%
27%
73%
– UI1:
Follow
person
was
cumbersome
– UI2:
Small
screen,
not
much
use
of
camera
part
– UI3:
Less
AR,
but
user
friendly
34
37. Paper
prototyping:
Itera2on
2
tasks
1
)
Recognize
Gerry
Hendrickx
2
)
Check
Gerry’s
last
tweet
3
)
Look
for
informa2on
about
Ben
Schroyens
(who
is
not
around,
but
you
have
recognized
him
before
*hint*)
4
)
Delete
Ben
Schroyens
from
your
history
5
)
Link
your
account
with
your
Twiier
and
Mendeley
account
6
)
Setup
the
program
so
that
when
someone
recognizes
you,
they
can
access
info
from
Mendeley,
but
not
from
Twiier.
7
)
Delete
all
history
8
)
Scan
Serge
Hendrickx,
but
correct
the
program
when
the
person
is
not
correctly
iden2fied.
9
)
Mail
Gerry
Hendrickx
10
)
Add
Gerry
Hendrickx
to
your
iPhone
contacts.
37
38. Paper
prototyping:
Itera2on
2
• Think
aloud
• Note
remarks
and
specific
clicks
• USE
ques2onnaire
• Ques2ons
about
iPhone/social
network
use
38
40. Paper
prototyping:
Itera2on
2
USE
results
• Usefulness:
Ok,
not
life
changing
but
useful
• Ease
of
use:
– Room
for
improvement
– Beier
with
iOS
experience
• Ease
of
learning:
No
score
below
5!
• Sa2sfac2on:
Fun
to
use,
but
divided
need
to
have
it
40
41. Paper
prototyping:
Itera2on
2
• Posi2ve:
• Nega2ve:
– Clean
UI
– Not
enough
home
– iOS
style
buions
– The
concept
– Unclear
contact
icon
– Not
him/her
buion!
41
42. Paper
prototyping:
Itera2on
3
• Adapted
to
nega2ve
points
• Tested
with
prof
Duval
and
5
assistants
• Should
improve:
– Incorrect
buion
– S2ll
too
much
clicking
to
get
somewhere
=>
Tabbed
Bar
– Delete
person
from
history
42
43. Paper
prototyping:
Itera2on
3
• Nice
to
have:
– Preview
of
own
overview
page
– Presets
of
social
network
seongs
– Contact
buion
43
46. Planning:
Todo
next
weeks
• Test
technology:
– Possibili2es
of
camera
– Possibili2es
of
Face.com
– Possibili2es
of
iOS5
face
detec2on
– …
• Start
implementa2on
of
basis
46
48. Sta2s2cs
#
Blog
posts
16
#
Comments
on
other
blogs
5
#
Tweets
concerning
thesis
44
Total
#
of
hours
worked
187
#
of
hours
on
literature
study
20
#
of
hours
on
related
work
10
#
of
hours
on
reports/blog
posts
20
#
of
hours
dedicated
to
other
theses
15
#
of
hours
on
iOS
book
24
#
of
hours
on
design
35
#
of
hours
on
paper
prototype
tes2ng
28
#
of
hours
on
paper
prototype
crea2ng
35
and
evalua2ng
48
