The document discusses natural user interfaces (NUIs) and how computers can interact with humans in more natural ways. It describes how NUIs can recognize human emotions through facial analysis, thoughts through brain-computer interfaces, symbols through pattern recognition, and movements through motion capture technologies. Examples discussed include the MindReader API for emotion recognition, brain-computer interfaces, the ReacTIVision toolkit for pattern recognition, and Microsoft's Natal project for motion capture. The goal is for computers to have more human-like interactions and understand users in a natural way.
16. introduc:on
What
is
Natural?
Opposite
to
ArPficial
(produced
by
the
human).
What
is
an
interface?
Physical
and
funcPonal
connecPon
between
two
independent
devices
or
systems.
21. facial
analysis
Based
on
a
MIT
Media
Lab
project
soVware
MindReader
API
that
enables
the
real
Pme
analysis,
tagging
and
inference
of
cogniPve
affecPve
mental
states
from
facial
video.
This
framework
combines
vision-‐based
processing
of
the
face
with
predicPons
of
mental
state
models
to
interpret
the
meaning
underlying
head
and
facial
signals
overPme.
(Ekman
and
Friesen
1978)
–
Facial
Ac:on
Coding
System,
46
ac:ons
(plus
head
movements).
Standard
to
systemaPcally
categorize
the
physical
expression
of
emoPons,
and
it
has
proven
useful
to
psychologists
and
to
animators.
37. Processing.org
Processing
is
an
“open
source”
programming
language
and
an
environment
for
people
who
wants
to
program
with
images,
animaPons
and
interacPon.
Processing
is
free
and
it
available
for
GNU/Linux,
Mac
OS
X,
and
Windows.
Processing
is
a
project
leaded
by
Ben
Fry
and
Casey
Reas.
It
has
been
evolved
from
the
ideas
of
groups
such
as
Aestethics
and
CompuPng
Lab
at
the
MIT.