Gerd Kortuem gave a presentation at Internetome 2010 in London on the Internet of Things. The presentation discussed (1) how human interaction with objects will evolve as more everyday items become connected to the internet, requiring new models of human-computer interaction; (2) case studies on designing smart energy meters, workplace safety devices, and hospital information systems to be more user-centered; and (3) the need to focus more on how connected technologies will affect people, not just the technologies themselves.
Powerpoint exploring the locations used in television show Time Clash
Gerd Kortuem presents on Internet of Things
1. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Internetome 2010, London
Internet of Things =
People+ Things + Data
Gerd Kortuem
Lancaster University
www.kortuem.com
1
2. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
The presentation will be
shared over Twitter:
@kortuem
and on my blog:
www.kortuem.com
2
3. LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Researcher
Software developer
Consultant
Lancaster University
School of Computing and Communications
Management School
Imagination (Design Department)
Highwire PhD training network
20 (+10/year) PhD students
focused on innovation
transdisciplinary
4. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
My vision
IoT = People+ Things + Data
The value of the Internet (of Things)
increases the more computers
people are connected.
4
5. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Homo habilis
5
The tool maker
6. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
The operator: handle, control, monitor, observe
Homo habilis
6
7. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Homo habilis
7
The user: interact, browse, communicate, socialise
8. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
The future homo habilis
How will our relationship to objects
develop?
8
The
connected
object
Autonomy
Agency
Data-rich
Communicative
Social
Perceptive
Collaborative
Networked
9. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
We need to develop new models and theories
Human factors, interface design,
user experience design, information
design ... for connected objects.
9
10. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Interaction design
Contextual design
Information design
10
11. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Case 1: Interaction Design
What is wrong with energy meters?
11
12. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Influence, persuade, nudge.
Feedback loops
12
13. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Unanticipated effects
After being told that they used more
energy than their neighbours,
republicans who showed no
practical interest in environmental
causes increased electricity use by
0.75 per cent.
Average electricity reduction was 2.5%.
Dora L. Costa, Matthew E. Kahn. (2010) Energy Conservation "Nudges" and Environmentalist
Ideology: Evidence from a Randomized Residential Electricity Field Experiment. NBER Working
Paper No. 15939, May 7, 2010. National Bureau of Economic Research, 1050 Massachusetts Ave.,
Cambridge, MA.
13
14. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
50% of my Ph.D. students could not
install the energy meters at their
home.
Too much focus on product use, not
enough focus on the rest of the
product lifecycle.
14
15. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Maintaining interest
Effects may fade over time.
“The results show that the initial
savings in electricity consumption
of 7.8% after 4 months could not be
sustained in the medium- to long-
term”
van Dam, S. S., Bakker, C. A., van Hal, J. D. M. Home energy monitors: impact over the
medium-term. Building Research & Information. 2010, vol 38, issue 5, pp. 458-469.
15
16. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Do we need more screens? Trend to more complexity.
“Energy dashboards” and “home
“energy management systems”
instead of simple controls.
16
www.gridpoint.com.
www.tendrilinc.com. http://www.ecovisionsolutions.com.au/
17. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
An alternative approach
Laptop energy management as
example to follow
17
Reduced interface
Closing the lid
Automatic energy
management
of all components
User defined energy
management preferences
Energy management
of individual
components
Disk spins down
Cpu reduces speed
Display reduces brightness
18. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
The light power switch
Tangible interaction instead of
persuasion
18
controls all devices in a room
19. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
The energy door lock
Door lock as decision and control
point: back in 5 minutes or 5 weeks?
19
Unlock
Sleep
Shutdown
20. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Lesson
Not everything that looks like a
feedback loop should be designed as
such.
Tangible controls vs generic screen-
based control.
Deep modifications may be required
to get interaction right.
20
21. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Case 2: Contextual Design
Smart objects for the work place
21
22. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Networked sensor drill
Improving health and safety at construction sites
22
23. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Protecting against Vibration-White-Finger Syndrome
23
24. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Protecting against Vibration-White-Finger Syndrome
24
Duration of use
measured
Vibration characteristics
known for each equipment,
measured by manufacturer
Soil condition
assumed
Actual Exposure
Maximum Legal Exposure
Compliant?
25. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Inform, motivate.
Envisioned feedback loop
25
26. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Design process
26
27. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Issue 1. Self-Image and social pressure
Safety equipment often not used
27
28. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Issue 2. Information disclosure
Unit with display was accepted, unit
w/o display was perceived as
surveillance technology.
28
29. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Issue 3. Information accountability
There can be too much information.
If a job needs to get done nobody
(management, worker) wants to
know that someone is over the
exposure limit.
29
30. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Issue 4. Unexpected social feedback loops
Operators as source of expertise and
drivers of behavioural change.
30
31. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Lessons
Open design
Information disclosure (may be good or bad)
Empowering users
Supporting collaboration
31
32. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Case 3: Information Design
Mapping information to space
32
33. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Internet of Things for information-rich environments
Hospital Ward
33
Critical decisions
Time pressure
Many devices
Many people
Better decisions
Better care
34. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Analysing work behaviour
Human Activity Language
S: do a
S: do a with d
S: do a to P
S: do a with d to P
34
S:staff
a:action
P: patient
d: device
35. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
35
36. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
36
Saline
machine
Patient 1
Patient 2
Patient 3
Use
device
UD
on patient
37. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
37
Saline
machine
Patient 1
Patient 2
Patient 3
Use
device
UD
on patient Micro Displays
38. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Micro Displays
Situated Information
38
!
39. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Visual Design
Encoding for maximum clarity and
information density
39
3
3
measure
blood
pressure
19
Colour Representing
Entity and Relationship
Instruction | Explanation
Confirmation | Trends
Entity A Identity
Entity B Identity
Status
Design by Kevin Smith
40. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Lessons
Multi-dimensional design space:
What information,
when,
where
and how?
40
41. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Recap
Interaction design
Contextual design
Information design
41
42. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Global R&D agenda still mostly focuses on technology
Not much about people or design
for people in here ...
Vision and Challenges
for Realising the
Internet of Things
March 2010
Edited by
Harald Sundmaeker
Patrick Guillemin
Peter Friess
Sylvie Woelfflé
The meaning of things
lies not in the things
themselves, but in our
attitude towards them.
Antoine de Saint-Exupéry
42
43. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
Conclusion
1. Homo habilis: our relation to future smart
objects yet undefined (user, operator, ...).
2. IoT Design for people requires more than
adding a thin interface layer; requires deep
modification of IoT concepts, architectures,
etc...
3. Current industry (and research) agenda ignores
interaction design and information design for
the IoT.
4. Ecosystem design: new design methodologies
and design tools are needed for defining our
interaction (with ecosystems of) smart
connected objects.
43
44. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
IoT = People+ Things + Data
Thank you.
gerd@kortuem.com
@kortuem
www.kortuem.com
44
45. GERD KORTUEM | WWW.KORTUEM.COM | @KORTUEM | GERD@KORTUEM.COM | INTERNETOME 2010 LONDON | SLIDE LANCASTER UNIVERSITY SCHOOL OF COMPUTING
AND COMMUNICATIONS
`
45