This document presents the TriPlet conceptual framework for multidimensional adaptation of user interfaces to the context of use. It begins with an introduction to contextualization, discussing how current interactive systems consider conventional contexts of use but interaction now occurs in non-conventional contexts with heterogeneous users, platforms, and environments. It then discusses the motivations for adaptation to context, defines key terms, and outlines the scope and methodology of the TriPlet framework. The methodology involves analyzing the state of the art, identifying relevant dimensions for context, and validating the framework through case studies. The document provides an in-depth review of related work on meta-models, frameworks and design spaces to support context-aware adaptation.
1. TriPlet:
A
Conceptual
Framework
for
Mul<dimensional
Adapta<on
of
User
Interfaces
to
the
Context
of
Use
Vivian
Genaro
Mo,
École
Polytechnique
de
Louvain
Université
catholique
de
Louvain
Louvain-‐la-‐Neuve,
Belgium
vivian.genaromo>@uclouvain.be
2. Louvain
Interac<on
Laboratory
(LILab)
Place
des
Doyens,
1
–
B-‐1348
Louvain-‐la-‐Neuve,
Belgium
hPp://www.lilab.be,
hPp://www.lilab.eu,
hPp://www.lilab.info
Louvain-la-Neuve, December 10th, 2013
4. ContextualizaBon
§
InteracBve
systems
tend
to
consider
convenBonal
contexts
of
use
§
§
§
Able-‐bodied
user
Stable
environment
Desktop
PC
Louvain-la-Neuve, December 10th, 2013
4
5. ContextualizaBon
§
The
interacBon
currently
occurs
in
non-‐convenBonal
contexts
§
Heterogeneity
of
§
Users
§
PlaUorms
§
Environments
Louvain-la-Neuve, December 10th, 2013
5
9. MoBvaBons
§ Users
§
§
Heterogeneous
group
PlasBc
user
interfaces
§ Technology
§
Fragmented
device
market
§ Environment
§
Variety
of
contexts
§ Stakeholders
§
Only
limited
support
Louvain-la-Neuve, December 10th, 2013
9
10. MoBvaBons
§ Stakeholders
§
Limited
coverage
of
context
Published in CASFE’2013 and SigDoc’2013 [Mot13]
10
11. DefiniBons
§ Context
Any
informaBon
that
is
relevant
for
adapBng
the
system
to
the
scenario
of
the
user
[Abo99],
[Dey00]
§
§ Adapta<on
Modifying
applicaBon
aspects
[Bro86],
[Thi94],
[Bru96],
[Lor00]
Goal
§
§
§
§
higher
usability
and
accessibility
levels
be^er
user
experiences
§ Context-‐aware
Adapta<on
Louvain-la-Neuve, December 10th, 2013
11
12. Scope
§ Target
Audience
§
UI
designers
and
developers
§ Focus
§
§
InteracBve
InformaBon
Systems
ValidaBon
mainly
on
web
apps
and
GUI’s
§ SDLC
coverage
Louvain-la-Neuve, December 10th, 2013
12
28. Dimension
Category
Properties
Classes
Scenario
User
Profile
Age
Children
Teenager
Adult
Elderly
If the users are elderly, the
targets must be larger, and
drag and pinch gestures
must be preferred [Kob11]
Attention
Level
Distracted
Regular
Concentrated
If the user is distracted,
then motion gestures may
be preferred as the input
modality [Neg12]
Interaction
History
Often
Regular
Rare
If the menu items have a
often access, they must be
easily accessed [Gaj06]
Cognitive
Dyslexia
Autism
If the user is dyslexic, the
font size must be adapted
[Dir09]
Visual
Blind
Color-blind
If user is blind, then haptic
feedback must guide touchbased interactions [Gon11]
Numeracy
Poor
Medium
High
If the user has poor
numeracy, simplify the
numerical information
[Bau11]
Disabilities
Domain
Expertize
Level
Louvain-la-Neuve, December 10th, 2013
28
29. Dimension
Category
Properties
Classes
Scenario
Platform
Device
Network
Bandwidth
Bits per
second
If there are rate constraints
in the network bandwidth,
then remove channels or
quality layers of the audio
[Fei05]
Type
Mobile Phone
If mobile phones, then the
UI must support multiple
interaction methods (focusbased, pointer-based and
touch-based) [W3C10]
Screen
Large Screen
Wall Display
Vertically
Curved
If large screen, then
optimize the use of screen
space and reduce the
scrolling [Neb11]
Louvain-la-Neuve, December 10th, 2013
29
30. Dimension
Category
Properties
Classes
Scenario
Cold
Warm
Hot
If temperature is cold,
then display
advertisements
appropriate for winter
[Hea12]
Noise Level
Loud
Moderate
Silent
If noise level is loud, then
replace audio content per
text [Fei05]
Date
Day
Month
Year
If commemorative date,
then replace logo image
[Doo12]
Environment Environmental Temperature
Factors
Period
Louvain-la-Neuve, December 10th, 2013
30
40. Design
Spaces
Modalities, Fusion, Abstraction
What, When, Why, How, To What, Who, How many, With what, For what
Costs, Benefits, Frequency, Predictability, Performance, Satisfaction
Technique, Quality, Function
Target, Means, Time
Presence, Content Suggestion, Actionables
Louvain-la-Neuve, December 10th, 2013
40
41. AdaptaBon
Lifecycle
User interface adaptation
Goals
Initiative
Intention
Evaluation
Meaning of an
input expression
Proposal
Decision
Meaning of an
output expression
Action
Specification
Interpretation
Shape of an
input expression
Execution
Shape of an
output expression
Perception
Execution
System
The ISATINE framework [Lóp08]
Louvain-la-Neuve, December 10th, 2013
41
43. Shortcomings
S1.
Limited
coverage
of
CAA
dimensions
S2.
Focused
impact
on
CAA
S3.
Specific
applicaBon
domain
S4.
ParBal
support
for
guiding
CAA
S5.
Moderate
usability
for
CAA
UI’s
S6.
Technology-‐dependency
of
the
soluBons
S7.
Obsolescence
of
the
support
provided
S8.
Simple
logic
to
address
CAA
S9.
Lack
of
unificaBon
of
the
vocabulary
and
approaches
Louvain-la-Neuve, December 10th, 2013
43
44. Thesis
Statement
TriPlet
§ To
propose,
to
define,
to
develop,
and
to
instanBate
a
mulBdimensional
conceptual
framework
(TriPlet)
CAMM
CARF
CADS
§ To
provide
stakeholders
structured
guidance
for
addressing
context-‐aware
adaptaBon
of
user
interfaces
Louvain-la-Neuve, December 10th, 2013
44
58. Steps
followed
to
Extract
AT’s
§
Search
on
digital
bases
(ScienBfic
and
Commercial)
§
Context-‐aware
adaptaBon
§
And
concepts
closely
related
§
SystemaBcally
extract
adaptaBon
techniques
§
A
funcBon
to
change
a
system
aspect
according
to
a
given
criteria
§
Locate
the
concepts
within
a
common
template
§
Publish
them
in
a
wiki
Louvain-la-Neuve, December 10th, 2013
58
59. References
[Cou07]; [Ser10]
Description
Re-molding consists in the reconfiguration the UI according to the
target context: elements can be re-located, re-sized, added and
supplied. Pagination and scrolling may be used.
Rationale
Given a UI and a target context, the elements are re-arranged for
the new context to assure usability
Example
When the user changes the platform (e.g. from a Desktop PC to a
Smartphone)
Context
According to the platform,
device, screen dimensions
Advantages
The usability level will be improved
Disadvantages It is necessary to know before hand
the best location for the elements,
some of them may be suppressed
Source: http://www.alistapart.com/articles/switchymclayout
Louvain-la-Neuve, December 10th, 2013
59
65. ValidaBon
§ Several
approaches
§ InstanBaBon
of
the
framework
§ By
exploraBon
on
selected
case
studies
§ Variability
of
decisions
§ 2
illustraBve
case
studies
§ Car
rental
§
A
reference
case
study
for
FP7
Serenoa
and
W3C
WG
on
MBUI
Touris<c
applica<on
§
§
§
Weather,
Weathaware,
Walkaware
A
reference
case
study
for
ITEA
UsiXML
Louvain-la-Neuve, December 10th, 2013
65
67. Case
Study
§ 3
implementaBons
each
§
TriPlet
support
§ Costumers
§
Car
Rental
and
TourisBc
App
§ IT
Team
§
UI
Designers,
Developer
Team
and
Project
Manager
Louvain-la-Neuve, December 10th, 2013
67
68. TriPlet
support
during
the
SDLC
Planning
customers
CADS
CARF
Analysis
designers
Design
CAMM
Development
development team
68
69. Car
Rental
Example
§ Task
§
Users
rent
a
car
Louvain-la-Neuve, December 10th, 2013
69
72. Car
Rental
#1
–
Context
of
Use
A
and
B
A
B
Louvain-la-Neuve, December 10th, 2013
72
73. Car
Rental
#1
–
Context
of
Use
A
and
B
Louvain-la-Neuve, December 10th, 2013
73
74. Car
Rental
#1
–
Context
of
Use
A
§
Credits:
Aldemar
Aramayo,
Alexander
Damnjanovich
(LSINF2356
–
HCI
course)
Louvain-la-Neuve, December 10th, 2013
74
75. Car
Rental
#1
–
Context
of
Use
A
Louvain-la-Neuve, December 10th, 2013
75
76. Car
Rental
#1
–
Context
of
Use
B
Louvain-la-Neuve, December 10th, 2013
76
77. Car
Rental
#1
–
Context
of
Use
B
Louvain-la-Neuve, December 10th, 2013
77
78. Car
Rental
#1
–
CoU
A
(Video)
78
Louvain-la-Neuve, December 10th, 2013
79. Car
Rental
#1
–
CoU
B
(Video)
Louvain-la-Neuve, December 10th, 2013
79
80. Car
Rental
#1
–
CADS
Louvain-la-Neuve, September 23rd, 2013
80
81. Car
Rental
#2
–
Context
of
Use
A,
B
and
C
81
Louvain-la-Neuve, December 10th, 2013
82. Car
Rental
#2
–
Context
of
Use
A,
B,
C
A
Louvain-la-Neuve, September 23rd, 2013
B
82 82
C
83. Car
Rental
#2
-‐
Video
Credits:
Thibault
Goemans,
Michael
Lacroix,
Grégory
Nuy^ens,
SébasBen
Scoumanne
(LINF2356
–
HCI
course)
Louvain-la-Neuve, December 10th, 2013
83
84. Car
Rental
#2
–
CADS
Louvain-la-Neuve, September 23rd, 2013
84
85. Car
Rental
#3
–
Context
of
Use
1,
2
and
3
Louvain-la-Neuve, December 10th, 2013
85
86. Car
Rental
#3
–
Context
of
Use
1
and
2
A
B
Louvain-la-Neuve, December 10th, 2013
C
D
86
87. Car
Rental
#3
–
Context
of
Use
3
E
§
F
Credits:
Javier
Escolar,
CrisBna
Cachón,
and
Ignacio
Marín
(reference
case
study
and
demos
Serenoa
project)
Louvain-la-Neuve, December 10th, 2013
87
88. Car
Rental
#3
–
CADS
Louvain-la-Neuve, September 23rd, 2013
88
91. TourisBc
ApplicaBon
§ Task
§
§
§
Support
users
in
planning
their
trip
Weather
informaBon
Sightseeing
§
Credits:
QuenBn
Poncelet
and
François
Debande
mater
thesis
[Deb11]
Louvain-la-Neuve, December 10th, 2013
91
109. Comparing
CS2
–
CADS
Louvain-la-Neuve, September 23rd, 2013
110. ContribuBons
§ A
conceptual
framework
for
MulBdimensional
Context-‐aware
AdaptaBon
of
User
Interfaces
§ TriPlet
CARF
§
§
DescripBve
Templates
for
AdaptaBon
Techniques
CAMM
§
§
Formal
definiBon
of
concepts,
their
properBes
and
relaBonships
CADS
§
§
A
Design
Space
to
analyze,
evaluate
and
compare
applicaBons
Louvain-la-Neuve, December 10th, 2013
110
111. Benefits
§ Designer
and
Developer
§
§
§
AlternaBves
for
design
decisions
Standard
Framework
enabling
instanBaBons
Unified
terminology
§ End
user
§
§
§
QualiBes
Completeness
More
suitable
and
context-‐aware
UI’s
111
Louvain-la-Neuve, December 10th, 2013
113. Discussion
§ Many
trade-‐offs
sBll
exist
§
§
§
Privacy
vs.
Context
Context
opBmizaBon
vs.
prioriBzaBon
User
control
vs.
system
control
§ Decisions
vary
according
to
each
scenario
Louvain-la-Neuve, December 10th, 2013
113
114. Final
Remarks
§ The
framework
supports
stakeholders
in
the
development
of
context-‐aware
adaptaBon
§
§
§
Providing
a
catalog
that
aids
the
design
decisions
Providing
a
meta-‐model
that
standardizes
concepts
Providing
means
to
analyze
the
applicaBon
§ No
toolkit
is
provided
though
Louvain-la-Neuve, December 10th, 2013
114
115. Conclusion
§ One-‐size-‐does-‐not-‐fit-‐all
§
AdaptaBon
is
needed
§ So
far,
not
enough
support
§
Unified,
integrated,
complete
§ TriPlet
§
§
§
§
§
Extensible
Flexible
Generic
Purpose
Technology-‐independent
Domain-‐independent
Louvain-la-Neuve, December 10th, 2013
115
116. Future
Works
§ AdaptaBon
techniques
as:
§
§
(Design)
pa^erns
Library
of
algorithms
§ A
portal
to
publish
the
knowledge
and
tools
§
Enabling
search
and
retrieval
of
CAA
Knowledge
§ A
toolkit
/
Eclipse
plugin
to
generate
the
computaBonal
version
of
the
framework
Louvain-la-Neuve, December 10th, 2013
116
117. Acknowledgments
§ Serenoa
project
that
is
funded
by
the
European
Union
through
its
Seventh
Framework
Programme
as
a
STREP
Project
no.
FP7-‐ICT-‐258030
§ ITEA2-‐Call
8
UsiXML
(User
Interface
eXtensible
Markup
Language)
project
that
is
funded
by
DirecBon
Générale
DGO6
of
Région
Wallonne
§ QualIHM
(Région
Wallonne,
DirecBon
générale
operaBonnelle
de
l’Economie,
de
l’Emploi
et
de
la
Recherche
DGO6)
§ “The
WIST
-‐
Des<ne
research
project
(Design
&
EvaluaBon
Studio
For
Intent-‐
Based
Ergonomic
Web
Sites),
funded
by
«WIST»
Wallonie
InformaBon
Science
&
Technology
research
program
(Walloon
Region,
ConvenBon
n°315577,
h^p://www.info.fundp.ac.be/DESTINE
LILAB
Louvain-la-Neuve, December 10th, 2013
117
118. Publications
§
§
§
§
§
§
§
§
Vivian Genaro Motti, Javier Escolar, Cristina G. Cachón, Ignacio Marín and Jean
Vanderdonckt: Managing Adaptation Rules for Context-aware Graphical
User Interfaces. In: UMUAI 2013 (Under review)
Vivian Genaro Motti and Jean Vanderdonckt: A Unified Model for Contextaware Adaptation of User Interfaces. In: RRIOC 2013 (To appear)
Vivian Genaro Motti, Dave Raggett, Sascha Van Cauwelaert, Jean Vanderdonckt:
Simplifying the Development of Cross-Platform Web User Interfaces by
Collaborative Model-Based Design. In: SIGDOC 2013
Vivian Genaro Motti, Dave Raggett, Jean Vanderdonckt: Current Practices on
Model-based Context-aware Adaptation. In: CASFE 2013: 17-23
Vivian Genaro Motti, Jean Vanderdonckt. 2013. A Computational Framework
for Context-aware Adaptation of User Interfaces. In: RCIS 2013.
Ugo Braga Sangiorgi, Vivian Genaro Motti, François Beuvens, and Jean
Vanderdonckt. 2012. Assessing lag perception in electronic sketching. In:
NordiCHI '12
Charles-Eric Dessart, Vivian Genaro Motti, and Jean Vanderdonckt. 2012.
Animated transitions between user interface views. In: AVI '12
Charles-Eric Dessart, Vivian Genaro Motti, and Jean Vanderdonckt. 2011.
Showing user interface adaptivity by animated transitions. In: EICS '11
Louvain-la-Neuve, December 10th, 2013
118
119. Courses
§
VANDERDONCKT, J.; MOTTI, V. G. . Multi-Dimensional Context-Aware
Adaptation of Web Applications. In: ICWE’2011. Paphos-Cyprus (Course
Presented).
§
MOTTI, V. G.; VANDERDONCKT, J. . Context-Aware Adaptation of User
Interfaces. In: Interact’2011. Lisbon-Portugal (Course Presented).
§
§
7 Deliverables (Serenoa)
6 Working Papers (LSM)
Louvain-la-Neuve, December 10th, 2013
119