The document reviews the state of the art in adaptive user interfaces. It discusses several approaches to adapting user interfaces for different contexts, including mobile devices, web interfaces, and services. It analyzes solutions that use middleware platforms, context-aware adaptation, and substituting semantically equivalent interface elements to enable adaptation. The document structures the discussion around adaptation of general user interfaces, web interfaces, and services.
Distributed Semantic Middleware for Social Robotic Services
Adaptive and Plastic User Interfaces: A review of the State of the Art.
1. Adaptative User Interfaces
A review of the state of the art
Eduardo Castillejo
DeustoTech - Deusto Institute of Technology, University of Deusto
October 16, 2012
7. [Calvary 2001 I]
Based in Context migrations. Each change activates a
trigger that launches the best suitable interface selection
process.
Adaptative User Interfaces UI Adaptation 4 / 34
9. [Repo 2004]
Based on a middleware which manages the adaptation
process.
The platform detects the user’s device (1), queries its
capabilities (3), and returns the corresponding user interface
taking into account the selected service and the current
device (4).
Adaptative User Interfaces UI Adaptation 6 / 34
10. [Nilsson 2006] [Hallsteinsen 2004]
The applications are built to support the creation of variants
which fit with the different requisites that may appear during
its use.
The adaptation middleware creates and manages an
acceptable configuration of the applications.
Adaptative User Interfaces UI Adaptation 7 / 34
11. [Lehtonen 2002]
The adaptation process is based on some configuration
files (Product Configuration Files) which define the interface
appearance and stores the user’s parameters.
The designed UI are based on Bean Markup Language (a
language oriented to UI) and Java Beans.
BML is directly runnable, so it is possible to be launched at
runtime.
Adaptative User Interfaces UI Adaptation 8 / 34
13. [Stuerzlinger 2006]
It’s focused on the adaptation of desktop applications and
the re-configuration of the current window interfaces by a
User Interface Facades system.
Adaptative User Interfaces UI Adaptation 10 / 34
15. Summary
Solution Paradigm Adaptation Dynamic process Platform
[Calvary 2001 I] Prologue-Action-Epilogue Based on context Yes Mobile
[Calvary 2001 II] Prologue-Action-Epilogue Based on context Yes Mobile
[Repo 2004] Middleware (*) No Mobile
[Nilsson 2006] Middleware Based on context Yes Mobile
[Hallsteinsen 2004] Middleware Based on context Yes Mobile
[Lehtonen 2002] Document assembly Based on user parameters Yes Mobile
[Stuerzlinger 2006] User Interface Facades Based on direct interaction
¸ No Desktop
* Although they make references to context, it is its own change which launches the adaptation process, but it is not
launched by its current parameters or values.
Adaptative User Interfaces UI Adaptation 12 / 34
16. Outline
UI Adaptation
Web UI Adaptation
[Safi 2011]
[Malandrino 2010]
[Domingues 2011]
`
[Paterno 2010]
Summary
Services adaptation
References
Adaptative User Interfaces Web UI Adaptation 13 / 34
17. [Safi 2011]
XHTML server that applies a specific CSS based source
code to the web page and allows the adaptation of the
requested web pages to heterogeneous mobile devices.
Some extra parameters (e.g. device OS, screen resolution
and size, available font styles...) are taken into account to
enhance the adaptation process.
Adaptative User Interfaces Web UI Adaptation 14 / 34
19. [Malandrino 2010]
Based on the same idea of [Safi 2011], adding context to the
equation.
Adaptative User Interfaces Web UI Adaptation 16 / 34
20. [Domingues 2011]
The web page is modified with some dynamic and
automatic changes in the web browser.
Problem: it is necessary to include an AJAX script to be run
in the client side.
This script requests the corresponding adaptation requests
and renders the adaptation output.
Adaptative User Interfaces Web UI Adaptation 17 / 34
22. `
[Paterno 2010]
The client request is analysed similarly to the previous
solutions by using a middle side server.
The web page’s HTML logic and the associated CSS files are
extracted by a reverse engineering process.
Next, these files are sent to a module which main purpose is
to redesign the web page for the client device.
Some of the graphic interface elements or views are
substituted by others which are semantically equivalent.
Adaptative User Interfaces Web UI Adaptation 19 / 34
24. Summary
Solution Paradigm Use of context Used capabilities
[Safi 2011] Adaptation server (XHTML + CSS) - Device’s
[Malandrino 2010] Adaptation server Network architecture;
User’s current activity;
User’s preferences; Device’s and user’s
[Domingues 2011] Adaptation server - -
`
[Paterno 2010] Middle side server - -
Adaptative User Interfaces Web UI Adaptation 21 / 34
26. [Camara 2009]
A tool (ITACA) which supports generative adaptation,
starting from the already existing automatic description
interface behaviour model extraction.
It supports the specification and validation of adaptation
agreements, it automatizes the protocols generation and
relates the proposed abstract model with implementation
languages.
Problem: The agreements specification may need human
participation.
Adaptative User Interfaces Services adaptation 23 / 34
28. [Moser 2008]
VieDAME, a platform based on the substitution of
semantically equivalent elements, assuring that,
intercepting SOAP messages and suffering from a very little
performance penalty and by using a vision based on aspects,
it is capable of substitute services at runtime in BPEL
environments.
Adaptative User Interfaces Services adaptation 25 / 34
29. [Moser 2008]
The ”VieDAME core” includes the monitoring, service
selection and message transformation, and it provides
services as the storage and access to data and data planning
and configuration.
”VieDAME engine adapters”.
Adaptative User Interfaces Services adaptation 26 / 34
31. [Kongdenfha 2006]
A framework to manage the service adaptation based on AOP
to interact with independent service protocols and operation.
A taxonomy of a possible incongruence between interfaces is
identified .
To work with this incongruences some adaptation templates
are used.
Adaptative User Interfaces Services adaptation 28 / 34
33. Outline
UI Adaptation
Web UI Adaptation
Services adaptation
References
Adaptative User Interfaces References 30 / 34
34. References
[Nilsson 2006] E. G. Nilsson, J. Floch, S. Hallsteinsen, y E. Stav, “Model-based user interface adaptation”,
Computers & Graphics, vol. 30, num. 5, pp. 692–701, 2006.
[Schilit 1995] W. N. Schilit, “A system architecture for context-aware mobile computing”, Columbia University,
1995.
[Dey 2001] A. K. Dey, “Understanding and using context”, Personal and ubiquitous computing, vol. 5, num. 1, pp.
4–7, 2001.
[Calvary 2001 I] G. Calvary, J. Coutaz, y D. Thevenin, “Supporting context changes for plastic user interfaces: a
process and a mechanism”, People and Computers, pp. 349–364, 2001.
[Calvary 2001 II] G. Calvary, J. Coutaz, y D. Thevenin, “A unifying reference framework for the development of
plastic user interfaces”, Engineering for Human-Computer Interaction, pp. 173–192, 2001.
[Calvary 2002] G. Calvary, J. Coutaz, D. Thevenin, Q. Limbourg, N. Souchon, L. Bouillon, M. Florins, J.
Vanderdonckt, y others, “Plasticity of User Interfaces: A Revisited Reference Framework”, in In Task Models and
Diagrams for User Interface Design, 2002.
[Repo 2004] P. Repo, “Facilitating user interface adaptation to mobile devices”, in Proceedings of the third Nordic
conference on Human-computer interaction, 2004, pp. 433–436.
[Hallsteinsen 2004] S. Hallsteinsen, E. Stav, y J. Floch, “Self-adaptation for everyday systems”, in Proceedings
of the 1st ACM SIGSOFT workshop on Self-managed systems, 2004, pp. 69–74.
[Stuerzlinger 2006] W. Stuerzlinger, O. Chapuis, D. Phillips, y N. Roussel, “User interface facades: towards fully
¸
adaptable user interfaces”, in Proceedings of the 19th annual ACM symposium on User interface software and
technology, 2006, pp. 309–318.
[Marmolin 1995] H. Marmolin, Y. Sundblad, K. Schmidt, y others, “Medium versus mechanism: Supporting
collaboration through customisation”, in ECSCW’95: proceedings of the Fourth European Conference on
Computer-Supported Cooperative Work, 10-14 September 1995, Stockholm, Sweden, 1995, vol. 8, p. 133.
Adaptative User Interfaces References 31 / 34
35. References
[Weerawarana 2001] S. Weerawarana, F. Curbera, M. J. Duftler, D. A. Epstein, y J. Kesselman, “Bean Markup
Language: A composition language for JavaBeans components”, in Proceedings of the 6th conference on
USENIX Conference on Object-Oriented Technologies and Systems-Volume 6, 2001, pp. 13–13.
´
[Lehtonen 2002] M. Lehtonen, R. Petit, O. Heinonen, y G. Linden, “A dynamic user interface for document
assembly”, in Proceedings of the 2002 ACM symposium on Document engineering, 2002, pp. 134–141.
[Watanabe 1999] T. Watanabe, “Document Analysis and Recognition”, IEICE transactions on information and
systems, 1999.
[Gu 2006] X. D. Gu, J. Chen, W. Y. Ma, y G. L. Chen, “Visual based content understanding towards web
adaptation”, in Adaptive Hypermedia and Adaptive Web-Based Systems, 2006, pp. 164–173.
[Safi 2011] Q. G. K. Safi, T. Nawaz, S. M. A. Shah, y T. Mahmood, “Intelligent Device Independent UI Adaption
for Heterogeneous Ubiquitous Environments”, IJCSNS, vol. 11, num. 11, p. 75, 2011. Global Mobile Statistics
2012: Mobile browsing v desktop browsing.
[Malandrino 2010] D. Malandrino, F. Mazzoni, D. SRiboni, C. Bettini, M. Colajanni, y V. Scarano, “MIMOSA:
context-aware adaptation for ubiquitous web access”, Personal and Ubiquitous Computing, vol. 14, num. 4, pp.
301–320, 2010.
[Domingues 2011] M. A. Domingues, “Exploiting multidimensional data for web site automation”, AI
Communications, vol. 24, num. 3, pp. 289–290, 2011.
` `
[Paterno 2010] F. Paterno y G. Zichittella, “Desktop-to-mobile web adaptation through customizable
two-dimensional semantic redesign”, Human-Centred Software Engineering, pp. 79–94, 2010.
[Camara 2009] J. Camara, J. A. Martin, G. Salaun, J. Cubo, M. Ouederni, C. Canal, y E. Pimentel, “Itaca: An
integrated toolbox for the automatic composition and adaptation of web services”, in Software Engineering, 2009.
ICSE 2009. IEEE 31st International Conference on, 2009, pp. 627–630.
[Moser 2008] O. Moser, F. Rosenberg, y S. Dustdar, “Non-intrusive monitoring and service adaptation for
WS-BPEL”, in Proceedings of the 17th international conference on World Wide Web, 2008, pp. 815–824.
Adaptative User Interfaces References 32 / 34
36. References
[Kongdenfha 2006] W. Kongdenfha, R. Saint-Paul, B. Benatallah, y F. Casati, “An aspect-oriented framework for
service adaptation”, Service-Oriented Computing–ICSOC 2006, pp. 15–26, 2006.
[Benatallah 2005] B. Benatallah, F. Casati, D. Grigori, H. Nezhad, y F. Toumani, “Developing adapters for web
services integration”, in Advanced Information Systems Engineering, 2005, pp. 415–429.
Adaptative User Interfaces References 33 / 34
37. All rights of images are reserved by the
original owners*, the rest of the content is licensed
under a Creative Commons by-sa 3.0 license.
* [Calvary 2001 I], [Calvary 2001 II], [Repo 2004], [Nilsson 2006],
[Lehtonen 2002], [Stuerzlinger 2006], [Safi 2011], [Malandrino 2010],
`
[Domingues 2011], [Paterno 2010], [Camara 2009], [Moser 2008],
[Kongdenfha 2006]
38. Adaptative User Interfaces
A review of the state of the art
Eduardo Castillejo
DeustoTech - Deusto Institute of Technology, University of Deusto
October 16, 2012