1. Convergence of Emergent Technologies for the Digital Home Celia Gutiérrez, Sara Pérez PT2 Madrid, 22 de junio de 2010 Liderado por:

2. Convergence of Emergent Technologies for the Digital Home Accessibility and Inredis Importance of accessibility technologies. Scope of Inredis project INterfaces for Relationships between environment and DISabled people. Leadership by Technosite. Structured in 9 packages. Package 2.1: State of the art.

3. Convergence of Emergent Technologies for the Digital Home Ambient Intelligence Scenario for a better quality of life Enriched with devices and infrastructures personalized according to users’ preferences can detect users' needs anticipate to their behavior react before their presence A pervasive or ubiquitous component: set of services provided anywhere anyway at any moment Architecture: services coexist within the network.

4. Convergence of Emergent Technologies for the Digital Home Digital Home One of the main scenarios of application for Ambient Intelligence. Convergence of technologies at three levels: Physical, Middleware, and Services: Physical level: Components that interact with users, New Interaction Devices. Components that perceive the user context,New Materials, Microsystems and Sensors. Ad-hoc networks that connect them, Connectivity. Support and Security. Middleware level: Context Aware Middleware Service level

5. Convergence of Emergent Technologies for the Digital Home Digital Home scenario Traditional home devices: Brown goods White goods Digital home: convergence of Telecommunications Audiovisual computer science consumer electronics

6. Convergence of Emergent Technologies for the Digital Home Digital Home scenario Examples of services from the Digital Home: Communication services: voice, voice over IP (VoIP),… Home telemanagement services: domotic telemanagement (lights, etc.), telesurveillance, … Personal services: device sharing, … Extended home or network of homes Professional services: social and sanitary teleassistance,… Information and content access services: Internet, … Security services: firewall, antivirus, antispam, … Digital Entertainment: television on IP (IPTV), online games, …

7. Convergence of Emergent Technologies for the Digital Home Physical level (Connectivity) Wide coverage and deployment: Accessibility to services at different places and through different kinds of devices Operability among them based on standardization processes Convergence to unique models Technologies: Next Generation Networks (NGN) Wireless Technologies

8. Convergence of Emergent Technologies for the Digital Home Physical level (Connectivity) Next Generation Networking (NGN): All kind of information and services (e.g., voice, multimedia, data) as packages through a global network Based on IP (all-IP) Though just started off, they present: an integrated profile of fixed and mobile networks the assumption of using package commutation instead of circuit commutation. Integration and ubiquity => improve disabled people’ access to information Integration of technologies over a common base Well defined layered architecture IMS (Identity Management Systems) enables communication: on several ways adapted to the particular users' needs.

9. Convergence of Emergent Technologies for the Digital Home Physical level (Connectivity) IPv6 protocol: Sixth and most recent version of IP (Internet Protocol). Standardized by IETF (Internet Engineering Task Force) Features: Wider range of IP addresses Multicast addressing Self-configuration Roaming Digital Home: Suitable environment for the IPv6. There is the convergence of any kind of device and their access by remote control. Self-configuration needed to make all devices connected. These characteristics make IPv6 a base technology for the NGN.

10. Convergence of Emergent Technologies for the Digital Home Physical level (Connectivity) Wireless technologies used in domestics enviroment: WPAN (Wireless Personal Area Network) and WBAN (Wireless Body Area Network) Ad-hoc networks Sensor networks Universal Mobile Telecommunications System (UMTS) networks

11. Convergence of Emergent Technologies for the Digital Home Physical level (New Materials, Microsystems and Sensors) Digital Home specially profited by this kind of technology Most emergent technologies Micro Electro Mechanic Systems (MEMS) Nano Electro Mechanic Systems (NEMS)

12. Convergence of Emergent Technologies for the Digital Home Physical level (New Materials, Microsystems and Sensors) Micro Electro Mechanic Systems (MEMS) Greater integration using 3D processes of fabrication and new materials Using techniques of intelligent energetic management, new microarchitectures of micronucleus nature, and complete systems integrated in a chip, SoC (System On Chip).

13. Convergence of Emergent Technologies for the Digital Home Physical level (New Materials, Microsystems and Sensors) Nano Electro Mechanic Systems (NEMS) Base of one of the technological jumps of next decade Take advantage of microelectronic fabrication manipulation of the materials at molecular level Development of complete electro optic mechanic systems into a chip, as well as chemical and biological sensors, energy collectors and microbatteries. Limitless possibilities: it will allow changing the material properties as the designer likes Examples for Digital Home: Micromirrors for DLP (Digital Light Processing) televisions gyroscopes for the stabilization of camera trembles GPS (Geographical Positioning Systems) localization dead reckoning Interaction devices in video consoles

14. Convergence of Emergent Technologies for the Digital Home Physical level (New Interfaces) Posible by the advances on new materials, signal processing, microelectronics, graphic acceleration and Artificial Intelligence. Types: Augmented reality Haptic (based on the active tact) Voice Body gestures Look Sense of smell Brain signal Multimodal interfaces Development of more natural and versatile user interfaces => for the disabled people Strong tendency towards multimodal interfaces => improve the sensorial perception

15. Convergence of Emergent Technologies for the Digital Home Physical level (New Interfaces) Augmented reality: Complements the real world with virtual objects (generated by computer) They appear to live within the same space of the real world. Featured by the combination and alignment of virtual and real objects Interactively and real time run Not restricted to the visual modality =>all sensorial channels Disadvantage: technical and ergonomic problems that make it difficult to sell Digital Home:entertainment and displays in mobile phones

16. Convergence of Emergent Technologies for the Digital Home Physical level (New Interfaces) Embodied Conversational Agent (ECA): Belong to the multimodal interfaces Offers affective and intellectual human-humanoid interactions Increasing interest academic, industrial, specially video game market Future for the Digital Home: provide a more efficient and affective interaction specially for people with difficulties in the computer management

17. Convergence of Emergent Technologies for the Digital Home Physical level (Support and Security Technologies) Support technologies: Soften any kind of limitation Development of accessible software for mobile phones and software for PCs (screen readers, magnifiers, dialing and activation, big and braille keyboard keys,…) Compact solutions Easy the way to access to the digital contents because of their flexibility and their personalization capacity Digital Home: they provide transparency in the use of the technology to the end user. Security technologies: Biometric solutions most important ones Identification and authentication of users Digital Home: applied to get into the house automatically Recognition of physiological or behavioral characteristics, like the facial thermography, hand palm scan, or keyboard tap.

18. Convergence of Emergent Technologies for the Digital Home Context Aware Middleware Level Intermediate layer in the infrastructures that develop Ambient Intelligence applications Incorporates the user's context Deal with big, complex and heterogeneous distributed systems New requirements like the capacity to adapt, self-configure and self-manage in changing environments Digital Home:provides accessibility features:sensors collect context information, this information is interpreted and, as response, operations are sent to the effectors, in order to adapt to the user's needs Technologies of publish and subscribe services are of great importance, specially UPnP (Universal Plug and Play)

19. Convergence of Emergent Technologies for the Digital Home Service Level Responsible for the provision of services adapted to the user. Detect actions, perform, and even anticipate personalized services. Several AI (Artificial Intelligence): AI identification of actions involves the task of matching them with patterna (Learning and Adaptive Systems) Multi-agent Systems can be considered as an integration technology that may provide adaptivity, learning, multimodality, distribution and interaction Cognitive Vision used for biometric recognition, video surveillance and Domotics.

20. Gracias por su atención

21. Shape Memory Fabrics to Improve Quality Life to People with Disability (PWD) Juan-Carlos Chicote; Santiago Perez IWANN 2009, Part II, LNCS 5518-0889. proceedings PT4 Madrid, 22 de junio de 2010 Liderado por:

22. Índice I. Tarea de trabajo. II. Metodología III. Modelos experimentales IV. Campos de aplicación V. Conclusiones

23. I. Tarea de trabajo PT4. Interacción persona máquina. Líder: TMT Factory Tarea 4.7.- tecnologías basadas en Textil Inteligente:Desarrollo de la plataforma Experimental.Socios: Vía Libre. Technosite.Centro Tecnológico. Cetemmsa.

24. II. Metodología 1/3.- Estado del arte 2/3.- Plataforma genérica. 3/3.- Modelos experimentales

25. II. Metodología Tecnologías consolidadas (tecla textil, fibra óptica) Tecnologías emergentes (sensorización, actuadores) Selección de tecnología: Textil con actuadores

26. III. Modelos experimentales a.- Muñequera con Nitinol. b.- Muñequera con vibración c.- cinturón eléctrico d.- cinturón con pistón e.- Aproximación EAP (Electro Active Polimers)

28. Force

29. Flexibility

30. Easy to control

31. Weaknesses:

32. Heat.

33. Cost.

35. Very Intuitive

36. Cheap

37. Low consumption

38. Weaknesses:

40. 100% Textile

41. Very Fast.

42. Very modulable.

43. Weaknesses:

44. Need to be in contact with skin

46. Intuitive

47. Cheap

48. Easy to control

49. Weaknesses:

51. High Price in this moment

52. Low force (No perception)

53. Low stability in time

55. V. Conclusiones Materiales inteligentes y nuevos modos de interacción. EAP tecnología incipiente, y costosa. Elementos mecánicos con bajo consumo y bajo coste. Interfaces hápticos aumentando modos de interacción.

56. GRACIAS POR SU ATENCIÓN

57. ICIW 2010 - The Fifth International Conference on Internet and Web Applications and Services May 9 - 15, 2010 - Barcelona, Spain Multimodal Interaction in Distributed and Ubiquitous Computing Marc Pous y Luigi Ceccaroni PT4 Madrid, 22 de junio de 2010 Liderado por:

58. Management of distributed services that offer the capability of processing and synthesizing multiple modalities of interaction

59. INREDIS ICD

60. DISTRIBUTED INTERACTION SERVICES Voice services Voice recognition Via microphone, real-time streaming  converting the voice signal into text Voice synthesis Sign language service Spanish sign language recognition Via webcam, real-time streaming  converting the image into text Emotion service Emotion recognition (voice + image) Via webcam and microphone, real-time streaming Avatar service Emotional avatar Sign-language speaker avatar

61. DISTRIBUTED SERVICES SIGN LANGUAGE SERVICES

62. DISTRIBUTED SERVICES VOICE SERVICES

63. How to consume multimodal distributed services offered by an ICD?

64. W3C MMI Architecture W3C MMI Architecture http://www.w3.org/TR/mmi-arch/

65. W3C MMI Framework http://www.w3.org/TR/mmi-framework/

66. Proposed multimodal interactionframework

67. ICD ARCHITECTURE ICD Architecture

68. USER–CENTERED DESIGN User profiles (Personas) Blind users Deaf users Unable to read People living or visiting a city Scenarios Context-aware informative scenario Emergency scenario

69. ICD DESIGN and INTERFACES (1) Interactionidentification (2) Main page - Mapor avatar - Commandbuttons - Content - Scenariooptions (3) Contextualizedmapwithservices (4) Avatar withmap and Street View service

70. CONCLUSIONS and FUTURE WORK Implementation based on the W3C MMI Architecture idea Platform able to integrate multimodal interactive distributed services and offer interaction in real-time Web-based applications and device-independent implementation Improvement of the user experience and accessibility of people with special needs What are we working on now? Real-time interaction: delay reduction between interactions Browser-based apps not being able to easily access device hardware Synchronous interaction vs. Asynchronous technologies Improvement of the distributed services orchestration Enhancement of the mobile usability

71. MOBILE PHONES? http://www.slideshare.net/nokiaconversations/younghee-jung-and-jan-chipchase-presentation-for-nokia-design-london-studio-event-london-29th-april-2008

72. Gracias por su atención

73. Arquitectura orientada a servicios para proporcionar accesibilidad Marta Alvargonzález, Esteban Etayo,Jose Antonio Gutiérrez, Jaisiel Madrid JSWEB2010, Valencia 8-9 de septiembre de 2010 PT5 y PT7+8 Madrid, 22 de junio de 2010 Liderado por:

74. Arquitectura orientada a servicios para proporcionar accesibilidad Servicios y herramientas de accesibilidad y usuarios con discapacidad Requisitos de los productos de apoyo: interoperabilidad y ubicuidad Requisitos adicionales: transparencia al usuario y escalabilidad

75. Integración de productos de apoyo en una arquitectura SOA Arquitectura orientada a servicios para proporcionar accesibilidad Arquitectura de la solución y acceso a los productos de apoyo Esquema de funcionamiento simplificado

76. Arquitectura de la solución y acceso a los productos de apoyo Arquitectura orientada a servicios para proporcionar accesibilidad Componentes internos de la plataforma

77. Caso de uso: un usuario con discapacidad visual accede a un servicio de e-gobierno Arquitectura orientada a servicios para proporcionar accesibilidad

79. Conclusiones Arquitectura orientada a servicios para proporcionar accesibilidad Propuesta novedosa: solución global de accesibilidad Requisitos de productos de apoyo y requisitos adicionales Caso de uso

80. Gracias por su atención

81. Ontology-driven Adaptive Accessible Interfaces in the INREDIS project RaúlMiñón, AmaiaAizpurua, Idoia Cearreta, Nestor Garay, Julio Abascal Laboratory of HCI for Special Needs (UPV/EHU) PT6 Madrid, 22 de junio de 2010 Liderado por:

82. 60 Contents Introduction INREDIS project Modelling Interface Generator – IG Interface Generator: Ontologies Proposedarchitecture Developedprototype Conclusions Acknowledgements

83. 61 Introduction Services offered through Internet should be accessible, ubiquitous and interoperable Not the current situation: most interfaces do not take into account users’ needs nor the interaction context Specific characteristics of the device to request service are also frequently ignored Negative impact on the accessibility, usability, ubiquity and interoperability of the service Adaptation is very helpful to overcome accessibility barriers, with user modelling based on relevant user (skills, preferences, interests, …) and context (task, objetive, …) features to optimize adaptation process Framework: INREDIS project

84. 62 Includes all the elements necessary to allow ubiquitous, wireless, seamless interaction Aims to provide universal accessibility, interoperability and ubiquity to allow people with disabilities controlling service machines, vending machines, home appliances, … Here we depict the architecture of the Interface Generator module used to produce adaptive interfaces Ontologies are used to perform modelling parameters INREDIS project

85. 63 Modelling User Technologicalcontext Includingdevicehandledbyuser, type of networksupportingcommunication, … Non-technologicalcontext Including place, activity, objectives, …

86. 64 Interface Generator - IG Aim: providing universal accesstoeveryone, regardlessuseddeviceoraccessedservice Ontologicalmodelchosen (automatedreasoning, dynamicclassification, consistencechecking, …) Different ontologies designed and others in conceptualizationphase Modular enoughtoencompassfuture ontologies

87. 65 Ontologies in the INREDIS Framework

88. 66 Designed ontologies (I) Userontology: tomodelusers’ skills and characteristics Allowsmodalities of informationusers can produce and receivetobeconsulted Createsuserstereotypes and mapseachusertoappropriatestereotypes Alsomodelssociodemographicfeatures Target ontology: tomodelcharacteristics of thepossible targets orservicesthat can beintegrated (ATMs, vending machines, …)

89. 67 Designed ontologies (II) Userdeviceontology: togatherallinformationaboutthedeviceusedtointeractwiththesystem Devicefeatures are classifiedinto hardware and software features Severalrelevantcharacteristics: platform, displaysize, mark-up languagessupported, peripheralsavailable

90. 68 Ontologies in conceptualizationphase Interface ontology: to guide process of deciding interface mark-up language and components Adaptationontology: tomodelthebestadaptationsforeachuserstereotype Assistivetechnologiesontology: tomodelthediverseassistivetechnologiesaccessiblethrough INREDIS framework

91. 69 Ontologies population When ontologies are readytheymustbepopulatedwithrelevant data Implicittechniques (data mining) and explicittechniques (filling in forms) willbeused Userprivacy has tobetakenintoaccount Alsoprivacyregulations

92. 70 Proposedarchitecture Diverse modules, eachwithspecificfunctionalitiestoperformspecifictasks Highly flexible toenableincorporation of new modules providing new functionalities in thefuture

93. Modules in thearchitecture (I) IG Manager Module: orchestrator thatmanagesthewholeprocess and thefunctionalities of the IG Controls and leads interactionsbetween IG sub-modules Constructor Module: responsibleforcreating a default interface in anabstractlanguage Resources Manager Module: analysesresourcesprovidedbythe target to determine whethertheseresources are compatible withtheuser and her/hisdevice 71

94. Modules in thearchitecture (II) Selector Module: to decide whichadaptationsmustbeperformedtoobtainanaccessible interface, style sheet that will be used to represent the content and final mark-up language that will be used to generate the interface Adapter Module: appliesadaptationsselectedby Selector Module tothe default interface supportedbyuser, her/hisdevice and ableto control target functionalities Data Injector Module: checkswhetherthereisan interface previouslygeneratedforthecurrentuserdevice and target. Itinjectsspecificvalues of thecomponentsintothe interface and theend of wholetheprocess 72

95. 73 Developedprototype Focused on generating an adaptive interface that can be accessed through the UCH technology It also adapts the content of the user interface to two different types of users according to their capabilities Usertype 1 has less visual capacitythanusertype 2 User’sdeviceis a PC and the target deviceto control is a TV set

96. 74 Conclusions Developedprototypeshowedthefunctionality and thevalidity of each module Italsodetectsinconsistencies and deficiencies of each module Currentlydeveloping a more complete version of the IG thatextentsitsfeaturestoallowadaptationtoallstereotypesprovidedbythe general ontology, regardlessdevice and target using UIML

97. 75 Acknowledgements This research is being developed under a research contract within the INREDIS project The involved work has received financial support from the Department of Education, Universities and Research of the Basque Government

98. Gracias por su atención

99. A Semantic Matching Process for Detecting and Reducing Accessibility Gaps in an Ambient Intelligence Scenario Rafael González-Cabero PT6 Madrid, 22 de junio de 2010 Liderado por:

100. A Semantic Matching Process for Detecting and Reducing Accessibility Gaps in an Ambient Intelligence Scenario Objective and Motivating Scenario

101. The INREDIS Knowledge Lifecycle A Semantic Matching Process for Detecting and Reducing Accessibility Gaps in an Ambient Intelligence Scenario

102. Considered Elements A Semantic Matching Process for Detecting and Reducing Accessibility Gaps in an Ambient Intelligence Scenario

103. A Semantic Matching Process for Detecting and Reducing Accessibility Gaps in an Ambient Intelligence Scenario Considered Discrepancies Medium Discrepancy Channel Discrepancy Capability Discrepancy Code Discrepancy

104. A Semantic Matching Process for Detecting and Reducing Accessibility Gaps in an Ambient Intelligence Scenario

105. Gracias por su atención

106. Securingthe Universal Control HubArchitecture F. Heras, R. Giménez, X. Trabado PT7+8 Madrid, 22 de junio de 2010 Liderado por:

107. Securingthe Universal Control HubArchitecture Presentación Póster presentado en la 3rd EuropeanConferenceonAmbientIntelligence, noviembre de 2009, Salzburg (Austria). Organizado por la Universidad de Salzburg y Philips

108. Securingthe Universal Control HubArchitecture Motivación Analizar las carencias de la arquitectura UCH respecto a sus aspectos de seguridad Proponer mejoras específicas para cada uno de los puntos detectados

109. Securingthe Universal Control HubArchitecture Principales carencias de seguridad Autenticación Comunicaciones seguras Encriptación de datos Integridad del sistema

110. Securingthe Universal Control HubArchitecture Estrategia de securización Optimización de los tres ámbitos básicos de la arquitectura de interoperabilidad: comunicaciones controlador arquitectura, componentes internos de la arquitectura y comunicaciones arquitectura objetivo

111. Securingthe Universal Control HubArchitecture Puntos de securización: comunicaciones controlador arquitectura Integración de servicios federados de identificación (OpenID) Seguridad a nivel de enlace gracias a la utilización de canales seguros para la comunicación Seguridad a nivel de aplicación gracias al despliegue de componentes complementarios para la encriptación de las comunicaciones

112. Securingthe Universal Control HubArchitecture Puntos de securización: componentes internos arquitectura Explotación de los objetos de sesión propios de UCH para las operaciones de seguridad Integración de time-outs para el control de la interacción entre componentes Implementación de los componentes internos necesarios para asegurar la integridad de los datos

113. Securingthe Universal Control HubArchitecture Puntos de securización: comunicaciones arquitectura objetivo Para dispositivos objetivo con capacidad de computación, integración de componentes de seguridad a nivel de aplicación Especificación de nuevos estándares de interoperabilidad segura Para dispositivos objetivo no móviles, utilización de canales cableados para las comunicaciones

114. Gracias por su atención