2. uBiquitous, secUre inTernetof-things with Location and
contEx-awaReness
FP7 call: FP7-ICT-2011-7
Integrated Project
October 2011 September 2014
15 M€
1234 man.months
2
3. High level objective
Design and demonstrate prototype of a
comprehensive, pervasive and effective ContextAware information system, which will operate
transparently and seamlessly across various
scenarios towards a unified Smart Life
environment.
3
4. Vertical IoT
SmartTransport
SmartHome
- Monitoring and
controlling
- Saving Energy
comfortably
- Interacting with
appliances
-…
SmartHealth
- Monitoring medicine
intake
- Personalized
diabetes assistance
- Providing training
tips
-…
SmartShopping
- Promoting
carpooling
- Minimizing taxi
delays
- Avoiding traffic
jams
-…
!
- Managing
sparkdeals
- Getting advice on
buying goods
- Retrieving
discount
-…
SmartCity
- Managing parking
space
- Lighting up a city
efficiently
- Monitoring Air
Quality
-…
4
15. Project organisation
WP6
Dissemination, Standardization, Education, Exploitation
Vertical and
horizontal usecases
Functional and
Non Functional
Requirements
analysis
WP1
Use case and
Requirements
WP2
Enabling
Technologies
Integration and
testing
WP4
Implementation
WP3
Architecture
Specification and
development
WP5
Field Trials
WP7
Project Management
15
17. From Vertical Use Cases to Requirements
70+ UseCases, 40+ Actors
Smart
Transport
SmartHealth SmartHome /
/ Wellness
Office
Horizontal
UCs
Horizontal
UCs
Horizontal
UCs
Smart
Shopping
SmartCity
Horizontal
UCs
Horizontal
UCs
Customers Interviews (60+)
Aggregated results from Verticals
External
Member
Group
Ethics & Privacy
Smart Live Concept:
Horizontal Story Line
Vertical
Field Trials
User Acceptance
BUTLER Requirements
Technologies
Architecture
Platform
Business
Models
17
19. Privacy and Security (1/2)
User shall be able to manage its distributed user profile.
•
•
•
•
Control of identity sharing over distributed applications.
Control of data duplication – when and where
Implementation of regulation
Controlling dynamic inference of user data - identity, current
behavior, system computed user profile.
Defining security and privacy requirements to be taken into
account as design level.
• Design and implementation of BUTLER privacy and security
framework.
• Framework integrates user dynamic data (location, behavior, …) in
security protocols
• Application shall integrate such framework
20. Privacy and Security (2/2)
1. Main objective: user controls/manages its profile
Application 1
Static and
Dynamic
Distributed
User Profile
2. Applications use/update
Application 2
21. Behavioural modelling and mining (1/3)
Recognize context-aware intent through external observation
•
•
•
•
Behavior
Decisions
Typical course of actions
Corresponding events and context
Extract meaningful information from distributed event streams
• Purposeful and meaningful abstractions for daily life activities
• Interactions between a few individuals and mass behavior
• Algorithms and software components for aggregation,
classification, learning, predicting and anticipating users’
behavior and activities
• Metrics to assess quality or trustworthiness of information
22. Behavioural modelling and mining (2/3)
events
events
1. Model
events
Actions
Profile &
Preferences
Context
Intentions
Behavior
3. Anticipate
Tasks
2. Observe and learn
23. Behavioural modelling and mining (3/3)
New event-based modeling abstractions
• Represent both individual and group behavior
• Explore feasibility of hybrid models combining statistical and
relational models, task trees, workflow and markov models,
dynamic bayesian networks, …
• Semantic modeling abstractions to describe domain knowledge in
relevant (patterns of) events
New processing and synthesis techniques
• Context-aware and semantic event pattern recognition
• Causality detection to anticipate human behavior
• Learning and data stream mining based on complex event
processing techniques (CEP)
24. Geo-Temporal Contextualization (1/2)
Aim to develop algorithms for the seamless acquisition of
geo-temporal information in heterogeneous networks, clearly
defined as following objectives.
Objectives
– Identification of the forms of geo-temporal context information
– Tracking and localize the context information securely
– Simultaneous localization and mapping through cooperative P2P links,
with new location-dependent security mechanisms
– Energy/time-efficient indoor localization within heterogeneous
networks
24
25. Geo-Temporal Contextualization (2/2)
Workflow
– Concrete algorithms be developed to enhance acquire geo-temporal
context with the help of objects, topology, etc…
– Development of corresponding algorithms on real platforms
Domain Specific Objectives
– Provide ambient information about metro platforms when the user
reaches the station entrance, for users located on station platforms.
– Schedule planner - plan the user departure according to user's
agenda, traffic conditions and parking availability.
25
26. Contextual networking
Aim is to develop algorithms to provide contextual information at a macroperspective, focusing on contextualized networking strategies, behavior
synthesis (crowd management, incentives) and “contextual games” model to
predict users’ behaviors.
Generic workflow
– Cooperate with the other tasks and create the use cases for the
applications and services;
– Create concrete algorithms to be utilized in such use cases;
– Algorithms brought forward to the implementation tasks;
– Results validations by using the prototypes generated in the
implementation tasks
Domain specific objectives
– Shopping environment related modelling of consumer groups
– To be able affect consumer behaviour via context based targeted
advertising and offers
– Other objectives: to be further studied
26
27. Scientific Dissemination Status
• Goal: 80 publications (DOW)
• M1-M12: Goal 12 publications
– Achievement:
• 17 Conferences
• 5 Journals
Jacobs Ericsson
Spain
Uni
6%CEA
TST 12%
12%
6%
OULU
6%
KU
ISMB
LEUVEN
12%
24%
Jacobs
OULU
Uni
10%
10%
iHOMELab
20%
Conf.Y1
UL iHOMELab
6%
18%
Jour.Y1
KU
LEUVEN
60%
• M12-M24: Goal 24 publications
– Achievement
• 19 Conferences
• 6 Journals
• M25-M36: Goal 24 publications
– Already Achieved (11/2013):
• 11 Conferences
• 2 Journals
Jacobs Inno
Uni 3%
13%
TST
5%
KU
LEUVEN
13%
OULU
10%
CEA
21%
Conf.Y2 OULU
3%
ISMB
UL
18%
18% iHOMELab
5%
Jacobs
Uni
50%
Jour.Y2
ISMB
20%
KU
LEUVEN
20%
• Current Status: 60 publications (13 joint publications)
• Several best paper awards and prizes
27
29. System/Device Management
BUTLER Architecture - overview
Services
actions on
actuators
precise location
information
predicted behavior
rich context
information
user data
Data/Context Management
location related data
actions
raw context data
sensor data
user data
Communications
29
30. BUTLER Horizontal Architecture
BUTLER APPLICATIONS
SYSTEM/DEVICE MANAGEMENT
SERVICES
DATA EXPOSITION SERVICES
SYSTEM MANAGEMENT
SmartObject
Management
Portal
Deployment
Service
Monitoring
Software
Update
Resource
Exposition
Context
Exposition
Multimedia
Service
User Profile
Exposition
Localization
Exposition
DATA AND SERVICE DIRECTORY
BUILT-IN CONTEXT-AWARE SERVICES & APPLICATIONS
Application
Repository
Behavior
Exposition
Energy
Service
Service
Registration
Service
Composition
Service
(Re-binding)
Service
Discovery
Data
Discovery
DATA/CONTEXT MANAGEMENT
USER PORTAL
Data Management &
Marketplace Portal
User Profile
Manager
Generic Notification
/ Actuation
Mechanism
Localization
Manager
User Behavior
Capture
Context/Behavior
Information
Provider
Context
Management Portal
Resource Access
Persistent
Storage
Simple Event
Processing
Complex Event
Processing
Device Data
Collector / Actuator
COMMUNICATIONS
Network
Monitoring
Device
Monitoring
Device
Directory
Device
Discovery
Device
Authentication
Authorization
Server
IoT Protocol Adapters
User Device
Directory
User Connectivity Manager
HTML5
CoAP
Zigbee
KNX
NFC
Bluetooth
User
Authentication
…
3GPP
…
Internet
Wifi
Server
Directory
Server
Authentication
Server Connectivity Manager
Internet
Ethernet
30
31. BUTLER platforms interactions
SmartServer Platform
Integration protocols
(RESTfull, streaming, etc.)
SmartObject Platform
App
App
SmartServer
App
Different comm.
protocols
IoT Sensors and
Actuators
SmartObjects
(IoT)
App
SmartObject (GW)
SmartServer
cloud
SmartServer
Internet
Mob
App
SmartMobile
Platform
local
Local
wireless
Mob
App
App
Request
App
Notification API
3rd party
Applications
SmartMobile Middleware
Phone Sensors
Platform Functional Components (WP3)
BUTLER APIs
Mobile OS APIs
31
32. SmartObject/Gateway Platform
Smart Gateway
The SmartObject Gateway allows interconnection of different networks to achieve
access and communication among embedded devices, servers and mobile
terminals
32
42. Smart City - Parking (TST)
SmartServer
SmartObject
Accounting
&
Billing
Communication
Interfaces
Parking App
Context
Manager
Communication
Interfaces
Vehicle Detection
Lighting System
Sensor
SmartMobile
Communication
Interfaces
GUI
Parking App
• Integration to the BUTLER Platform
• Export TST devices as BUTLER smart objects
• Smart Parking applications make use of BUTLER smart
services (security, user profile management, localisation)
400+ device deployed
4000+ potential users
42
43. Smart City - Shopping (TST, Banco
Santander, Santander city)
•
Integration to the
BUTLER Platform
• Export Santander
infrastructure devices as
BUTLER smart objects
Smart Shopping
Commerce Campaign
Users - Customers
• Smart Shopping
application makes use of
BUTLER smart services
(security, contextawareness, user profile
management, localisation
)
Context-Information
400+ device deployed
4000+ potential users
43
44. Smart Office (TIL, Inno, IHL)
Push Data
T° Sensor
Smart Servers
Smart
Gateway
50+ users
Display Information
Push
Information
Smart Mobile
Smart Mobile
Smart Plug
Users
Office
Coffee
Machine /
Social
Place
• Integration to the BUTLER Platform
• Export Office devices as BUTLER smart objects
• Smart Office application makes use of BUTLER smart services
(security, context-awareness, localisation)
44