The presentation titled, "The role of semantic web technologies in smart environments" was presented by Faisal Razzak on 15/03/2013 (14:10) at DAUIN, Politecnico di Torino, Italy. The presentation provides an overview of the PhD Thesis and explores the potential role of semantic web technologies in smart/Intelligent environments. It ponders on two main contributions, i.e., User Intelligible goals and Semantic Data Exchange. Briefly talks about Domotic Effects framework (Modelling, Evaluation, Enforcement and Optimization) and Effects Ontology. It also talks about the concept of Linked Open Dynamic Data and Publisher Ontology.
The Role of Semantic Web Technologies in Smart Environments
1. Politecnico di Torino
Dip. Automatica e Informatica
Final PhD Presentation @ DAUIN Torino, Italy
The Role of Semantic Web Technologies
in Smart Environments
Faisal Razzak
2. My PhD work
User Intelligible Goals
• Domotic Effects
• Modeling
• Evaluation
• Enforcement
• Optimization in Energy Management domain
Semantic Data Exchange
• Linked Open Dynamic Data -- LO(D)D
• Semantic Energy Information Publishing Framework (SEIPF)
Other Works – Internet of Things
• Spamming the Internet of Things (IoT)
• Web of Domotics (WoD)
• Eye Tracking Systems (Cogain Project)
2 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
4. Motivation
Users pour their personalities in order to use and
transform their personal environments (2006).
Resulted in “Programmable smart/ personal
environments”.
Davidoff, Scott, Min Lee, Charles Yiu, John Zimmerman, and Anind Dey. "Principles of smart home
control." UbiComp 2006: Ubiquitous Computing (2006): 19-34
4 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
5. Motivation
IST Advisory group published a draft titled „Ambient
Intelligence: From vision to reality‟. In order to build
intelligence, we need to innovate abstract concepts and
models to address human centric expressions of
personal style. (2003)
A series of workshops and interviews, concluded that
designers work top-down and like to start from abstract
descriptions. (2008)
The need for abstract models to address human centric
expressions
1) Ducatel, K., M. Bogdanowicz, F. Scapolo, J. Leijten, and J. C. Burgelman. "Ambient
intelligence: From vision to reality." IST Advisory Group Draft Rep., Eur. Comm(2003).
2) van Doorn, Mark, Arjen de Vries, and Emile Aarts. "End-User Software Engineering of
Smart Retail Environments: The Intelligent Shop Window." Ambient Intelligence(2008):
157-174.
5 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
6. The Issues
The issue of Device centric vision?
The question of Enforcement?
The question of Evaluation (monitoring)?
Can there be a unified model?
6 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
7. Domotic Effects Framework
Domotic Effects model Human
intelligible state and goal.
• It provides AMI designers with
an abstraction layer that
enables defining generic goals
inside the environment, in a
declarative way.
• The high-level nature allows
the residents to program their
personal, office or work spaces
as they see fit.
• Simple Effect (SE) and
DogEffects Ontology Complex Effect (CE)
7 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
12. How to put it simply?
Enforcement ? Evaluation
Users’ Goals Devices
Users
12 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
13. More Details
Mathematical Enforcement Evaluation
Formulation Architecture Architecture
Results
13 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
14. Enforcement
16 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
15. Evaluation – Zero Delay Simulation
17 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
16. Is it Applicable? -- Evaluation
Evaluation
In one experiment, results showed that for an iteration the
presence of 1500 CEs with the maximum level of 177 can
be evaluated in 118 ms (averaged over 150 times).
In another experiment results showed that for a single
device change, the presence of 1400 CEs with the
maximum level of 272 can be evaluated in 258 ms.
The goal was in less than 1 or 2 seconds.
18 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
17. Is it Applicable? -- Enforcement
Six use cases
Secure Home
Home Illumination
Morning Wakeup
Isolated Kitchen
Room Illumination
Air Passage across Home
All possible combination of use cases, i.e., 64
In summary, the implemented enforcement module was able to
resolve to devices in less than 100 ms.
The goal was in less than 1 or 2 seconds.
19 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
18. An enforcement with minimal power
consumption
Formulation
Results
Compared against
Enumeration approach.
For 90% of iterations the
result of power
consumption was better
or at least equal (in case
of minimal).
The heuristic solution
time was between 1 to
2 seconds for all cases.
Even for cases with
more than 100,000
(enumerated)
20
solutions.
Presentation @DAUIN, Razzak
Politecnico di Torino, Italy
19. User Intelligible goals – Domotic Effects
(Papers)
Published (ISI-Journal)
Fulvio Corno and Faisal Razzak. "Intelligent Energy Optimization for User
Intelligible Goals in Smart Home Environments." IEEE Transactions on Smart
Grid (2012): Vol. 3 Issue: 4, pp. 2128-2135, ISSN - 1949-3053
Submitted (ISI-Journal)
Fulvio Corno and Faisal Razzak: SAT Based enforcement of Domotic Effects in
Smart Environments
Fulvio Corno and Faisal Razzak: Monitoring of Smart Environments using
Domotic Effects
Currently Writing
Dario Bonino, Fulvio Corno and Faisal Razzak: Modeling Intelligible Effects in
Smart Homes
22 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
20. An Alternate View
Semantic web technologies provide both strong
structural representation and semantics.
AGAINST
Semantic web technologies provide only strong
structural representation.
Semantics comes from context (User and current
settings).
24 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
22. Context
Smart Sensing and Measuring Environments
Smart Homes Sensor and
Smart Factories
Smart Grid Actuator Networks
Environment monitoring
Social mobile applications
Smart Appliances
Affordable and efficient sensors
26 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
23. Context
Smart Sensing and Measuring Environments
Smart Appliances
acceleration
acceleration compass
compass GPS
air pressure proximity
temperature microphone
energy light camera
(active, reactive, rev
BT Scan
erse, kVAr, ...)
Affordable and efficient sensors
27 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
24. Context
Smart Sensing and Measuring Environments
Smart Appliances
Affordable and efficient sensors
Motion
RFID
Smoke Pressure
Gyroscope
Proximity 2D codes
28 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
25. Motivation
Applications need to access
information from multiple
Application Application environments
Standard way to publish
and consume information
Environ Environ Environ About accessible
ment ment ment environments
About available
Applian Applian Applian
applicances, sensors and
ces ces ces their characteristics
About the actual data
measured by sensors
sensors sensors sensors
29 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
26. Other Approaches
Handling Temporal Data (Time Ontology)
RDF Streaming Engines (C-SPARQL,
SPARQLStream, EP-SPARQL)
1. http://www.w3.org/TR/owl-time/
2. D. Anicic, P. Fodor, S. Rudolph, N. Stojanovic, EP-SPARQL: a unified language for event processing and stream
reasoning, in: Proceedings of the 20th international conference on World wide web, ACM, 2011, pp. 635–644.
3. D. Barbieri, D. Braga, S. Ceri, E. Della Valle, M. Grossniklaus, C-SPARQL: SPARQL for continuous querying, in:
Proceedings of the 18th international conference on World wide web, ACM, 2009, pp. 1061–1062.
4. S. Groppe, J. Groppe, D. Kukulenz, V. Linnemann, A SPARQL engine for streaming RDF data, in: Signal-Image
Technologies and Internet-Based System, 2007. Third International IEEE Conference on, IEEE, 2007, pp. 167–
174.
5. D. Le-Phuoc, M. Dao-Tran, J. Xavier Parreira, M. Hauswirth, A native and adaptive approach for unified
processing of linked streams and linked data, The Semantic Web–ISWC 2011 (2011) 370–388.
30 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
27. Approach
Applications need to access
Adopt Semantic Web information from multiple
«Linked Open Data environments
(LOD)» approach Standard way to publish
and consume information
Static information: About accessible
Can be encoded in RDF environments
according to a public
About available
Ontology
applicances, sensors and
their characteristics
Dynamic information: About the actual data
New approach to measured by sensors
represent streams of RDF
events
31 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
28. 32 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
29. Producer Consumer
Application Application
Publisher Publishes Views & Subscribe
Compone r
nt Compone
PID
nt
Document Subscribe
s to
E Channels
E
E E
Smart Environment
E E Channel 1 E E
E E Channel2 E E
Transport Mechanism (3rd party Cloud based Service)
33 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
30. General LO(D)D Architecture
Smart Static
Environment information
Producer publishes
Application about
E sensor
streams
G monitors
F
34 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
31. General LO(D)D Architecture
Smart Static
Environment information
Producer publishes
E Application about
E F sensor
G streams
E
G monitors describes
F
E Sensor
G E
data
F channel
G Sensor
updates F
data
channel
G
Sensor
data
channel
35 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
32. General LO(D)D Architecture
Smart Static subscribes
Environment information
Producer publishes
E Application about Consumer
E F sensor E Application
G streams
E
G monitors describes
F Consumer
E
E
E Sensor Application
G E E
data
F channel
G Sensor G
Consumer
updates F Application
data F
channel receives
G G
Sensor
data
channel
36 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
33. Proposed solutions
Producer Open source libraries and API to enable
Application
Consumer application to interact with LO(D)D data
Application
RDF document with meta-data (PID)
Static Publisher information
information
List of channels, their source data, their
about
sensor datatypes, and subscription URI/key
streams RDF «fragments» representing each event
E Contains: event#, sensor id, timestamp,
F
G value, unit of measure
E
Uses publish-subscribe pattern as transport
mechanism for distributing RDF fragments
Sensor
data
channel
37 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
34. Publisher Information Document (PID)
According to lightweight «Publisher» ontology
Contains declarations of all channels handled by this publisher
– all needed static information
Gives information to subscribe to channels
Created by <RDF:Description RDF:about="&Publisher;energymtr">
publisher API <publisher:Location RDF:datatype="&xsd;string">
Torino, Italia</publisher:Location>
Published
over http <publisher:subscribekey>sub-xxxxxx-
42904d46dEEEEE
</publisher:subscribekey>
<publisher:channelName>Energy Meters
</publisher:channelName>
<RDF:type RDF:resource="&Publisher;Channel"/>
</RDF:Description>
38 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
35. Event data fragments
Individual data points encoded in RDF
Self-consistent information (e.g. Unit of measure)
Standard syntax and semantics
Application-independent representation
Compact
<rdf:Description RDF:about = "&publisher;emergymtrChan1">
encodings <publisher:MeterNumber RDF:datatype="&xsd;int">
231 </publisher:MeterNumber>
available
<publisher:Unit RDF:datatype="&xsd;string" >
http://purl.oclc.org/NET/muo/ucum/unit/power-level/
bel-kilowatt</publisher:Unit>
<publisher:hasTimeStamp RDF:datatype="&xsd;dateTime">
2012-02-02T13:06:41.056Z </publisher:hasTimeStamp>
<publisher:hasCurrentValue RDF:datatype ="&xsd;double">
0.3 </publisher:hasCurrentValue>
</RDF:Description>
39 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
36. Cloud based Transport mechanism
Provides the updates to subscribers whenever
publishers update data
New RDF fragments are sent to the cloud service
Maintains list of subscribers
Handles logic to provide transport from Publisher to
many Subscriber in real time
It makes the Publisher a “light-weight component”
Publisher is independent from the number of connected
subscribers
...and others
pubsubhubbub
40 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
37. Experiment
Building Infrastructure
Politecnico di Torino
poliEnergy
PID
Publishes C
P
P
• 126 Electrical
Meters. poliEnergy
• Take reading Aggregator
PID
every 15
minutes
• Aggregates
reading into 3
ranges.
• Publishes using 3
C channels
42 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy
38. Other Works
Spamming the Internet of Things
Faisal Razzak "Spamming the Internet of Things: A Possibility and its
probable Solution." Procedia Computer Science 10 (2012): 658-665.
MobiWIS 2012 in Canada.
Semantic Web Technologies‟ role in Smart Environments
Faisal Razzak. "Semantic Web Technologies’ role in Smart Environments."
P. Herrero et al. (Eds.): OTM 2012 Workshops, LNCS 7567, pp. 54–58,
2012.
OTM Workshops 2012 (Rome)
Semantic Energy Information Publishing Framework
1. Dario Bonino, Fulvio Corno, and Faisal Razzak. "Enabling machine
understandable exchange of energy consumption information in intelligent
domotic environments." Energy and Buildings 43, no. 6 (2011): 1392-
1402.
Web of Domotics
1. Faisal Razzak, Dario Bonino, and Fulvio Corno. "Mobile interaction with smart
environments through linked data." In Systems Man and Cybernetics
43 Presentation @DAUIN, Politecnico di Razzak
(SMC), 2010 IEEE International Conference on, IEEE, pp. 2922-2929.
Torino, Italy
39. Publications
International Journals
1. Fulvio Corno and Faisal Razzak. "Intelligent Energy Optimization for User Intelligible Goals in Smart
Home Environments." IEEE Transactions on Smart Grid (2012): Vol. 3 Issue: 4, pp. 2128-2135,
ISSN - 1949-3053
2. Dario Bonino, Fulvio Corno, and Faisal Razzak. "Enabling machine understandable exchange of
energy consumption information in intelligent domotic environments." Energy and Buildings 43, no.
6 (2011): 1392-1402.
Proceedings
1. Fulvio Corno and Faisal Razzak. "Publishing LO (D) D: Linked Open (Dynamic) Data for Smart Sensing
and Measuring Environments." Procedia Computer Science 10 (2012): 381-388.
2. Faisal Razzak "Spamming the Internet of Things: A Possibility and its probable Solution." Procedia
Computer Science 10 (2012): 658-665.
3. Faisal Razzak. "Semantic Web Technologies’ role in Smart Environments." P. Herrero et al. (Eds.): OTM
2012 Workshops, LNCS 7567, pp. 54–58, 2012.
4. Faisal Razzak, Dario Bonino, and Fulvio Corno. "Mobile interaction with smart environments through
linked data." In Systems Man and Cybernetics (SMC), 2010 IEEE International Conference on,
IEEE, pp. 2922-2929. 2010.
44 5. Emiliano Castellina, Faisal Razzak, and Fulvio Corno. "Environmental di
Presentation @DAUIN, Politecnico Control Application Compliant Razzak
Torino, Italy
with COGAIN Guidelines." COGAIN2009 Proceedings (2009): 31.
40. Acknowledgement
My work in PhD (till now) would not have been possible
without the knowledge and guidance of following people:
Prof. Fulvio Corno
Dr. Emiliano Castellina (now with Reply)
Dr. Dario Bonino
Muhammad Sanaullah
And all the teachers who taught PhD courses.
45 Razzak
41. Thank you all & Any Questions?
Reference
s
Faisal Razzak (raja.faisal@gmail.com)
Skype: faisal.razzak27
Presentations: http://www.slideshare.net/konware
Profile: http://polito.academia.edu/FaisalRazzak
LinkedIn: http://it.linkedin.com/pub/faisal-razzak/50/511/421/