SlideShare une entreprise Scribd logo
1  sur  21
Télécharger pour lire hors ligne
Metadata Management for the
 Web of Things: a Practical
        Perspective


Carolina Fortuna, Alexandra Moraru, Patricia
 Oniga, Zoltan Padrah and Mihael Mohorcic
            http://sensorlab.ijs.si/
             http://sensors.ijs.si/


     Web of Things Workshop, June 19, 2012.
Outline

• Motivation
• Physical data sources
• Architecture alternatives
  • Embedded approach
  • Middleware approach
• The metadata storage
• The metadata representation
• The metadata access
• Conclusions
Motivation
We identified two types of meta-data that can be useful in
processing sensor measurements:

• Technical specifications of the sensor platforms
   • types of sensors, units of measurement for the observed
     phenomenon, range of sensors, performance in term of accuracy,
     stability of measurements, etc.


• Contextual specifications of the sensor platforms
  • environment where the platform is deployed (i.e. indoor or outdoor),
    placement conditions (i.e. outdoor under shelter, under water,
    exposed to turbulences), time of deployment, etc.
Motivation
• How do we know what a sensor measures?
• Typical platforms use abbreviations which are hard to
 recognize automatically:

 “tmp”,                     "location":
 “temp”,                    {       "disposition":"fixed",
 “temperature”,                     "ele":"23.0",
 “t”                                "name":"office",
                                    "lat":51.5235375648154,
                                    "exposure":"indoor",
                                    "lon":-0.0807666778564453,
                                    "domain":"physical"
                            }
Motivation
• Sometimes additional context is required


 What does the “temperature” sensor measure?
     – Air, water or some other temperature?
     – Indoor , outdoor, in a container?



    Consistent terminology is required for
               interoperability.
Physical data sources

• Using standard terminology
  • Open Geospatial Consortium’s Sensor Web Enablement standards
  • NOAA and other datasets published and annotated using these
    standards


• Non-standard based data sources
  • Existing and emerging middleware solutions such as GSN, Cosm,
    etc.
Standard based data sources
• Sensors push their
 observation results
 • to a database (which will be
   accessed by the SOS service)
 • or directly to the SOS service
   (Transactional-SOS in this case).

• Sensors are registered, using SensorML,
  at the catalog service (CAT).
• The user queries the catalog service
  • it responds with a list of SOS service instances
   that fulfill the requirements.
• The user binds the SOS and retrieves
 the observation data, encoded in O&M
 and SensorML.
W3C SSN
• W3C Semantic Sensor Network Ontology
  • Vocabulary that permits higher expressiveness
  • Compatible with SensorML
• Structured vocabularies have high overhead
  • Inconvenient for constrained devices
Architecture alternatives

We looked at two implementation options that would allow
using semantic representation for sensor meta-data:
 • Embedded approach
 • Middleware approach
We compared them with respect to three aspects:
 • Storage
 • Representation
 • Access
Embedded vs. Midleware based
  Architecture
Embedded approach
 • assign an IP address to every device
 • Sensors (things) are accessed directly from
  the web without any intermediates


Middleware approach
 • involves using a gateway solution
 • interface with the applications
 • interface with a network of things
 • applications communicate with a
   middleware that intermediates to the things
 • the middleware is responsible to collect
   metadata from the things and respond to
   clients’ requests.
Sensor Metadata Storage
        Embedded                             Middleware
•   metadata has been added      Relational Database
    to the embedded software       •   database schema reflects
    (firmware) of the devices          hardware configuration
•   facilitates the automatic
    gathering of information
                                 Knowledge base (triple stores)
    about the sensors              •   Uses exiting ontologies for data
•   stored in the flash memory         model
    of the devices

           Metadata header
               Module 1
               Module 2
                  …
              Module N
            Metadata footer
Sensor Metadata Storage
Embedded                                   Middleware
• JSON-LD in our implementation            • we implemented it as
• The message occupies 15KB out
                                             relational database and as
  of the 512KB of flash memory
                                             triple store
  (~3%).                                   • if additional metadata is
• For comparison
                                             needed at a later time
  • the CoAP application code takes
                                              – the extension or even
    about 25 KB and the full system             redesign of the database
    image                                     – in the triple based
  • the operating system with networking        representation predicate
    stack and application takes 216KB           and object types need to
    without optimization and roughly            be specified later in an
    150KB with compiler optimizations.          ontology
• Therefore the metadata uses 10%
 of the entire system image
Sensor Metadata Representation
   Structured representation of metadata following
   standardized format
      • Solutions typically use a publicly shared schema, vocabulary or
        ontology
           •   SensorML, ZigBee SmartEnergy, RDF (plus domain ontology – e.g. SSN)

      • most of them follow XML syntax
           •   Encoding techniques are needed for efficient storage and transmission from the embedded devices
           •   Efficient XML Interchange (EXI), Binary XML (BXML), Binary JSON (BSON)


        Embedded                                               Middleware
Structured representation                            Structured or custom
of metadata                                          representation
  •   disadvantage of occupying                            •     Structured -> fast integration with
      a notable proportion of the                                different storage systems
      device’s memory resources,                           •     Custom -> good when there are
  •   it is required for integration                             memory and energy constraints;
      purposes                                                   required specialized parsers and
                                                                 wrappers
Sensor Metadata Representation
                                   p01=403AB8F9&p02=VSCv1.2.1&p03=temperature
• Implementations                  &p04=degC&p05=pressure&p06=mbar
                                 (a)
   • Custom representation (a)     "@context":{
   • JSON-LD representation        "base":" http://hostname/semsense/resource/",
                                   "uri": "@subject",
     (b)                           "isa" : "@type",
                                   "sensorNode"                                        :
                                 "http://purl.oclc.org/NET/ssnx/ssn#System",
                                   "modules"                                           :
• A sensor node that has         "http://purl.oclc.org/NET/ssnx/ssn#hasSubSystem",
                                   ...}
  two types of sensors             "uri":"base:403AB8FC",
  attached to it, measuring             "isa": "sensorNode",
                                        "modules" : [ {
  temperature and pressure                 "uri":"base:403AB8FC/s1",
                                           "isa": "sensor",
  in degree Celsius and                    "observedProperty" : {
  millibars respectively                           "uri" : "temperature",
                                                   "uom" : "degC",
                                                   }
                                            },
                                                {
                                           "uri":"base:403AB8FC/s2",
                                           "isa": "sensor",
                                           "observedProperty" : {
                                                   "uri" : "pressure",
                                                   "uom" : "mbar",
                                                   }
                                            }]                                   (b)
Sensor Metadata Representation
Semantic Vocabulary
   •   SSN ontology
   •   Other Vocabularies/Ontologies: Basic GeoWGS84, GeoNames,
       Measurement Units Ontology
   •   Subset of concepts and relationships from SSN
Sensor Metadata Representation
Embedded                            Middleware
                                    • the transformation of
• a structured                        metadata can be
  representation                      straightforward if properly
  • disadvantage of occupying a
                                      represented in a structured
                                      manner
    notable proportion of the
                                    • permits users to send
    device’s memory
                                      SPARQL queries and
  • it supports immediate             receive the corresponding
    integration into WoT              answer,
  • for comparison, the custom         – this is currently not
    format equivalent to the full        supported in the
                                         embedded approach (but
    15KB JSON-LD message                 some efforts in the this
    takes only 1KB                       direction are underway)
Sensor Metadata Access
         Embedded                              Middleware
• a RESTful API to the resource         • SPARQL end-points of the
  containing metadata which               triple stores
  returns a structured JSON-LD              • Relational Database combined
  message                                   with D2R server
     • The application which                • Triple store -> Sesame
     generated the call can parse the
     message using a JSON-LD
     processor
     •metadata access on the node
     is done through the resource
     and not by querying the sensor
     node URI
Sensor Metadata Access

                               uIPv6/6LowPAN/CoAP




VESNA Sensor Node running Contiki 2.5 OS


ARM Cortex-M3
clock up to 72 MHz,
1 MHz 12-bit ADC,
1 MB flash, 96 kB SRAM,
128 kB non-volatile MRAM,
SD or micro SD card slot
USB 2.0 and RS-232 interface
Sensor Metadata Access

Embedded
• Constrained communications links
  • High packet loss rate (5-10%)
  • low datarate (10s kb/s)
• lack of or slow response from the thing
• inconvenient for the web application developer
• Retrieval of the JSON-LD message containing the metadata of
 the device took 12 seconds
  • approximately 15 KB in over 200 chunks
  • 100 kb/s link
• another inconvenience related to constrained devices is the
 inability to process multiple requests at the same time.
Conclusions
•   Both the embedded and the middleware solutions can
    be prototyped

•   The current state of the art in sensor devices limits the
    amount of stored data
          •XML like syntax is not well suited for storing.
          •constraints are imposed by the communication links.

•   The middleware approach is more convenient from the
    perspective of web application developer
      •    technological developments empowering the embedded approach
           may be catching up soon.
21




          Lab: http://sensorlab.ijs.si/
WoT Mash-up: http://sensors.ijs.si/
      Tutorial: http://carolinafortuna.com/web-of-things-tutorial/
      Contact: carolina.fortuna@ijs.si

Contenu connexe

En vedette

Fortuna 2012 physical_mashup_artificial_intelligence
Fortuna 2012 physical_mashup_artificial_intelligenceFortuna 2012 physical_mashup_artificial_intelligence
Fortuna 2012 physical_mashup_artificial_intelligencecarolninap
 
A Computational Space for the Web of Things
A Computational Space for the Web of ThingsA Computational Space for the Web of Things
A Computational Space for the Web of ThingsSimon Mayer
 
Trendy service discovery protocol at WoT 2012
Trendy service discovery protocol at WoT 2012Trendy service discovery protocol at WoT 2012
Trendy service discovery protocol at WoT 2012Talal Butt
 
Towards a Project Centric Metadata Model and Lifecycle for Ontology Mapping G...
Towards a Project Centric Metadata Model and Lifecycle for Ontology Mapping G...Towards a Project Centric Metadata Model and Lifecycle for Ontology Mapping G...
Towards a Project Centric Metadata Model and Lifecycle for Ontology Mapping G...Christophe Debruyne
 

En vedette (6)

Fortuna 2012 physical_mashup_artificial_intelligence
Fortuna 2012 physical_mashup_artificial_intelligenceFortuna 2012 physical_mashup_artificial_intelligence
Fortuna 2012 physical_mashup_artificial_intelligence
 
RESTful Triple Spaces of Things
RESTful Triple Spaces of ThingsRESTful Triple Spaces of Things
RESTful Triple Spaces of Things
 
A Computational Space for the Web of Things
A Computational Space for the Web of ThingsA Computational Space for the Web of Things
A Computational Space for the Web of Things
 
What is Linked Data?
What is Linked Data?What is Linked Data?
What is Linked Data?
 
Trendy service discovery protocol at WoT 2012
Trendy service discovery protocol at WoT 2012Trendy service discovery protocol at WoT 2012
Trendy service discovery protocol at WoT 2012
 
Towards a Project Centric Metadata Model and Lifecycle for Ontology Mapping G...
Towards a Project Centric Metadata Model and Lifecycle for Ontology Mapping G...Towards a Project Centric Metadata Model and Lifecycle for Ontology Mapping G...
Towards a Project Centric Metadata Model and Lifecycle for Ontology Mapping G...
 

Similaire à Fortuna 2012 metadata_management_web_of_things

Nosql query processing system for wireless sensor networks
Nosql query processing system for wireless sensor networksNosql query processing system for wireless sensor networks
Nosql query processing system for wireless sensor networksNikhil Bhaware
 
Data repositories -- Xiamen University 2012 06-08
Data repositories -- Xiamen University 2012 06-08Data repositories -- Xiamen University 2012 06-08
Data repositories -- Xiamen University 2012 06-08Jian Qin
 
Introduction to Galaxy and RNA-Seq
Introduction to Galaxy and RNA-SeqIntroduction to Galaxy and RNA-Seq
Introduction to Galaxy and RNA-SeqEnis Afgan
 
ElasticSearch as (only) datastore
ElasticSearch as (only) datastoreElasticSearch as (only) datastore
ElasticSearch as (only) datastoreTomas Sirny
 
Web of Things to the edge
Web of Things to the edgeWeb of Things to the edge
Web of Things to the edgeMichael Koster
 
Public private hybrid - cmdb challenge
Public private hybrid - cmdb challengePublic private hybrid - cmdb challenge
Public private hybrid - cmdb challengeryszardsshare
 
Opentracing jaeger
Opentracing jaegerOpentracing jaeger
Opentracing jaegerOracle Korea
 
Distributed Tracing with Jaeger
Distributed Tracing with JaegerDistributed Tracing with Jaeger
Distributed Tracing with JaegerInho Kang
 
Jirka - Integrating the ogc sensor web enablement framework into the ogc cata...
Jirka - Integrating the ogc sensor web enablement framework into the ogc cata...Jirka - Integrating the ogc sensor web enablement framework into the ogc cata...
Jirka - Integrating the ogc sensor web enablement framework into the ogc cata...Arne Bröring
 
Apache Cassandra training. Overview and Basics
Apache Cassandra training. Overview and BasicsApache Cassandra training. Overview and Basics
Apache Cassandra training. Overview and BasicsOleg Magazov
 
WOTS2E: A Search Engine for a Semantic Web of Things
WOTS2E: A Search Engine for a Semantic Web of ThingsWOTS2E: A Search Engine for a Semantic Web of Things
WOTS2E: A Search Engine for a Semantic Web of ThingsAndreas Kamilaris
 
Data Lake and the rise of the microservices
Data Lake and the rise of the microservicesData Lake and the rise of the microservices
Data Lake and the rise of the microservicesBigstep
 
How to create innovative architecture using VisualSim?
How to create innovative architecture using VisualSim?How to create innovative architecture using VisualSim?
How to create innovative architecture using VisualSim?Deepak Shankar
 
How to create innovative architecture using VisualSim?
How to create innovative architecture using VisualSim?How to create innovative architecture using VisualSim?
How to create innovative architecture using VisualSim?Deepak Shankar
 
How to create innovative architecture using ViualSim?
How to create innovative architecture using ViualSim?How to create innovative architecture using ViualSim?
How to create innovative architecture using ViualSim?Deepak Shankar
 
ME4AWSN - a Modeling Environment for Architecting WSNs
ME4AWSN - a Modeling Environment for Architecting WSNsME4AWSN - a Modeling Environment for Architecting WSNs
ME4AWSN - a Modeling Environment for Architecting WSNsIvano Malavolta
 
HPC and cloud distributed computing, as a journey
HPC and cloud distributed computing, as a journeyHPC and cloud distributed computing, as a journey
HPC and cloud distributed computing, as a journeyPeter Clapham
 
Challenges and Opportunities of Big Data Genomics
Challenges and Opportunities of Big Data GenomicsChallenges and Opportunities of Big Data Genomics
Challenges and Opportunities of Big Data GenomicsYasin Memari
 
A General Purpose Extensible Scanning Query Architecture for Ad Hoc Analytics
A General Purpose Extensible Scanning Query Architecture for Ad Hoc AnalyticsA General Purpose Extensible Scanning Query Architecture for Ad Hoc Analytics
A General Purpose Extensible Scanning Query Architecture for Ad Hoc AnalyticsFlurry, Inc.
 
Cedar Overview
Cedar OverviewCedar Overview
Cedar Overviewjbgraybeal
 

Similaire à Fortuna 2012 metadata_management_web_of_things (20)

Nosql query processing system for wireless sensor networks
Nosql query processing system for wireless sensor networksNosql query processing system for wireless sensor networks
Nosql query processing system for wireless sensor networks
 
Data repositories -- Xiamen University 2012 06-08
Data repositories -- Xiamen University 2012 06-08Data repositories -- Xiamen University 2012 06-08
Data repositories -- Xiamen University 2012 06-08
 
Introduction to Galaxy and RNA-Seq
Introduction to Galaxy and RNA-SeqIntroduction to Galaxy and RNA-Seq
Introduction to Galaxy and RNA-Seq
 
ElasticSearch as (only) datastore
ElasticSearch as (only) datastoreElasticSearch as (only) datastore
ElasticSearch as (only) datastore
 
Web of Things to the edge
Web of Things to the edgeWeb of Things to the edge
Web of Things to the edge
 
Public private hybrid - cmdb challenge
Public private hybrid - cmdb challengePublic private hybrid - cmdb challenge
Public private hybrid - cmdb challenge
 
Opentracing jaeger
Opentracing jaegerOpentracing jaeger
Opentracing jaeger
 
Distributed Tracing with Jaeger
Distributed Tracing with JaegerDistributed Tracing with Jaeger
Distributed Tracing with Jaeger
 
Jirka - Integrating the ogc sensor web enablement framework into the ogc cata...
Jirka - Integrating the ogc sensor web enablement framework into the ogc cata...Jirka - Integrating the ogc sensor web enablement framework into the ogc cata...
Jirka - Integrating the ogc sensor web enablement framework into the ogc cata...
 
Apache Cassandra training. Overview and Basics
Apache Cassandra training. Overview and BasicsApache Cassandra training. Overview and Basics
Apache Cassandra training. Overview and Basics
 
WOTS2E: A Search Engine for a Semantic Web of Things
WOTS2E: A Search Engine for a Semantic Web of ThingsWOTS2E: A Search Engine for a Semantic Web of Things
WOTS2E: A Search Engine for a Semantic Web of Things
 
Data Lake and the rise of the microservices
Data Lake and the rise of the microservicesData Lake and the rise of the microservices
Data Lake and the rise of the microservices
 
How to create innovative architecture using VisualSim?
How to create innovative architecture using VisualSim?How to create innovative architecture using VisualSim?
How to create innovative architecture using VisualSim?
 
How to create innovative architecture using VisualSim?
How to create innovative architecture using VisualSim?How to create innovative architecture using VisualSim?
How to create innovative architecture using VisualSim?
 
How to create innovative architecture using ViualSim?
How to create innovative architecture using ViualSim?How to create innovative architecture using ViualSim?
How to create innovative architecture using ViualSim?
 
ME4AWSN - a Modeling Environment for Architecting WSNs
ME4AWSN - a Modeling Environment for Architecting WSNsME4AWSN - a Modeling Environment for Architecting WSNs
ME4AWSN - a Modeling Environment for Architecting WSNs
 
HPC and cloud distributed computing, as a journey
HPC and cloud distributed computing, as a journeyHPC and cloud distributed computing, as a journey
HPC and cloud distributed computing, as a journey
 
Challenges and Opportunities of Big Data Genomics
Challenges and Opportunities of Big Data GenomicsChallenges and Opportunities of Big Data Genomics
Challenges and Opportunities of Big Data Genomics
 
A General Purpose Extensible Scanning Query Architecture for Ad Hoc Analytics
A General Purpose Extensible Scanning Query Architecture for Ad Hoc AnalyticsA General Purpose Extensible Scanning Query Architecture for Ad Hoc Analytics
A General Purpose Extensible Scanning Query Architecture for Ad Hoc Analytics
 
Cedar Overview
Cedar OverviewCedar Overview
Cedar Overview
 

Dernier

Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessPixlogix Infotech
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?Igalia
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 

Dernier (20)

Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 

Fortuna 2012 metadata_management_web_of_things

  • 1. Metadata Management for the Web of Things: a Practical Perspective Carolina Fortuna, Alexandra Moraru, Patricia Oniga, Zoltan Padrah and Mihael Mohorcic http://sensorlab.ijs.si/ http://sensors.ijs.si/ Web of Things Workshop, June 19, 2012.
  • 2. Outline • Motivation • Physical data sources • Architecture alternatives • Embedded approach • Middleware approach • The metadata storage • The metadata representation • The metadata access • Conclusions
  • 3. Motivation We identified two types of meta-data that can be useful in processing sensor measurements: • Technical specifications of the sensor platforms • types of sensors, units of measurement for the observed phenomenon, range of sensors, performance in term of accuracy, stability of measurements, etc. • Contextual specifications of the sensor platforms • environment where the platform is deployed (i.e. indoor or outdoor), placement conditions (i.e. outdoor under shelter, under water, exposed to turbulences), time of deployment, etc.
  • 4. Motivation • How do we know what a sensor measures? • Typical platforms use abbreviations which are hard to recognize automatically: “tmp”, "location": “temp”, { "disposition":"fixed", “temperature”, "ele":"23.0", “t” "name":"office", "lat":51.5235375648154, "exposure":"indoor", "lon":-0.0807666778564453, "domain":"physical" }
  • 5. Motivation • Sometimes additional context is required What does the “temperature” sensor measure? – Air, water or some other temperature? – Indoor , outdoor, in a container? Consistent terminology is required for interoperability.
  • 6. Physical data sources • Using standard terminology • Open Geospatial Consortium’s Sensor Web Enablement standards • NOAA and other datasets published and annotated using these standards • Non-standard based data sources • Existing and emerging middleware solutions such as GSN, Cosm, etc.
  • 7. Standard based data sources • Sensors push their observation results • to a database (which will be accessed by the SOS service) • or directly to the SOS service (Transactional-SOS in this case). • Sensors are registered, using SensorML, at the catalog service (CAT). • The user queries the catalog service • it responds with a list of SOS service instances that fulfill the requirements. • The user binds the SOS and retrieves the observation data, encoded in O&M and SensorML.
  • 8. W3C SSN • W3C Semantic Sensor Network Ontology • Vocabulary that permits higher expressiveness • Compatible with SensorML • Structured vocabularies have high overhead • Inconvenient for constrained devices
  • 9. Architecture alternatives We looked at two implementation options that would allow using semantic representation for sensor meta-data: • Embedded approach • Middleware approach We compared them with respect to three aspects: • Storage • Representation • Access
  • 10. Embedded vs. Midleware based Architecture Embedded approach • assign an IP address to every device • Sensors (things) are accessed directly from the web without any intermediates Middleware approach • involves using a gateway solution • interface with the applications • interface with a network of things • applications communicate with a middleware that intermediates to the things • the middleware is responsible to collect metadata from the things and respond to clients’ requests.
  • 11. Sensor Metadata Storage Embedded Middleware • metadata has been added Relational Database to the embedded software • database schema reflects (firmware) of the devices hardware configuration • facilitates the automatic gathering of information Knowledge base (triple stores) about the sensors • Uses exiting ontologies for data • stored in the flash memory model of the devices Metadata header Module 1 Module 2 … Module N Metadata footer
  • 12. Sensor Metadata Storage Embedded Middleware • JSON-LD in our implementation • we implemented it as • The message occupies 15KB out relational database and as of the 512KB of flash memory triple store (~3%). • if additional metadata is • For comparison needed at a later time • the CoAP application code takes – the extension or even about 25 KB and the full system redesign of the database image – in the triple based • the operating system with networking representation predicate stack and application takes 216KB and object types need to without optimization and roughly be specified later in an 150KB with compiler optimizations. ontology • Therefore the metadata uses 10% of the entire system image
  • 13. Sensor Metadata Representation Structured representation of metadata following standardized format • Solutions typically use a publicly shared schema, vocabulary or ontology • SensorML, ZigBee SmartEnergy, RDF (plus domain ontology – e.g. SSN) • most of them follow XML syntax • Encoding techniques are needed for efficient storage and transmission from the embedded devices • Efficient XML Interchange (EXI), Binary XML (BXML), Binary JSON (BSON) Embedded Middleware Structured representation Structured or custom of metadata representation • disadvantage of occupying • Structured -> fast integration with a notable proportion of the different storage systems device’s memory resources, • Custom -> good when there are • it is required for integration memory and energy constraints; purposes required specialized parsers and wrappers
  • 14. Sensor Metadata Representation p01=403AB8F9&p02=VSCv1.2.1&p03=temperature • Implementations &p04=degC&p05=pressure&p06=mbar (a) • Custom representation (a) "@context":{ • JSON-LD representation "base":" http://hostname/semsense/resource/", "uri": "@subject", (b) "isa" : "@type", "sensorNode" : "http://purl.oclc.org/NET/ssnx/ssn#System", "modules" : • A sensor node that has "http://purl.oclc.org/NET/ssnx/ssn#hasSubSystem", ...} two types of sensors "uri":"base:403AB8FC", attached to it, measuring "isa": "sensorNode", "modules" : [ { temperature and pressure "uri":"base:403AB8FC/s1", "isa": "sensor", in degree Celsius and "observedProperty" : { millibars respectively "uri" : "temperature", "uom" : "degC", } }, { "uri":"base:403AB8FC/s2", "isa": "sensor", "observedProperty" : { "uri" : "pressure", "uom" : "mbar", } }] (b)
  • 15. Sensor Metadata Representation Semantic Vocabulary • SSN ontology • Other Vocabularies/Ontologies: Basic GeoWGS84, GeoNames, Measurement Units Ontology • Subset of concepts and relationships from SSN
  • 16. Sensor Metadata Representation Embedded Middleware • the transformation of • a structured metadata can be representation straightforward if properly • disadvantage of occupying a represented in a structured manner notable proportion of the • permits users to send device’s memory SPARQL queries and • it supports immediate receive the corresponding integration into WoT answer, • for comparison, the custom – this is currently not format equivalent to the full supported in the embedded approach (but 15KB JSON-LD message some efforts in the this takes only 1KB direction are underway)
  • 17. Sensor Metadata Access Embedded Middleware • a RESTful API to the resource • SPARQL end-points of the containing metadata which triple stores returns a structured JSON-LD • Relational Database combined message with D2R server • The application which • Triple store -> Sesame generated the call can parse the message using a JSON-LD processor •metadata access on the node is done through the resource and not by querying the sensor node URI
  • 18. Sensor Metadata Access uIPv6/6LowPAN/CoAP VESNA Sensor Node running Contiki 2.5 OS ARM Cortex-M3 clock up to 72 MHz, 1 MHz 12-bit ADC, 1 MB flash, 96 kB SRAM, 128 kB non-volatile MRAM, SD or micro SD card slot USB 2.0 and RS-232 interface
  • 19. Sensor Metadata Access Embedded • Constrained communications links • High packet loss rate (5-10%) • low datarate (10s kb/s) • lack of or slow response from the thing • inconvenient for the web application developer • Retrieval of the JSON-LD message containing the metadata of the device took 12 seconds • approximately 15 KB in over 200 chunks • 100 kb/s link • another inconvenience related to constrained devices is the inability to process multiple requests at the same time.
  • 20. Conclusions • Both the embedded and the middleware solutions can be prototyped • The current state of the art in sensor devices limits the amount of stored data •XML like syntax is not well suited for storing. •constraints are imposed by the communication links. • The middleware approach is more convenient from the perspective of web application developer • technological developments empowering the embedded approach may be catching up soon.
  • 21. 21 Lab: http://sensorlab.ijs.si/ WoT Mash-up: http://sensors.ijs.si/ Tutorial: http://carolinafortuna.com/web-of-things-tutorial/ Contact: carolina.fortuna@ijs.si