Data management and governance aspects of the CPaaS.io platform as presented at the first year review meeting in Tokyo on October 5, 2017.
Disclaimer:
This document has been produced in the context of the CPaaS.io project which is jointly funded by the European Commission (grant agreement n° 723076) and NICT from Japan (management number 18302). All information provided in this document is provided "as is" and no guarantee or warranty is given that the information is fit for any particular purpose. The user thereof uses the information at its sole risk and liability. For the avoidance of all doubts, the European Commission and NICT have no liability in respect of this document, which is merely representing the view of the project consortium. This document is subject to change without notice.
Powerful Google developer tools for immediate impact! (2023-24 C)
CPaaS.io Y1 Review Meeting - Holistic Data Management
1. City Platform as a Service – Integrated and Open
WP 6: Holistic Data Management and
Governance
Adrian Gschwend, BFH
Katsunori Shindo, Ubiquitous Networking Laboratory
Year 1 Review Meeting, Tokyo
October 5, 2017
4. Main Results
• Objective 1: Develop a model to assess data quality, in
particular regarding IoT data.
T6.1, initial work in D6.1: Holistic Data Management: State of the Art
(M6)
• Objective 2: Provide the mechanisms for linking
heterogeneous data sets from variety of sources.
T6.2, D6.1: Holistic Data Management: State of the Art (M6)
Analyzes current Best Practices in Data Management
Introduces schema, ontologies and vocabularies
Domains: IoT, O(G)D, Social Media, Personal data
29.11.2017 CPaaS.io - Consortium Confidential 4
5. Main Results
• Objective 3: Enable the provisioning of the data as linked data
through SPARQL endpoints.
Initial concept for Linked Data access to FIWARE & u2 in D6.2
U2: SPARQL and REST-based integration
FIWARE: Initial SPARQL endpoint exposing Deployment Knowledge Base
(T6.5)
Extended SSN Ontology with deployment specific concepts
Described Color Run Utrecht Deployment with Deployment Tool
• Objective 4: Develop the necessary mechanisms to support the
privacy requirements.
Started in T6.3 & 6.4, M9. Some basic work in D6.1 (M6)
29.11.2017 CPaaS.io - Consortium Confidential 5
6. Results in Year 1
Summary and Discussion
29.11.2017 CPaaS.io - Consortium Confidential 6
7. D6.1: Holistic Data Management
• Analyzing existing and upcoming Best Practices
• Data on the Web Best Practices introduction (W3C)
• Analyzing many existing ontologies and their pickup
• Analyzing IoT related ontologies
• W3C Community Group work (Spatial, SSN etc)
• Identifying gaps
29.11.2017 CPaaS.io - Consortium Confidential 7
8. Existing and Upcoming Best Practices
29.11.2017 CPaaS.io - Consortium Confidential 8
FIWARE: using NGSI data model u2: ucR model
In both models, one can map and expose a specific data set as RDF
Many of the presented standards in the area of Linked
and Open Data are summarized in the Data on the Web
Best Practices W3C Recommendation
RDF Linked Data (in RDF)
9. FIWARE, u2, RDF & Linked Data
• FIWARE
• NGSI Data model
• u2
• ucode ucR model
• RDF (Resource Description Framework)
• Graph based data model, URIs as identifiers
• Various serializations, among others JSON-LD
• SPARQL query language, supports federation (SERVICE keyword)
• Linked Data: HTTP based access to URIs
29.11.2017 CPaaS.io - Consortium Confidential 9
10. Conclusion of D6.1
• For data sets with a relevance for CPaaS.io use cases
it is important to expose as much data as possible as Linked
Data
• For that, modules will be implemented that allow access to
FIWARE or u2 data as RDF
29.11.2017 CPaaS.io - Consortium Confidential 10
11. D6.2: Linked Data Access Endpoint
• Initial architecture for Linked Data (RDF) integration
• FIWARE: Semantic Integration layer
• u2: SPARQL and REST-based integration
• First FIWARE components developed
• First SPARQL queries executed against metadata
• Discussions for mapping components for data itself
29.11.2017 CPaaS.io - Consortium Confidential 11
14. u2 Endpoint
u2: SPARQL and REST-based integration
29.11.2017 CPaaS.io - Consortium Confidential 14
Applications Sensors / Actuators
REST-based
query
JSON-LD
Formatted
data
RDF
Database
Relation
Database
KVS
Database
GIS
Database
SPARQL SQL SQLAPI for KVS DB
REST-based
query
JSON-LD
Formatted
data
SPARQL-based
interface
CPaaS.io
Front-End
Query Converter
Federation of
various databases
15. u2 Endpoint Implementation Architecture
29.11.2017 CPaaS.io - Consortium Confidential 15
Applications Sensors / Actuators
REST-based
query
JSON-LD
Formatted
data
RDF
Database
Relation
Database
KVS
Database
GIS
Database
SPARQL SQL SQLAPI for KVS DB
REST-based
query
JSON-LD
Formatted
data
SPARQL-based
interface
u2 Endpoint
CPaaS.io
Front-End
Query Converter
(2) Convert query to
target database
(3) Access to
target databases
(1) Accept a query
(4) Convert response to
JSON-LD format
(5) Return formatted response
16. T6.5 Scenarios and Requirement Analysis
• Smart City Deployments
• Spatial Coverage
• Event Deployments
• Limited Duration
• Mobile Deployments
• Smart Home Deployments
• Building Centric Deployment
• Device Associations
29.11.2017 CPaaS.io - Consortium Confidential 16
17. T6.5 Deployment Tool
Reactive Web Application
• Inventory Management
• Type Management
• People and Groups
• Event and Venue Creation
• Mobile Deployments
• Map-based Static Deployments
Technical Implementation
• Fully RDF-based using a powerful device description and deployment extension
ontology of SSN
• Adaptive UI: Dialogs adapt to ontology and data
29.11.2017 CPaaS.io - Consortium Confidential 17
18. T6.5 Agile Development
Starting Point: Basic version of deployment tool V1.0 and
Deployment Ontology V1.0
Ontology V2.0.1: Better support for all deployment types
Deployment Tool V1.6.0: more than 10 releases
29.11.2017 CPaaS.io - Consortium Confidential 18
19. Plan for Year 2
Outlook
29.11.2017 CPaaS.io - Consortium Confidential 19
20. WP6 Outlook
• Semantic Data Integration (T6.2)
• Federated Querying over both platform implementations
• Accessing data (not just metadata) as RDF
• Data Quality models (T6.1)
• User empowered & context-based data access (T6.3 & 6.4)
• Personal data management: a function for citizens to set the policy of their own personal data
• Context-based access control: a function to change the policy of access control based on contexts
• Next Deliverables
• D6.3 : Holistic Data Management: Initial Concepts and Models [18]
• Semantic mapping of NGSI data model to RDF and u2 data model
• Description of Deployment Ontology
• ETSI Industry Specification Group (ISGs) related work
• Cross-sector Context Information Management (ISG CIM) for smart cities applications and beyond
• City Digital Profile (ISG CDP)
• Details in WP7
29.11.2017 CPaaS.io - Consortium Confidential 20
21. Gracias Mulțumesc 謝謝 Paldies Eskerrik asko Dziękuję Mahalo תודה Go raibh maith agat спасибо Grazzi आभारी
Xin cảm ơn 감사합니다 நன்றி Köszönöm مرسي Ndiyabulela Grazia Tak Благодаря Aitäh Terima kasih Děkuji
Asante Diolch شكرا Takk Ďakujem Gràcies Kiitos Obrigado Teşekkür ederim Ngiyabonga Þakka þér Grazas
Tapadh leibh ขอบคุณ Faleminderit Ačiū Danke Merci Grazie Hvala Ευχαριστώ Dankon Tack Dank je Grazcha
…
Thank You
ありがとう
This document has been produced in the context of the CPaaS.io project which is jointly funded by the European
Commission (grant agreement n° 723076) and NICT from Japan (management number 18302). All information provided
in this document is provided "as is" and no guarantee or warranty is given that the information is fit for any particular
purpose. The user thereof uses the information at its sole risk and liability. For the avoidance of all doubts, the European
Commission and NICT have no liability in respect of this document, which is merely representing the view of the project
consortium. This document is subject to change without notice.
29.11.2017 CPaaS.io - Consortium Confidential 21
Notes de l'éditeur
For the EUJ-02-2016 call text, refer to https://ec.europa.eu/programmes/horizon2020/sites/horizon2020/files/05i.%20LEIT-ICT_2016-2017_pre-publication.pdf, page 108ff.
~ What is RDF and Migrating FIWARE and u2 to RDF ~