http://lod2.eu/BlogPost/webinar-series
This webinar in the course of the LOD2 webinar series will present the release 3.0 of the LOD2 stack, which contains updates to
*) Virtuoso 7 [Openlink]: the original row store of the Virtuoso 6 universal server has now been replaced by a column store, increasing the performance of SPARQL queries significantly, the store is now up to three times as fast as the previous major version.
Linked Open Data Manager Suite [SWC]: the 'lodms' application allows the user to quickly set up pipelines for transforming linked data through the use of its many extensions. It also allows operations for extracting rdf from other types of data.
*) dbpedia-spotlight-ui [ULEI]: a graphical user interface component that allows the user to use a remote DBpedia spotlight instance to annotate a text with DBpedia concepts.
*) sparqlify [ULEI]: a scalable SPARQL-SQL rewriter, allowing you to query an SQL database as if it were a triple store.
*) SIREn [DERI]: a Lucene plugin that allows you to efficiently index and query RDF, as well as any textual document with an arbitrary amount of metadata fields.
*) CubeViz [ULEI]: CubeViz allows visualization of the Data Cube linked data representation of statistical data. It has support for the more advanced DataCube features, such as slices. It also allows the selection of a remote SPARQL endpoint and export of a modified cube.
*) R2R [UMA]: the R2R mapping API is now included directly into the lod2 demonstrator application, allowing users to experience the full effect of the R2R semantic mapping language through a graphical user interface.
*) ontowiki-csvimport [ULEI]: an OntoWiki extension that transforms CSV files to RDF. The extension can create Data Cubes that can be visualized by CubeViz.
If you are interested in Linked (Open) Data principles and mechanisms, LOD tools & services and concrete use cases that can be realised using LOD then join us in the free LOD2 webinar series!
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
LOD2 Webinar Series: 3rd relase of the Stack
1. Creating Knowledge out of Interlinked Data
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 1
http://lod2.eu
2. Creating Knowledge out of Interlinked Data
LOD2 is a large-scale integrating project co-funded by the European
Commission within the FP7 Information and Communication Technologies
Work Programme. This 4-year project comprises leading Linked Open Data
technology researchers, companies, and service providers. Coming from
across 12 countries the partners are coordinated by the Agile Knowledge
Engineering and Semantic Web Research Group at the University of
Leipzig, Germany.
LOD2 will integrate and syndicate Linked Data with existing large-scale
applications. The project shows the benefits in the scenarios of Media and
Publishing, Corporate Data intranets and eGovernment.
EU-FP7 LOD2 WP6 – 12.-13.9.2013.
Page 2
http://lod2.eu
http://lod2.eu
3. Creating Knowledge out of Interlinked Data
Once per month the LOD2 webinar series offer a free webinar about tools and services along the Linked
Open Data Life Cycle.
Stay with us and learn more about acquisition, editing, composing, connected applications – and finally
publishing Linked Open Data.
EU-FP7 LOD2 WP6 – 12.-13.9.2013.
Page 3
http://lod2.eu
http://lod2.eu
4. Creating Knowledge out of Interlinked Data
Third release of LOD2 Stack
Presented by Bert Van Nuffelen & Karel Kremer, TenForce
EU-FP7 LOD2 WP6 – 12.-13.9.2013.
Page 4
http://lod2.eu
http://lod2.eu
5. Creating Knowledge out of Interlinked Data
Presentation Overview
A. LOD2 Stack Release 3.0 overview
B. Connecting the dots: Workbench for Statistical Office
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 5
http://lod2.eu
6. Creating Knowledge out of Interlinked Data
LOD2 STACK RELEASE 3.0
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 6
http://lod2.eu
7. Creating Knowledge out of Interlinked Data
LOD2 stack progress
Release 1: 25 components/Packages
Release 2: 37 components/Packages
Release 3: 47 components in LOD2 stack release 3
• 10 new components/Packages
• Of which 44 are available as a Debian package
• Of which 24 are available through a graphical user interface in the
demonstrator and/or the statistical workbench
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 7
http://lod2.eu
9. Creating Knowledge out of Interlinked Data
Virtuoso 7 Universal Server (1/10)
• A Column store implementation
• Queries up to three times as fast as latest major version
• Many other improvements
Interlinking/
Fusing
Classification/
Enrichme
nt
Manual
revision/
authoring
Storage/
Querying
Quality
Analysis
Extractio
n
Evolution
/ Repair
Search/
Browsing
/
Explorati
on
e.g. to load times and parallellization
• Benchmarking: BSBM results:
http://wifo5-03.informatik.uni-mannheim.de/bizer/berlinsparqlbenchmark/results/V7/
http://virtuoso.openlinksw.com/
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 9
http://lod2.eu
10. Creating Knowledge out of Interlinked Data
Rdf dataset integration (2/10)
• Easy integration of RDF datasets as dependencies
for debian packages
• Allows packages to provide example data in an easy
way
Interlinking/
Fusing
Classification/
Enrichme
nt
Manual
revision/
authoring
Storage/
Querying
Quality
Analysis
Extractio
n
Evolution
/ Repair
Search/
Browsing
/
Explorati
on
RDF dataset
https://github.com/AKSW/rdf-dataset-integration
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 10
http://lod2.eu
11. Creating Knowledge out of Interlinked Data
Sparqlify (3/10)
Interlinking/
Fusing
• Scalable SPARQL-SQL rewriter,
Classification/
Enrichme
nt
Manual
revision/
authoring
Storage/
Querying
• Query an SQL database as if it were a RDF store.
Quality
Analysis
Extractio
n
Evolution
/ Repair
Search/
Browsing
/
Explorati
on
{ SPARQL }
{ SQL }
Sparqlify
Relational Database
http://aksw.org/Projects/Sparqlify.html
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 11
http://lod2.eu
12. Creating Knowledge out of Interlinked Data
SIREn (4/10)
Interlinking/
Fusing
• Semantic Information Retrieval Engine
Classification/
Enrichme
nt
Manual
revision/
authoring
Storage/
Querying
• Lucene/SOLR extension
Quality
Analysis
Extractio
n
Evolution
/ Repair
Search/
Browsing
/
Explorati
on
• Transformation of RDF graphs into trees to allow very
efficient querying and search
http://siren.sindice.com/
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 12
http://lod2.eu
13. Creating Knowledge out of Interlinked Data
R2R Framework (5/10)
• RDF vocabulary mapping framework
Interlinking/
Fusing
Classification/
Enrichme
nt
Manual
revision/
authoring
Storage/
Querying
• Defines mapping language from one vocabulary to
another
Quality
Analysis
Extractio
n
Evolution
/ Repair
Search/
Browsing
/
Explorati
on
• Automatic Execution of mapping rules
http://wifo5-03.informatik.uni-mannheim.de/bizer/r2r/
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 13
http://lod2.eu
14. Creating Knowledge out of Interlinked Data
DBpedia Spotlight UI (6/10)
• Lightweight Frontend for remote DBpedia Spotlight
Instance
• User interface to extract Dbpedia Entities from text
Interlinking/
Fusing
Classification/
Enrichme
nt
Manual
revision/
authoring
Storage/
Querying
Quality
Analysis
Extractio
n
Evolution
/ Repair
Search/
Browsing
/
Explorati
on
https://github.com/AKSW/dbpedia-spotlight-ui
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 14
http://lod2.eu
15. Creating Knowledge out of Interlinked Data
LOD Manager Suite (7/10)
Interlinking/
Fusing
• quickly set up pipelines for transforming linked data
Classification/
Enrichme
nt
Manual
revision/
authoring
Storage/
Querying
• many extensions
Quality
Analysis
Extractio
n
• Extract RDF from other types of data.
Evolution
/ Repair
Search/
Browsing
/
Explorati
on
http://www.semantic-web.at/linked-open-data-management-suite-lodms
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 15
http://lod2.eu
16. Creating Knowledge out of Interlinked Data
Facete (8/10)
• Generic Facetted Browser for RDF data
• Supports any remote SPARQL endpoint
• Automatically visualize RDF on a map
• Permalink functionality for sharing
Interlinking/
Fusing
Classification/
Enrichme
nt
Manual
revision/
authoring
Storage/
Querying
Quality
Analysis
Extractio
n
Evolution
/ Repair
Search/
Browsing
/
Explorati
on
http://aksw.org/Projects/Facete.html
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 16
http://lod2.eu
17. Creating Knowledge out of Interlinked Data
CubeViz (9/10)
• Facetted Browser for Data Cube Vocabulary
Interlinking/
Fusing
Classification/
Enrichme
nt
Manual
revision/
authoring
Storage/
Querying
Quality
Analysis
• Many different visualizations available
Extractio
n
• Supports more advanced features like slices
Evolution
/ Repair
Search/
Browsing
/
Explorati
on
• Support for RDF export and Permalinks
http://aksw.org/Projects/CubeViz.html
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 17
http://lod2.eu
18. Creating Knowledge out of Interlinked Data
CSV Import (10/10)
Interlinking/
Fusing
Classification/
Enrichme
nt
Manual
revision/
authoring
• Transforms CSV files to RDF
Storage/
Querying
• Supports transformation to Data Cubes
Quality
Analysis
Extractio
n
Evolution
/ Repair
Search/
Browsing
/
Explorati
on
• Template reuse supported
http://aksw.org/Projects/CSVImport.html
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 18
http://lod2.eu
19. Creating Knowledge out of Interlinked Data
Demonstrating interaction between components
• LOD2 demonstrator: ‘intelligent bookmark
service’ for stack
http://demo.lod2.eu/lod2demo
• LOD2 statistical office workbench: deeper
integration in the context of statistical data
http://demo.lod2.eu/lod2statworkbench
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 19
http://lod2.eu
20. Creating Knowledge out of Interlinked Data
LOD2 Authentication – Authorization – Provenance layer
• WebID for user profile and security in Statistical Workbench
• Authorization control to
(Dis)Allow access to a section (URL) in the workbench
Provide role based views inside a section (URL) in the workbench
(for native functionality in the workbench)
• Provenance information can be collected based on profile
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 20
http://lod2.eu
21. Creating Knowledge out of Interlinked Data
More info: Stack.lod2.eu
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 21
http://lod2.eu
22. Creating Knowledge out of Interlinked Data
Updating the stack to version 3
• Release 3 requires a Ubuntu 12.04LTS 64bit machine
• A simple apt-get upgrade will be enough, BUT
• New version of the stack uses the Virtuoso Open Source edition, version
7
• Conflicts with old Virtuoso Open Source 6 package
• The package manager will guide you through the transition process
• But best ensure you have a backup of the contents of the database.
• Instructions on migrating your database:
http://wiki.lod2.eu/display/LOD2DOC/Upgrading+an+installation+to+the+latest+releas
e
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 22
http://lod2.eu
23. Creating Knowledge out of Interlinked Data
More information …
Stack.lod2.eu and Wiki.lod2.eu
• How to start & How to contribute
• Overview of the individual api documentations
• Tutorial section
• Contact point: support@lod2.eu
Public demo
• http://demo.lod2.eu/lod2demo
• http://demo.lod2.eu/lod2statworkbench
LOD2 Webinars series
• http://lod2.eu/BlogPost/webinar-series
• View them on youtube
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 23
http://lod2.eu
24. Creating Knowledge out of Interlinked Data
Further improvements
Component improvements
regular component updates e.g. bugfixes Virtuoso 7
New components
Facete: a client side faceted browser for linked data having geospatial coordinates.
…But we want to learn from you!
Usage experience
Challenges encountered
Mail us at:
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 24
http://lod2.eu
25. Creating Knowledge out of Interlinked Data
Ensuring the continuity: LinkedData.org
In 2014, the stack moves to a project neutral space
• http://stack.linkeddata.org/
Repository for java artifacts for linked data
• http://mvn.linkeddata.org/
A collaboration with the GeoKnow project
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 25
http://lod2.eu
26. Creating Knowledge out of Interlinked Data
LOD2 STATISTICAL OFFICE
WORKBENCH
The work on the statistical Office Workbench is a the result of a cooperation between the
partners IMP, ULEI and TenForce.
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 26
http://lod2.eu
27. Creating Knowledge out of Interlinked Data
Motivation of the work
Data, knowledge and research interest available:
• Publink with DG Infso for the Digital Agenda Scoreboard (2011)
• Publink with Serbian National Statistical Office (2011-2012) & use case described in
D.6.4.1.
• Publicdata.eu & Deliverable D9.4.1 : assessment of government data shows that
statistical data is freely available in large quantities. (2012)
• LATC project: transformation or Eurostat data into RDF (2012)
• Creation of Cubeviz application (2012-2013)
But:
• No tool support for creation data cubes in RDF
• No tool support for managing data cubes
• No tool support for merging & splitting data cubes
And selecting a domain allows to explore the integration of components better.
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 27
http://lod2.eu
28. Creating Knowledge out of Interlinked Data
Statistical Office Use case
Investment service
company
advanced
analysis
2
automatic
publishing
define
standards
Data Analyst
automatic
harvesting
automatic
publishing
1. Public sector needs an
infrastructure to publish into and
curate information from the LOD
cloud
publish
data
administration
2. Support for consumption of this
data
CSO IT Administrator
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 28
1
Statistician
http://lod2.eu
29. Creating Knowledge out of Interlinked Data
Statistical Office Workbench – GUI
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 29
http://lod2.eu
30. Creating Knowledge out of Interlinked Data
Functionalities
• efficient transformation / conversion of traditional data stores (e.g. CSV,
XML, relational databases) into linked, machine readable formats
• building and querying RDF Data Cube stores
• validating RDF Data Cube stores
• interlinking (e.g. code lists) and adding meaning to data
• visualization and exploration of multi-dimensional RDF data cubes
• publishing RDF Data Cube to CKAN
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 30
http://lod2.eu
31. Creating Knowledge out of Interlinked Data
Karel Kremer
DEMO
STATISTICAL OFFICE WORKBENCH
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 31
http://lod2.eu
33. Creating Knowledge out of Interlinked Data
Introducing the Data
* Data Modified slightly to improve demo clarity
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 33
http://lod2.eu
34. Creating Knowledge out of Interlinked Data
Data Cube Vocabulary
• Data cube according to W3C: http://www.w3.org/TR/vocab-data-cube/
ns1:slice
ns1:slice
ns1:slice
ns1:slice
rdf:type
qb:Slice .
rdfs:label "only Europe region slice" .
qb:sliceStructure
local:onlyEurope .
cube:Location
cube:r1-c1 ;
qb:observation cube:c1-r14 , cube:c1-
r15,
cube:c1-r9 , cube:c1-r10
,
cube:c1-r11 , cube:c1-r12
,
cube:c1-r13 , cube:c1-r4
,
cube:c1-r5 , cube:c1-r6
,
cube:c1-r7 , cube:c1-r8
cube:c1-r3 rdf:type
qb:Observation ;
,
cube:Location
cube:r1-c1 ;
cube:c1-r3 .
cube:Disease
cube:r3-c0 ;
cube:m
" 7 782" ;
qb:dataSet cube:ds .
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 34
http://lod2.eu
35. Creating Knowledge out of Interlinked Data
Merging Data Cubes
Disease
Region
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 35
http://lod2.eu
36. Creating Knowledge out of Interlinked Data
Scenario
CSV
Import
Link
Merge
Data Cube
&
reconcile
Statistical Office Workbench
Triple Store
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 36
http://lod2.eu
37. Creating Knowledge out of Interlinked Data
Scenario
Code
Lists
Context
CSV
CSV
CKAN
RDF
CSV
Import
Merge
RDF
Data Cube
RDF
Link
RDF
&
reconcile
Statistical Office Workbench
Triple Store
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 37
http://lod2.eu
38. Creating Knowledge out of Interlinked Data
Scenario
Code
Lists
Context
CSV
CSV
CKAN
RDF
CSV
Import
Merge
RDF
Data Cube
RDF
Link
RDF
&
reconcile
Statistical Office Workbench
Triple Store
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 38
http://lod2.eu
39. Creating Knowledge out of Interlinked Data
Introducing the Data
* Data Modified slightly to improve demo clarity
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 39
http://lod2.eu
40. Creating Knowledge out of Interlinked Data
{ DEMO }
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 40
http://lod2.eu
41. Creating Knowledge out of Interlinked Data
Try It Yourself!
• Get your own stack:
Install LOD2 stack from the Debian repository
Or download the pre-configured virtual machine
• Follow the tutorials here:
http://wiki.lod2.eu/display/LOD2DOC/LOD2+Statistical+Workbench
• This and much more on: http://stack.lod2.eu
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 41
http://lod2.eu
42. Creating Knowledge out of Interlinked Data
Credits
Jingle
Coordination
R.E.M., Martin Kaltenböck, Florian Kondert
Thomas Thurner
Martin Kaltenböck
Moderation
Martin Kaltenböck
Presented by Bert Van Nuffelen & Karel Kremer
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 42
http://lod2.eu
43. Creating Knowledge out of Interlinked Data
QUESTIONS?
Don’t forget: all info to be found at http://stack.lod2.eu !
EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013.
Page 43
http://lod2.eu
44. Creating Knowledge out of Interlinked Data
Hope you enjoyed staying with us – if you need more detailed information, visit us at www.lod2.eu and
let us know how we can improve to meet your expectations!
Don’t forget to register for our next webinar
28.11.2013 – ORE + DLearner (by ULEI)
December 2013 – NIF (by ULEI)
Have a great day and don’t forget http://stack.lod2.eu
EU-FP7 LOD2 WP6 – 12.-13.9.2013.
Page 44
http://lod2.eu
http://lod2.eu
45. Creating Knowledge out of Interlinked Data
EU-FP7 LOD2 WP6 – 12.-13.9.2013.
Page 45
http://lod2.eu
http://lod2.eu
Notes de l'éditeur
this is an artificial situation, but it simulates the most frequent situation that you will have in real life!
Of course, not only languages, also other context, like give me a definition of the disease, the symptom
this is an artificial situation, but it simulates the most frequent situation that you will have in real life!