Enabling combined Software and Data engineering at Web-scale

http://aligned-project.eu ISWC, 21st October 2016, Kobe
Enabling combined Software and Data
engineering at Web-scale
The ALIGNED suite of Ontologies
Monika Solanki
https://w3id.org/people/msolanki
@nimonika
University of Oxford
Joint work with
Bojan Boži´c, Markus Freudenberg, Dimitris Kontokostas,
Christian Dirschl, Rob Brennan &
The ALIGNED consortia

monika.solanki@cs.ox.ac.uk, @nimonika The ALIGNED suite of Ontologies

Motivation
Recent years have seen a signiﬁcant increase in the
demand for data-intensive applications.
Crucial technical and economic challenge ⇒ Effective,
collaborative integration of software and big data
engineering for Web-scale systems.
Current engineering techniques for building these systems
are both immature and often partitioned into software
engineering and data engineering processes, tasks or
teams.
There is a need for integrated engineering approaches
along with an underlying curatorial process to improve and
manage data over time.

Semantic models and Linked data
The expressivity of semantic models makes them useful for
both addressing data quality and applying model-driven
approaches to software engineering.
Semantic models can enable tools to easily publish
relevant meta-data about engineering processes.
Linked data based restful APIs can enable tool integration
and process or lifecycle synchronisation/communication.

Goal
Develop a common suite of lightweight meta-models or
vocabularies to describe both software and data engineering
system speciﬁcations and lifecycles, thereby creating a
common technical space for tools to easily publish relevant
meta-data about systems engineering.

Contributions
The ALIGNED* suite of ontologies
Speciﬁcally designed to model the information exchange
needs of combined software and data engineering.
Aims to align the divergent processes encapsulating data
and software engineering.
Deployed for validation and incremental improvement in
the ALIGNED project on four, large-scale data-intensive
systems engineering use cases.
Improves productivity, agility and quality.
*http://aligned-project.eu

The ALIGNED suite of ontologies
Provides support for
Semantics-based model driven software engineering
Data quality engineering techniques
Development of tools for uniﬁed views of software and data
engineering processes
Software/data test case interlinking,

ALIGNED Suite: Overview
Text

ALIGNED Suite: Design Intents
Text
Design Intent Ontology (DIO) documents the design decisions
about data intensive system artefacts such as requirements,
designs or datasets.
Available at: https://w3id.org/dio

ALIGNED Suite: Software Engineering
Text
Deﬁnes the major agents, activities and entities involved in a
software engineering project and their relations with a special
focus on capturing the engineering lifecycle.
Available at: https://w3id.org/slo
https://w3id.org/sip

ALIGNED Suite: Data Engineering (1)
Text
DLO is the basis for deriving speciﬁc domain ontologies which
represent lifecycles of concrete data engineering projects -
DBpedia and Seshat.
Available at: https://w3id.org/dlo

ALIGNED Suite: Data Engineering (2)
Text
DataID is a multi-layered meta-data system, which, in its core,
describes datasets and their different manifestations.
Available at: http://dataid.dbpedia.org/ns/core

ALIGNED Suite: Unified quality reports (1)
Defines a unified reporting representation for data quality
metrics, ontology reasoning errors, test cases, and test case
results based on the W3C SHACL reporting vocabulary.
RUT is designed to capture the lifecycle of RDF validation with
the test driven validation methodology.

ALIGNED Suite: Uniﬁed quality reports (2)
RVO describes both ABox and TBox reasoning errors for the
integration of reasoners into data lifecycle tool-chains.
Available at: https://w3id.org/rvo

ALIGNED Suite: Domain Models
Enterprise information processing: extensions and models for the
JURION use case.
E-research in the Social Sciences and Humanities: extensions and
models for the Seshat use case.
Crowd-sourced public datasets: extensions and models for the
DBpedia use case.
Enterprise software development: extensions and models for the
PoolParty use case.

Use case: Wolters Kluwer’s JURION
JURION: an innovative legal information platform
developed by Wolters Kluwer Germany
Merges and interlinks over 1 million documents of content
and data from diverse sources.
Data is presented to users, e.g. law ofﬁces
Data lifecycle stages: extraction, storage, authoring,
interlinking, enrichment, quality analysis, repair and
publication.
Information processing pipeline ⇒ highly customised
applications for legal information retrieval, alerts, analysis
and semantic search.

Use case: Wolters Kluwer’s JURION
Challenge
Currently, the software development process and data life cycle
are highly independent from each other and require extensive
manual management to coordinate their parallel development,
leading to higher costs, quality issues and a slower
time-to-market.

Wolters Kluwer’s JURION

Evaluation (1)
Generic criteria Evaluation
Value Addition - enrich information about process speciﬁc
procedures for a tool by adding data and
software engineering speciﬁc metadata
- add context dependent information for
enabling automation in tools
Potential users - community of content producers, owners
of large amounts of data, data managers,
ontology engineers
- Software development model design-
ers, and developers of human societies
datasets

Evaluation (2)
Availability -https://w3id.org/*
-http://aligned-project.eu
-https://github.com/
aligned-h2020/ALIGNED_
Ontologies
Sustainability - Long term sustainability has been as-
sured by TCD and the ontology engineers
involved in the design

Evaluation (3)
Design and technical
quality
- Designed in accordance to ontology en-
gineering principles
- Axiomatisations based on the compe-
tency questions identiﬁed during require-
ments scoping from potential exploiting
application
Documentation - The ALIGNED public deliverables and
publications
- Self documentation
- HTML documentation via the LODE ser-
vice
- Graphicall illustrations

Conclusions
Combining data and software engineering processes to
increase productivity and agility, is a challenge.
The proposed ALIGNED suite of ontologies provides
semantic models of design intents, domain speciﬁc
datasets, software engineering processes, quality
heuristics and error handling mechanisms.
The ALIGNED suite contributes immensely towards
enabling interoperability and alleviating some of the
complexities involved.
We have exempliﬁed the usage of the suite on a real-world
use case from the legal domain and evaluated it against
the desired criteria.

Enabling combined Software and Data engineering at Web-scale

Recommandé

Recommandé

Contenu connexe

Tendances

Tendances (20)

En vedette

En vedette (8)

Similaire à Enabling combined Software and Data engineering at Web-scale

Similaire à Enabling combined Software and Data engineering at Web-scale (20)

Plus de Monika Solanki

Plus de Monika Solanki (14)

Dernier

Dernier (20)

Enabling combined Software and Data engineering at Web-scale