Presentation by Florain Marienfeld on Open Government Data Standardisation Workshop of Informatik 2013, Koblenz

1. Fraunhofer FOKUS
Florian.Marienfeld@fokus.fraunhofer.de
Auftraggeber:
GovData.de
Status and Perspective of Open Data in Germany
Florian Marienfeld | 17. September, 2013 | Workshop on Open Gov Data Standardisation
© Fraunhofer FOKUS, 2013

2. Fraunhofer FOKUS
Florian.Marienfeld@fokus.fraunhofer.de
Open Government Data
Government Data
 Motives
– Transparency
– Innovation
– Participation
– Efficiency
 Core Elements
– Machine-readable data
– Licenses
– Accessibility
Open Government Data Venn Diagram
by justgrimes

3. Fraunhofer FOKUS
Florian.Marienfeld@fokus.fraunhofer.de
 Only suitable formats allow for re-use in apps.
 Range: from PDF to RDF
 „Suitability“ depends strongly on context, e.g. XLS OK most of the times.
 Serious developing starts at CSV.
Open Data core elements
Machine Readability
.sql
.xml
.doc .csv
.xls.pdf .json
.rdf

4. Fraunhofer FOKUS
Florian.Marienfeld@fokus.fraunhofer.de
Open Data Core Elements
Free Licences
 What rights are guaranteed? Re-distribution, (commercial) re-use, derivatives
 Range: from Copyright to Creative-Commons-Zero
 „Suitability“ depends some what on the context.
 CC-BY is most often a fair compromise.
© DL-DE

5. Fraunhofer FOKUS
Florian.Marienfeld@fokus.fraunhofer.de 5
Auftraggeber:
GovData
Zeitplan
2012 2013 2014 2015
Pilot
operation
Operation
Study BMI->
Fraunhofer FOKUS
et al.
Develop
Prototype
FOKUS

6. Fraunhofer FOKUS
Florian.Marienfeld@fokus.fraunhofer.de
GovData-Portal for Germany
• https://www.govdata.de
Launched 19. Febr. 2013
• Prototyped at Fraunhofer
FOKUS
• Datasets of the
Federation, States and
Counties;
Statistics, Environment and
Geodata
• Includes Documents and
applications
• Focus on free licenses
(DL-DE, CC-BY, etc.)

7. Fraunhofer FOKUS
Florian.Marienfeld@fokus.fraunhofer.de 7
Auftraggeber:
GovData
Status Prototype
Requirements
• Metadata  search and find
• Online-Resources  direct link
• license  enable re-use
• (Author  Point of Contact)
Figures 16. September 2013
• 3808 Datasets
• 230 Documents
• 15 Apps

8. Fraunhofer FOKUS
Florian.Marienfeld@fokus.fraunhofer.de 8
Auftraggeber:
Architecture
GovData.de
Portal
Information Pool
(Web Portal + CMS)
User Interface
for the Data Catalog
Indexer + Thesaurus
Katalog
CSW/CKAN Harvester
REST
Interface
Browser
Apps
Web Sites of
Public Authorities
Subject Catalogs
(Geo Data, etc.)
Open Data Catalogs
(Berlin, Bavaria, Bremen, etc.)
REST
Interface

9. Fraunhofer FOKUS
Florian.Marienfeld@fokus.fraunhofer.de 9
Auftraggeber:
GovData.de
Harvesting
• CKAN -> CKAN
• JSON -> CKAN
• ISO19115 -> CKAN
• CKAN-API
?
DeStatis (David Liuzzo)
Schnittstellen:
• ISO19115/XML
• CKAN/JSON

10. Fraunhofer FOKUS
Florian.Marienfeld@fokus.fraunhofer.de
Sample Metadata
Field Value
Name Abfallerzeuger-abfallmengen-12312
Title Abfallerzeuger, Abfallmengen (gefährliche Abfälle):
Bundesländer, Jahre
Author Statistisches Bundesamt
License ID CC-BY
Resource URL https://www-
genesis.destatis.de/gis/wmsByteStream?GenMLURL=https
%3A//www-
genesis.destatis.de/genesis/online/link/tabelleDownload/32
151-0003.xml
Tags Hessen, Berlin, Visualisierung, Abfall
Spatial Coordinates: [[15.02, 47.16], [15.02, 47.16]]
Original Portal www-genesis.destatis.de

11. Fraunhofer FOKUS
Florian.Marienfeld@fokus.fraunhofer.de
GovData
Metadata-Structure
• Design Principles
– CKAN based – JSON Schema
– Minimal amount of fields
– Link to original metadata catalog
• Continuously developed, current
version at
https://github.com/fraunhoferfokus/o
gd-metadata
• Harmonizing efforts within Germany
and internationally, esp. AT und EU
DCAT AP

12. Fraunhofer FOKUS
Florian.Marienfeld@fokus.fraunhofer.de 12
Auftraggeber:
Cooperation
across administrative levels
• Initiative by the Work Group Open Government (incl.
Federation, states, counties)
• Datenlizenz Deutschland: accepted by community and administration
• Workshops for Data providers
• Metadata structure sees uptak und and get refined
• Inspiration specific domains, e.g. WG Metadata of German Geodata
Infrastructure (GDI DE – in charge of INSPIRE)

13. Fraunhofer FOKUS
Florian.Marienfeld@fokus.fraunhofer.de 13
Auftraggeber:
GovData.de
Next Steps
• Open more data
• Catalog more Open Data, connect more providers
• Improve metadata quality, harmonize
• Integrate federal geo and environmental data
• Harvesting as a network rather than hierarchical.

14. Fraunhofer FOKUS
Florian.Marienfeld@fokus.fraunhofer.de 14
Auftraggeber:
Metadata quality
Automatic Approach
• Part of the Continuous Integration process
• Weekly „Link checking“
• False negatives due to timeouts, rate limiting etc.
• Issues have to be solve decentrally.
• Continuous Validation
• Can identify bugs, but
• Validity is just an indicator for quality
So, ...

15. Fraunhofer FOKUS
Florian.Marienfeld@fokus.fraunhofer.de 15
Auftraggeber:
(Metadata) Quality
Participatory Approach
• Comments on den datasets
• https://github.com/fraunhoferfokus/GovData

16. Fraunhofer FOKUS
Florian.Marienfeld@fokus.fraunhofer.de 16
Auftraggeber:
Metadata Transfer
Hierarchical Strategy
Bund
Land1
Kommune1 Kommune2
Land2
Kommune3 Kommune1

17. Fraunhofer FOKUS
Florian.Marienfeld@fokus.fraunhofer.de 17
Auftraggeber:
Metadata Transfer
What really happens
GDI DE
GDI Land1
GDI
Kommune1
GDI
Kommune2
GDI Land2
GDI
Kommune3
GDI
Kommune1
GovData.de
Daten.berlin.de Daten.hamburg.de Daten.bremen.de Daten.bayern.de
PortalU
Xx Yy
StaBA
... ...

18. Fraunhofer FOKUS
Florian.Marienfeld@fokus.fraunhofer.de 18
Auftraggeber:
Metadata Transfer
Vision: Transfer Messages in a Network
Data.eu
Govdata
.de
GDI
Daten.b
ayern.d
e
Offene-
daten.d
e
Netzdat
en-
berlin.d
e

19. Fraunhofer FOKUS
Florian.Marienfeld@fokus.fraunhofer.de
Kontakt
Florian Marienfeld
Telefon + 49 30 – 3463 – 7241
Florian.Marienfeld@fokus.fraunhofer.de
Open Data Team:
Ina Schieferdecker ina.schieferdecker@fokus.fraunhofer.de
Jens Klessmann jens.klessmann@fokus.fraunhofer.de
http://open-data.fokus.fraunhofer.de
Fraunhofer Institut FOKUS
Kaiserin-Augusta-Allee 31 | 10589 Berlin