SlideShare une entreprise Scribd logo
1  sur  34
Open, Convert, Use
The Citadel Open Data ecosystem
What is Citadel?
• Citadel is a project co-funded by the EC
–
–
–
–
–

To create a common European open data ecosystem
To allow apps to be used in different cities
To make it easy to open up data (for cities)
To make it easy to use this data (for citizens and developers )
Not only through standards, but through easy and usable tools as well

Open

Convert

Use
Open

• Many governments are opening up data
• Citadel focuses on cities
– Strong links with local community
– But often lack in ICT budgets or know how (small cities)
– Strong demand for Open Data!!
Benefits
• Inform
– Allergies?
– Make it visible which trees will need to be cut soon
– Remarkable trees

• Engage citizens to identify risks, diseases
• Crowd-source the information in a timely manner
• Fun
What took us so long?
•
•
•
•

We don’t check each tree every week
We don’t want to provide data that is inaccurate
We don’t have the exact geo-location for every tree.
We don’t know what the best format is to do so
CSV
The Swiss army knife of open data
•
•
•
•
•
•

simple
common
non-proprietary
easy to export (from Ecxel)
readable
…
CSV
CSV doesn’t always cut it
• Different delimiters (tabs, semicolons, commas)
– “F. Mercury; musician” ≠ “F. Mercury”; “Musician”

•
•
•
•

Encoding hell (Greek characters?)
Different line endings on different operating systems
Often has markup, subtitles, etc…
No semantics (which column names are used in France?)
JRC Forest Map 2000. Source: EC-JRC – FRC Unit (earthzine.org)
Open

Convert

Use
Platform concept
• Open
– Anyone can do it: publishing Excel files is a good
start

• Convert
– Converter tools transform and publish CSV/Excel
files (the majority of datasets) as “live” JSON files

• Use
– The App Generator Tool allows you to immediately
use selected datasets
ODC architecture
Converter development
• Version 1: on-line PHP
– Test concept with partners and cities
– Quick & dirty, but very simple to understand

• Version 2: off-line Java
– More complex semantic functions
– More stable development, possible batch use

• Version 3: on-line Java
– Anytime, anywhere
Demo

Converter

Data Days 2014, Ghent, 18 Feb 2014
Interaction with Cities
• Enthusiastic reaction (we got something right)
– 16 datasets converted over winter holidays

• Empowering civil servants as co-designers
– Experimenting with prototypes, betas

• Motivating for data quality
– Seeing the process end-to-end
Ecosystem development
• Converter enhancements
– Adaptations to convert other datasets

• New templates
– New templates can be developed for different
data structures (eg socio-economic data)

• Dataset enhancements
– “Rich” datasets (eg containing links in text fields)
can link to external functionalities (ie reservations)
Next Steps
• Mobile access
– Integration with AGT for on-the-fly conversions

• Support on-going day-to-day use
– Save semantic mappings for re-use
– Support batch processing
– Integrate with AGT dataset listings

• Continue co-design with pilots
Open

Convert

Use
Citadel lifecycle

Open

Convert

Data Days 2014, Ghent, 18 Feb 2014

Use
Data (re-)use
• Thousands of datasets are published every day
– by public and private sources
– in different formats
– in many different domains

• Is there any value in publishing them?
• Is it worth the effort/cost?
• How are they used?

Data Days 2014, Ghent, 18 Feb 2014
Citadel approach
• Make it easy to publish data
• Make it easy for people to use data
• Quick and simple apps
– Increase the citizens’ innovation potential
– Demonstrate the value of the dataset

– Apps that can be used in different cities

Data Days 2014, Ghent, 18 Feb 2014
How this is achieved
• Mobile application templates (for different
types of data)
–
–
–
–
–

Parking
Events in the city
Points of Interest in the city
Crowd-sourcing Information
Environmental Data

• Application Generation Tool
– 4 steps to create an app

• Citadel Hub
– Documentation, resources, discussion forum
Data Days 2014, Ghent, 18 Feb 2014
Citadel Mobile Application Templates
• Common template features:
– HTML5, jQuery mobile, php ( + mysql)
– Datasets in common JSON format
• Environmental uses Xively feeds

– 'Near-me' functionality using HTML5 geo-location feature
– Map and list views
– Category based filtering
• All categories loaded dynamically

– Back end functionality for storage
Data Days 2014, Ghent, 18 Feb 2014
Parking places
• Information about the parking lots in a city
• List of total/available parking places
• List of places for disabled's people vehicles
• Variation: On-Street parking

Data Days 2014, Ghent, 18 Feb 2014
Events in the city
• Different event
categories: festivals,
exhibitions,

presentations, etc.
• Detailed description of
each event: time, place,
fees, transportation,
pictures
• Filter by date
• Add to favorites

Data Days 2014, Ghent, 18 Feb 2014
Points of Interest (PoIs) in the city
• Different categories of
PoIs: museums, hotels,
restaurants, etc.
• Filtering function
• Detailed description of
each PoI
• Voting mechanism
• Add to favorites

Data Days 2014, Ghent, 18 Feb 2014
User-generated PoIs or crowd-sourced
information
• “Add new PoI”
functionality
• Different categories of
user-generated PoIs
• Detailed description of
each user-generated
PoI
• “Add to favourites”

Data Days 2014, Ghent, 18 Feb 2014
Environmental data
• Xively feeds
• Environmental data for
different locations

(simulation of live feeds
for Athens and
Manchester).
• Available sensors shown
on the map
• Detailed page shows
environmental data for
each sensor (including
historical data)
Data Days 2014, Ghent, 18 Feb 2014
Demo

AGT

Data Days 2014, Ghent, 18 Feb 2014
Application Generation Tool
Screenshots 1/2

Data Days 2014, Ghent, 18 Feb 2014
Application Generation Tool
Screenshots 2/2

Data Days 2014, Ghent, 18 Feb 2014
In summary...
• The power of open data lies, not only on publishing,
but on re-using
 Public administrators become aware of what data
is useful or interesting for citizens
 The relationship between City officials and
citizens is strengthened
 The innovation potential of citizens increases in a
very participatory way

Data Days 2014, Ghent, 18 Feb 2014
Thank you!
Open
Convert
Use

Thimo Thoeye (City of Gent)
Jesse Marsh (Alfamicro)
Evangelos Argyzoudis (Intrasoft Intl)

Data Days 2014, Ghent, 18 Feb 2014
Thank you for your attention
Thimo Thoeye (Stad Gent), thimothoeye@gmail.com
Jesse Marsh (Alfamicro), jesse@atelier.it
Leonardo Dal Zovo (Alfamicro), ldalzovo@gmail.com
Evangelos Argyzoudis (Intrasoft), evangelos.argyzoudis@intrasoft-intl.com
Leonidas Kallipolitis, l.kallipolitis@atc.gr

Contenu connexe

Tendances

E&L-presentatie - Linked Data Benchmark Council
E&L-presentatie - Linked Data Benchmark CouncilE&L-presentatie - Linked Data Benchmark Council
E&L-presentatie - Linked Data Benchmark Council
ErfGeo
 

Tendances (12)

HRI presentation smart environmental information seminar - 31Oct2013
HRI presentation smart environmental information seminar - 31Oct2013HRI presentation smart environmental information seminar - 31Oct2013
HRI presentation smart environmental information seminar - 31Oct2013
 
Introduction to OpenStreetMap
Introduction to OpenStreetMapIntroduction to OpenStreetMap
Introduction to OpenStreetMap
 
E&L-presentatie - Linked Data Benchmark Council
E&L-presentatie - Linked Data Benchmark CouncilE&L-presentatie - Linked Data Benchmark Council
E&L-presentatie - Linked Data Benchmark Council
 
What's up, Europeana Newspapers?
What's up, Europeana Newspapers?What's up, Europeana Newspapers?
What's up, Europeana Newspapers?
 
JRC, GHA Live presentation: Maps, GISs and SDIs
JRC, GHA Live presentation: Maps, GISs and SDIsJRC, GHA Live presentation: Maps, GISs and SDIs
JRC, GHA Live presentation: Maps, GISs and SDIs
 
Introduction to OpenStreetMap - UCC YouthMappers
Introduction to OpenStreetMap - UCC YouthMappersIntroduction to OpenStreetMap - UCC YouthMappers
Introduction to OpenStreetMap - UCC YouthMappers
 
Open data hackathon jelgava - report
Open data hackathon   jelgava - reportOpen data hackathon   jelgava - report
Open data hackathon jelgava - report
 
Werner Zanotti - Brixen Tourismus - New web portal brixen.org and integration...
Werner Zanotti - Brixen Tourismus - New web portal brixen.org and integration...Werner Zanotti - Brixen Tourismus - New web portal brixen.org and integration...
Werner Zanotti - Brixen Tourismus - New web portal brixen.org and integration...
 
Unfolding the City
Unfolding the CityUnfolding the City
Unfolding the City
 
2017 iii 3_jiri_polacek_inspire_implementationasalinkbetweenegovernmentandenv...
2017 iii 3_jiri_polacek_inspire_implementationasalinkbetweenegovernmentandenv...2017 iii 3_jiri_polacek_inspire_implementationasalinkbetweenegovernmentandenv...
2017 iii 3_jiri_polacek_inspire_implementationasalinkbetweenegovernmentandenv...
 
Jordi Martí-Henneberg, Luís Espinha da Silveira, Daniel Alves & Josep Puig,To...
Jordi Martí-Henneberg, Luís Espinha da Silveira, Daniel Alves & Josep Puig,To...Jordi Martí-Henneberg, Luís Espinha da Silveira, Daniel Alves & Josep Puig,To...
Jordi Martí-Henneberg, Luís Espinha da Silveira, Daniel Alves & Josep Puig,To...
 
Dublinked Data Visualisation Competition Launch Event - AIRO NUIM Presentation
Dublinked Data Visualisation Competition Launch Event - AIRO NUIM PresentationDublinked Data Visualisation Competition Launch Event - AIRO NUIM Presentation
Dublinked Data Visualisation Competition Launch Event - AIRO NUIM Presentation
 

En vedette (8)

Dynacity Data Challenge
Dynacity Data ChallengeDynacity Data Challenge
Dynacity Data Challenge
 
Citadel
CitadelCitadel
Citadel
 
Flagis Academic Session
Flagis Academic SessionFlagis Academic Session
Flagis Academic Session
 
Linked Open Data @ Stad Gent
Linked Open Data @ Stad GentLinked Open Data @ Stad Gent
Linked Open Data @ Stad Gent
 
Apps 4 dummies shopt IT (V-ICT-OR)
Apps 4 dummies shopt IT (V-ICT-OR)Apps 4 dummies shopt IT (V-ICT-OR)
Apps 4 dummies shopt IT (V-ICT-OR)
 
Open Data in Gent
Open Data in GentOpen Data in Gent
Open Data in Gent
 
Breadcrumbs presentatie
Breadcrumbs presentatieBreadcrumbs presentatie
Breadcrumbs presentatie
 
Open Data
Open DataOpen Data
Open Data
 

Similaire à Citadel technical

Dublinked tech workshop_15_dec2011
Dublinked tech workshop_15_dec2011Dublinked tech workshop_15_dec2011
Dublinked tech workshop_15_dec2011
Dublinked .
 
Data Days: Citadel pilots results
Data Days: Citadel pilots resultsData Days: Citadel pilots results
Data Days: Citadel pilots results
SarahBuelens
 
WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BA...
WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BA...WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BA...
WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BA...
Micah Altman
 
Open data scotland workshop
Open data scotland workshopOpen data scotland workshop
Open data scotland workshop
Katalin Gallyas
 
Open data scotland workshop
Open data scotland workshopOpen data scotland workshop
Open data scotland workshop
Katalin Gallyas
 
Ontology Building vs Data Harvesting and Cleaning for Smart-city Services
Ontology Building vs Data Harvesting and Cleaning for Smart-city ServicesOntology Building vs Data Harvesting and Cleaning for Smart-city Services
Ontology Building vs Data Harvesting and Cleaning for Smart-city Services
Paolo Nesi
 

Similaire à Citadel technical (20)

What can be done with Open Data?
What can be done with Open Data?What can be done with Open Data?
What can be done with Open Data?
 
Ontology Engineering at Scale for Open City Data Sharing
Ontology Engineering at Scale for Open City Data SharingOntology Engineering at Scale for Open City Data Sharing
Ontology Engineering at Scale for Open City Data Sharing
 
Dublinked tech workshop_15_dec2011
Dublinked tech workshop_15_dec2011Dublinked tech workshop_15_dec2011
Dublinked tech workshop_15_dec2011
 
Data Days: Citadel pilots results
Data Days: Citadel pilots resultsData Days: Citadel pilots results
Data Days: Citadel pilots results
 
WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BA...
WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BA...WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BA...
WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BA...
 
A Data Scientist Exploration in the World of Heterogeneous Open Geospatial Data
A Data Scientist Exploration in the World of Heterogeneous Open Geospatial DataA Data Scientist Exploration in the World of Heterogeneous Open Geospatial Data
A Data Scientist Exploration in the World of Heterogeneous Open Geospatial Data
 
Open Source Summit Paris '17 Amsterdam Open Source
Open Source Summit Paris '17 Amsterdam Open SourceOpen Source Summit Paris '17 Amsterdam Open Source
Open Source Summit Paris '17 Amsterdam Open Source
 
Amsterdam developing public code for every city and everyone, Boris Van Hoyte...
Amsterdam developing public code for every city and everyone, Boris Van Hoyte...Amsterdam developing public code for every city and everyone, Boris Van Hoyte...
Amsterdam developing public code for every city and everyone, Boris Van Hoyte...
 
open concept in GIS and open source software for GIS analysis
open concept in GIS and open source software for GIS analysisopen concept in GIS and open source software for GIS analysis
open concept in GIS and open source software for GIS analysis
 
OER World Map Project
OER World Map Project OER World Map Project
OER World Map Project
 
City of Amsterdam: High velocity development
City of Amsterdam: High velocity developmentCity of Amsterdam: High velocity development
City of Amsterdam: High velocity development
 
Linked Statistical Data: does it actually pay off?
Linked Statistical Data: does it actually pay off?Linked Statistical Data: does it actually pay off?
Linked Statistical Data: does it actually pay off?
 
Being open, accessible, and understandable by Jonathan Challener, OECD - #ima...
Being open, accessible, and understandable by Jonathan Challener, OECD - #ima...Being open, accessible, and understandable by Jonathan Challener, OECD - #ima...
Being open, accessible, and understandable by Jonathan Challener, OECD - #ima...
 
CD March 2016 - What is HYPERCAT?
CD March 2016 - What is HYPERCAT?CD March 2016 - What is HYPERCAT?
CD March 2016 - What is HYPERCAT?
 
Open data scotland workshop
Open data scotland workshopOpen data scotland workshop
Open data scotland workshop
 
Open data scotland workshop
Open data scotland workshopOpen data scotland workshop
Open data scotland workshop
 
Ontology Building vs Data Harvesting and Cleaning for Smart-city Services
Ontology Building vs Data Harvesting and Cleaning for Smart-city ServicesOntology Building vs Data Harvesting and Cleaning for Smart-city Services
Ontology Building vs Data Harvesting and Cleaning for Smart-city Services
 
Fostering Connectivity & Interactivity Between all Urban Entities
Fostering Connectivity & Interactivity Between all Urban EntitiesFostering Connectivity & Interactivity Between all Urban Entities
Fostering Connectivity & Interactivity Between all Urban Entities
 
Opening Up: The City of Regina's Open Data Journey
Opening Up: The City of Regina's Open Data JourneyOpening Up: The City of Regina's Open Data Journey
Opening Up: The City of Regina's Open Data Journey
 
From open data to data-driven services
From open data to data-driven servicesFrom open data to data-driven services
From open data to data-driven services
 

Plus de Thimo Thoeye (6)

Linked open data sandwich
Linked open data sandwichLinked open data sandwich
Linked open data sandwich
 
TechBoost 2017
TechBoost 2017TechBoost 2017
TechBoost 2017
 
Stad Gent & OSLO²
Stad Gent & OSLO²Stad Gent & OSLO²
Stad Gent & OSLO²
 
Innovating Cities with Nature (EUROCITIES)
Innovating Cities with Nature (EUROCITIES)Innovating Cities with Nature (EUROCITIES)
Innovating Cities with Nature (EUROCITIES)
 
UDMS 24/04/2015
UDMS 24/04/2015UDMS 24/04/2015
UDMS 24/04/2015
 
De Krook@Stuurgroep GLL
De Krook@Stuurgroep GLLDe Krook@Stuurgroep GLL
De Krook@Stuurgroep GLL
 

Citadel technical

  • 1. Open, Convert, Use The Citadel Open Data ecosystem
  • 2. What is Citadel? • Citadel is a project co-funded by the EC – – – – – To create a common European open data ecosystem To allow apps to be used in different cities To make it easy to open up data (for cities) To make it easy to use this data (for citizens and developers ) Not only through standards, but through easy and usable tools as well Open Convert Use
  • 3. Open • Many governments are opening up data • Citadel focuses on cities – Strong links with local community – But often lack in ICT budgets or know how (small cities) – Strong demand for Open Data!!
  • 4.
  • 5. Benefits • Inform – Allergies? – Make it visible which trees will need to be cut soon – Remarkable trees • Engage citizens to identify risks, diseases • Crowd-source the information in a timely manner • Fun
  • 6. What took us so long? • • • • We don’t check each tree every week We don’t want to provide data that is inaccurate We don’t have the exact geo-location for every tree. We don’t know what the best format is to do so
  • 7. CSV The Swiss army knife of open data • • • • • • simple common non-proprietary easy to export (from Ecxel) readable …
  • 8. CSV CSV doesn’t always cut it • Different delimiters (tabs, semicolons, commas) – “F. Mercury; musician” ≠ “F. Mercury”; “Musician” • • • • Encoding hell (Greek characters?) Different line endings on different operating systems Often has markup, subtitles, etc… No semantics (which column names are used in France?)
  • 9. JRC Forest Map 2000. Source: EC-JRC – FRC Unit (earthzine.org)
  • 11. Platform concept • Open – Anyone can do it: publishing Excel files is a good start • Convert – Converter tools transform and publish CSV/Excel files (the majority of datasets) as “live” JSON files • Use – The App Generator Tool allows you to immediately use selected datasets
  • 13. Converter development • Version 1: on-line PHP – Test concept with partners and cities – Quick & dirty, but very simple to understand • Version 2: off-line Java – More complex semantic functions – More stable development, possible batch use • Version 3: on-line Java – Anytime, anywhere
  • 14. Demo Converter Data Days 2014, Ghent, 18 Feb 2014
  • 15. Interaction with Cities • Enthusiastic reaction (we got something right) – 16 datasets converted over winter holidays • Empowering civil servants as co-designers – Experimenting with prototypes, betas • Motivating for data quality – Seeing the process end-to-end
  • 16. Ecosystem development • Converter enhancements – Adaptations to convert other datasets • New templates – New templates can be developed for different data structures (eg socio-economic data) • Dataset enhancements – “Rich” datasets (eg containing links in text fields) can link to external functionalities (ie reservations)
  • 17. Next Steps • Mobile access – Integration with AGT for on-the-fly conversions • Support on-going day-to-day use – Save semantic mappings for re-use – Support batch processing – Integrate with AGT dataset listings • Continue co-design with pilots
  • 19. Citadel lifecycle Open Convert Data Days 2014, Ghent, 18 Feb 2014 Use
  • 20. Data (re-)use • Thousands of datasets are published every day – by public and private sources – in different formats – in many different domains • Is there any value in publishing them? • Is it worth the effort/cost? • How are they used? Data Days 2014, Ghent, 18 Feb 2014
  • 21. Citadel approach • Make it easy to publish data • Make it easy for people to use data • Quick and simple apps – Increase the citizens’ innovation potential – Demonstrate the value of the dataset – Apps that can be used in different cities Data Days 2014, Ghent, 18 Feb 2014
  • 22. How this is achieved • Mobile application templates (for different types of data) – – – – – Parking Events in the city Points of Interest in the city Crowd-sourcing Information Environmental Data • Application Generation Tool – 4 steps to create an app • Citadel Hub – Documentation, resources, discussion forum Data Days 2014, Ghent, 18 Feb 2014
  • 23. Citadel Mobile Application Templates • Common template features: – HTML5, jQuery mobile, php ( + mysql) – Datasets in common JSON format • Environmental uses Xively feeds – 'Near-me' functionality using HTML5 geo-location feature – Map and list views – Category based filtering • All categories loaded dynamically – Back end functionality for storage Data Days 2014, Ghent, 18 Feb 2014
  • 24. Parking places • Information about the parking lots in a city • List of total/available parking places • List of places for disabled's people vehicles • Variation: On-Street parking Data Days 2014, Ghent, 18 Feb 2014
  • 25. Events in the city • Different event categories: festivals, exhibitions, presentations, etc. • Detailed description of each event: time, place, fees, transportation, pictures • Filter by date • Add to favorites Data Days 2014, Ghent, 18 Feb 2014
  • 26. Points of Interest (PoIs) in the city • Different categories of PoIs: museums, hotels, restaurants, etc. • Filtering function • Detailed description of each PoI • Voting mechanism • Add to favorites Data Days 2014, Ghent, 18 Feb 2014
  • 27. User-generated PoIs or crowd-sourced information • “Add new PoI” functionality • Different categories of user-generated PoIs • Detailed description of each user-generated PoI • “Add to favourites” Data Days 2014, Ghent, 18 Feb 2014
  • 28. Environmental data • Xively feeds • Environmental data for different locations (simulation of live feeds for Athens and Manchester). • Available sensors shown on the map • Detailed page shows environmental data for each sensor (including historical data) Data Days 2014, Ghent, 18 Feb 2014
  • 29. Demo AGT Data Days 2014, Ghent, 18 Feb 2014
  • 30. Application Generation Tool Screenshots 1/2 Data Days 2014, Ghent, 18 Feb 2014
  • 31. Application Generation Tool Screenshots 2/2 Data Days 2014, Ghent, 18 Feb 2014
  • 32. In summary... • The power of open data lies, not only on publishing, but on re-using  Public administrators become aware of what data is useful or interesting for citizens  The relationship between City officials and citizens is strengthened  The innovation potential of citizens increases in a very participatory way Data Days 2014, Ghent, 18 Feb 2014
  • 33. Thank you! Open Convert Use Thimo Thoeye (City of Gent) Jesse Marsh (Alfamicro) Evangelos Argyzoudis (Intrasoft Intl) Data Days 2014, Ghent, 18 Feb 2014
  • 34. Thank you for your attention Thimo Thoeye (Stad Gent), thimothoeye@gmail.com Jesse Marsh (Alfamicro), jesse@atelier.it Leonardo Dal Zovo (Alfamicro), ldalzovo@gmail.com Evangelos Argyzoudis (Intrasoft), evangelos.argyzoudis@intrasoft-intl.com Leonidas Kallipolitis, l.kallipolitis@atc.gr

Notes de l'éditeur

  1. In the case of Citadel we deal with public sources: municipalities which are either well-established in the open data field (e.g. Ghent or Manchester) but also cities which are in their infancy, in terms of open data.A common problem they have is that they don’t know how the data they publish are being used.How is the value of a dataset determined?By how hard it is to publish it?By how hard it is to keep it updated?How useful is it?