Apidays New York 2024 - The value of a flexible API Management solution for O...
ckan 2.0 Introduction (20140618 updated)
1. CKAN 2 Introduction
Presenter: 李承錱 Cheng-Jen Lee (Sol)
Email: cjlee AT iis.sinica.edu.tw
This work is licensed under a
Creative Commons Attribution-ShareAlike 3.0 Taiwan License.
2. Agenda
● About CKAN
● Feature Tour
– Publish & Find Datasets
– Store & Manage Data
– Engage with Users & Others
– Customise & Extend
● CKAN and 5 ★ Open Data
● Showcase
● Issues
2014/6/18 2
3. Agenda
● About CKAN
● Feature Tour
– Publish & Find Datasets
– Store & Manage Data
– Engage with Users & Others
– Customise & Extend
● CKAN and 5 ★ Open Data
● Showcase
● Issues
2014/6/18 3
4. About CKAN
● The Comprehensive Knowledge Archive
Network
● A powerful data management system
● Publishing
● Sharing
● Finding
● Using Data
2014/6/18 4
5. About CKAN
83 instances
around the world
in May 2014
2014/6/18 5
17. Feature Tour (3)
Engage with Users & Others
Organization
2014/6/18 17
18. Feature Tour (3)
Engage with Users & Others
Manage Users of
an Organization
2014/6/18 18
19. Feature Tour (3)
Engage with Users & Others
Manage Role of Members
Admin (管理者): edit datasets & members
Editor (編輯): edit datasets
Viewer (成員): view (private) datasets
Note: Public datasets are visible to everyone
2014/6/18 19
20. Feature Tour (3)
Engage with Users & Others
Harvest and Federation
2014/6/18 20
21. Feature Tour (3)
Engage with Users & Others
History
2014/6/18 21
22. Feature Tour (4)
Customise & Extend
● RESTful JSON APIs
– The Action API
– The DataStore API
– The FileStore API...
● Extensions (over 60)
– ckanext-harvest
– ckanext-spatial
Open source is good!
● Themable
● Integrates with other CMS (ex. Drupal)
2014/6/18 22
24. CKAN and 5 ★ Open Data
● ★ Make your stuff available on the Web (whatever
format) under an open license
2014/6/18 24
25. CKAN and 5 ★ Open Data
● ★★ Make it available as structured data (e.g.,
Excel instead of image scan of a table)
★★★ Use non-proprietary formats (e.g., CSV
instead of Excel)
– Accept any data format
– Beautiful data demonstration
– Datastore : Indexing for structured data
2014/6/18 25
26. CKAN and 5 ★ Open Data
● ★★★★ Use URIs to denote things, so that people
can point at your stuff
– Permanent link for each dataset
– Get Dataset URI through API
● ★★★★★ Link your data to other data to provide
context
– Linked data and RDF for metadata
2014/6/18 26
27. CKAN and 5 ★ Open Data
● RDF for metadata
– DCAT and Dublin Core
– curl -L -H "Accept:application/rdf+xml"
http://thedatahub.org/dataset/gold-prices
2014/6/18 27
28. Agenda
● About CKAN
● Feature Tour
– Publish & Find Datasets
– Store & Manage Data
– Engage with Users & Others
– Customise & Extend
● CKAN and 5 ★ Open Data
● Showcase
● Issues
2014/6/18 28
41. Issues (Cont'd)
● What You Should Know
– Python & Pylons
– ckan plugins toolkit
– SQLAlchemy & SQL
– HTML, JavaScript
– Babel (Translation)
– Web Server (UNIX, Apache, Nginx ...)
2014/6/18 41
42. Resources
● Official Documents:
– http://docs.ckan.org/en/latest/
● Installation Notes (in Chinese):
– https://ckan-docs-tw.readthedocs.org/
● CKAN Development Discussions:
– http://lists.okfn.org/mailman/listinfo/ckan-dev
● CKAN Taiwan Interest Group:
– https://groups.google.com/forum/#!forum/ckan-taiwan-interest-group
2014/6/18 42
43. Thanks for your attention!
Any Q?
Email: u10313335 AT citi.sinica.edu.tw
http://about.me/sollee
2014/6/18 43
44. CKAN 2: Additional
Topics
Presenter: 李承錱 Cheng-Jen Lee (Sol)
Email: u10313335 AT citi.sinica.edu.tw
This work is licensed under a
Creative Commons Attribution-ShareAlike 3.0 Taiwan License.
57. Harvesters
Custom harvester
● Implement the harvester interface
to perform harvesting operations
● Three stages
● gather: get the identification
● fetch: fetch the contents
● import: create ckan package (dataset)
2014/6/18 57
58. Harvesters
The harvesting interface
from base import HarvesterBase
class SRDAHarvester(HarvesterBase):
def _set_config(self,config_str):
def info(self):
...
def gather_stage(self, harvest_job):
def fetch_stage(self, harvest_object):
def import_stage(self, harvest_object):
See the extension site for details
An example (SRDA): http://goo.gl/ZMnND7
2014/6/18 58
Notes de l'éditeur
地理資訊圖資雲服務平台
由 Open Knowledge Foundation 支持
由 Open Knowledge Foundation 支持
公布網址
Data.gov.uk 即是 drupal+CKAN
Store the raw data and metadata. Visualise structured data with interactive tables, graphs and maps.