Contenu connexe
Similaire à Ffctn hackons la-corruption
Similaire à Ffctn hackons la-corruption (7)
Plus de montrealouvert (20)
Ffctn hackons la-corruption
- 1. ETUDE DE CAS
VISUALISER DES
DONNÉES OUVERTES
Sébastien Pierre, FFunction inc.
@Hackons la Corruption., Novembre 2012
www.ffctn.com
© FFUNCTION INC, 2011 ffunction
inc.
- 6. SOME THINGS HAVEN'T CHANGED SINCE 2008
➔
SCRAPING DATA
in the absence of open-data, journalists will
often be in the same context, having to spend
time to collect, explore and assess the quality of
the data.
© FFUNCTION INC, 2011 ffunction
inc.
- 7. SOME THINGS HAVEN'T CHANGED SINCE 2008
➔
FROM DATA TO STORY
Each dataset is a discovery, getting a
(compelling) story out of it is still a major
challenge.
© FFUNCTION INC, 2011 ffunction
inc.
- 9. As the result of a federal government directive*,
Travel and Hospitality Expenses have been
published on the web in Canada since 2004
* Called “proactive disclosure”
© FFUNCTION INC, 2011 ffunction
inc.
- 11. Data is (still) not
directly accessible,
and hosted on each
specific ministry
website, in a
specific format.
© FFUNCTION INC, 2011 ffunction
inc.
- 14. 22Mb SQL file
scraped by citizens
(available on Github)
© FFUNCTION INC, 2011 ffunction
inc.
- 15. A DATASET WHICH TURNS OUT TO BE A BIT OPAQUE...
© FFUNCTION INC, 2011 ffunction
inc.
- 16. BUILDING A TOOL TO EXPLORE THE DATA
© FFUNCTION INC, 2011 ffunction
inc.
- 21. Mapping out the different types of expenses (travel, hospitality & guidelines)
© FFUNCTION INC, 2011 ffunction
inc.
- 23. Changing the focus (under/over guidelines instead of total spending)
© FFUNCTION INC, 2011 ffunction
inc.
- 24. Adding guides to improve reading the information
© FFUNCTION INC, 2011 ffunction
inc.
- 25. Adding filtering to narrow down to subsets of the data
© FFUNCTION INC, 2011 ffunction
inc.
- 27. Trying even more alternative representations on the data
© FFUNCTION INC, 2011 ffunction
inc.
- 31. I just found out the 5 top spending
Federal depts, check it out at
http://ur1.ca/a3spt
© FFUNCTION INC, 2011 ffunction
inc.
- 34. FINDINGS
1
© FFUNCTION INC, 2011 ffunction
inc.
- 35. Cumulative spending
TRENDS ONLY BECOME APPARENT
WITH THE PROPER MODE OF REPRESENTATION
Monthly spending
© FFUNCTION INC, 2011 ffunction
inc.
- 36. PROBLEMS IN THE DATA QUALITY
BECOME VISIBLE
© FFUNCTION INC, 2011 ffunction
inc.
- 37. THINGS YOU WOULD EXPECT
ARE NOT NECESSARILY THERE
Spending of ministers for all departments
© FFUNCTION INC, 2011 ffunction
inc.
- 38. DATA TO STORY: CHALLENGES
➔
NON-OPEN DATA
– Missing or incomplete data: is the problem in the
scraper or in the actual data?
– At least you now have a tool to assess (and improve)
the data quality
© FFUNCTION INC, 2011 ffunction
inc.
- 39. DATA TO STORY: CHALLENGES
➔
NOT WHAT I THOUGHT
– You might expect something about the data,
but the visualization might prove your wrong
– You might have been looking for something specific
but you cannot see it in the visualization
See my “30 min of data visualization”
workshop for more on this...
© FFUNCTION INC, 2011 ffunction
inc.
- 40. DATA TO STORY: CHALLENGES
➔
DID I TRY HARD ENOUGH?
– There's no secret: you'll find something interesting if
you explore your data enough.
– If everything fails, you can at least get fun facts or
controversial examples out of it.
© FFUNCTION INC, 2011 ffunction
inc.
- 43. WAR IS COSTING CANADA AN ARM AND A LEG!
3 MILLIONS!
(over a period of five years)
© FFUNCTION INC, 2011 ffunction
inc.
- 44. THE BEST STORY IS:
WE NEED OPEN DATA!
THIS IS NOT AN ACCEPTABLE PROACTIVE DISCLOSURE!
© FFUNCTION INC, 2011 ffunction
inc.
- 45. TOOLS
1
© FFUNCTION INC, 2011 ffunction
inc.
- 46. GOOGLE REFINE https://github.com/OpenRefine
© FFUNCTION INC, 2011 ffunction
inc.
- 47. DATA WRANGLER http://vis.stanford.edu/wrangler/
© FFUNCTION INC, 2011 ffunction
inc.
- 48. DATA WRAPPER http://datawrapper.de/
© FFUNCTION INC, 2011 ffunction
inc.
- 49. MANY EYES http://www-958.ibm.com/software/data/cognos/manyeyes/
© FFUNCTION INC, 2011 ffunction
inc.
- 50. R17 http://www.rseventeen.com/
© FFUNCTION INC, 2011 ffunction
inc.
- 51. THANK
YOU!
sebastien@ffctn.com / @ffunction
WWW.FFCTN.COM
© FFUNCTION INC, 2011 ffunction
inc.