11. 4
Scrape your data
“Web scraping (web harvesting or web data extraction) is a computer software
technique of extracting information from websites.” (Wikipedia)
http://www-news.iaea.org/
11
14. Process the data
What Analytics, Data mining, Big Data
software you used in the past 12 months for a
real project (not just evaluation) [798 voters]
http://www.kdnuggets.com/
14
15. The software for data analysis
Share of R- or SAS-related posts to Stack
Overflow by week.
http://r4stats.com/articles/popularity/
15
17. Example: ABC News
Interactive map of gas wells and leases in Australia
Scraping: Main data coming from
gouvernemental websites
FOI: Data on chemical releases
Variety of reports: Data on salt and water
http://datajournalismhandbook.org/
17
18. Example: ABC News
•
A web developer and designer
•
A lead journalist
•
A part time researcher with expertise in data extraction, excel spread sheets and
data cleaning
•
A part time junior journalist
•
A consultant executive producer
•
A academic consultant with expertise in data mining, graphic visualization and
advanced research skills
•
The services of a project manager and the administrative assistance of the ABC’s
multi-platform unit
•
Importantly we also had a reference group of journalists and others whom we
consulted on a needs basis
http://datajournalismhandbook.org/
18