Argentina’s Senate Expenses:    Opening Public Data    and Data Journalism
Argentina´s Senate Site (www.senado.gov.ar) – SenateExpenses           4           1           2           3
www.senado.gov.ar                           Site DescriptionThe identified links are:1. Procurement Tenders (1320 PDF’s)  ...
2) Processing Data - PDF’s Password Protected - Password Removal    Files are PDF´s generated from paper scanned documents...
3) Transforming Data - Run OCR  33.000 TXT documents
3) Transforming Data - OCR issues“Noisy” or unevenly scaned documents produce unpredictable results….
4) Processing Data I:          Insert 33.000 TXT files in Excel worksheet, identifying entities, (persons and Companies),a...
5) Identifying Patterns and Entities                                                        What                          ...
5) Identifying Patterns and Entities   Security Agents expenses :                                                         ...
6) Processing Data II :         Detecting dates interval, destination, number of security agents, and ammount of money{
Journalistic Case : Show Service Company - Direct Purchases
1) Getting Data                  Application to download                  + 33.000 Documents !!!
Senate’sPresident Decree
Senate Administration Department E.g
Senate Accountant Department E.g.
Senate Expensed Structured     Dataset in Excel
Sunday Print edition  and Infography
Sunday Print Editon infography
TABLEAU: filters per amount & destiny
IMPACT: VP takes to TV a stack of        decrees in print
IMPACT: Judge reopens investigation         on VP’s expenses
Interactive Gantt with overlapped or   inexesistent trips reimboursed
Print Edition
Senate Expenses TAG gathersstories origitated in this database
Senate expensesslideshare
Prochain SlideShare
Chargement dans... 5
×

Senate expensesslideshare

7,608

Published on

Published in: Technologies
0 commentaires
1 mention J'aime
Statistiques
Remarques
  • Soyez le premier à commenter

Aucun téléchargement
Vues
Total des vues
7,608
Sur Slideshare
0
À partir des ajouts
0
Nombre d'ajouts
11
Actions
Partages
0
Téléchargements
12
Commentaires
0
J'aime
1
Ajouts 0
No embeds

No notes for slide

Senate expensesslideshare

  1. 1. Argentina’s Senate Expenses: Opening Public Data and Data Journalism
  2. 2. Argentina´s Senate Site (www.senado.gov.ar) – SenateExpenses 4 1 2 3
  3. 3. www.senado.gov.ar Site DescriptionThe identified links are:1. Procurement Tenders (1320 PDF’s) TOTAL : 33.6572. Administrative decisions (14.205 PDF’s) PDF’s3. Accounting decisions (6.817 PDF’s)4. Presidential Decrees (11.315 PDF’s) Feb 8, 2013
  4. 4. 2) Processing Data - PDF’s Password Protected - Password Removal Files are PDF´s generated from paper scanned documents…. But….. Password Protected PDF’s (against copy and printing). So, before executing OCR process, we need to remove the Password Protection.
  5. 5. 3) Transforming Data - Run OCR  33.000 TXT documents
  6. 6. 3) Transforming Data - OCR issues“Noisy” or unevenly scaned documents produce unpredictable results….
  7. 7. 4) Processing Data I: Insert 33.000 TXT files in Excel worksheet, identifying entities, (persons and Companies),amounts (money or bodyguards) and customizable Keywords)  Analyze applying Filtering
  8. 8. 5) Identifying Patterns and Entities What WhoTravel Expenses requested by the President of the Senate (Vicepresident ofArgentina), Mr. Amado Boudou, for 4 Security Agents for his trip to the UnitedStates of America from 10/04/2012 to 10/05/2012.$ 154.864,90 (~USD 35.000) When Where How much
  9. 9. 5) Identifying Patterns and Entities Security Agents expenses : 15 Santa Fe Agents 6/18/2012- 6/21/2012 $49,737 OCR mistakes
  10. 10. 6) Processing Data II : Detecting dates interval, destination, number of security agents, and ammount of money{
  11. 11. Journalistic Case : Show Service Company - Direct Purchases
  12. 12. 1) Getting Data Application to download + 33.000 Documents !!!
  13. 13. Senate’sPresident Decree
  14. 14. Senate Administration Department E.g
  15. 15. Senate Accountant Department E.g.
  16. 16. Senate Expensed Structured Dataset in Excel
  17. 17. Sunday Print edition and Infography
  18. 18. Sunday Print Editon infography
  19. 19. TABLEAU: filters per amount & destiny
  20. 20. IMPACT: VP takes to TV a stack of decrees in print
  21. 21. IMPACT: Judge reopens investigation on VP’s expenses
  22. 22. Interactive Gantt with overlapped or inexesistent trips reimboursed
  23. 23. Print Edition
  24. 24. Senate Expenses TAG gathersstories origitated in this database
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×