SlideShare une entreprise Scribd logo
1  sur  14
Télécharger pour lire hors ligne
CROWD SOURCING 102
                          Real-Time Data Mining and Curation with SwiftRiver



                                  Personal Democracy Forum 2011
                                           jg@swiftly.org
                                        @jongos @swiftriver




Tuesday, June 7, 2011
About Ushahidi                       Notable Uses                             The Challenge
    Ushahidi is a free, open-source      Ushahidi has been deployed in            As the amounts of data
    platform used for crowdsourcing      major global crisis scenarios,           aggregated by Ushahidi users
    and visualizing data geospatially.   allowing organizations to draw           grows, they face a common
    It was born out of the 2008          situational awareness from the           problem. How do they effectively
    election unrest when founders        crowd.      To date it’s been            manage this realtime data? How
    Juliana Rotish, Erik Hersman, Ory    downloaded over 15,000 times.            can we help them discover
    Okolloh and David Kobia wanted                                                credible and actionable info from
    to allow Kenyan citizens a way to    S o m e o f t h e m o re n o t a b l e   the deluge of reports they’ll get
    SMS reports of incident to know      deployments include recently in          from the public? The SwiftRiver
    what was occurring around them.      Egypt, the Haiti earthquakes, the        initiative was created to begin to
    This was one of the earliest uses    fires in Russia, the Queensland           answer some of these questions
    of crowdsourcing for crisis          floods in Australia.                      for Ushahidi deployers.
    response.

Tuesday, June 7, 2011
“It’s not information overload. It’s filter failure.”
                                                                - Clay Shirky




Tuesday, June 7, 2011
PLATFORM GOALS
                  Consider the context, relevance defined by the user

                  Offer an opt-in global database of trust and authority

                  Algorithms augment, but not define, human decision making

                  Work across media channels (Twitter, Email, Feeds, SMS)

                  Be accessible (offline/online/mobile)

                  Index massive amounts of the mobile/social web


Tuesday, June 7, 2011
THIS IS A DATA PROBLEM




Tuesday, June 7, 2011
DATA IS AGNOSTIC




Tuesday, June 7, 2011
STRATEGY


                  Operate more like a startup than activists

                  Test humanitarian solutions in a business context

                  Journalists, Private Sector, NGOs & Government Agencies

                  Build internal engineering capacity




Tuesday, June 7, 2011
PROGRESS

                  7,000+ downloads in 6 months

                  7,000+ API Users

                  100,000+ Lines of code

                  5 APIs and 2 Apps

                  Data Items Processed - 70,000,000 (liberal extrapolation)



Tuesday, June 7, 2011
Tuesday, June 7, 2011
Tuesday, June 7, 2011
Tuesday, June 7, 2011
ABC Australia Deployment

Tuesday, June 7, 2011
Sweeper - User Interface

Tuesday, June 7, 2011
CROWD SOURCING 102
                          Real-Time Data Mining and Curation with SwiftRiver



                              jg@swiftly.org
                            @jongos @swiftriver


Tuesday, June 7, 2011

Contenu connexe

Similaire à Crowdsourcing 102: Mining Real-Time Data

Ben Goertzel - Singularity Summit Australia talk in 2011
Ben Goertzel - Singularity Summit Australia talk in 2011Ben Goertzel - Singularity Summit Australia talk in 2011
Ben Goertzel - Singularity Summit Australia talk in 2011
Adam Ford
 
Guidance for Incorporating Big Data into Humanitarian Operations - 2015 - web...
Guidance for Incorporating Big Data into Humanitarian Operations - 2015 - web...Guidance for Incorporating Big Data into Humanitarian Operations - 2015 - web...
Guidance for Incorporating Big Data into Humanitarian Operations - 2015 - web...
Katie Whipkey
 
John_Smart_Amplify11
John_Smart_Amplify11John_Smart_Amplify11
John_Smart_Amplify11
AmplifyFest
 

Similaire à Crowdsourcing 102: Mining Real-Time Data (20)

Ben Goertzel - Singularity Summit Australia talk in 2011
Ben Goertzel - Singularity Summit Australia talk in 2011Ben Goertzel - Singularity Summit Australia talk in 2011
Ben Goertzel - Singularity Summit Australia talk in 2011
 
Scraping the Social Graph with Ushahidi and SwiftRiver
Scraping the Social Graph with Ushahidi and SwiftRiverScraping the Social Graph with Ushahidi and SwiftRiver
Scraping the Social Graph with Ushahidi and SwiftRiver
 
Big data, democratized analytics and deep context,
Big data, democratized analytics and deep context, Big data, democratized analytics and deep context,
Big data, democratized analytics and deep context,
 
Big Data, Democratized Analytics and International Development
Big Data, Democratized Analytics and International Development Big Data, Democratized Analytics and International Development
Big Data, Democratized Analytics and International Development
 
Ushahidi esri juliana
Ushahidi esri julianaUshahidi esri juliana
Ushahidi esri juliana
 
Global pulse technology
Global pulse technologyGlobal pulse technology
Global pulse technology
 
Global pulse technology summary
Global pulse technology summaryGlobal pulse technology summary
Global pulse technology summary
 
Data Science For Social Good: Tackling the Challenge of Homelessness
Data Science For Social Good: Tackling the Challenge of HomelessnessData Science For Social Good: Tackling the Challenge of Homelessness
Data Science For Social Good: Tackling the Challenge of Homelessness
 
ICCM 2013 Panel 1: What's so Big about Big Data?
ICCM 2013 Panel 1: What's so Big about Big Data?ICCM 2013 Panel 1: What's so Big about Big Data?
ICCM 2013 Panel 1: What's so Big about Big Data?
 
Privacy, Security and Motivation of Crowds
Privacy, Security and Motivation of CrowdsPrivacy, Security and Motivation of Crowds
Privacy, Security and Motivation of Crowds
 
Foresight Analytics
Foresight AnalyticsForesight Analytics
Foresight Analytics
 
Guidance for Incorporating Big Data into Humanitarian Operations - 2015 - web...
Guidance for Incorporating Big Data into Humanitarian Operations - 2015 - web...Guidance for Incorporating Big Data into Humanitarian Operations - 2015 - web...
Guidance for Incorporating Big Data into Humanitarian Operations - 2015 - web...
 
US Office of Personnel Management: Notes on "Big Data"
US Office of Personnel Management: Notes on  "Big Data" US Office of Personnel Management: Notes on  "Big Data"
US Office of Personnel Management: Notes on "Big Data"
 
Open Data Movement around the Globe
Open Data Movement around the GlobeOpen Data Movement around the Globe
Open Data Movement around the Globe
 
ITP / SED Day 2
ITP / SED Day 2ITP / SED Day 2
ITP / SED Day 2
 
Ushahidi 101 (old)
Ushahidi 101 (old)Ushahidi 101 (old)
Ushahidi 101 (old)
 
Ushahidi: mobile crisis reporting
Ushahidi: mobile crisis reportingUshahidi: mobile crisis reporting
Ushahidi: mobile crisis reporting
 
Edyra
EdyraEdyra
Edyra
 
John_Smart_Amplify11
John_Smart_Amplify11John_Smart_Amplify11
John_Smart_Amplify11
 
The Evolution of Open Data
The Evolution of Open DataThe Evolution of Open Data
The Evolution of Open Data
 

Plus de Ushahidi

Pivoting An African Open Source Project
Pivoting An African Open Source ProjectPivoting An African Open Source Project
Pivoting An African Open Source Project
Ushahidi
 

Plus de Ushahidi (20)

Data Science for Social Good and Ushahidi - Final Presentation
Data Science for Social Good and Ushahidi - Final PresentationData Science for Social Good and Ushahidi - Final Presentation
Data Science for Social Good and Ushahidi - Final Presentation
 
Corruption mapping (april 2013, part 2)
Corruption mapping (april 2013, part 2)Corruption mapping (april 2013, part 2)
Corruption mapping (april 2013, part 2)
 
Anti-Corruption Mapping (April 2013, part 1)
Anti-Corruption Mapping (April 2013, part 1)Anti-Corruption Mapping (April 2013, part 1)
Anti-Corruption Mapping (April 2013, part 1)
 
Ushahdi 3.0 Design Framework
Ushahdi 3.0 Design Framework Ushahdi 3.0 Design Framework
Ushahdi 3.0 Design Framework
 
Around the Globe Corruption Mapping (part 2)
Around the Globe Corruption Mapping (part 2)Around the Globe Corruption Mapping (part 2)
Around the Globe Corruption Mapping (part 2)
 
Around the Globe Corruption Mapping (part 1)
Around the Globe Corruption Mapping (part 1)Around the Globe Corruption Mapping (part 1)
Around the Globe Corruption Mapping (part 1)
 
Ushahidi Toolbox - Real-time Evaluation
Ushahidi Toolbox - Real-time EvaluationUshahidi Toolbox - Real-time Evaluation
Ushahidi Toolbox - Real-time Evaluation
 
Ushahidi Toolbox - Implementation
Ushahidi Toolbox - ImplementationUshahidi Toolbox - Implementation
Ushahidi Toolbox - Implementation
 
Ushahidi Toolbox - Assessment
Ushahidi Toolbox - AssessmentUshahidi Toolbox - Assessment
Ushahidi Toolbox - Assessment
 
Kenya Ushahidi Evaluation: Unsung Peace Heros/Building Bridges
Kenya Ushahidi Evaluation: Unsung Peace Heros/Building BridgesKenya Ushahidi Evaluation: Unsung Peace Heros/Building Bridges
Kenya Ushahidi Evaluation: Unsung Peace Heros/Building Bridges
 
Kenya Ushahidi Evaluation: Uchaguzi
Kenya Ushahidi Evaluation: UchaguziKenya Ushahidi Evaluation: Uchaguzi
Kenya Ushahidi Evaluation: Uchaguzi
 
Kenya Ushahidi Evaluation: Blog Series
Kenya Ushahidi Evaluation: Blog SeriesKenya Ushahidi Evaluation: Blog Series
Kenya Ushahidi Evaluation: Blog Series
 
Pivoting An African Open Source Project
Pivoting An African Open Source ProjectPivoting An African Open Source Project
Pivoting An African Open Source Project
 
Ushahidi personas scenarios
Ushahidi personas scenariosUshahidi personas scenarios
Ushahidi personas scenarios
 
Citizen pollution mapping made easy
Citizen pollution mapping made easy Citizen pollution mapping made easy
Citizen pollution mapping made easy
 
Testimony
TestimonyTestimony
Testimony
 
Map it, Change it
Map it, Change itMap it, Change it
Map it, Change it
 
Map it, Make it, Hack it
Map it, Make it, Hack itMap it, Make it, Hack it
Map it, Make it, Hack it
 
What if Citizens Mapped Health?
What if Citizens Mapped Health?What if Citizens Mapped Health?
What if Citizens Mapped Health?
 
Re-imagining Citizen Engagement
Re-imagining Citizen EngagementRe-imagining Citizen Engagement
Re-imagining Citizen Engagement
 

Dernier

Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Dernier (20)

Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 

Crowdsourcing 102: Mining Real-Time Data

  • 1. CROWD SOURCING 102 Real-Time Data Mining and Curation with SwiftRiver Personal Democracy Forum 2011 jg@swiftly.org @jongos @swiftriver Tuesday, June 7, 2011
  • 2. About Ushahidi Notable Uses The Challenge Ushahidi is a free, open-source Ushahidi has been deployed in As the amounts of data platform used for crowdsourcing major global crisis scenarios, aggregated by Ushahidi users and visualizing data geospatially. allowing organizations to draw grows, they face a common It was born out of the 2008 situational awareness from the problem. How do they effectively election unrest when founders crowd. To date it’s been manage this realtime data? How Juliana Rotish, Erik Hersman, Ory downloaded over 15,000 times. can we help them discover Okolloh and David Kobia wanted credible and actionable info from to allow Kenyan citizens a way to S o m e o f t h e m o re n o t a b l e the deluge of reports they’ll get SMS reports of incident to know deployments include recently in from the public? The SwiftRiver what was occurring around them. Egypt, the Haiti earthquakes, the initiative was created to begin to This was one of the earliest uses fires in Russia, the Queensland answer some of these questions of crowdsourcing for crisis floods in Australia. for Ushahidi deployers. response. Tuesday, June 7, 2011
  • 3. “It’s not information overload. It’s filter failure.” - Clay Shirky Tuesday, June 7, 2011
  • 4. PLATFORM GOALS Consider the context, relevance defined by the user Offer an opt-in global database of trust and authority Algorithms augment, but not define, human decision making Work across media channels (Twitter, Email, Feeds, SMS) Be accessible (offline/online/mobile) Index massive amounts of the mobile/social web Tuesday, June 7, 2011
  • 5. THIS IS A DATA PROBLEM Tuesday, June 7, 2011
  • 7. STRATEGY Operate more like a startup than activists Test humanitarian solutions in a business context Journalists, Private Sector, NGOs & Government Agencies Build internal engineering capacity Tuesday, June 7, 2011
  • 8. PROGRESS 7,000+ downloads in 6 months 7,000+ API Users 100,000+ Lines of code 5 APIs and 2 Apps Data Items Processed - 70,000,000 (liberal extrapolation) Tuesday, June 7, 2011
  • 13. Sweeper - User Interface Tuesday, June 7, 2011
  • 14. CROWD SOURCING 102 Real-Time Data Mining and Curation with SwiftRiver jg@swiftly.org @jongos @swiftriver Tuesday, June 7, 2011