SlideShare a Scribd company logo
1 of 17
Download to read offline
AI for Social Good
through benchmarking
at scale
Laure Delisle
PAI - 26 Sep 2019
We are doing great!
10 years ago...
CIFAR-10 - Alex Krizhevsky. Learning Multiple Layers of Features from Tiny Images. 2009.
We are doing great!
SOTA - Papers with Code
We are doing great!
SOTA - Papers with Code
EfficientNet - Tan et al. EfficientNet: Improving Accuracy and Efficiency through AutoML and Model Scaling. ICML 2019
BenchmarkingPerformance
Prolific AI research
State Of The Art
SOTA - Papers with Code
We can do even better
Underserved datasets for real world impact
Underserved datasets
Cassava leaves dataset - Ramcharan et al. Deep Learning for Image-Based Cassava Disease Detection. Frontiers in Plant Science 2017.
Ethiopian datasets - Knoema. Illustration: Ethiopian anthem in Ahmaric
Somali audio transcription dataset - Shaqodoon. 2019
Missing link
State Of The Art Underserved datasets
?
Missing link
State Of The Art Underserved datasets
Incentives
Some initiatives…
AI for Social Good - Neurips / ICLR workshops.
Google AI impact Challenge - AI for Social Good
Funding
Gathering research
Pro-bono research
and partnerships
Exploiting the system
In 2018, the number of conference paper
submissions has increased
by 47% for ICML, by 50% for NeurIPS,
and by almost 100% for ICLR.
D. Sculley, Jasper Snoek and Alex Wiltschko. Avoiding a Tragedy of the Commons in the Peer Review Process. Critiquing and
Correcting Trends in Machine Learning, NeurIPS 2018 Workshop.
AI papers submitted
NeurIPS - D. Sculley, Jasper Snoek and Alex Wiltschko. Avoiding a Tragedy of the Commons in the Peer Review Process.
Critiquing and Correcting Trends in Machine Learning, NeurIPS 2018 Workshop.
ICML - Peltarion. https://peltarion.com/article/icml-2018-an-ai-party-in-our-own-backyard
ICLR - @iclr_conf. Tweet on Sep 25 2019.
NeurIPS
ICLR
ICML
Checking boxes
Checklist illustration - Trello
NeurIPS checklist - @blaine_bateman. Tweet on May 9 2019.
ImpactSet
#ImpactSet
...
Gather the datasets
ImpactSet | %
Incentivize Generate impact

More Related Content

Similar to Impact Set

The Future of Agile is Diversity
The Future of Agile is DiversityThe Future of Agile is Diversity
The Future of Agile is Diversity
Karina Kohl
 

Similar to Impact Set (20)

There's no such thing as Artificial Intelligence
There's no such thing as Artificial IntelligenceThere's no such thing as Artificial Intelligence
There's no such thing as Artificial Intelligence
 
Enlisting the Use of Educated Volunteers at a Distance -- or, why Crowdsourci...
Enlisting the Use of Educated Volunteers at a Distance -- or, why Crowdsourci...Enlisting the Use of Educated Volunteers at a Distance -- or, why Crowdsourci...
Enlisting the Use of Educated Volunteers at a Distance -- or, why Crowdsourci...
 
IC-SDV 2019: Neural Networks today - Mihai Lupu (Research Studio Data Science...
IC-SDV 2019: Neural Networks today - Mihai Lupu (Research Studio Data Science...IC-SDV 2019: Neural Networks today - Mihai Lupu (Research Studio Data Science...
IC-SDV 2019: Neural Networks today - Mihai Lupu (Research Studio Data Science...
 
ARTIFICIAL INTELLIGENCE
ARTIFICIAL INTELLIGENCEARTIFICIAL INTELLIGENCE
ARTIFICIAL INTELLIGENCE
 
Smart Networks: Blockchain, Deep Learning, and Quantum Computing
Smart Networks: Blockchain, Deep Learning, and Quantum ComputingSmart Networks: Blockchain, Deep Learning, and Quantum Computing
Smart Networks: Blockchain, Deep Learning, and Quantum Computing
 
Filip Maertens - AI, Machine Learning and Chatbots: Think AI-first
Filip Maertens - AI, Machine Learning and Chatbots: Think AI-first Filip Maertens - AI, Machine Learning and Chatbots: Think AI-first
Filip Maertens - AI, Machine Learning and Chatbots: Think AI-first
 
9/1 Top 5 Deep Learning
9/1 Top 5 Deep Learning9/1 Top 5 Deep Learning
9/1 Top 5 Deep Learning
 
Music in the Archives
Music in the ArchivesMusic in the Archives
Music in the Archives
 
Deep Learning Explained: The future of Artificial Intelligence and Smart Netw...
Deep Learning Explained: The future of Artificial Intelligence and Smart Netw...Deep Learning Explained: The future of Artificial Intelligence and Smart Netw...
Deep Learning Explained: The future of Artificial Intelligence and Smart Netw...
 
Ypo 20190131 v1
Ypo 20190131 v1 Ypo 20190131 v1
Ypo 20190131 v1
 
Artificial Intelligence and Machine Learning
Artificial Intelligence and Machine LearningArtificial Intelligence and Machine Learning
Artificial Intelligence and Machine Learning
 
The Future of Agile is Diversity
The Future of Agile is DiversityThe Future of Agile is Diversity
The Future of Agile is Diversity
 
IoT - Internet of Things
IoT - Internet of ThingsIoT - Internet of Things
IoT - Internet of Things
 
Introduction to the Artificial Intelligence and Computer Vision revolution
Introduction to the Artificial Intelligence and Computer Vision revolutionIntroduction to the Artificial Intelligence and Computer Vision revolution
Introduction to the Artificial Intelligence and Computer Vision revolution
 
State of AI Report 2023 - Air Street Capital
State of AI Report 2023 - Air Street CapitalState of AI Report 2023 - Air Street Capital
State of AI Report 2023 - Air Street Capital
 
Artificial Intelligence in Space Science Industry
Artificial Intelligence in Space Science Industry Artificial Intelligence in Space Science Industry
Artificial Intelligence in Space Science Industry
 
frog POV: Now That Data is Everything
frog POV: Now That Data is Everythingfrog POV: Now That Data is Everything
frog POV: Now That Data is Everything
 
"Methods for Understanding How Deep Neural Networks Work," a Presentation fro...
"Methods for Understanding How Deep Neural Networks Work," a Presentation fro..."Methods for Understanding How Deep Neural Networks Work," a Presentation fro...
"Methods for Understanding How Deep Neural Networks Work," a Presentation fro...
 
Chatting with Computers
Chatting with ComputersChatting with Computers
Chatting with Computers
 
Introduction and e research time line review
Introduction and e research time line reviewIntroduction and e research time line review
Introduction and e research time line review
 

Recently uploaded

Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdfPests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
PirithiRaju
 
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptxSCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
RizalinePalanog2
 
Biopesticide (2).pptx .This slides helps to know the different types of biop...
Biopesticide (2).pptx  .This slides helps to know the different types of biop...Biopesticide (2).pptx  .This slides helps to know the different types of biop...
Biopesticide (2).pptx .This slides helps to know the different types of biop...
RohitNehra6
 
Seismic Method Estimate velocity from seismic data.pptx
Seismic Method Estimate velocity from seismic  data.pptxSeismic Method Estimate velocity from seismic  data.pptx
Seismic Method Estimate velocity from seismic data.pptx
AlMamun560346
 
Presentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxPresentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptx
gindu3009
 
Formation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disksFormation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disks
Sérgio Sacani
 
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdfPests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
PirithiRaju
 

Recently uploaded (20)

Green chemistry and Sustainable development.pptx
Green chemistry  and Sustainable development.pptxGreen chemistry  and Sustainable development.pptx
Green chemistry and Sustainable development.pptx
 
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdfPests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
 
GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)
 
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
 
Animal Communication- Auditory and Visual.pptx
Animal Communication- Auditory and Visual.pptxAnimal Communication- Auditory and Visual.pptx
Animal Communication- Auditory and Visual.pptx
 
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptxSCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
 
Forensic Biology & Its biological significance.pdf
Forensic Biology & Its biological significance.pdfForensic Biology & Its biological significance.pdf
Forensic Biology & Its biological significance.pdf
 
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
 
VIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C PVIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C P
 
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
 
Biopesticide (2).pptx .This slides helps to know the different types of biop...
Biopesticide (2).pptx  .This slides helps to know the different types of biop...Biopesticide (2).pptx  .This slides helps to know the different types of biop...
Biopesticide (2).pptx .This slides helps to know the different types of biop...
 
Nanoparticles synthesis and characterization​ ​
Nanoparticles synthesis and characterization​  ​Nanoparticles synthesis and characterization​  ​
Nanoparticles synthesis and characterization​ ​
 
Seismic Method Estimate velocity from seismic data.pptx
Seismic Method Estimate velocity from seismic  data.pptxSeismic Method Estimate velocity from seismic  data.pptx
Seismic Method Estimate velocity from seismic data.pptx
 
GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)
 
Zoology 4th semester series (krishna).pdf
Zoology 4th semester series (krishna).pdfZoology 4th semester series (krishna).pdf
Zoology 4th semester series (krishna).pdf
 
Presentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxPresentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptx
 
Formation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disksFormation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disks
 
CELL -Structural and Functional unit of life.pdf
CELL -Structural and Functional unit of life.pdfCELL -Structural and Functional unit of life.pdf
CELL -Structural and Functional unit of life.pdf
 
Botany krishna series 2nd semester Only Mcq type questions
Botany krishna series 2nd semester Only Mcq type questionsBotany krishna series 2nd semester Only Mcq type questions
Botany krishna series 2nd semester Only Mcq type questions
 
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdfPests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
 

Impact Set

  • 1. AI for Social Good through benchmarking at scale Laure Delisle PAI - 26 Sep 2019
  • 2. We are doing great!
  • 3. 10 years ago... CIFAR-10 - Alex Krizhevsky. Learning Multiple Layers of Features from Tiny Images. 2009.
  • 4. We are doing great! SOTA - Papers with Code
  • 5. We are doing great! SOTA - Papers with Code EfficientNet - Tan et al. EfficientNet: Improving Accuracy and Efficiency through AutoML and Model Scaling. ICML 2019 BenchmarkingPerformance
  • 6. Prolific AI research State Of The Art SOTA - Papers with Code
  • 7. We can do even better
  • 8. Underserved datasets for real world impact Underserved datasets Cassava leaves dataset - Ramcharan et al. Deep Learning for Image-Based Cassava Disease Detection. Frontiers in Plant Science 2017. Ethiopian datasets - Knoema. Illustration: Ethiopian anthem in Ahmaric Somali audio transcription dataset - Shaqodoon. 2019
  • 9. Missing link State Of The Art Underserved datasets ?
  • 10. Missing link State Of The Art Underserved datasets Incentives
  • 11. Some initiatives… AI for Social Good - Neurips / ICLR workshops. Google AI impact Challenge - AI for Social Good Funding Gathering research Pro-bono research and partnerships
  • 13. In 2018, the number of conference paper submissions has increased by 47% for ICML, by 50% for NeurIPS, and by almost 100% for ICLR. D. Sculley, Jasper Snoek and Alex Wiltschko. Avoiding a Tragedy of the Commons in the Peer Review Process. Critiquing and Correcting Trends in Machine Learning, NeurIPS 2018 Workshop.
  • 14. AI papers submitted NeurIPS - D. Sculley, Jasper Snoek and Alex Wiltschko. Avoiding a Tragedy of the Commons in the Peer Review Process. Critiquing and Correcting Trends in Machine Learning, NeurIPS 2018 Workshop. ICML - Peltarion. https://peltarion.com/article/icml-2018-an-ai-party-in-our-own-backyard ICLR - @iclr_conf. Tweet on Sep 25 2019. NeurIPS ICLR ICML
  • 15. Checking boxes Checklist illustration - Trello NeurIPS checklist - @blaine_bateman. Tweet on May 9 2019.
  • 17. #ImpactSet ... Gather the datasets ImpactSet | % Incentivize Generate impact