SlideShare une entreprise Scribd logo
1  sur  27
Ivan Oransky, MD
Co-Founder, Retraction Watch
Distinguished Writer In Residence, NYU (Journalism)
Vice President, Editorial, Medscape
@ivanoransky
@retractionwatch
Does Science Self-Correct?
What We’ve Learned at Retraction Watch
REWARD | EQUATOR Conference 2020
Berlin
February 21, 2020
Ripped From The Headlines
Not Ripped From NEJM
Why We Launched Retraction Watch
August 3, 2010
The Retraction Watch Database
retractiondatabase.org
Leveling Off?
Science, October 26, 2018
Common Reasons for Retractions
• Duplication (“self-plagiarism”)
• Plagiarism
• Image Manipulation
• Faked Data
• Fake Peer Reviews
• Publisher Error
• Authorship Issues
• Legal Reasons
• Not Reproducible
Why Are Papers Retracted?
Science, October 26, 2018
Why Does It Take So Long?
‘Slow, Opaque and Inconsistent’
“After 1 year, journals had communicated decisions for 16/36 (44%)
publications. None of the decision letters specifically addressed each of
the concerns raised. Decisions were no action, correction and retraction
for 9, 3 and 4 publications, respectively: the amounts of duplicate data
reporting and data/reporting discrepancies were similar irrespective of
journal decision…Journal responses to concerns about duplicate
publication, authorship transgressions, and data/reporting discrepancies
were slow, opaque and inconsistent.”
Are We Catching Them All?
Allison et al Nature 2016 http://www.nature.com/news/reproducibility-a-tragedy-of-errors-1.19264
Are We Catching Them All?
“Overall, 3.8% of published papers contained
problematic figures, with at least half exhibiting
features suggestive of deliberate manipulation. The
prevalence of papers with problematic images has
risen markedly during the past decade.”
Who Retracts Most?
What Happens to Retracted Papers’
Citations?
“One other phenomenon should be mentioned; there were 64
instances of self‐citation. The vast majority of the
self‐citations did not make mention of the fact that the cited
article had been retracted.”
Do Journals Get the Word Out?
Journal of Librarianship and Scholarly Communication,
January 8, 2018
Do Journals Get the Word Out?
Of the 812 records for retracted
publications, 40.0% (n=325) did not
indicate that the paper had been
retracted.
Journal of Librarianship and Scholarly Communication,
January 8, 2018
Want Free Retraction Alerts?
Post-Publication Peer Review On The Rise
The Role of The Sleuths
Nick Brown and James Heathers
Elisabeth Bik
Whistleblowers to Watch
The Buck Stops…
• With journals?
• With publishers?
• With COPE?
• With universities?
• With government agencies?
The Buck Stops…
• With journals?
• With publishers?
• With COPE?
• With universities?
• With government agencies?
With lawyers.
A “Major Retraction Engine”
Signs of Change
Signs of Change
Contact Info/Acknowledgements
ivan@retractionwatch.com
http://retractionwatch.com
@retractionwatch
Thanks:
The MacArthur Foundation
The Arnold Foundation
The Helmsley Trust
HHMI
Individual donors

Contenu connexe

Similaire à Does Science Self-Correct?

Chan aaas open_access_knowledgeisolation
Chan aaas open_access_knowledgeisolationChan aaas open_access_knowledgeisolation
Chan aaas open_access_knowledgeisolation
CRDF Global
 
Where do you get your information fromTo answer everyday questi.docx
Where do you get your information fromTo answer everyday questi.docxWhere do you get your information fromTo answer everyday questi.docx
Where do you get your information fromTo answer everyday questi.docx
cooperapleh
 

Similaire à Does Science Self-Correct? (20)

WCRI 2019: What makes a story a story?
WCRI 2019: What makes a story a story?WCRI 2019: What makes a story a story?
WCRI 2019: What makes a story a story?
 
Why We Should Be Talking About Reproducibility -- But Not Forget About Fraud
Why We Should Be Talking About Reproducibility -- But Not Forget About FraudWhy We Should Be Talking About Reproducibility -- But Not Forget About Fraud
Why We Should Be Talking About Reproducibility -- But Not Forget About Fraud
 
The problems of post retraction citation - and mitigation strategies that wor...
The problems of post retraction citation - and mitigation strategies that wor...The problems of post retraction citation - and mitigation strategies that wor...
The problems of post retraction citation - and mitigation strategies that wor...
 
Fake Peer Review: What We've Learned at Retraction Watch
Fake Peer Review: What We've Learned at Retraction WatchFake Peer Review: What We've Learned at Retraction Watch
Fake Peer Review: What We've Learned at Retraction Watch
 
Scientific Fraud, Retractions, and the Future of Scientific Publishing
Scientific Fraud, Retractions, and the Future of Scientific PublishingScientific Fraud, Retractions, and the Future of Scientific Publishing
Scientific Fraud, Retractions, and the Future of Scientific Publishing
 
The Retraction Watch Database
The Retraction Watch DatabaseThe Retraction Watch Database
The Retraction Watch Database
 
Predatory Journals
Predatory JournalsPredatory Journals
Predatory Journals
 
Chan aaas open_access_knowledgeisolation
Chan aaas open_access_knowledgeisolationChan aaas open_access_knowledgeisolation
Chan aaas open_access_knowledgeisolation
 
Rethinking Metrics of International Growth and Impact of Open Access
Rethinking Metrics of International Growth and Impact of Open Access Rethinking Metrics of International Growth and Impact of Open Access
Rethinking Metrics of International Growth and Impact of Open Access
 
Fixing Scholarly Publishing (Cologne 6.4.2018)
Fixing Scholarly Publishing (Cologne 6.4.2018)Fixing Scholarly Publishing (Cologne 6.4.2018)
Fixing Scholarly Publishing (Cologne 6.4.2018)
 
Science in the context of journals, Open, and the future
Science in the context of journals, Open, and the futureScience in the context of journals, Open, and the future
Science in the context of journals, Open, and the future
 
Problem-citations--CrossrefLive18--2018-11-13
Problem-citations--CrossrefLive18--2018-11-13Problem-citations--CrossrefLive18--2018-11-13
Problem-citations--CrossrefLive18--2018-11-13
 
Using web of science for Research 2016.01.25
Using web of science for Research 2016.01.25Using web of science for Research 2016.01.25
Using web of science for Research 2016.01.25
 
Joakim Nivre - 2017 - Presidential Address ACL 2017: Challenges for ACL
Joakim Nivre - 2017 - Presidential Address ACL 2017: Challenges for ACLJoakim Nivre - 2017 - Presidential Address ACL 2017: Challenges for ACL
Joakim Nivre - 2017 - Presidential Address ACL 2017: Challenges for ACL
 
Altmetrics in practice: our experience
Altmetrics in practice: our experienceAltmetrics in practice: our experience
Altmetrics in practice: our experience
 
Where do you get your information fromTo answer everyday questi.docx
Where do you get your information fromTo answer everyday questi.docxWhere do you get your information fromTo answer everyday questi.docx
Where do you get your information fromTo answer everyday questi.docx
 
Legal scholarship and OA publishing: developing radical pathways to free, op...
 Legal scholarship and OA publishing: developing radical pathways to free, op... Legal scholarship and OA publishing: developing radical pathways to free, op...
Legal scholarship and OA publishing: developing radical pathways to free, op...
 
Vinay BHU PPT_Predatory Journals.ppt
Vinay BHU PPT_Predatory Journals.pptVinay BHU PPT_Predatory Journals.ppt
Vinay BHU PPT_Predatory Journals.ppt
 
Predatory Journals.ppt
Predatory Journals.pptPredatory Journals.ppt
Predatory Journals.ppt
 
Rutgers
RutgersRutgers
Rutgers
 

Plus de Ivan Oransky

Fnlm june 10 2013 final
Fnlm june 10 2013 finalFnlm june 10 2013 final
Fnlm june 10 2013 final
Ivan Oransky
 

Plus de Ivan Oransky (20)

The relationship between PubPeer comments and the speed of retraction
The relationship between PubPeer comments and the speed of retractionThe relationship between PubPeer comments and the speed of retraction
The relationship between PubPeer comments and the speed of retraction
 
During COVID-19, Are Preprints The Problem?
During COVID-19, Are Preprints The Problem?During COVID-19, Are Preprints The Problem?
During COVID-19, Are Preprints The Problem?
 
APRIN talk, Tokyo, March 2018
APRIN talk, Tokyo, March 2018APRIN talk, Tokyo, March 2018
APRIN talk, Tokyo, March 2018
 
FNLM Carlisle talk
FNLM Carlisle talkFNLM Carlisle talk
FNLM Carlisle talk
 
How Often Are Studies Wrong?
How Often Are Studies Wrong?How Often Are Studies Wrong?
How Often Are Studies Wrong?
 
How Journalists Can Effectively -- And Safely -- Report on Scientific Fraud
How Journalists Can Effectively -- And Safely -- Report on Scientific FraudHow Journalists Can Effectively -- And Safely -- Report on Scientific Fraud
How Journalists Can Effectively -- And Safely -- Report on Scientific Fraud
 
How to pitch reporters without being annoying
How to pitch reporters without being annoyingHow to pitch reporters without being annoying
How to pitch reporters without being annoying
 
Reviewers (And Editors) Behaving Badly
Reviewers (And Editors) Behaving BadlyReviewers (And Editors) Behaving Badly
Reviewers (And Editors) Behaving Badly
 
Does Stem Cell Research Have A Retraction Problem?
Does Stem Cell Research Have A Retraction Problem?Does Stem Cell Research Have A Retraction Problem?
Does Stem Cell Research Have A Retraction Problem?
 
Coverage of Clinical Medicine: A Diagnosis and Treatment Plan
Coverage of Clinical Medicine: A Diagnosis and Treatment PlanCoverage of Clinical Medicine: A Diagnosis and Treatment Plan
Coverage of Clinical Medicine: A Diagnosis and Treatment Plan
 
Shoot The Messenger? Challenges in Medical Journalism
Shoot The Messenger? Challenges in Medical JournalismShoot The Messenger? Challenges in Medical Journalism
Shoot The Messenger? Challenges in Medical Journalism
 
Debunking Made Easy, AHCJ 2014
Debunking Made Easy, AHCJ 2014Debunking Made Easy, AHCJ 2014
Debunking Made Easy, AHCJ 2014
 
Retractions, Peer Review, and Transparency
Retractions, Peer Review, and TransparencyRetractions, Peer Review, and Transparency
Retractions, Peer Review, and Transparency
 
Post-Publication Peer Review in Science: Reflections on Retractions and Med...
Post-Publication Peer Review in Science: Reflections on Retractions and Med...Post-Publication Peer Review in Science: Reflections on Retractions and Med...
Post-Publication Peer Review in Science: Reflections on Retractions and Med...
 
New Media, Traditional Media: How are messages getting through in today’s eco...
New Media, Traditional Media: How are messages getting through in today’s eco...New Media, Traditional Media: How are messages getting through in today’s eco...
New Media, Traditional Media: How are messages getting through in today’s eco...
 
Covering Medical Studies: Tips and Tricks (my NABJ presentation)
Covering Medical Studies: Tips and Tricks (my NABJ presentation)Covering Medical Studies: Tips and Tricks (my NABJ presentation)
Covering Medical Studies: Tips and Tricks (my NABJ presentation)
 
Can We Still Trust Science?
Can We Still Trust Science?Can We Still Trust Science?
Can We Still Trust Science?
 
Fnlm june 10 2013 final
Fnlm june 10 2013 finalFnlm june 10 2013 final
Fnlm june 10 2013 final
 
Can You Trust What You Read In (Scientific and News)papers?
Can You Trust What You Read In (Scientific and News)papers?Can You Trust What You Read In (Scientific and News)papers?
Can You Trust What You Read In (Scientific and News)papers?
 
We Are All Gatekeepers Now: Scrutiny of Science Goes Public
We Are All Gatekeepers Now: Scrutiny of Science Goes PublicWe Are All Gatekeepers Now: Scrutiny of Science Goes Public
We Are All Gatekeepers Now: Scrutiny of Science Goes Public
 

Dernier

Conjugation, transduction and transformation
Conjugation, transduction and transformationConjugation, transduction and transformation
Conjugation, transduction and transformation
Areesha Ahmad
 
Pests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdf
PirithiRaju
 
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsBiogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Sérgio Sacani
 
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptxSCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
RizalinePalanog2
 
Presentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxPresentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptx
gindu3009
 

Dernier (20)

Forensic Biology & Its biological significance.pdf
Forensic Biology & Its biological significance.pdfForensic Biology & Its biological significance.pdf
Forensic Biology & Its biological significance.pdf
 
FAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
FAIRSpectra - Enabling the FAIRification of Spectroscopy and SpectrometryFAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
FAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
 
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43bNightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
 
9999266834 Call Girls In Noida Sector 22 (Delhi) Call Girl Service
9999266834 Call Girls In Noida Sector 22 (Delhi) Call Girl Service9999266834 Call Girls In Noida Sector 22 (Delhi) Call Girl Service
9999266834 Call Girls In Noida Sector 22 (Delhi) Call Girl Service
 
module for grade 9 for distance learning
module for grade 9 for distance learningmodule for grade 9 for distance learning
module for grade 9 for distance learning
 
Justdial Call Girls In Indirapuram, Ghaziabad, 8800357707 Escorts Service
Justdial Call Girls In Indirapuram, Ghaziabad, 8800357707 Escorts ServiceJustdial Call Girls In Indirapuram, Ghaziabad, 8800357707 Escorts Service
Justdial Call Girls In Indirapuram, Ghaziabad, 8800357707 Escorts Service
 
Conjugation, transduction and transformation
Conjugation, transduction and transformationConjugation, transduction and transformation
Conjugation, transduction and transformation
 
Botany 4th semester file By Sumit Kumar yadav.pdf
Botany 4th semester file By Sumit Kumar yadav.pdfBotany 4th semester file By Sumit Kumar yadav.pdf
Botany 4th semester file By Sumit Kumar yadav.pdf
 
GBSN - Microbiology (Unit 3)
GBSN - Microbiology (Unit 3)GBSN - Microbiology (Unit 3)
GBSN - Microbiology (Unit 3)
 
Chemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdfChemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdf
 
Pests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdf
 
GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)
 
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsBiogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
 
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptxSCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
 
Connaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verified
Connaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verifiedConnaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verified
Connaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verified
 
Presentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxPresentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptx
 
Kochi ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Kochi ESCORT SERVICE❤CALL GIRL
Kochi ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Kochi ESCORT SERVICE❤CALL GIRLKochi ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Kochi ESCORT SERVICE❤CALL GIRL
Kochi ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Kochi ESCORT SERVICE❤CALL GIRL
 
Factory Acceptance Test( FAT).pptx .
Factory Acceptance Test( FAT).pptx       .Factory Acceptance Test( FAT).pptx       .
Factory Acceptance Test( FAT).pptx .
 
Proteomics: types, protein profiling steps etc.
Proteomics: types, protein profiling steps etc.Proteomics: types, protein profiling steps etc.
Proteomics: types, protein profiling steps etc.
 
Clean In Place(CIP).pptx .
Clean In Place(CIP).pptx                 .Clean In Place(CIP).pptx                 .
Clean In Place(CIP).pptx .
 

Does Science Self-Correct?

  • 1. Ivan Oransky, MD Co-Founder, Retraction Watch Distinguished Writer In Residence, NYU (Journalism) Vice President, Editorial, Medscape @ivanoransky @retractionwatch Does Science Self-Correct? What We’ve Learned at Retraction Watch REWARD | EQUATOR Conference 2020 Berlin February 21, 2020
  • 2. Ripped From The Headlines
  • 3.
  • 5. Why We Launched Retraction Watch August 3, 2010
  • 6. The Retraction Watch Database retractiondatabase.org
  • 8. Common Reasons for Retractions • Duplication (“self-plagiarism”) • Plagiarism • Image Manipulation • Faked Data • Fake Peer Reviews • Publisher Error • Authorship Issues • Legal Reasons • Not Reproducible
  • 9. Why Are Papers Retracted? Science, October 26, 2018
  • 10. Why Does It Take So Long?
  • 11. ‘Slow, Opaque and Inconsistent’ “After 1 year, journals had communicated decisions for 16/36 (44%) publications. None of the decision letters specifically addressed each of the concerns raised. Decisions were no action, correction and retraction for 9, 3 and 4 publications, respectively: the amounts of duplicate data reporting and data/reporting discrepancies were similar irrespective of journal decision…Journal responses to concerns about duplicate publication, authorship transgressions, and data/reporting discrepancies were slow, opaque and inconsistent.”
  • 12. Are We Catching Them All? Allison et al Nature 2016 http://www.nature.com/news/reproducibility-a-tragedy-of-errors-1.19264
  • 13. Are We Catching Them All? “Overall, 3.8% of published papers contained problematic figures, with at least half exhibiting features suggestive of deliberate manipulation. The prevalence of papers with problematic images has risen markedly during the past decade.”
  • 15. What Happens to Retracted Papers’ Citations? “One other phenomenon should be mentioned; there were 64 instances of self‐citation. The vast majority of the self‐citations did not make mention of the fact that the cited article had been retracted.”
  • 16. Do Journals Get the Word Out? Journal of Librarianship and Scholarly Communication, January 8, 2018
  • 17. Do Journals Get the Word Out? Of the 812 records for retracted publications, 40.0% (n=325) did not indicate that the paper had been retracted. Journal of Librarianship and Scholarly Communication, January 8, 2018
  • 20. The Role of The Sleuths Nick Brown and James Heathers Elisabeth Bik
  • 22. The Buck Stops… • With journals? • With publishers? • With COPE? • With universities? • With government agencies?
  • 23. The Buck Stops… • With journals? • With publishers? • With COPE? • With universities? • With government agencies? With lawyers.