SlideShare a Scribd company logo
1 of 34
When To Select Observational Studies as Evidence for Comparative Effectiveness Reviews Prepared for: The Agency for Healthcare Research and Quality (AHRQ) Training Modules for Systematic Reviews Methods Guide www.ahrq.gov
Systematic Review Process Overview
[object Object],[object Object],[object Object],Learning Objectives
[object Object],[object Object],Current Perspective
[object Object],Comparative Effectiveness Reviews
[object Object],[object Object],[object Object],[object Object],[object Object],Danger of Overreliance on Randomized Controlled Trials
[object Object],[object Object],[object Object],[object Object],Observational Studies
[object Object],[object Object],[object Object],Using Observational Studies To Assess Benefits (I)
Using Observational Studies To Assess Benefits (II) OS = observational study; PICOTS = population, intervention, comparator, outcome, timing, and setting. Consider OSs Always consider: Controlled trials Will OSs provide valid and useful information? Assess whether OSs address the review question  Are there gaps in trial evidence? Systematic review question   ( including PICOTS) Yes Refocus the review  question on gaps Assess the suitability of OSs:   Natural history of the disease  or exposure Potential biases Confine review to  controlled trials No
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Gaps in Trial Evidence: PICOTS
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Are Trial Data Sufficient? (I)
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Are Trial Data Sufficient? (II)
[object Object],[object Object],[object Object],[object Object],[object Object],When To Identify Gaps in Trial Evidence
Iterative Process for Identifying Gaps in Evidence ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Extract Data from Studies ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Report Systematic Review
[object Object],[object Object],Gaps in Trial Evidence
Using Observational Studies To Assess Benefits OS = observational study; PICOTS = population, intervention, comparator, outcome, timing, and setting. Systematic review question   ( including PICOTS) OS = observational study; PICOTS = population, intervention, comparator,  outcome, timing, and setting Consider OSs Always consider: Controlled trials Will OSs provide valid and useful information? Assess whether OSs address the review question  Are there gaps in trial evidence? Yes Refocus the review  question on gaps Assess the suitability of OSs:   Natural history of the disease  or exposure Potential biases Confine review to  controlled trials No
[object Object],[object Object],[object Object],[object Object],Will Observational Studies Provide Valid and Useful Information?
[object Object],[object Object],[object Object],Assessing the Suitability of Observational Studies To Answer the Review Questions
[object Object],[object Object],[object Object],Clinical Context
[object Object],[object Object],[object Object],[object Object],Potential Biases That May Limit the Suitability of Including Observational Studies
[object Object],[object Object],[object Object],[object Object],Confounding by Indication
[object Object],[object Object],[object Object],Using Observational Studies To Assess Benefits
[object Object],[object Object],[object Object],[object Object],Harms Assessments
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Using Randomized Controlled Trials To Assess Harms (I)
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Using Randomized Controlled Trials To Assess Harms (II)
[object Object],[object Object],[object Object],[object Object],Using Randomized Controlled Trials To Assess Harms (III)
[object Object],[object Object],[object Object],[object Object],Using Data From Unpublished Trials To Assess Harms
[object Object],[object Object],[object Object],[object Object],[object Object],Using Observational Studies To Assess Harms
[object Object],[object Object],[object Object],Hypothesis Testing Versus Hypothesis Generating Chou R, et al.  J Clin Epidemiol  2010;63:502-12.
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Types of Observational Studies That Can Be Used To Assess Harms
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Screening Observational Studies for Inclusion in Harms Assessments
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Key Messages
[object Object],[object Object],References
[object Object],[object Object],Authors

More Related Content

What's hot

4. level of evidence
4. level of evidence4. level of evidence
4. level of evidenceSaurab Sharma
 
Comparing Research Designs
Comparing Research DesignsComparing Research Designs
Comparing Research DesignsPat Barlow
 
Blinding in RCT the enigma unraveled
Blinding in RCT the enigma unraveledBlinding in RCT the enigma unraveled
Blinding in RCT the enigma unraveledMANVEER SINGH
 
Doug Altman - MedicReS World Congress 2012
Doug Altman - MedicReS World Congress 2012 Doug Altman - MedicReS World Congress 2012
Doug Altman - MedicReS World Congress 2012 MedicReS
 
Epi chapter 4
Epi chapter 4Epi chapter 4
Epi chapter 4emmoss21
 
EBM Therapy Appraisal Template F1
EBM Therapy Appraisal Template F1EBM Therapy Appraisal Template F1
EBM Therapy Appraisal Template F1Imad Hassan
 
EBM Systematic Review Appraisal Template V1
EBM Systematic Review Appraisal Template V1EBM Systematic Review Appraisal Template V1
EBM Systematic Review Appraisal Template V1Imad Hassan
 
Clinical Research Methodology
Clinical  Research  MethodologyClinical  Research  Methodology
Clinical Research Methodologydrmomusa
 
Non Randomised Control Trial
Non Randomised Control TrialNon Randomised Control Trial
Non Randomised Control TrialKarishma Halageri
 
Improving Inclusion/Exclusion Criteria for Clinical Trials
Improving Inclusion/Exclusion Criteria for Clinical TrialsImproving Inclusion/Exclusion Criteria for Clinical Trials
Improving Inclusion/Exclusion Criteria for Clinical TrialsBrook White, PMP
 
HLinc presentation: levels of evidence
HLinc presentation:  levels of evidenceHLinc presentation:  levels of evidence
HLinc presentation: levels of evidenceCatherineVoutier
 
Risk of bias in systematic review
Risk of bias in systematic reviewRisk of bias in systematic review
Risk of bias in systematic reviewPrabesh Ghimire
 

What's hot (20)

Assessment of Bias
Assessment of BiasAssessment of Bias
Assessment of Bias
 
4. level of evidence
4. level of evidence4. level of evidence
4. level of evidence
 
Comparing Research Designs
Comparing Research DesignsComparing Research Designs
Comparing Research Designs
 
Blinding in RCT the enigma unraveled
Blinding in RCT the enigma unraveledBlinding in RCT the enigma unraveled
Blinding in RCT the enigma unraveled
 
Doug Altman - MedicReS World Congress 2012
Doug Altman - MedicReS World Congress 2012 Doug Altman - MedicReS World Congress 2012
Doug Altman - MedicReS World Congress 2012
 
Epi chapter 4
Epi chapter 4Epi chapter 4
Epi chapter 4
 
Topic Refinement Quiz
Topic Refinement QuizTopic Refinement Quiz
Topic Refinement Quiz
 
EBM Therapy Appraisal Template F1
EBM Therapy Appraisal Template F1EBM Therapy Appraisal Template F1
EBM Therapy Appraisal Template F1
 
Research Design
Research DesignResearch Design
Research Design
 
Study Eligibility Criteria
Study Eligibility CriteriaStudy Eligibility Criteria
Study Eligibility Criteria
 
EBM Systematic Review Appraisal Template V1
EBM Systematic Review Appraisal Template V1EBM Systematic Review Appraisal Template V1
EBM Systematic Review Appraisal Template V1
 
Clinical Research Methodology
Clinical  Research  MethodologyClinical  Research  Methodology
Clinical Research Methodology
 
Non Randomised Control Trial
Non Randomised Control TrialNon Randomised Control Trial
Non Randomised Control Trial
 
Improving Inclusion/Exclusion Criteria for Clinical Trials
Improving Inclusion/Exclusion Criteria for Clinical TrialsImproving Inclusion/Exclusion Criteria for Clinical Trials
Improving Inclusion/Exclusion Criteria for Clinical Trials
 
Blinding Techniques
Blinding TechniquesBlinding Techniques
Blinding Techniques
 
Evidence based medicine
Evidence based medicineEvidence based medicine
Evidence based medicine
 
EBM ppt by ANN
EBM ppt by ANNEBM ppt by ANN
EBM ppt by ANN
 
Study design of Prof Zak
Study design of Prof ZakStudy design of Prof Zak
Study design of Prof Zak
 
HLinc presentation: levels of evidence
HLinc presentation:  levels of evidenceHLinc presentation:  levels of evidence
HLinc presentation: levels of evidence
 
Risk of bias in systematic review
Risk of bias in systematic reviewRisk of bias in systematic review
Risk of bias in systematic review
 

Viewers also liked

2-Epidemiological studies
2-Epidemiological studies2-Epidemiological studies
2-Epidemiological studiesResearchGuru
 
Curious look into Observational studies
Curious look into Observational studiesCurious look into Observational studies
Curious look into Observational studiesArete-Zoe, LLC
 
Case study: Methodology Reviews
Case study: Methodology ReviewsCase study: Methodology Reviews
Case study: Methodology ReviewsCTSI at UCSF
 
What has been learned from the major observational
What has been learned from the major observationalWhat has been learned from the major observational
What has been learned from the major observationalfalcaoebarros
 
2011 01 16 NIS Training (Chcuk Generic)
2011 01 16 NIS Training (Chcuk Generic)2011 01 16 NIS Training (Chcuk Generic)
2011 01 16 NIS Training (Chcuk Generic)Stuart McCully
 
Keck Year 2 Evidence Based Medicine - Observational Studies and Trials
Keck Year 2 Evidence Based Medicine - Observational Studies and TrialsKeck Year 2 Evidence Based Medicine - Observational Studies and Trials
Keck Year 2 Evidence Based Medicine - Observational Studies and Trialslynnkysh
 
Farmacoepi Course Leiden 0210 Part 2
Farmacoepi Course Leiden 0210   Part 2Farmacoepi Course Leiden 0210   Part 2
Farmacoepi Course Leiden 0210 Part 2RobHeerdink
 
Late Phase Presentation
Late Phase PresentationLate Phase Presentation
Late Phase PresentationDavid Selkirk
 
Late Phase Outsourcing - Clinical Studies
Late Phase Outsourcing - Clinical StudiesLate Phase Outsourcing - Clinical Studies
Late Phase Outsourcing - Clinical StudiesMedpace
 
What Happens After Your Device is Approved? Collecting Data in the Real World
What Happens After Your Device is Approved? Collecting Data in the Real WorldWhat Happens After Your Device is Approved? Collecting Data in the Real World
What Happens After Your Device is Approved? Collecting Data in the Real WorldMedpace
 
Realizing Late Phase Value Through Strategic Partnerships with CROs by Joshua...
Realizing Late Phase Value Through Strategic Partnerships with CROs by Joshua...Realizing Late Phase Value Through Strategic Partnerships with CROs by Joshua...
Realizing Late Phase Value Through Strategic Partnerships with CROs by Joshua...PAREXEL International
 
WEBINAR: Developing Payer Evidence: The Role of Post Approval Programs
WEBINAR: Developing Payer Evidence: The Role of Post Approval ProgramsWEBINAR: Developing Payer Evidence: The Role of Post Approval Programs
WEBINAR: Developing Payer Evidence: The Role of Post Approval ProgramsNathan White, CPC
 
Late Phase Study Planning and Budgeting
Late Phase Study Planning and BudgetingLate Phase Study Planning and Budgeting
Late Phase Study Planning and BudgetingTTC, llc
 
Observational Techniques
Observational TechniquesObservational Techniques
Observational TechniquesHabiba Khan
 
Clinical rd presentation 10 jan2012_sharma
Clinical rd presentation 10 jan2012_sharmaClinical rd presentation 10 jan2012_sharma
Clinical rd presentation 10 jan2012_sharmaTTC, llc
 
Essential Documents of Clinical Trials_2
Essential Documents of Clinical Trials_2Essential Documents of Clinical Trials_2
Essential Documents of Clinical Trials_2heba rashed
 
observational analytical study
observational analytical studyobservational analytical study
observational analytical studyDr. Partha Sarkar
 
Study design
Study designStudy design
Study designRSS6
 

Viewers also liked (20)

2-Epidemiological studies
2-Epidemiological studies2-Epidemiological studies
2-Epidemiological studies
 
Curious look into Observational studies
Curious look into Observational studiesCurious look into Observational studies
Curious look into Observational studies
 
Case study: Methodology Reviews
Case study: Methodology ReviewsCase study: Methodology Reviews
Case study: Methodology Reviews
 
What has been learned from the major observational
What has been learned from the major observationalWhat has been learned from the major observational
What has been learned from the major observational
 
2011 01 16 NIS Training (Chcuk Generic)
2011 01 16 NIS Training (Chcuk Generic)2011 01 16 NIS Training (Chcuk Generic)
2011 01 16 NIS Training (Chcuk Generic)
 
Keck Year 2 Evidence Based Medicine - Observational Studies and Trials
Keck Year 2 Evidence Based Medicine - Observational Studies and TrialsKeck Year 2 Evidence Based Medicine - Observational Studies and Trials
Keck Year 2 Evidence Based Medicine - Observational Studies and Trials
 
Farmacoepi Course Leiden 0210 Part 2
Farmacoepi Course Leiden 0210   Part 2Farmacoepi Course Leiden 0210   Part 2
Farmacoepi Course Leiden 0210 Part 2
 
Late Phase Presentation
Late Phase PresentationLate Phase Presentation
Late Phase Presentation
 
Late Phase Outsourcing - Clinical Studies
Late Phase Outsourcing - Clinical StudiesLate Phase Outsourcing - Clinical Studies
Late Phase Outsourcing - Clinical Studies
 
What Happens After Your Device is Approved? Collecting Data in the Real World
What Happens After Your Device is Approved? Collecting Data in the Real WorldWhat Happens After Your Device is Approved? Collecting Data in the Real World
What Happens After Your Device is Approved? Collecting Data in the Real World
 
Realizing Late Phase Value Through Strategic Partnerships with CROs by Joshua...
Realizing Late Phase Value Through Strategic Partnerships with CROs by Joshua...Realizing Late Phase Value Through Strategic Partnerships with CROs by Joshua...
Realizing Late Phase Value Through Strategic Partnerships with CROs by Joshua...
 
WEBINAR: Developing Payer Evidence: The Role of Post Approval Programs
WEBINAR: Developing Payer Evidence: The Role of Post Approval ProgramsWEBINAR: Developing Payer Evidence: The Role of Post Approval Programs
WEBINAR: Developing Payer Evidence: The Role of Post Approval Programs
 
Late Phase Study Planning and Budgeting
Late Phase Study Planning and BudgetingLate Phase Study Planning and Budgeting
Late Phase Study Planning and Budgeting
 
Observational Techniques
Observational TechniquesObservational Techniques
Observational Techniques
 
Clinical rd presentation 10 jan2012_sharma
Clinical rd presentation 10 jan2012_sharmaClinical rd presentation 10 jan2012_sharma
Clinical rd presentation 10 jan2012_sharma
 
Essential Documents of Clinical Trials_2
Essential Documents of Clinical Trials_2Essential Documents of Clinical Trials_2
Essential Documents of Clinical Trials_2
 
Pharmacoepideiology
PharmacoepideiologyPharmacoepideiology
Pharmacoepideiology
 
observational analytical study
observational analytical studyobservational analytical study
observational analytical study
 
Observational study
Observational studyObservational study
Observational study
 
Study design
Study designStudy design
Study design
 

Similar to When to Select Observational Studies as Evidence for Comparative Effectiveness Reviews

Systematic Reviews Class 4c
Systematic Reviews Class 4cSystematic Reviews Class 4c
Systematic Reviews Class 4cguestf5d7ac
 
Living evidence 3
Living evidence 3Living evidence 3
Living evidence 3stanbridge
 
Ich guidelines e9 to e12
Ich guidelines e9 to e12Ich guidelines e9 to e12
Ich guidelines e9 to e12Khushboo Bhatia
 
9-Meta Analysis/ Systematic Review
9-Meta Analysis/ Systematic Review9-Meta Analysis/ Systematic Review
9-Meta Analysis/ Systematic ReviewResearchGuru
 
Critical appraisal.docx IMPORTAN TO HEALTH SCIENCE STUDENTS
Critical appraisal.docx IMPORTAN TO HEALTH SCIENCE STUDENTSCritical appraisal.docx IMPORTAN TO HEALTH SCIENCE STUDENTS
Critical appraisal.docx IMPORTAN TO HEALTH SCIENCE STUDENTSMulugetaAbeneh1
 
evidence based periodontics
 evidence based periodontics    evidence based periodontics
evidence based periodontics neeti shinde
 
Considering adverse effects in prioritising reviews
Considering adverse effects in prioritising reviewsConsidering adverse effects in prioritising reviews
Considering adverse effects in prioritising reviewsCochrane.Collaboration
 
Guide for conducting meta analysis in health research
Guide for conducting meta analysis in health researchGuide for conducting meta analysis in health research
Guide for conducting meta analysis in health researchYogitha P
 
Level of Evidence- Dina Hudiya Nadana Lubis.pptx
Level of Evidence- Dina Hudiya Nadana Lubis.pptxLevel of Evidence- Dina Hudiya Nadana Lubis.pptx
Level of Evidence- Dina Hudiya Nadana Lubis.pptxdina410715
 
· Reflect on the four peer-reviewed articles you critically apprai.docx
· Reflect on the four peer-reviewed articles you critically apprai.docx· Reflect on the four peer-reviewed articles you critically apprai.docx
· Reflect on the four peer-reviewed articles you critically apprai.docxVannaJoy20
 
JC SEBMA Prognosis Appraisal Template V1
JC SEBMA Prognosis Appraisal Template V1JC SEBMA Prognosis Appraisal Template V1
JC SEBMA Prognosis Appraisal Template V1Imad Hassan
 
Study designs & amp; trials presentation1 2
Study designs & amp; trials presentation1 2Study designs & amp; trials presentation1 2
Study designs & amp; trials presentation1 2Praveen Ganji
 
Introa-Morton-slides.pdf
Introa-Morton-slides.pdfIntroa-Morton-slides.pdf
Introa-Morton-slides.pdfShahriarHabib4
 
Introduction to Evidence Based Dentistry
Introduction to Evidence Based DentistryIntroduction to Evidence Based Dentistry
Introduction to Evidence Based DentistryRasha Adel
 
Overview Of Ich New E9
Overview Of Ich New E9Overview Of Ich New E9
Overview Of Ich New E9Jay1818mar
 

Similar to When to Select Observational Studies as Evidence for Comparative Effectiveness Reviews (20)

Systematic Reviews Class 4c
Systematic Reviews Class 4cSystematic Reviews Class 4c
Systematic Reviews Class 4c
 
Assessing Applicability
Assessing ApplicabilityAssessing Applicability
Assessing Applicability
 
Dhiwahar ppt
Dhiwahar pptDhiwahar ppt
Dhiwahar ppt
 
Living evidence 3
Living evidence 3Living evidence 3
Living evidence 3
 
Ich guidelines e9 to e12
Ich guidelines e9 to e12Ich guidelines e9 to e12
Ich guidelines e9 to e12
 
9-Meta Analysis/ Systematic Review
9-Meta Analysis/ Systematic Review9-Meta Analysis/ Systematic Review
9-Meta Analysis/ Systematic Review
 
Critical appraisal.docx IMPORTAN TO HEALTH SCIENCE STUDENTS
Critical appraisal.docx IMPORTAN TO HEALTH SCIENCE STUDENTSCritical appraisal.docx IMPORTAN TO HEALTH SCIENCE STUDENTS
Critical appraisal.docx IMPORTAN TO HEALTH SCIENCE STUDENTS
 
evidence based periodontics
 evidence based periodontics    evidence based periodontics
evidence based periodontics
 
Considering adverse effects in prioritising reviews
Considering adverse effects in prioritising reviewsConsidering adverse effects in prioritising reviews
Considering adverse effects in prioritising reviews
 
Guide for conducting meta analysis in health research
Guide for conducting meta analysis in health researchGuide for conducting meta analysis in health research
Guide for conducting meta analysis in health research
 
Level of Evidence- Dina Hudiya Nadana Lubis.pptx
Level of Evidence- Dina Hudiya Nadana Lubis.pptxLevel of Evidence- Dina Hudiya Nadana Lubis.pptx
Level of Evidence- Dina Hudiya Nadana Lubis.pptx
 
· Reflect on the four peer-reviewed articles you critically apprai.docx
· Reflect on the four peer-reviewed articles you critically apprai.docx· Reflect on the four peer-reviewed articles you critically apprai.docx
· Reflect on the four peer-reviewed articles you critically apprai.docx
 
JC SEBMA Prognosis Appraisal Template V1
JC SEBMA Prognosis Appraisal Template V1JC SEBMA Prognosis Appraisal Template V1
JC SEBMA Prognosis Appraisal Template V1
 
Systematic review
Systematic reviewSystematic review
Systematic review
 
Study designs & amp; trials presentation1 2
Study designs & amp; trials presentation1 2Study designs & amp; trials presentation1 2
Study designs & amp; trials presentation1 2
 
Reserch methodology
Reserch methodologyReserch methodology
Reserch methodology
 
Introa-Morton-slides.pdf
Introa-Morton-slides.pdfIntroa-Morton-slides.pdf
Introa-Morton-slides.pdf
 
Clinical trials
Clinical trialsClinical trials
Clinical trials
 
Introduction to Evidence Based Dentistry
Introduction to Evidence Based DentistryIntroduction to Evidence Based Dentistry
Introduction to Evidence Based Dentistry
 
Overview Of Ich New E9
Overview Of Ich New E9Overview Of Ich New E9
Overview Of Ich New E9
 

More from Effective Health Care Program

The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...
The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...
The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...Effective Health Care Program
 
Management of the Patient with Stable Ischemic Heart Disease and Preserved Le...
Management of the Patient with Stable Ischemic Heart Disease and Preserved Le...Management of the Patient with Stable Ischemic Heart Disease and Preserved Le...
Management of the Patient with Stable Ischemic Heart Disease and Preserved Le...Effective Health Care Program
 

More from Effective Health Care Program (20)

The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...
The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...
The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...
 
Study Eligibility Criteria Quiz
Study Eligibility Criteria QuizStudy Eligibility Criteria Quiz
Study Eligibility Criteria Quiz
 
Searching for Relevant Studies
Searching for Relevant StudiesSearching for Relevant Studies
Searching for Relevant Studies
 
Searching for Relevant Studies Quiz
Searching for Relevant Studies QuizSearching for Relevant Studies Quiz
Searching for Relevant Studies Quiz
 
Reporting the Review
Reporting the ReviewReporting the Review
Reporting the Review
 
Reporting the Review Quiz
Reporting the Review QuizReporting the Review Quiz
Reporting the Review Quiz
 
Quantitative Synthesis II
Quantitative Synthesis IIQuantitative Synthesis II
Quantitative Synthesis II
 
Quantitative Synthesis II Quiz
Quantitative Synthesis II QuizQuantitative Synthesis II Quiz
Quantitative Synthesis II Quiz
 
Quantitative Synthesis I
Quantitative Synthesis IQuantitative Synthesis I
Quantitative Synthesis I
 
Quantitative Synthesis I Quiz
Quantitative Synthesis I QuizQuantitative Synthesis I Quiz
Quantitative Synthesis I Quiz
 
Presentation of Findings
Presentation of FindingsPresentation of Findings
Presentation of Findings
 
Presentation of Findings Quiz
Presentation of Findings QuizPresentation of Findings Quiz
Presentation of Findings Quiz
 
Management of the Patient with Stable Ischemic Heart Disease and Preserved Le...
Management of the Patient with Stable Ischemic Heart Disease and Preserved Le...Management of the Patient with Stable Ischemic Heart Disease and Preserved Le...
Management of the Patient with Stable Ischemic Heart Disease and Preserved Le...
 
Grading Strength of Evidence
Grading Strength of EvidenceGrading Strength of Evidence
Grading Strength of Evidence
 
Grading Strength of Evidence Quiz
Grading Strength of Evidence QuizGrading Strength of Evidence Quiz
Grading Strength of Evidence Quiz
 
Data Extraction
Data ExtractionData Extraction
Data Extraction
 
Data Extraction Quiz
Data  Extraction QuizData  Extraction Quiz
Data Extraction Quiz
 
Assessing Quality of Individual Studies Quiz
Assessing Quality of Individual Studies QuizAssessing Quality of Individual Studies Quiz
Assessing Quality of Individual Studies Quiz
 
Assessing Quality of Individual Studies
Assessing Quality of Individual StudiesAssessing Quality of Individual Studies
Assessing Quality of Individual Studies
 
Assessing Applicability Quiz
Assessing Applicability QuizAssessing Applicability Quiz
Assessing Applicability Quiz
 

Recently uploaded

Call Girls Ahmedabad Just Call 9630942363 Top Class Call Girl Service Available
Call Girls Ahmedabad Just Call 9630942363 Top Class Call Girl Service AvailableCall Girls Ahmedabad Just Call 9630942363 Top Class Call Girl Service Available
Call Girls Ahmedabad Just Call 9630942363 Top Class Call Girl Service AvailableGENUINE ESCORT AGENCY
 
Call Girls Service Jaipur {9521753030 } ❤️VVIP BHAWNA Call Girl in Jaipur Raj...
Call Girls Service Jaipur {9521753030 } ❤️VVIP BHAWNA Call Girl in Jaipur Raj...Call Girls Service Jaipur {9521753030 } ❤️VVIP BHAWNA Call Girl in Jaipur Raj...
Call Girls Service Jaipur {9521753030 } ❤️VVIP BHAWNA Call Girl in Jaipur Raj...khalifaescort01
 
Independent Call Girls In Jaipur { 8445551418 } ✔ ANIKA MEHTA ✔ Get High Prof...
Independent Call Girls In Jaipur { 8445551418 } ✔ ANIKA MEHTA ✔ Get High Prof...Independent Call Girls In Jaipur { 8445551418 } ✔ ANIKA MEHTA ✔ Get High Prof...
Independent Call Girls In Jaipur { 8445551418 } ✔ ANIKA MEHTA ✔ Get High Prof...parulsinha
 
Mumbai ] (Call Girls) in Mumbai 10k @ I'm VIP Independent Escorts Girls 98333...
Mumbai ] (Call Girls) in Mumbai 10k @ I'm VIP Independent Escorts Girls 98333...Mumbai ] (Call Girls) in Mumbai 10k @ I'm VIP Independent Escorts Girls 98333...
Mumbai ] (Call Girls) in Mumbai 10k @ I'm VIP Independent Escorts Girls 98333...Ishani Gupta
 
Call Girls Service Jaipur {9521753030} ❤️VVIP RIDDHI Call Girl in Jaipur Raja...
Call Girls Service Jaipur {9521753030} ❤️VVIP RIDDHI Call Girl in Jaipur Raja...Call Girls Service Jaipur {9521753030} ❤️VVIP RIDDHI Call Girl in Jaipur Raja...
Call Girls Service Jaipur {9521753030} ❤️VVIP RIDDHI Call Girl in Jaipur Raja...Sheetaleventcompany
 
Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...
Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...
Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...aartirawatdelhi
 
Coimbatore Call Girls in Coimbatore 7427069034 genuine Escort Service Girl 10...
Coimbatore Call Girls in Coimbatore 7427069034 genuine Escort Service Girl 10...Coimbatore Call Girls in Coimbatore 7427069034 genuine Escort Service Girl 10...
Coimbatore Call Girls in Coimbatore 7427069034 genuine Escort Service Girl 10...chennailover
 
Andheri East ) Call Girls in Mumbai Phone No 9004268417 Elite Escort Service ...
Andheri East ) Call Girls in Mumbai Phone No 9004268417 Elite Escort Service ...Andheri East ) Call Girls in Mumbai Phone No 9004268417 Elite Escort Service ...
Andheri East ) Call Girls in Mumbai Phone No 9004268417 Elite Escort Service ...Anamika Rawat
 
Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...
Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...
Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...Dipal Arora
 
9630942363 Genuine Call Girls In Ahmedabad Gujarat Call Girls Service
9630942363 Genuine Call Girls In Ahmedabad Gujarat Call Girls Service9630942363 Genuine Call Girls In Ahmedabad Gujarat Call Girls Service
9630942363 Genuine Call Girls In Ahmedabad Gujarat Call Girls ServiceGENUINE ESCORT AGENCY
 
Call Girl in Indore 8827247818 {LowPrice} ❤️ (ahana) Indore Call Girls * UPA...
Call Girl in Indore 8827247818 {LowPrice} ❤️ (ahana) Indore Call Girls  * UPA...Call Girl in Indore 8827247818 {LowPrice} ❤️ (ahana) Indore Call Girls  * UPA...
Call Girl in Indore 8827247818 {LowPrice} ❤️ (ahana) Indore Call Girls * UPA...mahaiklolahd
 
Call Girls Hyderabad Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Hyderabad Just Call 8250077686 Top Class Call Girl Service AvailableCall Girls Hyderabad Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Hyderabad Just Call 8250077686 Top Class Call Girl Service AvailableDipal Arora
 
Call Girls Rishikesh Just Call 9667172968 Top Class Call Girl Service Available
Call Girls Rishikesh Just Call 9667172968 Top Class Call Girl Service AvailableCall Girls Rishikesh Just Call 9667172968 Top Class Call Girl Service Available
Call Girls Rishikesh Just Call 9667172968 Top Class Call Girl Service Availableperfect solution
 
(Low Rate RASHMI ) Rate Of Call Girls Jaipur ❣ 8445551418 ❣ Elite Models & Ce...
(Low Rate RASHMI ) Rate Of Call Girls Jaipur ❣ 8445551418 ❣ Elite Models & Ce...(Low Rate RASHMI ) Rate Of Call Girls Jaipur ❣ 8445551418 ❣ Elite Models & Ce...
(Low Rate RASHMI ) Rate Of Call Girls Jaipur ❣ 8445551418 ❣ Elite Models & Ce...parulsinha
 
Russian Call Girls Service Jaipur {8445551418} ❤️PALLAVI VIP Jaipur Call Gir...
Russian Call Girls Service  Jaipur {8445551418} ❤️PALLAVI VIP Jaipur Call Gir...Russian Call Girls Service  Jaipur {8445551418} ❤️PALLAVI VIP Jaipur Call Gir...
Russian Call Girls Service Jaipur {8445551418} ❤️PALLAVI VIP Jaipur Call Gir...parulsinha
 
Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...
Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...
Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...hotbabesbook
 
Call Girls Jaipur Just Call 9521753030 Top Class Call Girl Service Available
Call Girls Jaipur Just Call 9521753030 Top Class Call Girl Service AvailableCall Girls Jaipur Just Call 9521753030 Top Class Call Girl Service Available
Call Girls Jaipur Just Call 9521753030 Top Class Call Girl Service AvailableJanvi Singh
 
Coimbatore Call Girls in Thudiyalur : 7427069034 High Profile Model Escorts |...
Coimbatore Call Girls in Thudiyalur : 7427069034 High Profile Model Escorts |...Coimbatore Call Girls in Thudiyalur : 7427069034 High Profile Model Escorts |...
Coimbatore Call Girls in Thudiyalur : 7427069034 High Profile Model Escorts |...chennailover
 
Saket * Call Girls in Delhi - Phone 9711199012 Escorts Service at 6k to 50k a...
Saket * Call Girls in Delhi - Phone 9711199012 Escorts Service at 6k to 50k a...Saket * Call Girls in Delhi - Phone 9711199012 Escorts Service at 6k to 50k a...
Saket * Call Girls in Delhi - Phone 9711199012 Escorts Service at 6k to 50k a...BhumiSaxena1
 
All Time Service Available Call Girls Marine Drive 📳 9820252231 For 18+ VIP C...
All Time Service Available Call Girls Marine Drive 📳 9820252231 For 18+ VIP C...All Time Service Available Call Girls Marine Drive 📳 9820252231 For 18+ VIP C...
All Time Service Available Call Girls Marine Drive 📳 9820252231 For 18+ VIP C...Arohi Goyal
 

Recently uploaded (20)

Call Girls Ahmedabad Just Call 9630942363 Top Class Call Girl Service Available
Call Girls Ahmedabad Just Call 9630942363 Top Class Call Girl Service AvailableCall Girls Ahmedabad Just Call 9630942363 Top Class Call Girl Service Available
Call Girls Ahmedabad Just Call 9630942363 Top Class Call Girl Service Available
 
Call Girls Service Jaipur {9521753030 } ❤️VVIP BHAWNA Call Girl in Jaipur Raj...
Call Girls Service Jaipur {9521753030 } ❤️VVIP BHAWNA Call Girl in Jaipur Raj...Call Girls Service Jaipur {9521753030 } ❤️VVIP BHAWNA Call Girl in Jaipur Raj...
Call Girls Service Jaipur {9521753030 } ❤️VVIP BHAWNA Call Girl in Jaipur Raj...
 
Independent Call Girls In Jaipur { 8445551418 } ✔ ANIKA MEHTA ✔ Get High Prof...
Independent Call Girls In Jaipur { 8445551418 } ✔ ANIKA MEHTA ✔ Get High Prof...Independent Call Girls In Jaipur { 8445551418 } ✔ ANIKA MEHTA ✔ Get High Prof...
Independent Call Girls In Jaipur { 8445551418 } ✔ ANIKA MEHTA ✔ Get High Prof...
 
Mumbai ] (Call Girls) in Mumbai 10k @ I'm VIP Independent Escorts Girls 98333...
Mumbai ] (Call Girls) in Mumbai 10k @ I'm VIP Independent Escorts Girls 98333...Mumbai ] (Call Girls) in Mumbai 10k @ I'm VIP Independent Escorts Girls 98333...
Mumbai ] (Call Girls) in Mumbai 10k @ I'm VIP Independent Escorts Girls 98333...
 
Call Girls Service Jaipur {9521753030} ❤️VVIP RIDDHI Call Girl in Jaipur Raja...
Call Girls Service Jaipur {9521753030} ❤️VVIP RIDDHI Call Girl in Jaipur Raja...Call Girls Service Jaipur {9521753030} ❤️VVIP RIDDHI Call Girl in Jaipur Raja...
Call Girls Service Jaipur {9521753030} ❤️VVIP RIDDHI Call Girl in Jaipur Raja...
 
Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...
Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...
Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...
 
Coimbatore Call Girls in Coimbatore 7427069034 genuine Escort Service Girl 10...
Coimbatore Call Girls in Coimbatore 7427069034 genuine Escort Service Girl 10...Coimbatore Call Girls in Coimbatore 7427069034 genuine Escort Service Girl 10...
Coimbatore Call Girls in Coimbatore 7427069034 genuine Escort Service Girl 10...
 
Andheri East ) Call Girls in Mumbai Phone No 9004268417 Elite Escort Service ...
Andheri East ) Call Girls in Mumbai Phone No 9004268417 Elite Escort Service ...Andheri East ) Call Girls in Mumbai Phone No 9004268417 Elite Escort Service ...
Andheri East ) Call Girls in Mumbai Phone No 9004268417 Elite Escort Service ...
 
Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...
Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...
Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...
 
9630942363 Genuine Call Girls In Ahmedabad Gujarat Call Girls Service
9630942363 Genuine Call Girls In Ahmedabad Gujarat Call Girls Service9630942363 Genuine Call Girls In Ahmedabad Gujarat Call Girls Service
9630942363 Genuine Call Girls In Ahmedabad Gujarat Call Girls Service
 
Call Girl in Indore 8827247818 {LowPrice} ❤️ (ahana) Indore Call Girls * UPA...
Call Girl in Indore 8827247818 {LowPrice} ❤️ (ahana) Indore Call Girls  * UPA...Call Girl in Indore 8827247818 {LowPrice} ❤️ (ahana) Indore Call Girls  * UPA...
Call Girl in Indore 8827247818 {LowPrice} ❤️ (ahana) Indore Call Girls * UPA...
 
Call Girls Hyderabad Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Hyderabad Just Call 8250077686 Top Class Call Girl Service AvailableCall Girls Hyderabad Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Hyderabad Just Call 8250077686 Top Class Call Girl Service Available
 
Call Girls Rishikesh Just Call 9667172968 Top Class Call Girl Service Available
Call Girls Rishikesh Just Call 9667172968 Top Class Call Girl Service AvailableCall Girls Rishikesh Just Call 9667172968 Top Class Call Girl Service Available
Call Girls Rishikesh Just Call 9667172968 Top Class Call Girl Service Available
 
(Low Rate RASHMI ) Rate Of Call Girls Jaipur ❣ 8445551418 ❣ Elite Models & Ce...
(Low Rate RASHMI ) Rate Of Call Girls Jaipur ❣ 8445551418 ❣ Elite Models & Ce...(Low Rate RASHMI ) Rate Of Call Girls Jaipur ❣ 8445551418 ❣ Elite Models & Ce...
(Low Rate RASHMI ) Rate Of Call Girls Jaipur ❣ 8445551418 ❣ Elite Models & Ce...
 
Russian Call Girls Service Jaipur {8445551418} ❤️PALLAVI VIP Jaipur Call Gir...
Russian Call Girls Service  Jaipur {8445551418} ❤️PALLAVI VIP Jaipur Call Gir...Russian Call Girls Service  Jaipur {8445551418} ❤️PALLAVI VIP Jaipur Call Gir...
Russian Call Girls Service Jaipur {8445551418} ❤️PALLAVI VIP Jaipur Call Gir...
 
Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...
Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...
Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...
 
Call Girls Jaipur Just Call 9521753030 Top Class Call Girl Service Available
Call Girls Jaipur Just Call 9521753030 Top Class Call Girl Service AvailableCall Girls Jaipur Just Call 9521753030 Top Class Call Girl Service Available
Call Girls Jaipur Just Call 9521753030 Top Class Call Girl Service Available
 
Coimbatore Call Girls in Thudiyalur : 7427069034 High Profile Model Escorts |...
Coimbatore Call Girls in Thudiyalur : 7427069034 High Profile Model Escorts |...Coimbatore Call Girls in Thudiyalur : 7427069034 High Profile Model Escorts |...
Coimbatore Call Girls in Thudiyalur : 7427069034 High Profile Model Escorts |...
 
Saket * Call Girls in Delhi - Phone 9711199012 Escorts Service at 6k to 50k a...
Saket * Call Girls in Delhi - Phone 9711199012 Escorts Service at 6k to 50k a...Saket * Call Girls in Delhi - Phone 9711199012 Escorts Service at 6k to 50k a...
Saket * Call Girls in Delhi - Phone 9711199012 Escorts Service at 6k to 50k a...
 
All Time Service Available Call Girls Marine Drive 📳 9820252231 For 18+ VIP C...
All Time Service Available Call Girls Marine Drive 📳 9820252231 For 18+ VIP C...All Time Service Available Call Girls Marine Drive 📳 9820252231 For 18+ VIP C...
All Time Service Available Call Girls Marine Drive 📳 9820252231 For 18+ VIP C...
 

When to Select Observational Studies as Evidence for Comparative Effectiveness Reviews

  • 1. When To Select Observational Studies as Evidence for Comparative Effectiveness Reviews Prepared for: The Agency for Healthcare Research and Quality (AHRQ) Training Modules for Systematic Reviews Methods Guide www.ahrq.gov
  • 3.
  • 4.
  • 5.
  • 6.
  • 7.
  • 8.
  • 9. Using Observational Studies To Assess Benefits (II) OS = observational study; PICOTS = population, intervention, comparator, outcome, timing, and setting. Consider OSs Always consider: Controlled trials Will OSs provide valid and useful information? Assess whether OSs address the review question Are there gaps in trial evidence? Systematic review question ( including PICOTS) Yes Refocus the review question on gaps Assess the suitability of OSs: Natural history of the disease or exposure Potential biases Confine review to controlled trials No
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16. Using Observational Studies To Assess Benefits OS = observational study; PICOTS = population, intervention, comparator, outcome, timing, and setting. Systematic review question ( including PICOTS) OS = observational study; PICOTS = population, intervention, comparator, outcome, timing, and setting Consider OSs Always consider: Controlled trials Will OSs provide valid and useful information? Assess whether OSs address the review question Are there gaps in trial evidence? Yes Refocus the review question on gaps Assess the suitability of OSs: Natural history of the disease or exposure Potential biases Confine review to controlled trials No
  • 17.
  • 18.
  • 19.
  • 20.
  • 21.
  • 22.
  • 23.
  • 24.
  • 25.
  • 26.
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.
  • 32.
  • 33.
  • 34.