1. #658
13:00
Identifying and Overcoming Challenges to
High-Quality Simulation-based Research:
Improving Rigor and Impact
Todd P Chang MD
Marc Auerbach MD MSc
Elizabeth Hunt MD MPH PhD
David Kessler MD MSc
Adam Cheng MD
International Network for Simulation-based Pediatric Innovation, Research and Education
2. Disclosures
• No relevant financial conflicts of interest
• The INSPIRE Network infrastructure has
partial funding from:
International Network for Simulation-based Pediatric Innovation, Research and Education
7. Objectives
• Evaluate characteristics of a simulation-based
research question or protocol conducive to
quality research & output
• Identify 6 specific challenges in simulation-based
research that threaten rigor and quality of
research output
• Demonstrate differences in problems faced by
single-center vs. multi-center research
International Network for Simulation-based Pediatric Innovation, Research and Education
16. 6 Potential Challenges
1.
2.
3.
4.
5.
6.
Scenario development
Outcome measurements
Sharing and rating videos
IT- and Mobile / Web solutions
Standardizing research protocols
Logistics, budgeting, staffing
International Network for Simulation-based Pediatric Innovation, Research and Education
17. 1. Scenario Development
• Simulator capabilities
• Facility capabilities
• Institutional equipment
• Protocols, medicolegal elements
International Network for Simulation-based Pediatric Innovation, Research and Education
19. 2. Outcome Measurements
• Standardization
• Simulator capabilities
• Data capture
• Instrument validity
International Network for Simulation-based Pediatric Innovation, Research and Education
21. 3. Sharing & rating videos
• Accessibility / Protection
• Videography quality
• Interobserver agreement
International Network for Simulation-based Pediatric Innovation, Research and Education
22. 3. Sharing video & reviews
International Network for Simulation-based Pediatric Innovation, Research and Education
23. 4. IT & Mobile Web
• Accessibility / Protection
• Platforms, Operating systems
• Institutional firewalls, blocked programs
• Firesharing
International Network for Simulation-based Pediatric Innovation, Research and Education
24. 4. IT & Mobile Web
International Network for Simulation-based Pediatric Innovation, Research and Education
25. 5. Standardizing protocols
• Simulator capabilities
• Facility and personnel capabilities
• Clinical standard of care
• Buy-in
International Network for Simulation-based Pediatric Innovation, Research and Education
27. 6. Logistics
• Research coordinators
• Institutional Review Boards
• Academic credit, Legitimacy of authorship
• Communication, troubleshooting
International Network for Simulation-based Pediatric Innovation, Research and Education
28. Does multicenter solve
everything?
1. Greater ‘n’
2. Reliability, Validity, Generalizability
3. Greater Expert pool
4. Greater Resources
International Network for Simulation-based Pediatric Innovation, Research and Education
29. Brophy RH et al. Multi-investigator collaboration in orthopaedic surgery research compared to other medical fields. J Ortho Res 2012;30(10):1523-8.
International Network for Simulation-based Pediatric Innovation, Research and Education
30. 13:30 Small Group II 13:59
International Network for Simulation-based Pediatric Innovation, Research and Education
31. 14:00 Report Out 14:24
International Network for Simulation-based Pediatric Innovation, Research and Education
