Comparative effectiveness of instructional design features in simulation-based education: Systematic review and meta-analysis

David A. Cook, Stanley J. Hamstra, Ryan Brydges, Benjamin Zendejas, Jason H. Szostek, Amy T. Wang, Patricia J. Erwin, Rose Hatala

Research output: Contribution to journalReview articlepeer-review

293 Scopus citations


Background: Although technology-enhanced simulation is increasingly used in health professions education, features of effective simulation-based instructional design remain uncertain. Aims: Evaluate the effectiveness of instructional design features through a systematic review of studies comparing different simulation-based interventions. Methods: We systematically searched MEDLINE, EMBASE, CINAHL, ERIC, PsycINFO, Scopus, key journals, and previous review bibliographies through May 2011. We included original research studies that compared one simulation intervention with another and involved health professions learners. Working in duplicate, we evaluated study quality and abstracted information on learners, outcomes, and instructional design features. We pooled results using random effects meta-analysis. Results: From a pool of 10 903 articles we identified 289 eligible studies enrolling 18 971 trainees, including 208 randomized trials. Inconsistency was usually large (I2 > 50%). For skills outcomes, pooled effect sizes (positive numbers favoring the instructional design feature) were 0.68 for range of difficulty (20 studies; p < 0.001), 0.68 for repetitive practice (7 studies; p = 0.06), 0.66 for distributed practice (6 studies; p = 0.03), 0.65 for interactivity (89 studies; p < 0.001), 0.62 for multiple learning strategies (70 studies; p < 0.001), 0.52 for individualized learning (59 studies; p < 0.001), 0.45 for mastery learning (3 studies; p = 0.57), 0.44 for feedback (80 studies; p < 0.001), 0.34 for longer time (23 studies; p = 0.005), 0.20 for clinical variation (16 studies; p = 0.24), and-0.22 for group training (8 studies; p = 0.09). Conclusions: These results confirm quantitatively the effectiveness of several instructional design features in simulation-based education.

Original languageEnglish (US)
Pages (from-to)e867-e898
JournalMedical teacher
Issue number1
StatePublished - 2013

ASJC Scopus subject areas

  • Education


Dive into the research topics of 'Comparative effectiveness of instructional design features in simulation-based education: Systematic review and meta-analysis'. Together they form a unique fingerprint.

Cite this