Simulation-based training in anaesthesiology: A systematic review and meta-analysis

British Journal of Anaesthesia

Volumn 112, Issue 2, 2014, Pages 231-245

  Lorello, G R ^a,b   Cook, D A ^c,d   Johnson, R L ^c   Brydges, R ^a,b  

^a UNIVERSITY OF TORONTO   (Canada)

^b UNIVERSITY HEALTH NETWORK   (Canada)

^c MAYO CLINIC   (United States)

^d MAYO CLINIC COLLEGE OF MEDICINE   (United States)

Author keywords

anaesthesia; education; patient simulation; simulation training; simulators

Indexed keywords

ANESTHESIOLOGY; BEHAVIOR; DISEASE MANAGEMENT; EFFECT SIZE; HEALTH PRACTITIONER; HUMAN; INFORMATION; KNOWLEDGE; MEDLINE; META ANALYSIS; PRIORITY JOURNAL; REVIEW; SATISFACTION; SIMULATION; SIMULATION BASED TRAINING; SKILL; SYSTEMATIC REVIEW; TIME; TRAINING;

ANAESTHESIA; EDUCATION; PATIENT SIMULATION; SIMULATION TRAINING; SIMULATORS;

ANESTHESIOLOGY; COMPUTER SIMULATION; EDUCATION, MEDICAL; HUMANS;

EID: 84892737039     PISSN: 00070912     EISSN: 14716771     Source Type: Journal    
DOI: 10.1093/bja/aet414     Document Type: Article

References (109)

1. Cooper JB, Taqueti VR. A brief history of the development of mannequin simulators for clinical education and training. Qual Saf Health Care 2004; 13: I11-8
2. Abrahamson S, Denson JS,Wolf RM. Effectiveness of a simulator in training anesthesiology residents. J Med Educ 1969; 44: 515-9
3. Denson JS, Abrahams S. A computer-controlled patient simulator. J Am Med Assoc 1969; 208: 504-8
4. Howard SK, Gaba DM, Fish KJ, Yang G, Sarnquist FH. Anesthesia crisis resource management training: teaching anesthesiologists to handle critical incidents. Aviat Space Environ Med 1992; 63: 763-70
5. Fletcher G, Flin R, McGeorge P, Glavin R, Maran N, Patey R. Anaesthetists' non-technical skills (ANTS): evaluation of a behavioural marker system. Br J Anaesth 2003; 90: 580-8
6. Flin R, Patey R, Glavin R, Maran N. Anaesthetists' non-technical skills. Br J Anaesth 2010; 105: 38-44
7. Flin R, Maran N. Identifying and training non-technical skills for teams in acute medicine. Qual Saf Health Care 2004; 13: I80-4
8. Cook DA, Hatala R, Brydges R, et al. Technology-enhanced simulation for health professions education: a systematic review and meta-analysis. J Am Med Assoc 2011; 306: 978-88
9. CookDA, Brydges R,HamstraSJ, et al. Comparative effectivenessof technology-enhanced simulation versus other instructional methods: a systematic review and meta-analysis. Simul Healthc 2012; 7: 308-20
10. Issenberg SB, McGaghie WC, Petrusa ER, Lee Gordon D, Scalese RJ. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach 2005; 27: 10-28
11. Cook DA, Hamstra SJ, Brydges R, et al. Comparative effectiveness of instructional design features in simulation-based education: systematic review and meta-analysis. Med Teach 2013; 35: e844-75
12. Cumin D, Merry AF. Simulators for use in anaesthesia. Anaesthesia 2007; 62: 151-62
13. Ross AJ, KodateN, Anderson JE, Thomas L, Jaye P. Review of simulation studies in anaesthesia journals, 2001-2010: mapping and content analysis. Br J Anaesth 2012; 109: 99-109
14. Leblanc VR. Review article: simulation in anesthesia: state of the science and looking forward. Can J Anaesth 2012; 59: 193-202
15. Moher D. Guidelines for reporting health care research: advancing the clarity and transparency of scientific reporting. Can J Anaesth 2009; 56: 96-101
16. Kennedy CC, Cannon EK, Warner DO, Cook DA. Advanced airway management simulation training in medical education: a systematic reviewandmeta-analysis. CritCare Med, AdvanceAccess published on 11 November 2013, PMID: 24220691
17. Johnson RL, Cannon EK, Mantilla CB, Cook DA. Cricoid pressure training using simulation: a systematic reviewand meta-analysis. Br J Anaesth 2013; 111: 338-46
18. Reed DA, Kern DE, Levine RB, Wright SM. Costs and funding for published medical education research. J Am Med Assoc 2005; 294: 1052-7
19. Wells G, Shea B, O'Connell D, et al. The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. 3rd Symposium on Systematic Reviews: Beyond the Basics Ottawa, ON Canada: Ottawa Hospital Research Institute
20. Cook DA, Levinson AJ, Garside S, Dupras DM, Erwin PJ, Montori VM. Internet-based learning in the health professions: a meta-analysis. J Am Med Assoc 2008; 300: 1181-96
21. Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. Br Med J 2003; 327: 557-60
22. CohenJ. StatisticalPower Analysis for the Behavioral Sciences. USA: Lawrence Erlbaum, 1988
23. Nadel FM, Lavelle JM, Fein JA, Giardino AP, Decker JM, Durbin DR. Teaching resuscitation to pediatric residents: the effects of an intervention. Arch Pediatr Adolesc Med 2000; 154: 1049-54
24. Jacobs LM, Burns KJ, Kaban JM, et al. Development and evaluation of the advanced trauma operative management course. J Trauma 2003; 55: 471-9
25. Boonmak P,BoonmakS, Srichaipanha S, Poomsawat S. Knowledge and skill after brief ACLS training. J Med Assoc Thai 2004; 87: 1311-4
26. Morgan PJ, Cleave-Hogg D, Desousa S, Lam-McCulloch J. Applying theory to practice in undergraduate education using high fidelity simulation. Med Teach 2006; 28: e10-5
27. Corbridge SJ, McLaughlin R, Tiffen J, Wade L, Templin R, Corbridge TC. Using simulation to enhance knowledge and confidence. Nurse Pract 2008; 33: 12-3
28. Kurrek MM, Devitt JH, Cohen M. Cardiac arrest in the OR: how are our ACLS skills? Can J Anaesth 1998; 45: 130-2
29. MurrayWB,GoodML,Gravenstein JS, vanOostromJH, BrasfieldWG. Learning about new anesthetics using a model driven, full human simulator. J ClinMonit Comput 2002; 17: 293-300
30. MayoPH,Hackney JE,MueckJT,RibaudoV, SchneiderRF. Achieving house staff competence in emergency airway management: results of a teaching programusing a computerized patient simulator. Crit Care Med 2004; 32: 2422-7
31. Blum RH, Raemer DB, Carroll JS, Dufresne RL, Cooper JB. A method for measuring the effectiveness of simulation-based team training for improving communication skills. Anesth Analg 2005; 100: 1375-80
32. Ault MJ, Rosen BT, Ault B. The use of tissue models for vascular access training: phase I of the procedural patient safety initiative. J Gen Intern Med 2006; 21: 514-7
33. Jankouskas T, Bush MC, Murray B, et al. Crisis resource management: evaluating outcomes of a multidisciplinary team. Simul Healthc 2007; 2: 96-101
34. Shukla A, Kline D, Cherian A, et al. Asimulation courseon lifesaving techniques for third-year medical students. Simul Healthc 2007; 2: 11-5
35. Burlacu CL, Chin C. Effect of pediatric simulation training on candidate's confidence. Paediatr Anaesth 2008; 18: 566-7
36. Kuduvalli PM, Jervis A, Tighe SQM, Robin NM. Unanticipated difficult airwaymanagement in anaesthetised patients: a prospective study of the effect of mannequin training on management strategies and skill retention. Anaesthesia 2008; 63: 364-9
37. Chen P-T, Huang Y-C, Cheng H-W, et al. New simulation-based airway management training program for junior physicians: advanced airway life support. Med Teach 2009; 31: e338-44
38. Morgan PJ, Tarshis J, LeBlanc V, et al. Efficacy of high-fidelity simulation debriefing on the performance of practicing anaesthetists in simulated scenarios. Br J Anaesth 2009; 103: 531-7
39. Pian-Smith MCM, Simon R, Minehart RD, et al. Teaching residents the two-challenge rule: a simulation-based approach to improve education and patient safety. Simul Healthc 2009; 4: 84-91
40. Park CS, Rochlen LR, Yaghmour E, et al. Acquisition of critical intraoperative event management skills in novice anesthesiology residents by using high-fidelity simulation-based training. Anesthesiology 2010; 112: 202-11
41. Pereira BMT, Ryan ML, Ogilvie MP, et al. Predeployment mass casualty and clinical trauma training for US Army Forward Surgical Teams. J Craniofac Surg 2010; 21: 982-6
42. IshibashiH, Shibutani K,Yoshii H, et al. Judgementonstudents' exercise for resuscitation using a manikin for CPCR exercise (1st report) [Japanese]. Nichidai Koko Kagaku 1990; 16: 84-9
43. GoodwinMW, FrenchGW. Simulationasatrainingandassessment tool in the management of failed intubation in obstetrics. Int J Obstet Anesth 2001; 10: 273-7
44. Forrest FC, Taylor MA, Postlethwaite K, Aspinall R. Use of a highfidelity simulator to develop testing of the technical performance of novice anaesthetists. Br J Anaesth 2002; 88: 338-44
45. Yee B, Naik VN, Joo HS, et al. Nontechnical skills in anesthesia crisis management with repeated exposure to simulation-based education. Anesthesiology 2005; 103: 241-8
46. Tuttle RP, Cohen MH, Augustine AJ, et al. Utilizing simulation technology for competency skills assessment and a comparison of traditional methods of training to simulation-based training. Respir Care 2007; 52: 263-70
47. Wang T-L, Xue J-X, Liu Q-H, Wang K-J, Wei L-M. Exploration and application by combining human patient simulator drivers of critical and emergency events with micro-division teaching during training primary residents [Chinese]. Zhonghua Yi Xue Za Zhi 2009; 89: 171-4
48. SchillemanK,Witlox RS,LoprioreE, Morley CJ,Walther FJ, tePas AB. Leak and obstruction withmask ventilation during simulated neonatal resuscitation. Arch Dis Child Fetal Neonatal Ed 2010; 95: F398-402
49. DeVita MA, Schaefer J, Lutz J, Wang H, Dongilli T. Improving medical emergency team (MET) performance using a novel curriculum and a computerized human patient simulator. Qual Saf Health Care 2005; 14: 326-31
50. Chopra V, Gesink BJ, de Jong J, Bovill JG, Spierdijk J, Brand R. Does training on an anaesthesia simulator lead to improvement in performance? Br J Anaesth 1994; 73: 293-7
51. Nyssen A-S, Larbuisson R, Janssens M, Pendeville P, Mayné A. A comparison of the training value of two types of anesthesia simulators: computer screen-based and mannequin-based simulators. Anesth Analg 2002; 94: 1560-5
52. Sites BD, Gallagher JD, Cravero J, Lundberg J, Blike G. The learning curve associated with a simulated ultrasound-guided interventional task by inexperienced anesthesia residents. Reg Anesth Pain Med 2004; 29: 544-8
53. Baranauskas MB, Margarido CB, Panossian C, Silva ED, Campanella MA,Kimachi PP. Simulation of ultrasound-guided peripheral nerve block: learning curve of CET-SMA/HSL Anesthesiology residents. Rev Bras Anestesiol 2008; 58: 106-11
54. Batchelder AJ, Steel A, Mackenzie R, Hormis AP, Daniels TS, Holding N. Simulation as a tool to improve the safety of pre-hospital anaesthesia-a pilot study. Anaesthesia 2009; 64: 978-83
55. Borges BCR, Boet S, Siu LW, et al. Incomplete adherence to the ASA difficult airway algorithm is unchanged after a high-fidelity simulation session. Can J Anaesth 2010; 57: 644-9
56. Siu LW, Boet S, Borges BC, et al. High-fidelity simulation demonstrates the influence of anesthesiologists' age and years from residency on emergency cricothyroidotomy skills. Anesth Analg 2010; 111: 955-60
57. Euliano TY. Teaching respiratory physiology: clinical correlation with a human patient simulator. J Clin Monit Comput 2000; 16: 465-70
58. Farnsworth ST, Egan TD, Johnson SE, Westenskow D. Teaching sedation and analgesia with simulation. J Clin Monit Comput 2000; 16: 273-85
59. Tan GM, Ti LK, Suresh S, Ho BS, Lee TL. Teaching first-year medical students physiology: does the human patient simulator allowformoreeffectiveteaching?SingaporeMedJ2002;43:238-42
60. Lopez YM, Pilar FJ, Medina JA, et al. Courses on mechanical ventilation in pediatrics: first experience in Spain. Pediatr Pulmonol 2007; 42: 1072-7
61. BergmanS,DeckelbaumD, Lett R, et al. Assessing theimpact of the trauma team training program in Tanzania. J Trauma 2008; 65: 879-83
62. Johnson PL Jr. Multiple comparisons among mechanical lung simulators using differences in pre-and post scores of allied health students. Respir Care Educ Annu 2008; 17: 23-33
63. Mah JW, Bingham K, Dobkin ED, et al. Mannequin simulation identifies common surgical intensive care unit teamwork errors long after introduction of sepsis guidelines. Simul Healthc 2009; 4: 193-9
64. Bose RR, Matyal R,Warraich HJ, et al. Utility of a transesophageal echocardiographic simulator as a teaching tool. J Cardiothorac Vasc Anesth 2011; 25: 212-5
65. Dalley P, Robinson B, Weller J, Caldwell C. The use of high-fidelity humanpatient simulation andthe introduction ofnewanesthesia delivery systems. Anesth Analg 2004; 99: 1737-41
66. Goldmann K, Steinfeldt T. Acquisition of basic fiberoptic intubation skills with a virtual reality airway simulator. J Clin Anesth 2006; 18: 173-8
67. BehrendM, Rosenthal R. Acquisition of spine injection skills using a beef injection simulator. Pain Phys 2007; 10: 591-8
68. Cordova-Dominguez JA, Guevara-Lopez U, Covarrubias-Gomez A, et al. Pilot study of a virtual simulation model to teach the lumbar sympathetic block procedure [Spanish]. Rev Mex Anestesiol 2007; 30: 61-6
69. Augarten A, Zaslansky R, Matok Pharm I, et al. The impact of educational intervention programs on pain management in a pediatric emergency department. Biomed Pharmacother 2006; 60: 299-302
70. Shavit I, Keidan I, Hoffmann Y, et al. Enhancing patient safety during pediatric sedation: theimpact of simulation-based training of nonanesthesiologists. Arch Pediatr Adolesc Med 2007; 161: 740-3
71. Weinger MB, Slagle JM, Kuntz A, et al. Improving actual handover behavior with a simulation-based training intervention. Human Factors and Ergonomics Society 54th Annual Meeting, 2010; 957-61
72. Gómez LM, CalderónM, Sáenz X, et al. Effect and benefit of clinical simulation in the development of psychomotor competencies in anesthesia: a random double-blind clinical trial [Spanish]. Rev Colomb Anestesiol 2008; 36: 93-107
73. Nishisaki A, Donoghue AJ, Colborn S, et al. Effect of just-in-time simulation training on tracheal intubation procedure safety in the pediatric intensive care unit. Anesthesiology 2010; 113: 214-23
74. Morgan PJ, Cleave-Hogg D, McIlroy J, Devitt JH. Simulation technology: acomparisonofexperientialandvisual learning for undergraduate medical students. Anesthesiology 2002; 96: 10-6
75. Curran VR, Aziz K, O'Young S, Bessell C. Evaluation of the effect of a computerized training simulator (ANAKIN) on the retention of neonatal resuscitation skills. Teach Learn Med 2004; 16: 157-64
76. Steadman RH, Coates WC, Huang YM, et al. Simulation-based training is superior to problem-based learning for the acquisition of critical assessment and management skills. Crit Care Med 2006; 34: 151-7
77. Hallikainen J, Vaisanen O, Randell T, Tarkkila P, Rosenberg PH, Niemi-Murola L. Teaching anaesthesia induction to medical students: comparison between full-scale simulation and supervised teaching in the operating theatre. Eur J Anaesthesiol 2009; 26: 101-4
78. Wenk M, Waurick R, Schotes D, et al. Simulation-based medical education is no better than problem-based discussions and induces misjudgment in self-assessment. Adv Health Sci Educ 2009; 14: 159-71
79. Modell JH, Cantwell S, Hardcastle J, Robertson S, Pablo L. Using the human patient simulator to educate students of veterinary medicine. J Vet Med Educ 2002; 29: 111-6
80. Keegan R, Henderson T, Brown G. Use of the virtual ventilator, a screen-based computer simulation, to teach the principles of mechanical ventilation. J Vet Med Educ 2009; 36: 436-43
81. Campos JH, Hallam EA, Ueda K. Training in placement of the leftsided double-lumen tube among non-thoracic anaesthesiologists: intubation model simulator versus computer-based digital video disc, a randomised controlled trial. Eur J Anaesthesiol 2011; 28: 169-74
82. Bruppacher HR,AlamSK, LeBlanc VR, et al. Simulation-based training improves physicians' performance in patient care in highstakes clinical setting of cardiac surgery. Anesthesiology 2010; 112: 985-92
83. ChandraDB, Savoldelli GL, Joo HS,Weiss ID, Naik VN. Fiberoptic oral intubation: the effect of model fidelity on training for transfer to patient care. Anesthesiology 2008; 109: 1007-13
84. Martin KM, Larsen PD, Segal R, Marsland CP. Effective nonanatomical endoscopy training produces clinical airway endoscopy proficiency. Anesth Analg 2004; 99: 938-44
85. Cummings AJ, Getz MA. Evaluation of a novel animal model for teaching intubation. Teach Learn Med 2006; 18: 316-9
86. Friedman Z, Siddiqui N, Katznelson R, Devito I, Bould MD, Naik V. Clinical impact of epidural anesthesia simulation on short-and long-termlearning curve: high-versus low-fidelity model training. Reg Anesth Pain Med 2009; 34: 229-32
87. Allen J, Meincke K, Ramirez M, Watts R, Marienau MS. A teaching tool in spinal anesthesia. AANA J 2003; 71: 29-36
88. St Pierre M, Hofinger G, Buerschaper C, et al. Simulator-based modular human factor training in anesthesiology. Concept and results of the module 'Communication and Team Cooperation' [German]. Anaesthesist 2004; 53: 144-52
89. Miotto HC, Couto BRGM, Goulart EMA, Amaral CFS, Moreira MDV. Advanced cardiac life support courses: live actors do not improve training results compared with conventional manikins. Resuscitation 2008; 76: 244-8
90. Muller MP, Hansel M, Fichtner A, et al. Excellence in performance andstress reduction duringtwodifferent full scale simulator training courses: a pilot study. Resuscitation 2009; 80: 919-24
91. Zausig YA, Grube C, Boeker-Blum T, et al. Inefficacy of simulatorbased training on anaesthesiologists' non-technical skills. Acta Anaesthesiol Scand 2009; 53: 611-9
92. Byrne AJ, Sellen AJ, Jones JG, et al. Effect of videotape feedback on anaesthetists' performance while managing simulated anaesthetic crises: a multicentre study. Anaesthesia 2002; 57: 176-9
93. Savoldelli GL, Naik VN, Park J, Joo HS, Chow R, Hamstra SJ. Value of debriefing during simulated crisis management: oral versus video-assisted oral feedback. Anesthesiology 2006; 105: 279-85
94. Welke TM, LeBlanc VR, Savoldelli GL, et al. Personalized oral debriefing versus standardized multimedia instruction after patient crisis simulation. Anesth Analg 2009; 109: 183-9
95. Rosenthal ME, Adachi M, Ribaudo V, Mueck JT, Schneider RF, Mayo PH. Achieving housestaff competence in emergency airway management using scenario based simulation training: comparison of attending vs housestaff trainers. Chest 2006; 129: 1453-8
96. Scavone BM, Toledo P, Higgins N,Wojciechowski K, McCarthy RJ. A randomized controlled trial of the impact of simulation-based training on resident performance during a simulated obstetric anesthesia emergency. Simul Healthc 2010; 5: 320-4
97. Ti L-K, Tan G-M, Khoo SGMY, Chen F-G. The impact of experiential learning on NUS medical students: our experience with task trainers and human-patient simulation. Ann Acad Med Singapore 2006; 35: 619-23
98. Johnson KB, Syroid ND, Drews FA, et al. Part task and variable priority training in first-year anesthesia resident education: a combined didactic and simulation-based approach to improve management of adverse airway and respiratory events. Anesthesiology 2008; 108: 831-40
99. Zendejas B, Brydges R, Wang AT, Cook DA. Patient outcomes in simulation-based medical education: a systematic review. J Gen Intern Med 2013; 28: 1078-89
100. Zendejas B, Wang AT, Brydges R, Hamstra SJ, Cook DA. Cost: the missing outcome in simulation-based medical education research: a systematic review. Surgery 2013; 153: 160-76
101. Isaranuwatchai W, Brydges R, Carnahan H, Backstein D, Dubrowski A. Comparing the cost-effectiveness of simulation modalities: a case study of peripheral intravenous catheterization training. Adv Health Sci Educ Theory Pract Advance Access published on 1 June 2013, PMID: 23728476
102. Raemer D, Anderson M, Cheng A, Fanning R, Nadkarni V, Savoldelli G. Research regarding debriefing as part of the learning process. Simul Healthc 2011; 6: S52-7
103. Brydges R, Dubrowski A, Regehr G. A new concept of unsupervised learning: directed self-guided learning in the health professions. Acad Med 2010; 85: S49-55
104. Wulf G, Shea C, Lewthwaite R. Motor skill learning and performance: a review of influential factors. Med Educ 2010; 44: 84
105. Bjork EL, Bjork R. MakingThingsHardonYourself, But ina GoodWay: Creating Desirable Difficulties to Enhance Learning. New York, NY: Worth Publishers, 2011; 56-64
106. Cook DA, West CP. Perspective: reconsidering the focus on 'outcomes research' in medical education: a cautionary note. Acad Med 2013; 88: 162-7
107. McGaghie WC. Medical education research as translational science. Sci Transl Med 2010; 2: 1-3
108. McGaghie WC, Draycott TJ, Dunn WF, Lopez CM, Stefanidis D. Evaluating the impact of simulation on translational patient outcomes. Simul Healthc 2011; 6: S42-7
109. Cook DA, Bordage G, Schmidt HG. Description, justification and clarification: a framework for classifying the purposes of research in medical education. Med Educ 2008; 42: 128-33