Simulation-based assessment in anesthesiology: Requirements for practical implementation

Anesthesiology

Volumn 112, Issue 4, 2010, Pages 1041-1052

  Boulet, John R ^a   Murray, David J ^b,c  

^a FOUNDATION FOR ADVANCEMENT OF INTERNATIONAL MEDICAL EDUCATION AND RESEARCH   (United States)

^b ST LOUIS CHILDREN S HOSPITAL   (United States)

^c WASHINGTON UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANESTHESIOLOGY; CURRICULUM; MEDICAL EDUCATION; PATIENT SAFETY; PRIORITY JOURNAL; PSYCHOMETRY; REVIEW; SCORING SYSTEM; SIMULATION; SKILL;

ANESTHESIOLOGY; CLINICAL COMPETENCE; HUMANS; PATIENT SIMULATION; REPRODUCIBILITY OF RESULTS;

EID: 77950862304     PISSN: 00033022     EISSN: 15281175     Source Type: Journal    
DOI: 10.1097/ALN.0b013e3181cea265     Document Type: Review

References (132)

1. Scoles PV, Hawkins RE, LaDuca A: Assessment of clinical skills in medical practice. J Contin Educ Health Prof 2003; 23:182-190
2. Chin C, Arrica M, Bertolizio G, Ingelmo P: Simulation training in pediatric anesthesia. Minerva Anestesiol 2009; March 31 [Epub ahead of print]
3. Hubbard JP, Levit EJ, Schumacher CF, Schnabel TG, Jr: An objective evaluation of clinical competence. New technics used by the National Board of Medical Examiners. N Engl J Med 1965; 272:1321-1328
4. Epstein RM: Assessment in medical education. N Engl J Med 2007; 356:387-396
5. Grenvik A, Schaefer JJ III, DeVita MA, Rogers P: New aspects on critical care medicine training. Curr Opin Crit Care 2004; 10:233-237
6. Berkenstadt H, Erez D, Munz Y, Simon D, Ziv A: Training and assessment of trauma management: The role of simulation- based medical education. Anesthesiol Clin 2007; 25:65-74
7. Bradley P: The history of simulation in medical education and possible future directions. Med Educ 2006; 40:254-262
8. Srinivasan M, Hwang JC, West D, Yellowlees PM: Assess- ment of clinical skills using simulator technologies. Acad Psychiatry 2006; 30:505-515
9. Cooper JB, Taqueti VR: A brief history of the development of mannequin simulators for clinical education and training. Qual Saf Health Care 2006; 13(suppl 1):i11- 8
10. Boulet JR, Smee SM, Dillon GF, Gimpel JR: The use of standardized patient assessments for certification and licensure decisions. Simul Healthc 2009; 4:35-42
11. Boulet JR, Ben David MF, Ziv A, Burdick WP, Curtis M, Peitzman S, Gary NE: Using standardized patients to assess the interpersonal skills of physicians. Acad Med 1998; 73:S94 - 6
12. Morgan PJ, Pittini R, Regehr G, Marrs C, Haley MF: Evaluating teamwork in a simulated obstetric environment. ANESTHESIOLOGY 2007; 106:907-915
13. Melnick DE, Dillon GF, Swanson DB: Medical licensing examinations in the United States. J Dent Educ 2002; 66:595-599
14. Dillon GF, Clyman SG, Clauser BE, Margolis MJ: The introduction of computer-based case simulations into the United States Medical Licensing Examination. Acad Med 2002; 77:S94 - 6
15. Gimpel JR, Boulet JR, Errichetti AM: Evaluating the clinical skills of osteopathic medical students. J Am Osteopath Assoc 2003; 103:267-279
16. Edler AA: The use of simulation education in competency assessment: More questions than answers (letter). ANESTHESIOLOGY 2008; 108:167
17. Boulet JR, Swanson DB: Psychometric challenges of using simulations for high-stakes assessment, Simulations in Critical Care Education and Beyond. Edited by Dunn WF. Des Plains, Society of Critical Care Medicine, 2004, pp 119 -130
18. Boulet JR, Gimpel JR, Errichetti AM, Meoli FG: Using National Medical Care Survey data to validate examination content on a performance-based clinical skills assessment for osteopathic physicians. J Am Osteopath Assoc 2003; 103:225-231
19. Cook DA, Beckman TJ: Current concepts in validity and reliability for psychometric instruments: Theory and application. Am J Med 2006; 119:166.e7-16
20. Downing SM: Reliability: On the reproducibility of assessment data. Med Educ 2004; 38:1006-1012
21. Boulet JR, McKinley DW, Whelan GP, Hambleton RK: Quality assurance methods for performance-based assessments. Adv Health Sci Educ Theory Pract 2003; 8:27-47
22. Seropian MA: General concepts in full scale simulation: Getting started. Anesth Analg 2003; 97:1695-1705
23. Seropian MA, Brown K, Gavilanes JS, Driggers B: Simulation: Not just a manikin. J Nurs Educ 2004; 43:164-169
24. Issenberg SB, McGaghie WC, Hart IR, Mayer JW, Felner JM, Petrusa ER, Waugh RA, Brown DD, Safford RR, Gessner IH, Gordon DL, Ewy GA: Simulation technology for health care professional skills training and assessment. JAMA 1999; 282:861-866
25. Schwid HA: Anesthesia simulators-technology and applications. Isr Med Assoc J 2000; 2:949-953
26. Cooper JB, Taqueti VR: A brief history of the development of mannequin simulators for clinical education and training. Postgrad Med J 2008; 84:563-570
27. Cumin D, Merry AF: Simulators for use in anaesthesia. Anaesthesia 2007; 62:151-162
28. Ziv A, Rubin O, Sidi A, Berkenstadt H: Credentialing and certifying with simulation. Anesthesiol Clin 2007; 25: 261-269
29. Levine AI, Swartz MH: Standardized patients: The "other" simulation. J Crit Care 2008; 23:179-184
30. Waisel DB, Simon R, Truog RD, Baboolal H, Raemer DB: Anesthesiologist management of perioperative do-not-resuscitate orders: A simulation-based experiment. Simul Healthc 2009; 4:70-76
31. Sinz EH: Anesthesiology national CME program and ASA activities in simulation. Anesthesiol Clin 2007; 25:209-223
32. Scalese RJ, Obeso VT, Issenberg SB: Simulation technology for skills training and competency assessment in medical education. J Gen Intern Med 2008; 23(suppl 1):46-49
33. Gaba DM: The future vision of simulation in healthcare. Simul Healthc 2007; 2:126-135
34. Kapur PA, Steadman RH: Patient simulator competency testing: Ready for takeoff? Anesth Analg 1998; 86:1157-1159
35. McIntosh CA: Lake Wobegon for anesthesia where everyone is above average except those who aren't: Variability in the management of simulated intraoperative critical incidents. Anesth Analg 2009; 108:6-9
36. Glavin RJ, Gaba DM: Challenges and opportunities in simulation and assessment. Simul Healthc 2008; 3:69-71
37. McGaghie WC, Issenberg SB, Gordon DL, Petrusa ER: Assessment instruments used during anaesthetic simulation. Br J Anaesth 2001; 87:647-648
38. Morgan PJ, Cleave-Hogg D, DeSousa S, Tarshis J: Identification of gaps in the achievement of undergraduate anesthesia educational objectives using high-fidelity patient simulation. Anesth Analg 2003; 97:1690-1694
39. Hunt EA, Vera K, Diener-West M, Haggerty JA, Nelson KL, Shaffner DH, Pronovost PJ: Delays and errors in cardiopulmonary resuscitation and defibrillation by pediatric residents during simulated cardiopulmonary arrests. Resuscitation 2009; 80:819-825
40. Rose SH, Long TR, Elliott BA, Brown MJ: A historical perspective on resident evaluation, the Accreditation Council for Graduate Medical Education Outcome Project and Accreditation Council for Graduate Medical Education duty hour requirement. Anesth Analg 2009; 109: 190-193
41. Shilkofski NA, Nelson KL, Hunt EA: Recognition and treatment of unstable supraventricular tachycardia by pediatric residents in a simulation scenario. Simul Healthc 2008; 3:4-9
42. Daniels K, Lipman S, Harney K, Arafeh J, Druzin M: Use of simulation based team training for obstetric crises in resident education. Simul Healthc 2008; 3:154-160
43. Small SD: Simulation applications for human factors and systems evaluation. Anesthesiol Clin 2007; 25:237-259
44. Rosenblatt MA, Abrams KJ: The use of a human patient simulator in the evaluation of and development of a remedial prescription for an anesthesiologist with lapsed medical skills. Anesth Analg 2002; 94:149-153
45. Sundar E, Sundar S, Pawlowski J, Blum R, Feinstein D, Pratt S: Crew resource management and team training. Anesthesiol Clin 2007; 25:283-300
46. Matveevskii AS, Gravenstein N: Role of simulators, educational programs, and nontechnical skills in anesthesia resident selection, education, and competency assessment. J Crit Care 2008; 23:167-172
47. Dawson S: Procedural simulation: A primer. Radiology 2006; 241:17-25
48. Kneebone RL, Nestel D, Vincent C, Darzi A: Complexity, risk and simulation in learning procedural skills. Med Educ 2007; 41:808-814
49. McLaughlin SA, Doezema D, Sklar DP: Human simulation in emergency medicine training: A model curriculum. Acad Emerg Med 2002; 9:1310-1318
50. Bond WF, Lammers RL, Spillane LL, Smith-Coggins R, Fernandez R, Reznek MA, Vozenilek JA, Gordon JA: The use of simulation in emergency medicine: A research agenda. Acad Emerg Med 2007; 14:353-363
51. Bond WF, Spillane L: The use of simulation for emergency medicine resident assessment. Acad Emerg Med 2002; 9:1295-1299
52. Cantrell MJ, Deloney LA: Integration of standardized patients into simulation. Anesthesiol Clin 2007; 25:377-383
53. Nestel D, Kneebone R, Black S: Simulated patients and the development of procedural and operative skills. Med Teach 2006; 28:390-391
54. Issenberg SB, Scalese RJ: Simulation in health care education. Perspect Biol Med 2008; 51:31-46
55. Ogden PE, Cobbs LS, Howell MR, Sibbitt SJ, DiPette DJ: Clinical simulation: Importance to the internal medicine educational mission. Am J Med 2007; 120:820-824
56. Carroll JD, Messenger JC: Medical simulation: The new tool for training and skill assessment. Perspect Biol Med 2008; 51:47-60
57. Gaba DM, DeAnda A: A comprehensive anesthesia simulation environment: Re-creating the operating room for research and training. ANESTHESIOLOGY 1988; 69:387-394
58. Murray DJ, Boulet JR, Avidan M, Krause KC, Henrichs B, Woodhouse J, Evers AS: Performance of residents and anesthesiologists in a simulation-based skill assessment. ANESTHESIOLOGY 2007; 107:705-713
59. Murray DJ, Boulet JR, Kras JF, Woodhouse JA, Cox T, McAllister JD: Acute care skills in anesthesia practice: A simulation-based resident performance assessment. ANESTHESIOLOGY 2004; 101:1084-1095
60. Wilkinson TJ, Harris P: The transition out of medical school-A qualitative study of descriptions of borderline trainee interns. Med Educ 2002; 36:466-471
61. Murray D, Enarson C: Communication and teamwork: Essential to learn but difficult to measure. ANESTHESIOLOGY 2007; 106:895-896
62. Whelan GP, Boulet JR, McKinley DW, Norcini JJ, van Zanten M, Hambleton RK, Burdick WP, Peitzman SJ: Scoring standardized patient examinations: Lessons learned from the development and administration of the ECFMG Clinical Skills Assessment (CSA). Med Teach 2005; 27: 200-206
63. Adler MD, Trainor JL, Siddall VJ, McGaghie WC: Development and evaluation of high-fidelity simulation case scenarios for pediatric resident education. Ambul Pediatr 2007; 7:182-186
64. Scavone BM, Sproviero MT, McCarthy RJ, Wong CA, Sullivan JT, Siddall VJ, Wade LD: Development of an objective scoring system for measurement of resident performance on the human patient simulator. ANESTHESIOLOGY 2006; 105:260-266
65. Morgan PJ, Cleave-Hogg D, Guest CB: A comparison of global ratings and checklist scores from an undergraduate assessment using an anesthesia simulator. Acad Med 2001; 76:1053-1055
66. Gordon JA, Tancredi DN, Binder WD, Wilkerson WM, Shaffer DW: Assessment of a clinical performance evaluation tool for use in a simulator-based testing environment: A pilot study. Acad Med 2003; 78:S45-7
67. Morgan PJ, Lam-McCulloch J, Herold-McIlroy J, Tarshis J: Simulation performance checklist generation using the Delphi technique. Can J Anaesth 2007; 54:992-997
68. Wainer H. Estimating coefficients in linear models: It don't make no never mind. Psychol Bull 1976;83:213-217
69. Boulet JR, van Zanten M, De Champlain A, Hawkins RE, Peitzman SJ: Checklist content on a standardized patient assessment: An ex post facto review. Adv Health Sci Educ Theory Pract 2008; 13:59-69
70. Hunt EA, Walker AR, Shaffner DH, Miller MR, Pronovost PJ: Simulation of in-hospital pediatric medical emergencies and cardiopulmonary arrests: Highlighting the importance of the first 5 minutes. Pediatrics 2008; 121: e34-43
71. Girzadas DV Jr, Clay L, Caris J, Rzechula K, Harwood R: High fidelity simulation can discriminate between novice and experienced residents when assessing competency in patient care. Med Teach 2007; 29:452-456
72. Baker DP, Salas E, King H, Battles J, Barach P: The role of teamwork in the professional education of physicians: Current status and assessment recommendations. Jt Comm J Qual Patient Saf 2005; 31:185-202
73. van Zanten M, Boulet JR, McKinley DW, De Champlain A, Jobe AC: Assessing the communication and interpersonal skills of graduates of international medical schools as part of the United States Medical Licensing Exam (USMLE) Step 2 Clinical Skills (CS) Exam. Acad Med 2007; 82: S65- 8
74. Weller JM, Bloch M, Young S, Maze M, Oyesola S, Wyner J, Dob D, Haire K, Durbridge J, Walker T, Newble D: Evaluation of high fidelity patient simulator in assessment of performance of anaesthetists. Br J Anaesth 2003; 90: 43-47
75. Boulet JR, Rebbecchi TA, Denton EC, McKinley DW, Whelan GP: Assessing the written communication skills of medical school graduates. Adv Health Sci Educ Theory Pract 2004; 9:47-60
76. Swanson DB, Clauser BE, Case SM: Clinical skills assessment with standardized patients in high-stakes tests: A framework for thinking about score precision, equating, and security. Adv Health Sci Educ Theory Pract 1999; 4:67-106
77. Holmboe ES, Cassel CK: The role of physicians and certification boards to improve quality. Am J Med Qual 2007; 22:18-25
78. Klass D: Assessing doctors at work-progress and challenges. N Engl J Med 2007; 356:414-415
79. Morgan PJ, Cleave-Hogg D, DeSousa S, Tarshis J: Highfidelity patient simulation: Validation of performance checklists. Br J Anaesth 2004; 92:388-392
80. Gaba DM, Howard SK, Flanagan B, Smith BE, Fish KJ, Botney R: Assessment of clinical performance during simulated crises using both technical and behavioral ratings. ANESTHESIOLOGY 1998; 89:8-18
81. Byrne AJ, Greaves JD: Assessment instruments used during anaesthetic simulation: Review of published studies. Br J Anaesth 2001; 86:445-450
82. Fletcher GCL, McGeorge P, Flin RH, Glavin RJ, Maran NJ: The role of non-technical skills in anaesthesia: A review of current literature. Br J Anaesth 2002; 88:418-429
83. Morgan PJ, Cleave-Hogg D, Desousa S, Lam-McCulloch J: Applying theory to practice in undergraduate education using high fidelity simulation. Med Teach 2006; 28:e10 -5
84. van der Vleuten CP, Norman GR, De Graaff E: Pitfalls in the pursuit of objectivity: Issues of reliability. Med Educ 1991; 25:110-118
85. Devitt JH, Kurrek MM, Cohen MM, Fish K, Fish P, Noel AG, Szalai JP: Testing internal consistency and construct validity during evaluation of performance in a patient simulator. Anesth Analg 1998; 86:1160-1164
86. Shayne P, Gallahue F, Rinnert S, Anderson CL, Hern G, Katz E: Reliability of a core competency checklist assessment in the emergency department: The Standardized Direct Observation Assessment Tool. Acad Emerg Med 2006; 13:727-732
87. Brett-Fleegler MB, Vinci RJ, Weiner DL, Harris SK, Shih MC, Kleinman ME: A simulator-based tool that assesses pediatric resident resuscitation competency. Pediatrics 2008; 121:e597- 603
88. Boulet JR. Generalizability theory: Basics, Encyclopedia of Statistics in Behavioral Science. Edited by Everitt BS, Howell DC. Chichester, Wiley, 2005, pp 704 -711
89. Thompson B. A brief introduction to generalizability theory, Score Reliability: Contemporary Thinking on Reliability Issues. Edited by Thompson B. Thousand Oaks, Sage Publications, Inc., 2003, pp 43-58
90. Vu NV, Barrows HS: Use of standardized patients in clinical assessments: Recent developments and measurement findings. Educ Res 1994; 23:23-30
91. Berkenstadt H, Ziv A, Gafni N, Sidi A: Incorporating simulation-based objective structured clinical examination into the Israeli National Board Examination in ANESTHESIOLOGY. Anesth Analg 2006; 102:853-858
92. Savoldelli GL, Naik VN, Joo HS, Houston PL, Graham M, Yee B, Hamstra SJ: Evaluation of patient simulator performance as an adjunct to the oral examination for senior anesthesia residents. ANESTHESIOLOGY 2006; 104:475-481
93. Devitt JH, Kurrek MM, Cohen MM, Fish K, Fish P, Murphy PM, Szalai JP: Testing the raters: Inter-rater reliability of standardized anaesthesia simulator performance. Can J Anaesth 1997; 44:924-928
94. Schwid HA, Rooke GA, Carline J, Steadman RH, Murray WB, Olympio M, Tarver S, Steckner K, Wetstone S: Eval- uation of anesthesia residents using mannequin-based simulation: A multiinstitutional study. ANESTHESIOLOGY 2002; 97:1434-1444
95. Ringsted C, Ostergaard D, Ravn L, Pedersen JA, Berlac PA, Van der Vleuten CPM: A feasibility study comparing checklists and global rating forms to assess resident performance in clinical skills. Med Teach 2003; 25:654-658
96. Weller JM, Jolly B, Robinson B: Generalisability of behavioural skills in simulated anaesthetic emergencies. Anaesth Intensive Care 2008; 36:185-189
97. Weller JM, Robinson BJ, Jolly B, Watterson LM, Joseph M, Bajenov S, Haughton AJ, Larsen PD: Psychometric characteristics of simulation-based assessment in anaesthesia and accuracy of self-assessed scores. Anaesthesia 2005; 60:245-250
98. Murray DJ, Boulet JR, Kras JF, McAllister JD, Cox TE: A simulation-based acute skills performance assessment for anesthesia training. Anesth Analg 2005; 101:1127-1134
99. Downing SM: Validity: On the meaningful interpretation of assessment data. Med Educ 2003; 37:830-837
100. Kane MT: Current concerns in validity theory. J Educ Meas 2001; 38:319-342
101. Clauser BE, Margolis MJ, Swanson DB: Issues of validity and reliability for assessments in medical education, Practical Guide to the Evaluation of Clinical Competence, 1st edition. Edited by Holmboe ES, Hawkins RE. Philadelphia, Mosby/Elsevier, 2008, pp 10 -23
102. Grand'Maison P, Brailovsky CA, Lescop J: Content validity of the Quebec licensing examination (OSCE). Assessed by practising physicians. Can Fam Physician 1996; 42: 254-259
103. Berkenstadt H, Ziv A, Gafni N, Sidi A: The validation process of incorporating simulation-based accreditation into the ANESTHESIOLOGY Israeli national board exams. Isr Med Assoc J 2006; 8:728-733 (Pubitemid 44696921)
104. Gordon JA, Wilkerson WM, Shaffer DW, Armstrong EG: "Practicing" medicine without risk: Students' and educators' responses to high-fidelity patient simulation. Acad Med 2001; 76:469-472
105. Farrell SE: Evaluation of student performance: Clinical and professional performance. Acad Emerg Med 2005; 12:302.e6-10
106. Rosenthal R, Gantert WA, Hamel C, Hahnloser D, Metzger J, Kocher T, Vogelbach P, Scheidegger D, Oertli D, Clavien PA: Assessment of construct validity of a virtual reality laparoscopy simulator. J Laparoendosc Adv Surg Tech A 2007; 17:407-413
107. Young JS, Stokes JB, Denlinger CE, Dubose JE: Proactive versus reactive: The effect of experience on performance in a critical care simulator. Am J Surg 2007; 193:100-104
108. Boulet JR, Murray D, Kras J, Woodhouse J: Setting performance standards for mannequin-based acute-care scenarios. Simul Healthc 2008; 3:72-81
109. Reznick RK, MacRae H: Teaching surgical skills- changes in the wind. N Engl J Med 2006; 355:2664-2669
110. Tamblyn R, Abrahamowicz M, Dauphinee D, Wenghofer E, Jacques A, Klass D, Smee S, Blackmore D, Winslade N, Girard N, Du Berger R, Bartman I, Buckeridge DL, Hanley JA: Physician scores on a national clinical skills examination as predictors of complaints to medical regulatory authorities. JAMA 2007; 298:993-1001
111. Hatala R, Issenberg SB, Kassen B, Cole G, Bacchus CM, Scalese RJ: Assessing cardiac physical examination skills using simulation technology and real patients: A comparison study. Med Educ 2008; 42:628-636
112. Leape LL, Fromson JA: Problem doctors: Is there a system- level solution? Ann Intern Med 2006; 144:107-115
113. Fox-Robichaud AE, Nimmo GR: Education and simulation techniques for improving reliability of care. Curr Opin Crit Care 2007; 13:737-741
114. Knudson MM, Khaw L, Bullard MK, Dicker R, Cohen MJ, Staudenmayer K, Sadjadi J, Howard S, Gaba D, Krummel T: Trauma training in simulation: Translating skills from SIM time to real time. J Trauma 2008; 64:255-263
115. Ferris TG, Vogeli C, Marder J, Sennett CS, Campbell EG: Physician specialty societies and the development of physician performance measures. Health Aff (Millwood) 2007; 26:1712-1719
116. Howard SK, Gaba DM, Fish KJ, Yang G, Sarnquist FH: Anesthesia crisis resource management training: Teaching anesthesiologists to handle critical incidents. Aviat Space Environ Med 1992; 63:763-770
117. Pian-Smith MCM, Simon R, Minehart RD, Podraza M, Rudolph J, Walzer T, Raemer D: Teaching residents the two-challenge rule: A simulation-based approach to improve education and patient safety. Simul Healthc 2009; 4:84-91
118. Fernandez R, Vozenilek JA, Hegarty CB, Motola I, Reznek M, Phrampus PE, Kozlowski SWJ: Developing expert medical teams: Toward an evidence-based approach. Acad Emerg Med 2008; 15:1025-1036
119. Morgan PJ, Cleave-Hogg D: A Canadian simulation experience: Faculty and student opinions of a performance evaluation study. Br J Anaesth 2000; 85:779-781
120. Langdon MG, Cunningham AJ: High-fidelity simulation in post-graduate training and assessment: An Irish perspective. Ir J Med Sci 2007; 176:267-271
121. Yee B, Naik VN, Joo HS, Savoldelli GL, Chung DY, Houston PL, Karatzoglou BJ, Hamstra SJ: Nontechnical skills in anesthesia crisis management with repeated exposure to simulation-based education. ANESTHESIOLOGY 2005; 103: 241-248
122. Gaba DM, DeAnda A: The response of anesthesia trainees to simulated critical incidents. Anesth Analg 1989; 68: 444-451
123. Kuduvalli PM, Jervis A, Tighe SQM, Robin NM: Unanticipated difficult airway management in anaesthetised patients: A prospective study of the effect of mannequin training on management strategies and skill retention. Anaesthesia 2008; 63:364-369
124. Waldrop WB, Murray DJ, Boulet JR, Kras JF: Management of anesthesia equipment failure: A simulation-based resident skill assessment. Anesth Analg 2009; 109:426-433
125. Wright MC, Phillips-Bute BG, Petrusa ER, Griffin KL, Hobbs GW, Taekman JM: Assessing teamwork in medical education and practice: Relating behavioural teamwork ratings and clinical performance. Med Teach 2009; 31: 30-38
126. Morgan PJ, Cleave-Hogg DM, Guest CB, Herold J: Validity and reliability of undergraduate performance assessments in an anesthesia simulator. Can J Anaesth 2001; 48:225-233
127. Morgan PJ, Cleave-Hogg D: Evaluation of medical students' performance using the anaesthesia simulator. Med Educ 2000; 34:42-45
128. Weller JM, Merry AF, Robinson BJ, Warman GR, Janssen A: The impact of trained assistance on error rates in anaesthesia: A simulation-based randomised controlled trial. Anaesthesia 2009; 64:126-130
129. Domuracki KJ, Moule CJ, Owen H, Kostandoff G, Plummer JL: Learning on a simulator does transfer to clinical practice. Resuscitation 2009; 80:346-349
130. Kuduvalli PM, Parker CJR, Leuwer M, Guha A: Retention and transferability of team resource management skills in anaesthetic emergencies: The long-term impact of a highfidelity simulation-based course. Eur J Anaesthesiol 2009; 26:17-22
131. Blum RH, Raemer DB, Carroll JS, Sunder N, Felstein DM, Cooper JB: Crisis resource management training for an anaesthesia faculty: A new approach to continuing education. Med Educ 2004; 38:45-55
132. Okuda Y, Bryson EO, DeMaria S Jr, Jacobson L, Quinones J, Shen B, Levine AI: The utility of simulation in Medical education: What is the evidence? Mt Sinai J Med 2009; 76:330-343