Simulation with PARTS (Phase-augmented research and training scenarios): A structure facilitating research and assessment in simulation

Simulation in Healthcare

Volumn 10, Issue 3, 2015, Pages 178-187

  Schick, Carl J ^a   Weiss, Mona ^b   Kolbe, Michaela ^b   Marty, Adrian ^a   Dambach, Micha ^a   Knauth, Axel ^a   Spahn, Donat R ^a   Grote, Gudela ^b   Grande, Bastian ^a  

^a UNIVERSITY HOSPITAL ZURICH   (Switzerland)

^b ETH ZURICH   (Switzerland)

Author keywords

Anesthesia; Assessment; Complex cases; Crisis resource management; Debriefing; Facilitation; Feedback; Measurement; Phase separation; Rating; Scenario design; Simulation; Training; Visual rating tool

Indexed keywords

CLINICAL COMPETENCE; HUMAN; MEDICAL EDUCATION; ORGANIZATION AND MANAGEMENT; REPRODUCIBILITY; SIMULATION TRAINING; STANDARDS;

CLINICAL COMPETENCE; HUMANS; INTERNSHIP AND RESIDENCY; REPRODUCIBILITY OF RESULTS; SIMULATION TRAINING;

EID: 84930825178     PISSN: 15592332     EISSN: 1559713X     Source Type: Journal    
DOI: 10.1097/SIH.0000000000000085     Document Type: Article

References (77)

1. McGaghie WC, Issenberg SB, Petrusa ER, Scalese RJ,. A critical review of simulation-based medical education research: 2003-2009. Med Educ 2010; 44: 50-63.
2. Fanning RM, Gaba DM,. The role of debriefing in simulation-based learning. Simul Healthc 2007; 2: 115-125.
3. Rudolph JW, Simon R, Raemer DB, Eppich WJ,. Debriefing as formative assessment: closing performance gaps in medical education. Acad Emerg Med 2008; 15: 1010-1016.
4. Levine AI, Flynn BC, Bryson EO, Demaria S Jr,. Simulation-based Maintenance of Certification in Anesthesiology (MOCA) course optimization: use of multi-modality educational activities. J Clin Anesth 2012; 24: 68-74.
5. Berkenstadt H, Ziv A, Gafni N, Sidi A,. Incorporating simulation-based objective structured clinical examination into the Israeli National Board Examination in Anesthesiology. Anesth Analg 2006; 102: 853-858.
6. Weller J, Morris R, Watterson L, Effective management of anaesthetic crises: development and evaluation of a college-accredited simulation-based course for anaesthesia education in Australia and New Zealand. Simul Healthc 2006; 1: 209-214.
7. Hatala R, Kassen BO, Nishikawa J, Cole G, Issenberg SB,. Incorporating simulation technology in a Canadian internal medicine specialty examination: a descriptive report. Acad Med 2005; 80: 554-556.
8. Gallagher AG, Cates CU,. Approval of virtual reality training for carotid stenting: what this means for procedural-based medicine. JAMA 2004; 292: 3024-3026.
9. McGaghie WC, Draycott TJ, Dunn WF, Lopez CM, Stefanidis D,. Evaluating the impact of simulation on translational patient outcomes. Simul Healthc 2011; 6 (suppl): S42-S47.
10. Woolf SH,. The meaning of translational research and why it matters. JAMA 2008; 299: 211-213.
11. Gaba DM, Howard SK, Flanagan B, Smith BE, Fish KJ, Botney R,. Assessment of clinical performance during simulated crises using both technical and behavioral ratings. Anesthesiology 1998; 89: 8-18.
12. Künzle B, Zala-Mezö E, Kolbe M, Wacker J, Grote G,. Substitutes for leadership in anaesthesia teams and their impact on leadership effectiveness. European Journal of Work and Organizational Psychology 2010; 19: 505-531.
13. Tschan F, Semmer NK, Hunziker PR, Marsch SCU,. Decisive action vs. joint deliberation: different medical tasks imply different coordination requirements. Advances in Human Factors and Ergonomics in Healthcare 2011: 191-200.
14. Tschan F, Semmer NK, Vetterli M, Gurtner A, Hunziker S, Marsch SU,. Developing observational categories for group process research based on task and coordination requirement analysis: examples from research on medical emergency-driven teams. In: Coordination in Human and Primate Groups. Berlin, Heidelberg: Springer Berlin Heidelberg; 2011: 93-115.
15. Clayton MJ,. Delphi: a technique to harness expert opinion for critical decision-making tasks in education. Educational Psychology 1997; 17: 373-386.
16. Dieckmann P, Lippert A, Glavin R, Rall M,. When things do not go as expected: scenario life savers. Simul Healthc 2010; 5: 219-225.
17. Rosen MA, Salas E, Wu TS, Promoting teamwork: an event-based approach to simulation-based teamwork training for emergency medicine residents. Acad Emerg Med 2008; 15: 1190-1198.
18. Rosen MA, Salas E, Silvestri S, Wu TS, Lazzara EH,. A measurement tool for simulation-based training in emergency medicine: the simulation module for assessment of resident targeted event responses (SMARTER) approach. Simul Healthc 2008; 3: 170-179.
19. Fowlkes JE, Lane NE, Salas E, Franz T, Oser R,. Improving the measurement of team performance: the TARGETs methodology. Military Psychology 1994; 6: 47-61.
20. Fowlkes JE, Dwyer DJ, Oser RL, Salas E,. Event-based approach to training (EBAT). Int J Aviat Psychol 1998; 8: 209-221.
21. Weingart LR,. How did they do that? The ways and means of studying group processes. Research in Organizational Behavior 1997; 19: 189-240.
22. Kolbe M, Weiss M, Grote G, TeamGAINS: a tool for structured debriefings for simulation-based team trainings. BMJ Qual Saf 2013; 22: 541-553.
23. Nembhard IM, Edmondson AC,. Making it safe: the effects of leader inclusiveness and professional status on psychological safety and improvement efforts in health care teams. Journal of Organizational Behavior 2006; 27: 941-966.
24. Adler MD, Vozenilek JA, Trainor JL, Comparison of checklist and anchored global rating instruments for performance rating of simulated pediatric emergencies. Simul Healthc 2011; 6: 18-24.
25. Ahmed M, Sevdalis N, Paige J, Paragi-Gururaja R, Nestel D, Arora S,. Identifying best practice guidelines for debriefing in surgery: a tri-continental study. Am J Surg 2012; 203: 523-529.
26. Beaubien M, Baker DP,. The use of simulation for training teamwork skills in health care: how low can you go? Qual Saf Health Care 2004; 13: i51-i56.
27. Birsner ML, Satin AJ,. Developing a program, a curriculum, a scenario. Semin Perinatol 2013; 37: 175-178.
28. Blum RH, Boulet JR, Cooper JB, Muret-Wagstaff SL, Harvard Assessment of Anesthesia Resident Performance Research Group. Simulation-based assessment to identify critical gaps in safe anesthesia resident performance. Anesthesiology 2014; 120: 129-141.
29. Boulet JR, Murray D, Kras J, Woodhouse J,. Setting performance standards for mannequin-based acute-care scenarios: an examinee-centered approach. Simul Healthc 2008; 3: 72-81.
30. Boulet JR, Murray DJ,. Simulation-based assessment in anesthesiology: requirements for practical implementation. Anesthesiology 2010; 112: 1041-1052.
31. Cantillon P, Wood D, Hutchinson L,. ABC of learning and teaching in medicine. London: BMJ Books; 2003.
32. Carraccio CL, Benson BJ, Nixon LJ, Derstine PL,. From the educational bench to the clinical bedside: translating the Dreyfus developmental model to the learning of clinical skills. Acad Med 2008; 83: 761-767.
33. Cristancho SM, Moussa F, Dubrowski A,. A framework-based approach to designing simulation-augmented surgical education and training programs. Am J Surg 2011; 202: 344-351.
34. Cheng A, Rodgers DL, van der Jagt É Eppich W, O'Donnell J,. Evolution of the Pediatric Advanced Life Support course: enhanced learning with a new debriefing tool and Web-based module for Pediatric Advanced Life Support instructors. Pediatr Crit Care Med 2012; 13: 589-595.
35. Cooper JB, Singer SJ, Hayes J, Design and evaluation of simulation scenarios for a program introducing patient safety, teamwork, safety leadership, and simulation to healthcare leaders and managers. Simul Healthc 2011; 6: 231-238.
36. Donoghue A, Nishisaki A, Sutton R, Hales R, Boulet J,. Reliability and validity of a scoring instrument for clinical performance during Pediatric Advanced Life Support simulation scenarios. Resuscitation 2010; 81: 331-336.
37. Donoghue A, Ventre K, Boulet J, Design, implementation, and psychometric analysis of a scoring instrument for simulated pediatric resuscitation: a report from the EXPRESS pediatric investigators. Simul Healthc 2011; 6: 71-77.
38. Downing SM, Haladyna TM,. Validity threats: overcoming interference with proposed interpretations of assessment data. Med Educ 2004; 38: 327-333.
39. Edler AA, Fanning RG, Chen MI, Patient simulation: a literary synthesis of assessment tools in anesthesiology. J Educ Eval Health Prof 2009; 6: 3.
40. Fehr JJ, Boulet JR, Waldrop WB, Snider R, Brockel M, Murray DJ,. Simulation-based assessment of pediatric anesthesia skills. Anesthesiology 2011; 115: 1308-1315.
41. Frost EA,. Comprehensive Guide to Education in Aanesthesia. Springer; 2014.
42. Gaba DM, DeAnda A,. A comprehensive anesthesia simulation environment: re-creating the operating room for research and training. Anesthesiology 1988; 69: 387-394.
43. Gaba DM,. The future vision of simulation in health care. Qual Saf Health Care 2004; 13: i2-i10.
44. Gerard JM, Kessler DO, Braun C, Mehta R, Scalzo AJ, Auerbach M,. Validation of global rating scale and checklist instruments for the infant lumbar puncture procedure. Simul Healthc 2013; 8: 148-154.
45. Gordon JA, Tancredi DN, Binder WD, Wilkerson WM, Shaffer DW,. Assessment of a clinical performance evaluation tool for use in a simulator-based testing environment: a pilot study. Acad Med 2003; 78: S45-S47.
46. Gordon JA, Oriol NE, Cooper JB,. Bringing good teaching cases "to life": a simulator-based medical education service. Acad Med 2004; 79: 23-27.
47. Issenberg SB, McGaghie WC, Hart IR, Simulation technology for health care professional skills training and assessment. JAMA 1999; 282: 861-866.
48. Issenberg SB, McGaghie WC, Petrusa ER, Lee Gordon D, Scalese RJ,. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach 2005; 27: 10-28.
49. Issenberg SB, Ringsted C, Ostergaard D, Dieckmann P,. Setting a research agenda for simulation-based healthcare education: a synthesis of the outcome from an Utstein style meeting. Simul Healthc 2011; 6: 155-167.
50. Kim J, Neilipovitz D, Cardinal P, Chiu M, Clinch J,. A pilot study using high-fidelity simulation to formally evaluate performance in the resuscitation of critically ill patients: the University of Ottawa Critical Care Medicine, High-Fidelity Simulation, and Crisis Resource Management I Study. Crit Care Med 2006; 34: 2167-2174.
51. Morgan PJ, Cleave-Hogg D, DeSousa S, Tarshis J,. High-fidelity patient simulation: validation of performance checklists. Br J Anaesth 2004; 92: 388-392.
52. Morgan PJ, Lam-McCulloch J, Herold-McIlroy J, Tarshis J,. Simulation performance checklist generation using the Delphi technique. Can J Anaesth 2007; 54: 992-997.
53. Morgan PJ, Cleave-Hogg D, Guest CB,. A comparison of global ratings and checklist scores from an undergraduate assessment using an anesthesia simulator. Acad Med 2001; 76: 1053-1055.
54. Morgan PJ, Cleave-Hogg DM, Guest CB, Herold J,. Validity and reliability of undergraduate performance assessments in an anesthesia simulator. Can J Anaesth 2001; 48: 225-233.
55. Morgan PJ, Kurrek MM, Bertram S, LeBlanc V, Przybyszewski T,. Nontechnical skills assessment after simulation-based continuing medical education. Simul Healthc 2011; 6: 255-259.
56. Neal JM, Hsiung RL, Mulroy MF, Halpern BB, Dragnich AD, Slee AE,. ASRA checklist improves trainee performance during a simulated episode of local anesthetic systemic toxicity. Reg Anesth Pain Med 2012; 37: 8-15.
57. Norcini J,. Being smarter about SMARTER: a commentary on "a measurement tool for simulation-based training in emergency medicine: the simulation module for assessment of resident targeted event responses approach". Simul Healthc 2008; 3: 131-132.
58. Pastis NJ, Doelken P, Vanderbilt AA, Walker J, Schaefer JJ 3rd,. Validation of simulated difficult bag-mask ventilation as a training and evaluation method for first-year internal medicine house staff. Simul Healthc 2013; 8: 20-24.
59. Pierre MS, Breuer G,. Simulation in der medizin: Grundlegende konzepte-klinische anwendung. Springer-Verlag; 2013.
60. Raemer D, Anderson M, Cheng A, Fanning R, Nadkarni V, Savoldelli G,. Research regarding debriefing as part of the learning process. Simul Healthc 2011; 6 (suppl): S52-S57.
61. Reznek M, Smith-Coggins R, Howard S, Emergency medicine crisis resource management (EMCRM): pilot study of a simulation-based crisis management course for emergency medicine. Acad Emerg Med 2003; 10: 386-389.
62. Riley RH,. Manual of Simulation in Healthcare. Oxford, New York: Oxford University Press; 2008.
63. Rudolph JW, Simon R, Dufresne RL, Raemer DB,. There's no such thing as "nonjudgmental" debriefing: a theory and method for debriefing with good judgment. Simul Healthc 2006; 1: 49-55.
64. Salas E, Rosen A, Held D, Weissmuller J,. Performance measurement insimulation-based training: a review and best practices. Simulation & Gaming 2009; 40: 328-376.
65. Scalese RJ, Obeso VT, Issenberg SB,. Simulation technology for skills training and competency assessment in medical education. J Gen Intern Med 2008; 23 (suppl 1): 46-49.
66. Schwid HA,. Anesthesia simulators-technology and applications. Isr Med Assoc J 2000; 2: 949-953.
67. Schwid HA, Rooke GA, Carline J, Evaluation of anesthesia residents using mannequin-based simulation: a multiinstitutional study. Anesthesiology 2002; 97: 1434-1444.
68. Seropian MA,. General concepts in full scale simulation: getting started. Anesth Analg 2003; 97: 1695-1705.
69. Sinz EH,. Anesthesiology national CME program and ASA activities in simulation. Anesthesiol Clin 2007; 25: 209-223.
70. Stout RJ, Salas E, Fowlkes JE,. Enhancing teamwork in complex environments through team training. Group Dyn 1997; 1: 169-182.
71. Wass V, Van der Vleuten C, Shatzer J, Jones R,. Assessment of clinical competence. Lancet 2001; 357: 945-949.
72. Ziv A, Rubin O, Sidi A, Berkenstadt H,. Credentialing and certifying with simulation. Anesthesiol Clin 2007; 25: 261-269.
73. Künzle B, Zala-Mezö E, Wacker J, Kolbe M, Spahn DR, Grote G,. Leadership in anaesthesia teams: the most effective leadership is shared. Qual Saf Health Care 2010; 19: e46.
74. Rudolph JW, Morrison JB, Carroll JS,. The dynamics of action-oriented problem solving: linking interpretation and choice. Acad Manage Rev 2009; 34: 733-756.
75. Van Heukelom JN, Begaz T, Treat R,. Comparison of postsimulation debriefing versus in-simulation debriefing in medical simulation. Simul Healthc 2010; 5: 91-97.
76. Mudumbai SC, Gaba DM, Boulet JR, Howard SK, Davies MF,. External validation of simulation-based assessments with other performance measures of third-year anesthesiology residents. Simul Healthc 2012; 7: 73-80.
77. Swartz MH, Colliver JA, Bardes CL, Charon R, Fried ED, Moroff S,. Validating the standardized-patient assessment administered to medical students in the New York City Consortium. Acad Med 1997; 72: 619-626.