Standardized assessment for evaluation of team skills: Validity and feasibility

Simulation in Healthcare

Volumn 8, Issue 5, 2013, Pages 292-303

  Wright, Melanie C ^a,b   Segall, Noa ^c   Hobbs, Gene ^c   Phillips Bute, Barbara ^c   Maynard, Laura ^d   Taekman, Jeffrey M ^c  

^a Saint Alphonsus Regional Medical Center   (United States)

^b Trinity Institute for Health and Community Benefit   (United States)

^c DUKE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^d Santa Ana College   (United States)

Author keywords

Assertion; Assessment; Assistance; Communication; Conflict resolution; Situation assessment; Situation awareness; Team skills; TeamSTEPPS; Teamwork

Indexed keywords

ARTICLE; CLINICAL COMPETENCE; COMPUTER SIMULATION; EDUCATION; FEASIBILITY STUDY; HEALTH CARE QUALITY; HUMAN; INTERDISCIPLINARY COMMUNICATION; MEDICAL STUDENT; METHODOLOGY; NURSING STUDENT; ORGANIZATION AND MANAGEMENT; PATIENT CARE; PROGRAM EVALUATION; REPRODUCIBILITY; STANDARD; VALIDATION STUDY; VIDEORECORDING;

CLINICAL COMPETENCE; COMPUTER SIMULATION; EDUCATIONAL MEASUREMENT; FEASIBILITY STUDIES; HUMANS; INTERDISCIPLINARY COMMUNICATION; PATIENT CARE TEAM; PROGRAM EVALUATION; QUALITY ASSURANCE, HEALTH CARE; REPRODUCIBILITY OF RESULTS; STUDENTS, MEDICAL; STUDENTS, NURSING; VIDEOTAPE RECORDING;

EID: 84885390283     PISSN: 15592332     EISSN: 1559713X     Source Type: Journal    
DOI: 10.1097/SIH.0b013e318290a022     Document Type: Article

References (38)

1. Joint Commision. Update: sentinel event statistics. Jt Comm Perspect 2006;26:14-15.
2. Lingard L, Espin S, Whyte S, et al. Communication failures in the operating room: an observational classification of recurrent types and effects. Qual Saf Health Care 2004;13:330-334.
3. Helmreich RL, Davies J. Human factors in the operating room: interpersonal determinants of safety, efficiency, and morale. In: Aitkenhead AA, ed. Balliere's Clinical Anaesthesiology: Safety and Risk Management in Anaesthesia. London, England: Balliere Tindall; 1996:277-296.
4. Gaba DM. Crisis resource management and teamwork training in anaesthesia. Br J Anaesth 2010;105:3-6.
5. Baker DP, Salas E, King H, Battles J, Barach P. The role of teamwork in the professional education of physicians: current status and assessment recommendations. Jt Comm J Qual Patient Saf 2005;31:185-202.
6. Salas E. Is there a "big five" in teamwork? Small Group Res 2005;36:555-559.
7. Agency for Healthcare Research and Quality. TeamSTEPPS Team Strategies & Tools to Enhance Performance & Patient Safety. Rockville, MD: Agency for Healthcare Research and Quality. Available at: http://teamstepps.ahrq.gov/. Accessed February 3, 2011.
8. Neily J, Mills PD, Young-Xu Y, Carney BT, et al. Association between implementation of a medical team training program and surgical mortality. JAMA 2010;304:1693-1700.
9. Baker DP, Gustafson S, Beaubien J, Salas E, Barach P. Medical Teamwork and Patient Safety: The Evidence-Based Relation. Washington, DC: American Institutes for Research; 2003.
10. Salas E, Wilson KA, Burke CS, Wightman DC. Does crew resource management training work? An update, an extension, and some critical needs. Hum Factors 2006;48:392-412.
11. Fletcher G, Flin R, McGeorge P, Glavin R, Maran N, Patey R. Anaesthetists'Non-Technical Skills (ANTS): evaluation of a behavioural marker system. Br J Anaesth 2003;90:580-588.
12. Healey AN, Undre S, Vincent CA. Developing observational measures of performance in surgical teams. Qual Saf Health Care 2004; 13(Suppl 1):133-140.
13. Thomas EJ, Sexton JB, Helmreich RL. Translating teamwork behaviours from aviation to healthcare: development of behavioural markers for neonatal resuscitation. Qual Saf Health Care 2004; 13(Suppl 1):157-164.
14. Frankel A, Gardner R, Maynard L, Kelly A. Using the Communication and Teamwork Skills (CATS) Assessment to measure health care team performance. Jt Comm J Qual Patient Saf 2007;33:549-558.
15. Schraagen JM, Schouten T, Smit M, et al. Assessing and improving teamwork in cardiac surgery. Qual Saf Health Care 2010;19:1-6.
16. Malec JF, Tosher LC, Dunn WF, et al. The Mayo high performance teamwork scale: reliability and validity for evaluating key crew resource management skills. Simul Healthc 2007;2:4-10.
17. Moorthy K, Munz Y, Adams S, Pandey V, Darzi A. A human factors analysis of technical and team skills among surgical trainees during procedural simulations in a simulated operating theatre. Ann Surg 2005;242:631-639.
18. Morgan PJ, Pittini R, Regehr G, Marrs C, Haley MF. Evaluating teamwork in a simulated obstetric environment. Anesthesiology 2007;106:907-915.
19. Gaba DM, Howard SK, Flanagan B, Smith BE, Fish KJ, Botney R. Assessment of clinical performance during simulated crises using both technical and behavioral ratings. Anesthesiology 1998;89:8-36.
20. Wright MC, Petrusa ER, Griffin KL, Phillips-Bute BG, Hobbs GW, Taekman JM. Assessing teamwork in medical education and practice: relating behavioural teamwork ratings and clinical performance. Med Teach 2009;31:30-38.
21. Hobgood C, Sherwood G, Frush K, et al. Teamwork training with nursing and medical students: does the method matter? Results of an interinstitutional, interdisciplinary collaboration. Qual Saf Health Care 2010;19:e25.
22. Downing SM. Validity: on meaningful interpretation of assessment data. Med Educ 2003;37:830-837.
23. Wright MC, Luo X, Richardson WJ, et al. Piloting Team Coordination Training at Duke University Health System. Proceedings of the HFES 50th Annual Meeting. San Diego, CA: Human Factors and Ergonomics Society; 2006:949-953.
24. Baker DP, Salas E. Principles for measuring teamwork skills. Hum Factors 1992;34:469-475.
25. Behaviors that undermine a culture of safety. Sentinel Event Alert [Internet]. 2008; (40). Available at: http://www.jointcommission.org/sentinel- event-alert-issue-40-behaviors-that-undermine-a-culture-of-safety/.
26. Leape LL, Bates DW, Cullen DJ, et al. Systems analysis of adverse drug events. ADE Prevention Study Group. JAMA 1995;274:35-43.
27. Leape LL, Brennan TA, Laird N, et al. The nature of adverse events in hospitalized patients. Results of the Harvard Medical Practice Study II. N Engl J Med 1991;324:377-384.
28. Leonard M, Graham S, Bonacum D. The human factor: the critical importance of effective teamwork and communication in providing safe care. Qual Saf Health Care 2004;13(Suppl 1):185-190.
29. Waldrop WB,Murray DJ, Boulet JR, Kras JF. Management of anesthesia equipment failure: a simulation-based resident skill assessment. Anesth Analg 2009;109:426-433.
30. Henrichs BM, Avidan MS, Murray DJ, et al. Performance of certified registered nurse anesthetists and anesthesiologists in a simulation-based skills assessment. Anesth Analg 2009;108:255-262.
31. Flowerdew L, Gaunt A, Spedding J, et al. A multicentre observational study to evaluate a new tool to assess emergency physicians' non-technical skills. Emerg Med J 2012;[Epub ahead of print].
32. Brennan R. Generalizability Theory. New York, NY: Springer-Verlag; 2001.
33. Shavelson R,Webb N. Generalizability Theory: A Primer. Newbury Park, CA: Sage Publicatioons, Inc; 1991.
34. Brennan RL. Generalizability Theory. ITEMS; The Instructional Topics in Educational Measurement Series [Internet]. 2008-2010 November 1, 2010; Module 14 (Winter 1992):225-232. Available at: http://www.ncme.org/pubs/items.cfm.
35. Travillian KK, Volpe CE, Canon-Bowers JA, Salas E. Cross-Training Highly Interdependent Teams: Effects on Team Processes and Team Performance. Proceedings of the Human Factors and Ergonomics Society 37th Annual Meeting. Santa Monica, CA: Human Factors and Ergonomics Society; 1993:1243-1247.
36. Salas E, Nichols DR, Driskell JE. Testing three team training strategies in intact teams: a meta-analysis. Small Group Res 2007;38:471-488.
37. Fehr JJ, Boulet JR, Waldrop WB, Snider R, Brockel M, Murray DJ. Simulation-based assessment of pediatric anesthesia skills. Anesthesiology 2011;115:1308-1315.
38. Weller JM, Robinson BJ, Jolly B, et al. Psychometric characteristics of simulation-based assessment in anaesthesia and accuracy of self-assessed scores. Anaesthesia 2005;60:245-250.