Development and validation of a tool to assess emergency physicians' nontechnical skills

Annals of Emergency Medicine

Volumn 59, Issue 5, 2012, Pages

  Flowerdew, Lynsey ^a   Brown, Ruth ^b   Vincent, Charles ^a   Woloshynowych, Maria ^a  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b IMPERIAL COLLEGE HEALTHCARE NHS TRUST   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; ASSERTIVENESS; AUTHORITY; AWARENESS; BEHAVIORAL MARKER SYSTEM; CLINICAL DECISION MAKING; CLINICAL SUPERVISION; CONFLICT MANAGEMENT; CONTENT VALIDITY; DATA ANALYSIS; EMERGENCY PHYSICIAN; EMERGENCY WARD; HEALTH CARE PERSONNEL; HUMAN; INTERPERSONAL COMMUNICATION; INTERVIEW; MEDICAL EDUCATION; MEDICAL EXPERT; NONTECHNICAL SKILL; OBSERVATIONAL METHOD; PERFORMANCE MEASUREMENT SYSTEM; PRIORITY JOURNAL; PROFESSIONAL STANDARD; SKILL; TEAM BUILDING; VALIDATION STUDY; WORKLOAD;

EID: 84862809363     PISSN: 01960644     EISSN: 10976760     Source Type: Journal    
DOI: 10.1016/j.annemergmed.2011.11.022     Document Type: Article

References (53)

1. R. Flin, R. O'Connor, M. Crichton Safety at the Sharp End: A Guide to Non-technical Skills 2008 Ashgate Farnham, UK
2. K.S. Cosby Characteristics of patient care management problems identified in emergency department morbidity and mortality investigations during 15 years Ann Emerg Med 51 2008 251 261
3. J. Morey, R. Simon, G.D. Jay Error reduction and performance improvement in the emergency department through formal teamwork training: evaluation results of the MedTeams Project Health Serv Res 37 2002 1553 1581
4. P.O. Andersen, R. Maaløe, H.B. Andersen Critical incidents related to cardiac arrests reported to the Danish Patient Safety Database Resuscitation 81 2010 312 316
5. T. Manser Teamwork and patient safety in dynamic domains of healthcare: a review of the literature Acta Anaesthesiol Scand 53 2009 143 151
6. P. O'Connor, J. Campbell, J. Newon Crew resource management training effectiveness: a meta-analysis and some critical needs Int J Aviation Psychol 18 2008 353 368
7. J. Kim, D. Neilipovitz, P. Cardinal A pilot study using high-fidelity simulation to formally evaluate performance in the resuscitation of critically ill patients: the University of Ottawa Critical Care Medicine, High-Fidelity Simulation, and Crisis Resource Management I Study Crit Care Med 34 2006 2167 2174
8. P.O. Andersen, M.K. Jensen, A. Lippert Development of a formative assessment tool for measurement of performance in multi-professional resuscitation teams Resuscitation 81 2010 703 711
9. S.D. Small, R.C. Wuerz, R. Simon Demonstration of high-fidelity simulation team training for emergency medicine Acad Emerg Med 6 1999 312 323
10. G. Fletcher, R. Flin, P. McGeorge Anaesthetists' Non-Technical Skills (ANTS): evaluation of a behavioural marker system Br J Anaesth 90 2003 580 588
11. S. Yule, R. Flin, S. Paterson-Brown Development of a rating system for surgeons' non-technical skills Med Educ 40 2006 1098 1104
12. L. Flowerdew, R. Brown, C. Vincent Identifying non-technical skills associated with safety in the emergency department: a scoping review of the literature Ann Emerg Med 59 2012 386 394
13. S. Yule, R. Flin, N. Maran Surgeons' non-technical skills in the operating room: reliability testing of the NOTSS behavior rating system World J Surg 32 2008 548 556
14. J. Malec, L.C. Torsher, W.F. Dunn The Mayo High Performance Teamwork Scale: reliability and validity for evaluating key crew resource management skills Simul Healthc 2 2007 4
15. A. Frankel, R. Gardner, L. Maynard Using the Communication and Teamwork Skills (CATS) assessment to measure health care team performance Jt Comm J Qual Patient Saf 33 2007 549 558
16. D.T. Risser, M.M. Rice, M.L. Salisbury The potential for improved teamwork to reduce medical errors in the emergency department Ann Emerg Med 34 1999 373 383
17. A. Mishra, K. Catchpole, P. McCulloch The Oxford NOTECHS system: reliability and validity of a tool for measuring teamwork behaviour in the operating theatre Qual Saf Health Care 18 2009 104 108
18. E.J. Thomas, J.B. Sexton, R.L. Helmreich Translating teamwork behaviours from aviation to healthcare: development of behavioural markers for neonatal resuscitation Qual Saf Health Care 13 2004 i57 i64
19. A.N. Healey, S. Undre, C.A. Vincent Developing observational measures of performance in surgical teams Qual Saf Health Care 13 suppl 1 2004 i33 i40
20. S. Cooper, R. Cant, J. Porter Rating medical emergency teamwork performance: development of the Team Emergency Assessment Measure (TEAM) Resuscitation 81 2010 446 452
21. E. Ottestad, J. Boulet, G. Lighthall Evaluating the management of septic shock using patient simulation Crit Care Med 35 2007 769 775
22. J.B. Holcomb, R.D. Dumrie, J.W. Crommett Evaluation of trauma team performance using an advanced human patient simulator for resuscitation training J Trauma 52 2002 1078 1086
23. L. Mitchell, R. Flin Scrub Practitioners' List of Intra-operative Non-technical Skills (SPLINTS) R. Flin, L. Mitchell, Safer Surgery: Analysing Behaviour in the Operating Theatre 2009 Ashgate Farnham, UK 67 81
24. College of Emergency Medicine (UK) CEM generic skills curriculum [College of Emergency Medicine (UK) Web site.] http://www.collemergencymed.ac.uk/asp/ curriculumall.asp?id=7 Accessed September 1, 2009
25. C. Clough, P. Lewis, L. Thomas Medical leadership competency curriculum [Academy of Royal Medical Colleges Web site.] http://www.aomrc.org.uk/reports- guidance.html Accessed September 1, 2009
26. Flowerdew L, Brown R, Russ S, et al. Teams under pressure in the emergency department: an interview study. Emerg Med J. doi: 10.1136/emermed- 2011-200084.
27. Case reporting, member checking and auditing Y. Lincoln, E. Guba Naturalistic Inquiry 1985 Sage Newbury Park, CA 357 381
28. N. Abell, G.G. Koch Developing and Validating Rapid Assessment Instruments 2009 Oxford University Press New York, NY
29. L. Hull, S. Arora, E. Kassab Observational teamwork assessment for surgery: content validation and tool refinement J Am Coll Surg 212 2011 234 243
30. S.N. Haynes, D.C.S. Richard, E.S. Kubany Content validity in psychological assessment: a functional approach to concepts and methods Psychol Assess 7 1995 238 247
31. D.F. Polit Is the CVI an acceptable indicator of content validity? appraisal and recommendations Res Nurs Health 30 2007 459 467
32. J.S. Grant, L.L. Davis Selection and use of content experts for instrument development Res Nurs Health 20 1997 269 274
33. V.R. Martuza Applying Norm-Referenced and Criterion-Referenced Measurement in Education 1977 Allyn & Bacon Boston, MA 352
34. M.R. Lynn Determination and quantification of content validity Nurs Res 35 1986 382 385
35. E. Salas, C.S. Burke, K.C. Stagl Developing teams and team leaders: strategies and principles D. Day, S. Zaccaro, S.M. Halpin, Leader Development for Transforming Organizations: Growing Leaders for Tomorrow 2004 Lawrence Erlbaum Mahwah, NJ 325 355
36. R. Fernandez, S.W.J. Kozlowski, M.J. Shapiro Toward a definition of teamwork in emergency medicine Acad Emerg Med 15 2008 1104 1112
37. A. Kaissi, T. Johnson, M.S. Kirshbaum Measuring teamwork and patient safety attitudes of high-risk areas Nurs Econ 21 2003 211 218
38. B.K. Richardson Feedback Acad Emerg Med 11 2004 e1
39. S.M. Schenkel, R.K. Khare, M.M. Rosenthal Resident perceptions of medical errors in the emergency department Acad Emerg Med 10 2003 1318 1324
40. D.A. Kilroy Clinical supervision in the emergency department: a critical incident study Emerg Med J 23 2006 105 108
41. K.S. Cosby A framework for classifying factors that contribute to error in the emergency department Ann Emerg Med 42 2003 815 823
42. A.A. White, S.W. Wright, R. Blanco Cause-and-effect analysis of risk management files to assess patient care in the emergency department Acad Emerg Med 11 2004 1035 1041
43. A. Kachalia, T.K. Gandhi, A.L. Puopolo Missed and delayed diagnoses in the emergency department: a study of closed malpractice claims from 4 liability insurers Ann Emerg Med 49 2007 196 205
44. D. Stella, J. Hendrie, J. Smythe Critical incident monitoring is a useful quality improvement tool for the emergency department Emerg Med 8 1996 215 219
45. K.M. Haig, S. Sutton, J. Whittington SBAR: a shared mental model for improving communication between clinicians Jt Comm J Qual Patient Saf 32 2006 167 175
46. G.D. Jenkins, T.D. Taber A Monte Carlo study of factors affecting three indices of composite scale reliability J Appl Psychol 62 1977 392 398
47. D.A. Cook Does scale length matter? a comparison of nine- versus five-point rating scales for the mini-CEX Adv Health Sci Educ 14 2009 655 664
48. M. Cox, D.M. Irby, R.M. Epstein Assessment in medical education N Engl J Med 356 2007 387 396
49. D.A. Davis, P.E. Mazmanian, M. Fordis Accuracy of physician self-assessment compared with observed measures of competence JAMA 296 2006 1094 1102
50. M.F. Ben-David The role of assessment in expanding professional horizons Med Teach 22 2000 472 477
51. J.J. Norcini Work based assessment: ABC of learning and teaching in medicine BMJ 326 2003 753 755
52. J.R. Wilkinson Implementing workplace-based assessment across the medical specialties in the United Kingdom Med Educ 42 2008 364 373
53. D. Murphy, D. Bruce, S. Mercer The reliability of workplace-based assessment in postgraduate medical education and training: a national evaluation in general practice in the United Kingdom Adv Health Sci Educ 14 2009 219 232