Surgeons' non-technical skills in the operating room: Reliability testing of the NOTSS behavior rating system

World Journal of Surgery

Volumn 32, Issue 4, 2008, Pages 548-556

  Yule, Steven ^a   Flin, Rhona ^a   Maran, Nicola ^b   Rowley, David ^c   Youngson, George ^d   Paterson Brown, Simon ^b  

^a UNIVERSITY OF ABERDEEN   (United Kingdom)

^b ROYAL INFIRMARY OF EDINBURGH   (United Kingdom)

^c UNIVERSITY OF DUNDEE   (United Kingdom)

^d ROYAL ABERDEEN CHILDREN S HOSPITAL   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; BEHAVIORAL SCIENCE; CONTROLLED STUDY; DECISION MAKING; HUMAN; MEDICAL PRACTICE; OPERATING ROOM; SENSITIVITY ANALYSIS; SURGEON; VIDEORECORDING;

AWARENESS; COMMUNICATION; DECISION MAKING; HUMANS; LEADERSHIP; PROFESSIONAL PRACTICE; RESEARCH DESIGN; SENSITIVITY AND SPECIFICITY; SURGERY; TASK PERFORMANCE AND ANALYSIS;

EID: 41049110012     PISSN: 03642313     EISSN: 14322323     Source Type: Journal    
DOI: 10.1007/s00268-007-9320-z     Document Type: Article

References (27)

1. Gawande AA, Zinner MJ, Studdert DM, et al. (2003) Analysis of errors reported by surgeons at three teaching hospitals. Surgery 133:614-621
2. Yule S, Flin R, Maran N, et al. (2006) Non-technical skills for surgeons in the operating room. A review of the literature. Surgery 39:140-149
3. Stevenson KS, Gibson SC, Rogers PN, et al. Process of care in acute surgical admissions: room for improvement. Br J Surg in press
4. Christian C, Gustafon M, Roth E, et al. (2006) A prospective study of patient safety in the operating room. Surgery 139:159-173
5. Studdert DM, Mello MM, Gawande AA, et al. (2006) Claims, errors, and compensation payments in medical malpractice litigation. N Engl J Med 354:2024-2033
6. Carthey J, de Leval MR, Wright DJ, et al. (2003) Behavioral markers of surgical excellence. Safety Sci 41:409-425
7. Moorthy K, Munz Y, Adams S, et al. (2005) A human factors analysis of technical and team skills among surgical trainees during procedural simulations in a simulated operating theatre. Ann Surg 242:631-641
8. Templeton S, Feinmann J (2006) Arrogant surgeons 'risk another Bristol babies scandal'. The Sunday Times London September 3
9. Davidson P (2002) The surgeon of the future and implications for training. Aust N Z J Surg 72:822-828
10. Flin R, Maran N (2004) Identifying and training non-technical skills in acute medicine. Qual Safety Healthcare i180-i184
11. Flin R, Martin L, Goeters K, et al. (2003) Pilots' non-technical skills: NOTECHS. Hum Factors Aerospace Safety 3:95-117
12. Fletcher G, Flin R, McGeorge P, et al. (2003) Anaesthetists' non-technical skills (ANTS): evaluation of a behavioral marker system. Br J Anaesthesia 90:580-588
13. Klampfer B, Flin R, Helmreich RL, et al. (2001) Enhancing performance in high risk environments: recommendations for the use of behavioral markers. Berlin: GIHRE
14. Baker D, Mulqueen C, Dismukes R (2001) Training raters to assess resource management skills. In Salas E, Bowers C, Edens E, editors, Improving Teamwork in Organizations. Mahwah, NJ, Lawrence Earlbaum, 131-145
15. Flin R, Yule S, Paterson-Brown S, et al. (2005) Surgeons' non-technical skills. Surg News 4:83-85
16. Yule S, Flin R, Paterson-Brown S, et al. (2006) Development of a rating system for surgeons' non-technical skills. Med Ed 40:1098-1104
17. Goldsmith T, Johnson P (2002) Assessing and improving evaluation of aircrew performance. Int J Aviation Psychology 12:223-240
18. James L, Demaree R, Wolf G (1993) rwg: an assessment of within-group inter-rater agreement. J Appl Psychology 78:306-309
19. Nunnally J, Bernstein I (1993) Psychometric Theory. New York, McGraw Hill
20. Bliese P (2000) Within-group agreement, non-independence, and reliability. Implications for data aggregation and analysis. In Klein K, Kozlowski S, editors, Multilevel theory, research, and methods in organizations. San Francisco, Jossey-Bass
21. Shrout PE, Fleiss JL (1979) Intraclass correlations: uses in assessing rater reliability. Psychol Bull 86:420-428
22. O'Connor P, Hormann HJ, Flin R, et al. (2002) Developing a method for evaluating Crew Resource Management skills: a European perspective. Int J Aviation Psychology 12:265-288
23. Holt R, Boehm-Davis D, Beaubien J (2001) Evaluating resource management training. In Salas E, Bowers C, Edens E, editors. Improving Teamwork in Organizations. Applications of Resource Management Training. Mahwah, NJ, Lawrence Earlbaum Associates
24. Yule S, Flin R, Rowley D, et al. Debriefing surgeons on non-technical skills (NOTSS). Cognition, Technology & Work (in press)
25. Davis DA, Mazamanian PE, Fordis M, et al. (2006) Accuracy of physician self-assessment compared with observed measures of competence. JAMA 296:1094-1102
26. Donaldson LJ (2006) Good doctors, safer patients: proposals to strengthen the system to assure and improve the performance of doctors and to protect the safety of patients. London, Department of Health
27. Flin R, O'Connor P, Crichton M (2007) Safety at the Sharp End. A Guide to Non-Technical Skills. Aldershot, UK, Ashgate, in press