Observing and assessing surgical teams: The observational teamwork assessment for surgery© (OTAS)©

Safer Surgery: Analysing Behaviour in the Operating Theatre

Volumn , Issue , 2009, Pages 83-101

  Undre, Shabnam ^a   Sevdalis, Nick ^c   Vincent, Charles ^b  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b IMPERIAL COLLEGE LONDON   (United Kingdom)

^c NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 79251630800     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Chapter

References (56)

1. Arora, S., Sevdalis, N., Nestel, D., Tierney, T., Woloshynowych, M. and Kneebone, R. (2009) Managing intra-operative stress: What do surgeons want from a crisis training programme. American Journal of Surgery 197, 537-543.
2. Avermate van, J.A.G. (1998) NOTECHS: The Evaluation of Non-technical Skills of Multi-pilot Air Crew in Relation to the JAR-FCL Requirements. Research Report for the European Commission. Amsterdam: National Aerospace Laboratory, DGVII NLR-CR-98443.
3. Beard, J.D. (2007) Assessment of surgical competence. British Journal of Surgery 94, 1315-16.
4. Calland, J.F., Guerlain, S., Adams, R.B., Tribble, C.G., Foley, E. and Chekan, E.G. (2002) A systems approach to surgical safety. Surgical Endoscopy 16, 1005-14.
5. Carthey, J. (2003) The role of structured observational research in health care. Quality of Safety in Health Care 12, Suppl 2, ii13-ii16.
6. Catchpole, K. R., Giddings, A.E.B., de Leval, M.R., Peek, G.J., Godden, P.J., Utley, M., Gallivan, S., Hirst, G. and Dale, T. (2006) Identification of systems failure in successful paediatric cardiac surgery. Ergonomics 49, 567-88.
7. Davenport, D.L., Henderson, W.G., Mosca, C.L., Khuri, S.F. and Mentzer, R.M. (2007) Risk-adjusted morbidity in teaching hospitals correlates with reported levels of communication and collaboration in surgical teams but not with scale measures of teamwork climate, safety culture or working conditions, Journal of the American College of Surgeons 205, 778-84.
8. de Leval, M.R., Carthey, J., Wright, D.J., Farewell, V.T. and Reason, J.T. (2000) Human factors and cardiac surgery: A multicenter study, Journal of Thoracic and Cardiovascular Surgery 119, Pt 1, 661-72.
9. Dickinson, T.L. and McIntyre, R.M. (1997) A conceptual framework for teamwork measurement. In M.T. Brannick, E. Salas and C. Prince (eds) Team Performance Assessment and Measurement, 1st edition (pp. 19-44). New Jersey: Lawrence Erlbaum Associates, Inc.
10. Dwyer, D.J., Fowlkes, J.E., Oser, R.L., Salas, E. and Lane, N.E. (1997) Team performance measurement in distributed environments: The TARGETs methodology. In M.T. Brannick, E. Salas and C. Prince (eds) Team Performance Assessment and Measurement, 1st edition (pp. 137-54). New Jersey: Lawrence Erlbaum Associates, Inc.
11. Fletcher, G., Flin, R., McGeorge, P., Glavin, R., Maran, N. and Patey, R. (2003) Anaesthetists' Non-Technical Skills (ANTS): Evaluation of a behavioural marker system. British Journal of Anaesthesia 90(5), 580-8.
12. Flin, R., Martin, L., Goeters, K., Hoermann, J., Amalberti, R., Valot, C. and Nijhuis, H. (2003) Development of the NOTECHS (non-technical skills) system for assessing pilots' CRM skills. Human Factors and Aerospace Safety 3, 95-117.
13. Fowlkes, J.E., Lane, N.E., Salas, E., Franz, T. and Oser, R.L. (1994) Improving the measurement of team performance: The TARGETs methodology. Military Psychology 6, 47-61.
14. Fried, G.M. and Feldman, L.S. (2008) Objective assessment of technical performance. World Journal of Surgery 32, 156-60.
15. Gawande, A.A., Zinner, M.J., Studdert, D.M. and Brennan, T.A. (2003) Analysis of errors reported by surgeons at three teaching hospitals. Surgery 133(6), 614-21.
16. Greenberg, C.C., Regenbogen, S.E. and Studdert, D.M. (2007) Patterns of communication breakdowns resulting in injury to patients. Journal of the American College of Surgeons 204, 533-40.
17. Guerlain, S., Shin, T., Guo, H., Adams, R. and Calland, J.F. (2002) A Team Performance Data Collection and Analysis System. Proceedings of the Human Factors and Ergonomics Society, 46th Annual Meeting.
18. Guerlain, S., Adams, R.B., Turrentine, F.B., Shin, T., Guo, H., Collins, S.R. and Calland, J.F. (2005) Assessing team performance in the operating room: Development and use of a 'black-box' recorder and other tools for the intraoperative environment. Journal of the American College of Surgeons 200(1), 29-37.
19. Guerlain, S., Shin, T., Guo, H., Adams, R. and Calland, J.F. (2007) A Team Performance Data Collection and Analysis System. Proceedings of the Human Factors and Ergonomics Society 51st Annual Meeting, Baltimore, USA.
20. Healey, A.N., Undre, S. and Vincent, C.A. (2004) Developing observational measures of performance in surgical teams. Quality of Safety in Health Care 13, Suppl 1, i33-i40.
21. Healey, A.N., Sevdalis, N. and Vincent, C. (2006a) Measuring intra-operative interference from distraction and interruption observed in the operating theatre. Ergonomics 49, 589-604.
22. Healey, A.N., Undre, S. and Vincent, C.A. (2006b) Defining the technical skills of teamwork in surgery. Quality of Safety in Health Care 15(4), 231-4.
23. Healey, A.N., Undre, S., Sevdalis, N., Koutantji, M. and Vincent, C.A. (2006c) The complexity of measuring interprofessional teamwork in the operating theatre. Journal of Interprofessional Care 20(5), 485-95.
24. Healey, A.N. and Vincent, C. (2007) The systems of surgery, Theoretical Issues in Ergonomic Science 8, 429-43.
25. Helmreich, R.L. and Davies, J. (2007) Human factors in the operating: Interpersonal determinants of safety, efficiency and morale. In A.R. Aitkenhead (ed.) Clinical Anaesthesiology: Safety and Risk Management in Anaesthesia. London: Balliere Tindall.
26. Helmreich, R.L. and Foushee, H.C. (1993) Why crew resource management? Empirical and theoretical basis of human factors training in aviation. In E.L. Weiner, B.G. Kanki and R.L. Helmreich (eds) Cockpit Resource Management (pp. 3-45). New York: Academic.
27. Helmreich, R.L., Schaefer, H.G. and Sexton, B. (1995) The Operating Room Checklist. Technical Report 95-10. Austin, TX: NASA, University of Texas, FAA.
28. Helmreich, R.L, Klinect, J.R., Wilhelm, J.A., Tesmer, B., Gunther, D., Thomas, R., Romeo, C., Sumwalt, R. and Maurino, D. (2002) Line Operations Safety Audit (LOSA). DOC 9803-AN/761. Montreal: ICAO.
29. ISCP (2008) Intercollegiate Surgical Curriculum Programme. Available at: [last accessed November 2008].
30. JCAHO (2000) The Joint Commission: Operative and post-operative complications: Lessons for the future. Sentinel Events Alert 12. Available at: [last accessed January 2008].
31. Kaufman, L. (2003) The wrong nephrectomy. Bulletin of the Royal College of Anaesthetists 7, 848-9.
32. Klampfer, B., Flin, R., Helmreich, R., Häusler, R., Sexton, B., Fletcher, G., Field, P., Staender, S., Lauche, K., Dieckmann, P. and Amacher, A. (2001) Enhancing Performance in High Risk Environments: Recommendations for the Use of Behavioural Markers. Report from the behavioural markers workshop, Zürich, June. Berlin: Damler Benz Foundation.
33. Klinect, J.R., Murray, P., Merritt, A.C. and Helmreich, R.L. (2003) Line Operations Safety Audit (LOSA): Definition and operating characteristics. Proceedings of the 12th International Symposium on Aviation Psychology (pp. 663-8). Dayton, OH: The Ohio State University.
34. Lingard, L., Reznick, R., Espin, S., Regehr, G. and DeVito, I. (2002) Team communications in the operating room: Talk patterns, sites of tension, and implications for novices. Academic Medicine 77(3), 232-7.
35. Lingard, L., Espin, S., Whyte, S., Regehr, G., Baker, G.R., Reznick, R., Bohnen, J., Orser, B., Doran, D. and Grober, E. (2004a) Communication failures in the operating room: An observational classification of recurrent types and effects. Quality of Safety in Health Care 13(5), 330-4.
36. Lingard, L., Garwood, S. and Poenaru, D. (2004b) Tensions influencing operating room team function: Does institutional context make a difference. Medical Education 38, 691-9.
37. Mackenzie, C.F., Jefferies, N.J., Hunter, W.A., Bernhard, W.N. and Xiao, Y. (1996) Comparison of self-reporting of deficiencies in airway management with video analyses of actual performance. LOTAS Group. Level One Trauma Anesthesia Simulation. Human Factors 38(4), 623-35.
38. Mackenzie, C.F., Xiao, Y. and The IPO Group (2003) Observational Analysis of Video Records of Team Performance. Proceedings of the Human Factors and Ergonomic Society 47th Annual Meeting, Denver, Colorado, 1493-7.
39. Malec, J.F., Torsher, L.C., Dunn, W.F., Weingmann, D.A., Arnold, J.J., Brown, D.A. and Phatak, V. (2007) The Mayo high performance teamwork scale: Reliability and validity for evaluating key crew resource management skills. Simulation in Healthcare 2, 4-10.
40. Moorthy, K., Munz, Y., Adams, S., Pandey, V. and Darzi, A. (2005) A human factors analysis of technical and team skills among surgical trainees during procedural simulations in a simulated operating theatre. Annals of Surgery 242(5), 631-9.
41. Moorthy, K., Munz, Y., Forrest, D., Pandey, V., Undre, S. and Vincent, C. (2006) Surgical crisis management skills training and assessment: A simulation-based approach to enhancing operating room performance. Annals of Surgery 242, 631-9.
42. O'Connor, P., Hormann, H.J., Flin, R., Lodge, M. and Goeters, K.M. (2002) Developing a method for evaluating crew resource management skills: A European perspective. International Journal of Aviation Psychology 12(3), 263-85.
43. Paris, C.R., Salas, E. and Cannon-Bowers, J.A. (2000) Teamwork in multi-person systems: A review and analysis. Ergonomics 43(8), 1052-75.
44. Roth, E.M., Christian, C.K., Gustafson, M., Sheridan, T.B., Dwyer, K., Gandhi, T.K., Zinner, M.J. and Dierks, M.M. (2004) Using field observations as a tool for discovery: Analysing cognitive and collaborative demands in the operating room. Cognition, Technology & Work 6(3), 148-57.
45. Royal College of Surgeons of England (2007) Safe Shift Working for Surgeons in Training: Revised Policy Statement from the Working Time Directive Working Party. London: Royal College of Surgeons of England.
46. Sevdalis, N., Davis, R., Koutantji, M., Undre, S., Darzi, A. and Vincent, C. (2008a) Reliability of a revised NOTECHS scale for use in surgical teams. American Journal of Surgery 196(2), 184-90.
47. Sevdalis, N., Forrest, D., Undre, S., Darzi, A. and Vincent, C. (2008b) Annoyances, disruptions and interruptions in surgery: The Disruption in Surgery Index (Disi). World Journal of Surgery 32(8), 1643-50.
48. Undre, S. and Healey, A.N. (2006) Observational Teamwork Assessment for Surgery© OTAS © User Manual. Available at: [accessed June 2008].
49. Undre, S., Healey, A.N., Darzi, A. and Vincent, C.A. (2006a) Observational assessment of surgical teamwork: A feasibility study. World Journal of Surgery 30(10), 1774-83.
50. Undre, S., Sevdalis, N., Healey, A.N., Darzi, S.A. and Vincent, C.A. (2006b) Teamwork in the operating theatre: Cohesion or confusion? Journal or Evaluation in Clinical Practice 12(2), 182-9.
51. Undre, S., Koutantji, M., Sevdalis, N., Selvapatt, N., Williams, S., Gautama, S., McCulloch, P., Darzi, A. and Vincent, C. (2007a) Multi-disciplinary crisis simulations: The way forward for training surgical teams. World Journal of Surgery 31, 1843-53.
52. Undre, S., Sevdalis, N., Healey, A.N., Darzi, A. and Vincent, C.A. (2007b) Observational teamwork assessment for surgery (OTAS): Refinement and application in urological surgery. World Journal of Surgery 31(7), 1373-81.
53. Vincent, C., Moorthy, K., Sarker, S. K., Chang, A. and Darzi, A.W. (2004) Systems approaches to surgical quality and safety: From concept to measurement. Annals of Surgery 239(4), 475-82.
54. Yule, S., Flin, R., Paterson-Brown, S. and Maran, N. (2006a) Non-technical skills for surgeons in the operating room: A review of the literature. Surgery 139(2), 140-9.
55. Yule, S., Flin, R., Paterson-Brown, S., Maran, N. and Rowley, D.R. (2006b) Development of a rating system for surgeons' non-technical skills. Medical Education 40, 1098-104.
56. Yule, S., Flin, R., Maran, N., Rowley, D. R., Youngson, G.G. and Paterson-Brown, S. (2008) Surgeons' non-technical skills in the operating room: Reliability testing of the NOTSS behaviour rating system. World Journal of Surgery 32, 548-56.