Anaesthetists' non-technical skills (ANTS): Evaluation of a behavioural marker system

British Journal of Anaesthesia

Volumn 90, Issue 5, 2003, Pages 580-588

  Fletcher, G ^a   Flin, R ^a   McGeorge, M ^a   Glavin, R ^b   Maran, N ^b   Patey, R ^c  

^a UNIVERSITY OF ABERDEEN   (United Kingdom)

^b Stirling Royal Infirmary   (United Kingdom)

^c ABERDEEN ROYAL INFIRMARY   (United Kingdom)

Author keywords

Anaesthetists; Education, training

Indexed keywords

ACCURACY; ANESTHESIA; ANESTHESIST; ARTICLE; AWARENESS; COMPUTER PROGRAM; CONTROLLED STUDY; CURRICULUM; EVALUATION; GOOD CLINICAL PRACTICE; HUMAN; INFORMATION PROCESSING; MEDICAL DECISION MAKING; PHYSICIAN ATTITUDE; PRACTICE GUIDELINE; PRIORITY JOURNAL; PSYCHOMETRY; QUESTIONNAIRE; RELIABILITY; SKILL; TASK PERFORMANCE; TEAMWORK; TRAINING; UTILIZATION REVIEW; VALIDATION PROCESS;

EID: 0012363407     PISSN: 00070912     EISSN: None     Source Type: Journal    
DOI: 10.1093/bja/aeg112     Document Type: Article

References (39)

1. Fletcher GCL, McGeorge P, Flin RH, Glavin RJ, Maran N. The identification and measurement of anaesthetists' non-technical skills: a review of current literature. Br J Anaesth 2002; 88: 418-29
2. Helmreich R. Managing human error in aviation. Sci Am 1997; 276: 40-5
3. Weiner E, Kanki B, Helmreich R, eds. Cockpit Resource Management. San Diego, California: Academic Press, 1993
4. Helmreich RL. The evolution of Crew Resource Management. Paper presented at the IATA Human Factors Seminar, October 31, 1996, Warsaw, Poland; 5
5. Flin R, O'Connor P, Mearns K. Crew Resource Management: enhancing team performance in high reliability industries. Team Perform Manag 2002; 8: 68-78
6. Pizzi L, Goldfarb N, Nash D. Crew Resource Management and its applications in medicine. In: Shojania K, Duncan B, McDonald K, Wachter R, eds. Making Health Care Safer: A Critical Analysis of Patient Safety Practices. Washington, DC: Agency for Healthcare Research and Quality, 2001; Chapter 44: 511-19
7. Howard SK, Gaba DM, Fish KJ, Yang GS, Sarnquist FH. Anesthesia crisis resource management training: teaching anesthesiologists to handle critical incidents. Aviat Space Environ Med 1992; 63: 763-70
8. Maran N, Glavin R, Fletcher GCL. Training in human factors for anaesthetists in Scotland: identifying key skills and developing a training programme. Proceedings of the 7th European Forum on Quality Improvement in Health Care, Mar 21-23 2002, Edinburgh, Scotland. London: BMJ Publishing Group, 2002
9. Sexton B, Marsch S, Helmreich R, Betzendoerfer D, Kocher T, Scheidegger D. Participant evaluation of Team Oriented Medical Simulation, In: Henson LC, Lee AC, eds. Simulators in Anesthesiology Education. New York: Plenum, 1998: 107-8
10. Small SD, Wuerz RC, Simon R, Shapiro N, Conn A, Setnik G. Demonstration of high-fidelity simulation team training for emergency medicine. Acad Emerg Med 1999; 6: 312-23
11. Kirwan B, Ainsworth LK, eds. A Guide to Task Analysis. London: Taylor & Francis, 1992
12. Seamster TL, Kaempf GL. Identifying resource management skills for airline pilots. In: Salas E, Bowers C, Edens E, eds. Improving Teamwork in Organisations: Applications of Resource Management Training. Mahwah, New Jersey: Laurence Erlbaum, 2001; 9-30
13. Seamster TL, Redding RE, Kaempf GL. Applied Cognitive Task Analysis in Aviation. Aldershot: Avebury Aviation, 1997
14. Greaves JD, Grant J. Watching anaesthetists work: using the professional judgement of consultants to assess the developing clinical competence of trainees. Br J Anaesth 2000; 84: 525-33
15. Murray E, Gruppen L, Catton P, Hays R, Woolliscroft JO. The accountability of clinical education: its definition and assessment. Med Educ 2000; 43: 871-9
16. Flin R, Martin L. Behavioural markers for Crew Resource Management: a survey of current practice. Int J Aviat Psychol 2001; 11: 95-118
17. Klampfer B, Flin R, Helmreich RL, et al. Enhancing performance in high risk environments: recommendations for the use of behavioural markers. Ladenburg: Daimler-Benz Shiftung, 2001. Downloadable version available from: www.psyc.abdn.ac.uk/serv02: 10
18. Helmreich RL, Schaefer H-G, Sexton JB. Operating room checklist. Aerospace Crew Resource Project Technical Report 95-4. Austin, Texas: University of Texas, 1995
19. Gaba DM, Howard SK, Flanagan B, Smith BE, Fish KJ, Botney R. Assessment of clinical performance during simulated crises using both technical and behavioral ratings. Anesthesiology 1998; 89: 123-47
20. Helmreich RL, Merritt AC. Culture at Work in Aviation and Medicine. Aldershot: Ashgate, 1998
21. Holt RW, Boehm-Davis DA, Beaubien JM. Evaluating resource management training. In: Salas E, Bowers C, Edens E, eds. Improving Teamwork in Organisations: Applications of Resource Management Training. Mahwah, New Jersey: Laurence Erlbaum, 2001; 165-88
22. Fletcher G, Flin R, McGeorge P, Glavin R, Maran N, Patey R. Rating non-technical skills: developing a behavioural marker system for use in anaesthesia. Cognition Technology and Work. (Submitted)
23. Fletcher G, Flin R, McGeorge P, Glavin R, Maran N, Patey R. Final report: the identification and measurement of anaesthetists' non-technical skills. University of Aberdeen Grant Report for SCPMDE, 2001. Aberdeen: University of Aberdeen, 2001
24. Altmaier EM, From RP, Pearson KS, Gorbatenko-Roth KG, Ugolini KA. A prospective study to select and evaluate anesthesiology residents: phase I, the critical incident technique. J Clin Anesth 1997; 9: 629-36
25. Department of Anaesthesia, University of Basel-Kantonspital. Kommunikations-Status (KOMSTAT), Operationssal-Beobachtungen, Ver. 2.0, 07/97. Personal communication, 2000; available from Swiss anaesthesia server: http://www.medana.unibas.ch [in German]
26. Flanagan JC. The Critical Incident Technique. Psychol Bull 1954; 51: 327-58
27. Klein GA, Calderwood R, MacGregor D. Critical decision method for eliciting knowledge. IEEE Trans Syst Man Cybern 1989; 19: 462-72
28. Strauss A, Corbin J. Basics of Qualitative Research: Grounded Theory Procedures and Techniques. Newbury Park, California: Sage Publications, 1990
29. Flin R, Goeters KM, Hormann J, Martin L. A generic structure of non-technical skills for training and assessment. Proceedings of 23rd Conference of the European Association for Aviation Psychology, Sept 14-18, 1998, Vienna, Austria. Vienna, 1998
30. Flin R, Fletcher G, McGeorge P, Sutherland A, Patey R. Anaesthesists' attitudes to teamwork and safety. Anaesthesia 2003; 58: 233-42
31. O'Connor P, Hörmann H-J, Flin R, Lodge M, Goeters K-M, JARTEL Group. Developing a method for evaluating Crew Resource Management skills: a European perspective. Int J Aviat Psychol 2002; 12: 263-85
32. James LR, Demaree RG, Wolf G. Estimating within-group interrater reliability with and without response bias. J Appl Psychol 1984; 69: 85-98
33. wg. An assessment of within-group interrater agreement. J Appl Psychol 1993; 78: 306-9
34. Johnson PJ, Goldsmith TE. The importance of quality data in evaluating aircrew performance. US Federal Aviation Authority Technical Report, 1998. Available from Federal Aviation Authority website: www.faa.gov/avr/afs/aqphome
35. Goldsmith TE, Johnson PJ. Assessing and improving evaluation of aircrew performance. Int J Aviat Psychol 2002; 12: 223-40
36. Baker DP, Mulqueen C, Dismukes RK. Training raters to assess resource management skills. In: Salas E, Bowers C, Edens E, eds. Improving Teamwork in Organisations: Applications of Resource Management Training. Mahwah, New Jersey: Laurence Erlbaum, 2001; 131-45
37. Williams DM, Holt RW, Boehm-Davis DA. Training for interrater reliability: baselines and benchmarks. Proceedings of the 9th International Symposium on Aviation Psychology, Apr 27-May 1, 1997, Columbus, Ohio. Columbus, Ohio: Ohio State University, 1997: 514-20
38. Fletcher G, Flin R, McGeorge P, Glavin R, Maran N, Patey R. Evaluation of the prototype Anaesthesists Non-Technical Skills (ANTS) behavioural marker system: WP7 Experimental Report. University of Aberdeen Technical Report for NHS Education for Scotland, 2002. Aberdeen: University of Aberdeen, 2002
39. Byrne AJ, Greaves JD. Assessment instruments used during anaesthetic simulation: review of published studies. Br J Anaesth 2001; 86: 445-50