Behavioral markers for crew resource management: A review of current practice

International Journal of Aviation Psychology

Volumn 11, Issue 1, 2001, Pages 95-118

  Flin, Rhona ^a   Martin, Lynne ^b  

^a UNIVERSITY OF ABERDEEN   (United Kingdom)

^b NASA AMES RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0035530459     PISSN: 10508414     EISSN: None     Source Type: Journal    
DOI: 10.1207/S15327108IJAP1101_6     Document Type: Article

References (46)

1. Aiken, L. (1996). Rating scales and checklists. New York: Wiley.
2. Antersijn, P., & Verhoef, M. (1995). Assessment of non-technical skills: Is it possible? In N. McDonald, N. Johnston, & R. Fuller (Eds.), Applications of psychology to the aviation system (pp. 243-250). Aldershot, England: Averbury.
3. Birnbach, R., & Longridge, T. (1993). The regulatory perspective. In E. Wiener, B. Kanki, & R. Helmreich (Eds.), Cockpit resource management (pp. 263-281). San Diego, CA: Academic.
4. Boehm-Davis, D., Holt, R., & Seamster, T. (in press). Airline resource management programs. In E. Salas, C. Bowers, & E. Edens (Eds.), Improving teamwork in organizations: Applications of resource management training. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
5. Brannick, M., & Prince, C. (1991). Assessment of aircrew rating from within and between scenarios (Tech. Rep. No. DAAL0-3-86-D-001). Orlando, FL: Naval Training Systems Center.
6. Brannick, M., & Prince, C. (1995). Reliability of measures of aircrew skills across events and scenarios. In R. Jensen (Ed.), Proceedings of the 8th Symposium of Aviation Psychology (pp. 603-606). Columbus: Ohio State University.
7. Brannick, M., Salas, E., & Prince, C. (Eds.). (1997). Team performance, assessment and measurement. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
8. Butler, R. (1991). Lessons from cross-fleet/cross-airline observations: Evaluating the impact of CRM/LOFT training. In R. Jensen (Eds.), Proceedings of the 6th Symposium of Aviation Psychology (pp. 326-331). Columbus: Ohio State University.
9. Civil Aviation Authority. (1998). Flight crew CRM training standards (Aeronautical Information Circular 114/1998: Pink 178). Gatwick, England: Author.
10. Connelly, P. (1997). A resource package for CRM developers: Behavioural markers of CRM skill from real world case studies and accidents (Tech. Rep. No. 97-3). Austin: University of Texas, Aerospace Research Project.
11. Diehl, A. (1991, November). Does cockpit management training reduce aircrew error? Paper presented at the 22nd International Seminar for Air Safety Investigators, Canberra, Australia.
12. Dismukes, K., Jobe, K., & McDonnell, L. (1997). LOFT debriefings: An analysis of instructor techniques and crew participation (NASA Tech. Mem. 110442). Ames, IA: NASA.
13. Dutra, L., Norman, D., Malone, T., McDougall, W., & Edens, E. (1995). Crew resource management/assessment: Identification of key observable behaviours. In R. Jensen (Ed.), Proceedings of the 8th Symposium of Aviation Psychology (pp. 562-567). Columbus: Ohio State University.
14. Flin, R., Goeters, K.-M., Hormann, J., & Martin, L. (1998, September). A generic structure of non-technical skills. Paper presented at the European Association of Aviation Psychology conference, Vienna.
15. Flin, R., & Martin, L. (1998). Behavioural markers for crew resource management (Civil Aviation Authority Paper 98005). London: Civil Aviation Authority.
16. Fowlkes, J., Lane, N., Salas, E., Franz, T., & Oser, R. (1994). Improving the measurement of team performance: The TARGETS methodology. Military Psychology, 6, 47-61.
17. Gaba, D., Howard, S., Flanaghan, B., Smith, B., Fish, K., & Botney, R. (1998). Assessment of clinical performance during simulated crises using both technical and behavioural ratings. Anesthesiology, 89, 8-18.
18. Goeters, K.-M. (Ed.). (1998). Aviation psychology: A science and a profession. Aldershot, England: Ashgate.
19. Gregorich, S., & Wilhelm, J. (1993). Crew resource management training assessment. In E. Wiener, B. Kanki, & R. Helmreich (Eds.), Cockpit resource management (pp. 173-198). San Diego, CA: Academic.
20. Hamman, W., & Holt, R. (1997). Line operational evaluation (LOE): Air carrier scenario based evaluation. In D. Smith (Ed.), Proceedings of the Human Factors and Ergonomics Society 41st annual meeting (pp. 907-911). Albuquerque, NM: Human Factors and Ergonomics Society.
21. Helmreich, R. (1996, October). The evolution of crew resource management. Paper presented at the IATA Human Factors Seminar, Warsaw, Poland.
22. Helmreich, R., Butler, R., Taggart, W., & Wilhelm, J. (1997). The NASA/University of Texas/Federal Aviation Administration Line/LOS Checklist: A behavioral-based checklist for CRM skills assessment (Version 4.4) [Computer software]. Austin, TX: NASA/University of Texas/Federal Aviation Administration Aerospace Group.
23. Helmreich, R., Hines, W., & Wilhelm, J. (1996, September). Issues in crew resource management and automation use: Data from line audits. Paper presented at the 6th CRM Industry Workshop, Charlotte, NC.
24. Helmreich, R., Merritt, A., & Wilhelm, J. (1999). The evolution of crew resource management training in commercial aviation. International Journal of Aviation Psychology, 9, 19-32.
25. Helmreich, R., Wilhelm, J., Gregorich, S., & Chidester, T. (1990). Preliminary results from the evaluation of cockpit resource management training: Performance ratings of flight crews. Aviation, Space and Environmental Medicine, 61, 576-579.
26. Helmreich, R., Wilhelm, J., Kello, J., Taggart, W., & Butler, R. (1990). Reinforcing and evaluating crew resource management: Evaluator/LOS instructor reference manual (Tech. Manual 90-2). Austin: NASA/University of Texas.
27. Holt, R., Boehm-Davis, D., & Beaubien, J. (in press). Evaluating resource management training. In E. Salas, C. Bowers, & E. Edens (Eds.), Improving teamwork in organizations: Applications of resource management training. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
28. Joint Aviation Authorities. (1996). JAR-OPS. Flight operations. Hoofddorp, The Netherlands: Author.
29. Joint Aviation Authorities. (1997). JAR-FCL: Part 1. (Aeroplane) flight crew licensing requirements. Hoofddorp, The Netherlands: Author.
30. Lanzano, J., Seamster, T., & Edens, E. (1997). The importance of CRM skills in an AQP. In R. Jensen (Ed.), Proceedings of the 9th Symposium of Aviation Psychology (pp. 574-579). Columbus: Ohio State University.
31. Law, J., & Sherman, P. (1995). Do raters agree? Assessing inter-rater agreement in the evaluation of air crew resource management skills. In R. Jensen (Ed.), Proceedings of the 8th Symposium of Aviation Psychology (pp. 608-612). Columbus: Ohio State University.
32. Law, J., & Wilhelm, J. (1995). Ratings of CRM skill markers in domestic and international operations. In R. Jensen (Ed.), Proceedings of the 8th Symposium of Aviation Psychology (pp. 669-675). Columbus: Ohio State University.
33. Maschke, P., Goeters, K., Hormann, H., & Schiewe, A. (1995). The development of the DLR/Lufthansa crew resource management training. In N. Johnston, R. Fuller, & N. McDonald (Eds.), Aviation psychology: Training and selection (pp. 23-31). Aldershot, England: Avebury.
34. McDonnell, L., Jobe, K., & Dismukes, K. (1997). Facilitating LOS debriefings: A training manual (NASA Tech. Memorandum 112192). Ames, IA: NASA.
35. Naef, W. (1995). Practical application of CRM concepts: Swissair's human aspects development program. In R. Jensen (Ed.), Proceedings of the 8th Symposium of Aviation Psychology (pp. 597-602). Columbus: Ohio State University.
36. Royal Aeronautical Society. (1998). Guide to performance standards for instructors of crew resource management (CRM) training in commercial aviation. London: Author.
37. Salas, E., Fowlkes, J., Stout, R., Milanovich, D., & Prince, C. (1999). Does CRM training improve teamwork skills in the cockpit? Two evaluation studies. Human Factors, 41, 326-343.
38. Seamster, T., & Edens, E. (1993). Cognitive modelling of CRM assessment expertise: Identification of the primary assessors. In L. Smith (Ed.), Proceedings of the Human Factors and Ergonomics Society 37th Annual Meeting (pp. 122-126). San Diego, CA: Human Factors and Ergonomics Society.
39. Seamster, T., Edens, E., & Holt, R. (1995). Scenario event sets and the reliability of CRM assessment. In R. Jensen (Ed.), Proceedings of the 8th Symposium of Aviation Psychology (pp. 613-618). Columbus: Ohio State University.
40. Seamster, T., Edens, E., McDougall, W., & Hamman, W. (1994). Observable crew behaviors in the development and assessment of line operational evaluations (Rep. No. DTFA01-93-C-00055). Washington, DC: Federal Aviation Administration.
41. Seamster, T., Hamman, W., & Edens, E. (1995). Specification of observable behaviors within LOE/LOFT event sets. In R. Jensen (Ed.), Proceedings of the 8th Symposium of Aviation Psychology (pp. 663-668X). Columbus: Ohio State University.
42. Seamster, T., Prentiss, F., & Edens, E. (1997). Methods for the analysis of CRM skills. In R. Jensen (Ed.), Proceedings of the 9th Symposium of Aviation Psychology (pp. 500-504X). Columbus: Ohio State University.
43. Taggart, W. (1991). Advanced CRM training for instructors and evaluators. In R. Jensen (Ed.), Proceedings of the 6th Symposium of Aviation Psychology. Columbus: Ohio State University.
44. Taggart, W. (1995). The NASA/University of Texas/Federal Aviation Administration Line/LOS Checklist: Assessing system safety and crew performance. In R. Jensen (Ed.), Proceedings of the 8th Symposium of Aviation Psychology (pp. 688-693). Columbus: Ohio State University.
45. Van Avermaete, J., & Kruijsen, E. (1998). The evaluation of non-technical skills of multi-pilot aircrew in relation to the JAR-FCL requirements (NOTECHS Group Project Rep. No. NLRCR98443). Amsterdam: National Aerospace Laboratory.
46. Williams, D., Holt, R., & Boehm-Davis, D. (1997). Training for inter-rater reliability: Baselines and benchmarks. In R. Jensen (Ed.), Proceedings of the 9th Symposium on Aviation Psychology (pp. 514-519). Columbus: Ohio State University.