Crew resource management training effectiveness: A meta-analysis and some critical needs

International Journal of Aviation Psychology

Volumn 18, Issue 4, 2008, Pages 353-368

  O'Connor, Paul ^a,f   Campbell, Justin ^b   Newon, Jennifer ^c   Melton, John ^d   Salas, Eduardo ^e   Wilson, Katherine A ^e  

^a Navy Aviation Schools Command

^b UNIVERSITY OF WEST FLORIDA   (United States)

^c LOYOLA UNIVERSITY CHICAGO   (United States)

^d Naval Service Training Command

^e UNIVERSITY OF CENTRAL FLORIDA   (United States)

^f Navy and Marine Corps School of Aviation Safety   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 54349097280     PISSN: 10508414     EISSN: None     Source Type: Journal    
DOI: 10.1080/10508410802347044     Document Type: Article

References (53)

1. Alliger, G. M., & Katzman, S. (1997). When training affects variability: Beyond the assessment of mean differences in training evaluation. In J. K. Ford (Ed.), Improving training effectiveness in work organizations (pp. 223-246). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
2. American Psychological Association. (2001). Publication manual of the American Psychological Association. Washington, DC: Author.
3. Arthur, W., Bennett, W., Edens, P. S., & Bell, S. T. (2003). Effectiveness of training in organizations: A meta-analysis of design and evaluation features. Journal of Applied Psychology, 88, 234-245.
4. Baker, D., Bauman, M., & Zalesny, M. D. (1991). Development of aircrew coordination exercises to facilitate training transfer. In R. Jensen (Ed.), Proceedings of the 6th International Symposium on Aviation Psychology (pp. 314-319). Columbus: Ohio State University.
5. Baker, D., Prince, C., Shrestha, L., Oser, R., & Salas, E. (1993). Aviation computer games for crew resource management training. International Journal of Aviation Psychology, 3, 143-156.
6. Baldwin, T. T., & Ford, J. K. (1988). Transfer of training: A review and direction for future research. Personnel Psychology, 42, 331-342.
7. Bandura, A. (1977). Social learning theory. Englewood Cliffs, NJ: Prentice Hall.
8. Clothier, C. (1991). Behavioral interactions across various aircraft types: Results of systematic observations of line operations and simulations. In R. Jensen (Ed.), Proceedings of the 6th International Symposium on Aviation Psychology (pp. 332-337). Columbus: Ohio State University.
9. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
10. Connolly, T. J., & Blackwell, B. B. (1987). A simulator approach to training in aeronautical decision making. In R. Jensen (Ed.), Proceedings of the 4th International Symposium on Aviation Psychology (pp. 251-258). Columbus: Ohio State University.
11. Federal Aviation Administration. (2004). Advisory Circular No 120-51E: Crew resource management training. Washington, DC: Author.
12. Fisher, J., Phillips, E., & Mather, J. (2000). Does crew resource management training work? Air Medical Journal, 19, 137-139.
13. Flin, R., & Martin, L. (2001). Behavioral markers for crew resource management: A review of current practice. International Journal of Aviation Psychology, 11, 95-118.
14. XFlin, R., O'Connor, P., & Mearns, K. (2002). Crew resource management: Improving safety in high reliability industries. Team Performance Management, 8, 68-78.
15. Flores, S. A., & Crepaz, N. (2004). Quality of study methods in individual- and group-level HIV interventions research: Critical reporting elements. AIDS Education and Prevention, 16, 341-352.
16. Gregorich, S. E., Helmreich, R. L., & Wilhelm, J. A. (1990). The structure of cockpit management attitudes. Journal of Applied Psychology, 75, 682-690.
17. Gregorich, S. E., & Wilhelm, J. A. (1993). Crew resource management training assessment. In E. L. Wiener, B. G. Kanki, & R. L. Helmreich (Eds.), Cockpit resource management (pp. 173-196). San Diego, CA: Academic.
18. Guzzo, R. A., Jackson, S. E., & Katzell, R. A. (1987). Meta analysis. Research in Organizational Behavior, 9, 407-442.
19. Guzzo, R. A., Jette, R. D., & Katzell, R. A. (1985). The effects of psychologically based intervention programs on worker productivity. Personnel Psychology, 38, 275-291.
20. Hamblin, A. C. (1974). Evaluation and control of training. London: McGraw-Hill.
21. Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. San Diego, CA: Academic.
22. Helmreich, R. (1984). Cockpit management attitudes. Human Factors, 26, 583-589.
23. Helmreich, R. L., Merritt, A. C., & Wilhelm, J. A. (1999). The evolution of crew resource management training in commercial aviation. International Journal of Aviation Psychology, 9, 19-32.
24. Henry, J. D., Crawford, J. R., & Philips, L. H. (2005). A meta-analytic review of verbal fluency deficits in Huntington's disease. Neuropsychology, 19, 243-252.
25. Holzman, R. S., Cooper, J. B., Gaba, D. M., Philip, J. H., Small, S. D., & Feinstein, D. (1995). Anesthesia crisis resource management: Real-life simulation training in operating crises. Journal of Clinical Anesthesia, 7, 675-687.
26. Joint Aviation Authorities. (2006). JAR-OPS, 1 Subpart N, Crew resource management flight crew (amendment 12). Hoofddorp, Netherlands: Author.
27. Kirkpatrick, D. L. (1976). Evaluation of training. In R. L. Craig & L. R. Bittel (Eds.), Training and development handbook (pp. 18.1-18.27). New York: McGraw-Hill.
28. Klampfer, B., Flin, R., Helmreich, R., Häusler, R., Sexton, B., Fletcher, G., et al. (2001). Enhancing performance in high risk environments: Recommendations for the use of behavioural markers. Report from the behavioural markers workshop, Zürich, June. Berlin: Damler Benz Foundation.
29. Kurrek, M. M., & Fish, K. J. (1996). Anesthesia crisis resource management training: An intimidating concept, a rewarding experience. Canadian Journal of Anesthesia, 43, 430-434.
30. Lassiter, D. L., Vaughn, J. S., Smaltz, V. E., Morgan, B. B., & Salas, E. (1990). A comparison of two types of training interventions on team communication performance. In Proceedings of the Human Factors Society 34th annual meeting (pp. 1372-1376). Santa Monica, CA: Human Factors and Ergonomics Society.
31. Leedom, D. K., & Simon, R. (1995). Improving team coordination: A case for behavior-based training. Military Psychology, 7, 109-122.
32. Morey, J. C., Simon, R., Jay, G. D., Wears, R. L., Salisbury, M., Dukes, K. A., et al. (2002). Error reduction and performance improvement in the emergency department through formal teamwork training: Evaluation results of the MedTeams project. Health Services Research, 37, 1553-1581.
33. Morris, S. B., & DeShon, R. P. (2002). Combining effect size estimates in meta-analysis with repeated measures and independent-groups designs. Psychological Methods, 7, 105-125.
34. Mullen, B., & Rosenthal, R. (1985). Advanced BASIC meta-analysis. New York: Sage.
35. National Research Council. (1992). Combining information: Statistical issues and opportunities for research. Washington, DC: National Academy Press.
36. O'Connor, P., & Flin, R. (2003). Crew resource management training for offshore oil production teams. Safety Science, 41, 591-609.
37. O'Connor, P., Flin, R., & Fletcher, G. (2002). Methods used to evaluate the effectiveness of CRM training: A literature review. Journal of Human Factors and Aerospace Safety, 2, 217-234.
38. Ray, J. W., & Shadish, W. R. (1996). How interchangeable are different estimators of effect size? Journal of Consulting and Clinical Psychology, 64, 1316-1325.
39. Rosenberg, M. S., Adams, D. C., & Gurevitch, J. (2000). Meta Win 2.0. Sunderland, MA: Sinauer.
40. Salas, E., Burke, C. S., Bowers, C. A., & Wilson, K. A. (2001). Team training in the skies: Does crew resource management (CRM) training work? Human Factors, 41, 161-172.
41. Salas, E., & Cannon-Bowers, J. A. (1997). Methods, tools and strategies for team training. In M. Quinones & E. Ehrestein (Eds.), Training for a rapidly changing workplace: Applications in psychological research (pp. 291-322). Washington, DC: American Psychological Association Press.
42. Salas, E., & Cannon-Bowers, J. A. (2001). The science of training: A decade of progress. Annual Review of Psychology, 52, 471-499.
43. Salas, E., Fowlkes, J. E., Stout, R. J., Milanovich, D. M., & Prince, C. (1999). Does CRM training improve teamwork skills in the cockpit? Two evaluation studies. Human Factors, 41, 326-343.
44. Salas, E., Prince, C., Bowers, C., Stout, R., Oser, R. L., & Cannon-Bowers, J. A. (1999). A methodology for enhancing crew resource management training. Human Factors, 41, 161-172.
45. Salas, E., Rhodenizer, L., & Bowers, C. A. (2000). The design and delivery of CRM training: Using all of the resource available. Human Factors, 42, 490-511.
46. Salas, E., Wilson, K. A, Burke, C. S., & Wightman, D. C. (2006). Does CRM training work? An update, extension and some critical needs. Human Factors, 14, 392-412.
47. Salas, E., Wilson, K. A., Burke, C. S., Wightman, D. C., & Howse, W. R. (2006a). A checklist for crew resource management training. Ergonomics in Design, 14, 6-15.
48. Salas, E., Wilson, K. A., Burke, C. S., Wightman, D. C., & Howse, W. R. (2006b). Crew resource management training research, practice, and lessons learned. In R. C. Williges (Ed.), Review of human factors and ergonomics (Vol. 2, pp. 35-73). Santa Monica, CA: Human Factors and Ergonomics Society.
49. Shapiro, M. J., Morey, J. C., Small, S. D., Langford, V., Kaylor, C. J., Jagminas, L., et al. (2004). Simulation based teamwork training for emergency department staff: Does it improve clinical team performance when added to an existing didactic teamwork curriculum? Quality and Safety in Health Care, 13, 417-421.
50. Stout, R. J., Salas, E., & Fowlkes, J. E. (1997). Enhancing teamwork in complex environments through team training. Group Dynamics: Theory, Research, and Practice, 1, 169-182.
51. Stout, R. J., Salas, E., & Kraiger, K. (1996). The role of trainee knowledge structures in aviation psychology. International Journal of Aviation Psychology, 7, 235-250.
52. Whitener, E. M. (1990). Confusion of confidence intervals and credibility intervals in meta-analysis. Journal of Applied Psychology, 75, 315-321.
53. Wiener, E., Kanki, B., & Helmreich, R. (1993). Cockpit resource management. San Diego, CA: Academic.