The Design, Delivery and Evaluation of Crew Resource Management Training

Crew Resource Management, Second Edition

Volumn , Issue , 2010, Pages 205-232

  Shuffler, Marissa L ^a   Salas, Eduardo ^a   Xavier, Luiz F ^a  

^a UNIVERSITY OF CENTRAL FLORIDA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84882496626     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1016/B978-0-12-374946-8.10007-X     Document Type: Chapter

References (76)

1. R.A. Alkov and J.A. Gaynor (1991) Attitude changes in navy/marine flight instructors following an aircrew coordination training course. International Journal of Aviation Psychology 1 245-253.
2. G.A. Alliger and E.A. Janak (1989) Kirkpatrick's levels of training criteria: thirty years later. Personnel Psychology 42 331-342.
3. G.A. Alliger, S.I. Tannenbaum, W. Bennett, H. Traver and A. Shotland (1997) A meta-analysis of the relations among training criteria. Personnel Psychology 50 341-358.
4. K. Alvarez, E. Salas and C.M. Garofano (2004) An integrated model of training evaluation and effectiveness. Human Resources Development Review 3 385-416.
5. D. Baker, C. Prince, L. Shrestha, R. Oser and E. Salas (1993) Aviation computer games for CRM skills training. The International Journal of Aviation Psychology 3 143-155.
6. T.T. Baldwin and J.K. Ford (1988) Transfer of training: a review and directions for future research. Personnel Psychology 41 63-105.
7. R.L. Beard, E. Salas and C. Prince (1995) Enhancing transfer of training: Using roleplay to foster teamwork in the cockpit. The International Journal of Aviation Psychology 5 131-143.
8. C. Bowers, E. Salas, C. Prince and M. Brannick (1992) Games teams play: A method for investigating team coordination and performance. Behavior Research Methods, Instruments, & Computers 24 503-506.
9. M.T. Brannick, C. Prince and E. Salas (2005) Can PC-based systems enhance teamwork in the cockpit? The International Journal of Aviation Psychology 15 173-188.
10. M. Broad and J. Newstrom (1992) Transfer of training. Cambridge, MA: Perseus
11. W. Brun, J. Eid, B.H. Jihnsen, B. Ekornas, J.C. Laberg and T. Kobbeltvedt (2000) Shared mental models and task performance: studying the effects of a crew and bridge resource management training program (Project Report: 1 2001) Bergen, Norway: Militaer Psykologi og Ledelse
12. J.A. Cannon-Bowers, C. Prince, E. Salas, J. Owens, B. Morgan Jr. and G. Gonos (1989) Determining aircrew coordination training effectiveness. Paper presented at the 11th Interservice/ Industry Training Systems Conference. TX: Fort Worth November
13. Clothier, C.C. 1991. Behavioral interactions across various aircraft types: results of systematic observations of line operations and simulations. In: Jensen, R.S. (Ed.), Proceedings of the sixth International Symposium on Aviation Psychology, Ohio State University, Columbus, pp. 332–337.
14. Connolly, T.J., Blackwell, B.B. 1987. A simulator approach to training in aeronautical decision making. In: Jensen, R.S. (Ed.), Proceedings of the 4th International Symposium on Aviation Psychology, Ohio State University, Columbus, pp. 251–258.
15. Diehl, A. 1991. The effectiveness of training programs for preventing aircrew “error.” In: Jensen, R.S. (Ed.), Proceedings of the sixth Intemational Symposium on Aviation Psychology, Ohio State University, Columbus, pp. 640–655.
16. C. Ellis and G. Hughes (1999) Use of human patient simulation to teach emergency medicine trainees advanced airway skills. Journal of Accident Emergency Medicine 16 395-399.
17. Fonne, V.M., Fredriksen, O.K. 1995. Resource management and crew training for HSV-navigators. In: Jensen, R.S., Rakovan, L.A. (Eds), Proceedings of the eighth International Symposium on Aviation Psychology, Ohio State University, Columbus, pp. 585–590.
18. J.K. Ford, K. Kraiger and S.M. Merritt (2009) An updated review of the multidimensionality of training outcomes: New directions for training evaluation research. S.W.J. Kozlowski, E. Salas (Eds) Learning, Training, and Development in Organizations New York, NY: Routledge 135-168.
19. D.M. Gaba, S.K. Howard, K.J. Fish, B.E. Smith and Y.A. Sowb (2001) Simulation-based training in anesthesia crisis resource management (ACRM): a decade of experience. Simulation and Gaming 32 175-193.
20. D.M. Gaba, S.K. Howard, B. Flanagan, B.E. Smith, K.J. Fish and R. Botney (1998) Assessment of clinical performance during simulated crises using both technical and behavioral ratings. Anesthesiology 89 8-18.
21. R.M. Gagne (1984) Learning outcomes and their effects: useful categories of human performance. American Psychologist 39 377-385.
22. K.M. Goeters (2002) Evaluation of the effects of CRM training by the assessment of non-technical skills under LOFT. Human Factors and Aerospace Safety 2 71-86.
23. I.L. Goldstein and J.K. Ford (2002) Training in Organizations. 4th ed Belmont, CA: Wadsworth
24. I.L. Goldstein (1993) Training in organizations. 3rd ed. Pacific Grove, CA: Brooks/Cole
25. Gregorich, S.E. 1993. The dynamics of CRM attitude change: attitude stability. In Proceedings of the 7th International Symposium on Aviation Psychology (pp. 509–512). Columbus: Ohio State University.
26. S.E. Gregorich, R.L. Helmreich and J.A. Wilhelm (1990) Structure of cockpit management attitudes. Journal of Applied Psychology 75 682-690.
27. S.E. Gregorich and J.A. Wilhelm (1993) Crew resource management training assessment. E.L. Wiener, B.G. Kanki, R.L. Helmreich (Eds) Cockpit resource management CA: Academic Press 173-198.
28. S.E. Gregorich and J.A. Wilhelm (1993) Crew resource management training assessment. E.L. Wiener, B.G. Kanki, R.L. Helmreich (Eds) Cockpit resource management. San Diego, CA: Academic 173-198.
29. Grubb, G., Crossland, N., Katz, L. 2002. Evaluating and delivering the U.S. Army aircrew coordination training enhancement (ACTE) program. In Proceedings of the Interservice/Industry Training, Simulation and Education Conference, National Training Systems Association, Arlington, VA, pp. 1143–1149.
30. Grubb, G., Morey, J.C. (2003). Enhancement of the U.S. Army aircrew coordination training (ACT) program. In: Jensen, R.S. (Ed.), Proceedings of the twelth International Symposium on Aviation Psychology, Ohio State University, Columbus, pp. 446–452.
31. G. Grubb, C. Morey l. C and R. Simon (1999) Applications of the theory of reasoned action model of attitude assessment in the air force CRM program. R.S. Jensen, B. Cox, J.D. Callister, R. Lavis (Eds) Proceedings of the 10th International Symposium on Aviation Psychology Columbus: Ohio State University 298-301.
32. R.L. Helmreich (1984) Cockpit management attitudes. Human Factors 26 583-589.
33. R.L. Helmreich and A.C. Merritt (1998) Culture at work in aviation and medicine: National, organizational, and professional influences. Aldershot, England: Ashgate
34. R.L. Helmreich, A.C. Merritt and J.A. Wilhelm (1999) The evolution of crew resource management training in commercial aviation. The International Journal of Aviation Psychology 9 19-32.
35. R.L. Helmreich and J.A. Wilhelm (1989) When training boomerangs: Negative outcomes associated with Cockpit Resource Management programs. R.S. Jensen (Eds) Proceedings of the Fifth Symposium on Aviation Psychology Columbus, OH: Ohio State University 692-697.
36. E.F. Holton (1996) The flawed four-level evaluation model. Human Resource Development Quarterly 7 5-21.
37. S. Howard, D. Gaba, K. Fish, G. Yang and F. Samquist (1992) Anesthesia crisis resource management training: teaching anethesiologists to handle critical incidents. Aviation, Space, and Environmental Medicine 63 763-770.
38. Irwin, C.M. 1991. The impact of initial and recurrent cockpit resource management training on attitudes. In: Jensen, R.S. (Ed.), Proceedings of the sixth International Symposium on Aviation Psychology, Ohio State University, Columbus, pp. 344–349.
39. J. Jacobsen, A.L. Lindekaer, H.T. Ostergaard, K. Nielsen, D. Ostergaard, M. Laub, et al. (2001) Management of anaphylactic shock evaluated using a full-scale anaesthesia simulator. Acta Anaesthesiologica Scandinavica 45 315-319.
40. F. Jentsch and C.A. Bowers (1998) Evidence for the validity of PC-based simulations in studying aircrew coordination. The International Journal of Aviation Psychology 8 243-260.
41. Katz, L. (2003). Army CRM training: demonstration of a prototype computer-based program. In Proceedings of the twelth International Symposium on Aviation Psychology, Ohio State University, Columbus, pp. 648–650.
42. P.J. Kayten (1993) The accident investigator's perspective. E.L. Wiener, B.G. Kanki, R.L. Helmreich (Eds) Cockpit Resource Management San Diego, CA: Academic 283-314.
43. Kirkpatrick, D.L. 1959a. Techniques for evaluating training programs. Journal of ASTD 13, 3–9.
44. Kirkpatrick, D.L., 1959b. Techniques for evaluating training programs: Part 2—Learning. Journal of ASTD 13, 21–26.
45. Kirkpatrick, D.L., 1960a. Techniques for evaluating training programs: Part 3—Behavior. Journal of ASTD 14, 13–18.
46. Kirkpatrick, D.L., 1960b. Techniques for evaluating training programs: Part 4—Results. Journal of ASTD 14, 28–32.
47. D.L. Kirkpatrick (1967) Evaluation of training. R.L. Craig, L.R. Bittel (Eds) Training and Development Handbook New York: McGraw-Hill 87-112.
48. D.L. Kirkpatrick (1987) Evaluation of training. R.L. Craig (Eds) Training and Development Handbook: A Guide to Human Resource Development third ed New York: McGraw-Hill 301-319.
49. K. Kraiger (2002) Decision-based evaluation. K. Kraiger (Eds) Creating, Implementing, and Maintaining Effective Training and Development: State-of-the-Art Lessons for Practice San Francisco, CA: Jossey-Bass 331-375.
50. K. Kraiger, J.K. Ford and E. Salas (1993) Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation [Monograph]. Journal of Applied Psychology 78 311-328.
51. A.C. Merritt and R.L. Helmreich (1996) Creating and sustaining a safety culture - Some practical strategies (in aviation). Paper presented at the Applied aviation psychology - Achievement, change and challenge. Proceedings of the 3rd Australian Aviation Psychology Symposium Manly, Australia
52. J.C. Morey, G. Grubb and R. Simon (1997) Towards a new measurement approach for cockpit resource management attitudes. R.S. Jensen, L.A. Rakovan (Eds) Proceedings of the Ninth International Symposium on Aviation Psychology Columbus: Ohio State University 478-483.
53. J.C. Morey, R. Simon, G.D. Jay, R.L. Wears, M. Salisbury, K.A. Dukes, et al. (2002) Error reduction and performance improvement in the emergency department through formal teamwork training: evaluation results of the MedTeams project. Health Services Research 37 1553-1581.
54. R.A. Noe (2002) Employee training and development. 2nd ed Boston: McGraw-Hill
55. P. O'Connor, J. Campbell, J. Newon, J. Melton, E. Salas and K.A. Wilson (2008) Crew resource management training effectiveness: a meta-analysis and some critical needs. The International Journal of Aviation Psychology 18 353-368.
56. P. O'Connor, R. Flin and G. Fletcher (2002) Methods used to evaluate the effectiveness of CRM training: a literature review. Journal of Human Factors and Aerospace Safety 2 217-234.
57. A. Prince, C. Prince, M.T. Brannick and E. Salas (1997) The measurement of team process behaviors in the cockpit: Lessons learned. M.T. Brannick, E. Salas, C. Prince (Eds) Team performance assessment and measurement: Theory, methods and applications Hillsdale, NJ: LEA 289-310.
58. C. Prince and E. Salas (1999) Team processes and their training in aviation. D.J. Garland, J.A. Wise, V.D. Hopkins (Eds) Handbook of Aviation Human Factors Hillsdale, NJ: LEA, Inc 193-214.
59. C. Prince, R. Oser, E. Salas and W. Woodruff (1993) Increasing hits, reducing misses in CRM/LOS scenarios: Guidelines for simulator scenario development. The International Journal of Aviation Psychology 3 69-82.
60. Robertson, M.M., Taylor, J.C. 1995. Team training in aviation maintenance settings: a systematic evaluation. In: Hayward B.J., Lowe A.R. (Eds), Applied aviation psychology: achievement, change, and challenge. Proceedings of the Third Australian Aviation Psychology Symposium, Avebury Aviation, Aldershot, UK, pp. 373–383.
61. E. Salas, C.S. Burke, C.A. Bowers and K. Wilson (2001) Team training in the skies: does CRM training work? Human Factors 43 641-674.
62. E. Salas and J.A. Cannon-Bowers (2001) The science of training: A decade of progress. Annual Review of Psychology 52 471-499.
63. Salas, E., Fowlkes, J., Stout, R.J., Milanovich, D.M., Prince, C. 1999a. Does CRM training enhance teamwork skills in the cockpit?: two evaluation studies. Human Factors 41, 326–343.
64. Salas, E., Prince, C., Bowers, C.A., Stout, R., Oser, R.L., Cannon-Bowers, J.A. 1999b. A methodology to enhance crew resource management training. Human Factors 41, 161–172.
65. E. Salas, L. Rhodenizer and C.A. Bowers (2000) The design and delivery of CRM training: Exploring available resources. Human Factors 42 490-511.
66. Salas, E., Wilson, K.A., Burke, C.S., Wightman, D.C. 2006a. Does CRM training work? An update, extension and some critical needs. Human Factors 48, 392–412.
67. Salas, E., Wilson, K.A., Burke, C.S., Wightman, D.C., Howse, W.R. 2006b. Crew resource management training research, practice, and lessons learned. In: Williges R.C. (Ed.), Review of Human Factors and Ergonomics, vol. 2, Human Factors and Ergonomics Society, Santa Monica, CA, pp. 35–73.
68. Spiker, V.A., Tourville, S.J., Bragger, J., Dowdy, D., Nullmeyer, R.T. 1999. Measuring C-5 crew coordination proficiency in an operational wing. In Proceedings of the Interservice/Industry Training, Simulation and Education Conference [CD-ROM]. Arlington, VA: National Training Systems Association.
69. Spiker, V.A., Wilson, D.D., Deen, G.C. 2003. CRM and mission performance during C-130 mission-oriented simulator training. In: Jensen R.S. (Ed.), Proceedings of the twelth International Symposium on Aviation Psychology, Ohio State University, Columbus, pp. 1108–1114.
70. R.J. Stout, E. Salas and J.E. Fowlkes (1997) Enhancing teamwork in complex environments through team training. Group Dynamics 1 169-182.
71. S.I. Tannenbaum, J.A. Cannon-Bowers, E. Salas and J.E. Mathieu (1993) Factors that influence training effectiveness: A conceptual model and longitudinal analysis (Tech. Rep. No. 93-011). Orlando, FL: Naval Training Systems Center
72. Taylor, J.C. 1998. Evaluating the effectiveness of maintenance resource management (MRM). Paper presented at the twelth International Symposium on Human Factors in Aviation Maintenance, August, Washington, DC.
73. Taylor, J.C., Robertson, M.M., Peck, R., Stelly, J.W. 1993. Validating the impact of maintenance CRM training. In: Jensen R.S. (Ed.), Proceedings of the seventh International Symposium on Aviation Psychology, Ohio State University, Columbus, pp. 538–542.
74. J.C. Taylor and R.L. Thomas (2003) Written communication practices as impacted by a maintenance resource management training intervention. Journal of Air Transportation 8 69-90.
75. Thompson, J.S., Tourville, S.J., Spiker, V.A., Nullmeyer, R.T. 1999. Crew resource management and mission performance during MH-53J combat mission training. In Proceedings of the Interservice/Industry Training, Simulation and Education Conference [CD-ROM]. Arlington, VA: National Training Systems Association.
76. H. Yamamori and T. Mito (1993) Keeping CRM is keeping the flight safe. E.L. Wiener, B.G. Kanki, R.L. Helmreich (Eds) Cockpit Resource Management San Diego, CA: Academic 399-420.