An Integrated Model of Training Evaluation and Effectiveness

Human Resource Development Review

Volumn 3, Issue 4, 2004, Pages 385-416

  Alvarez, Kaye ^a   Salas, Eduardo ^a   Garofano, Christina M ^a  

^a UNIVERSITY OF CENTRAL FLORIDA   (United States)

Author keywords

individual characteristics; organizational characteristics; post training attitudes; training; training characteristics; training effectiveness; training evaluation; training motivation

Indexed keywords

EID: 84993748618     PISSN: 15344843     EISSN: None     Source Type: Journal    
DOI: 10.1177/1534484304270820     Document Type: Article

References (76)

1. Alliger, G. M., Tannenbaum, S. I., Bennett, W., Traver, H., & Shotland, A. (1997). A meta-analysis of relations among training criteria. Personnel Psychology, 50, 341-358.
2. Aronson, E., Ellsworth, P. C., Carlsmith, J. M., & Gonzales, M. H. (1990). Methods of research in social psychology (2nd ed.). New York: McGraw-Hill.
3. Baldwin, T. T., & Ford, J. K. (1988). Transfer of training: A review and directions for future research. Personnel Psychology, 41, 63-105.
4. Bell, B. S., & Kozlowski, S. W. J. (2002). Adaptive guidance: Enhancing self-regulation, knowledge, and performance in technology-based training. Personnel Psychology, 55, 267-306.
5. Brett, J. F., & Vande Walle, D. (1999). Goal orientation and goal content as predictors of performance in a training program. Journal of Applied Psychology, 84, 863-873.
6. Broad, M. L., & Newstrom, J. W. (1992). Transfer of training: Action-packed strategies to ensure high payoff from training investments. Reading, MA: Addison-Wesley.
7. Burke, L. A. (1997). Improving positive transfer: A test of relapse prevention training on transfer out-comes. Human Resource Development Quarterly, 8, 115-128.
8. Cannon-Bowers, J. A., Salas, E., Tannenbaum, S. I., & Mathieu, J. E. (1995). Toward theoretically based principles of training effectiveness: A model and initial empirical investigation. Military Psychology, 7, 141-164.
9. Carter, S. D. (2002). Matching training methods and factors of cognitive ability: A means to improve training outcomes. Human Resource Development Quarterly, 13, 71-87.
10. Cellar, D. F., Miller, M. L., Doverspike, D. D., & Klawsky, J. D. (1996). Comparison of factor structures and criterion-related validity coefficients for two measures of personality based on the five factor model. Journal of Applied Psychology, 81, 694-704.
11. Cole, N. D., & Latham, G. P. (1997). Effects of training in procedural justice on perceptions of disciplinary fairness by unionized employees and disciplinary subject matter experts. Journal of Applied Psychology, 82, 699-705.
12. Colquitt, J. A., & Simmering, M. J. (1998). Conscientiousness, goal orientation, and motivation to learn during the learning process: A longitudinal study. Journal of Applied Psychology, 83, 654-665.
13. Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design and analysis issues for field settings. Boston: Houghton Mifflin.
14. Davis, W. D., Fedor, D. B., Parsons, C. K., & Herold, D. M. (2000). The development of self-efficacy during aviation training. Journal of Organizational Behavior, 21, 857-871.
15. Doane, S. M., Alderton, D. L., Sohn, Y. W., & Pellegrino, J. W. (1996). Acquisition and transfer of skilled performance: Are visual discrimination skills stimulus specific? Journal of Experimental Psychology: Human Perception and Performance, 22, 1218-1248.
16. Doane, S. M., Sohn, Y. W., & Schreiber, B. (1999). The role of processing strategies in the acquisition and transfer of a cognitive skill. Journal of Experimental Psychology: Human Perception and Performance, 25, 1390-1410.
17. Driskell, J. E., Hogan, J., Salas, E., & Hoskin, B. (1994). Cognitive and personality predictors of training performance. Military Psychology, 6, 31-46.
18. Dyck, J. L., & Smither, J. A. (1996). Older adults’ acquisition of word processing: The contribution of cognitive abilities and computer anxiety. Computers in Human Behavior, 12, 107-119.
19. Eyring, J. D., Johnson, D. S., & Francis, D. J. (1993). A cross-level units-of-analysis approach to individual differences in skill acquisition. Journal of Applied Psychology, 78, 805-814.
20. Facteau, J. D., Dobbins, G. H., Russell, J. E. A., Ladd, R. T., & Kudisch, J. D. (1995). The influence of general perceptions of the training environment on pretraining motivation and perceived training transfer. Journal of Management, 21, 1-25.
21. Ferguson, E., Sanders, A., O’Hehir, F., & James, D. (2000). Predictive validity of personal statements and the role of the five-factor model of personality in relation to medical training. Journal of Occupational & Organizational Psychology, 73, 321-344.
22. Fisher, S. L., & Ford, J. K. (1998). Differential effects of learner effort and goal orientation on two learning outcomes. Personnel Psychology, 51, 397-420.
23. Ford, J. K., Smith, E. M., Weissbein, D. A., Gully, S. M., & Salas, E. (1998). Relationships of goal orientation, metacognitive activity, and practice strategies with learning outcomes and transfer. Journal of Applied Psychology, 83, 218-233.
24. Frayne, C. A., & Geringer, J. M. (2000). Self-management training for improving job performance: A field experiment involving salespeople. Journal of Applied Psychology, 85, 361-372.
25. Gist, M. E., & Stevens, C. K. (1998). Effects of practice conditions and supplemental training method on cognitive learning and interpersonal skill generalization. Organizational Behavior & Human Decision Processes, 75, 142-169.
26. Goettl, B. P., Yadrick, R. M., Connolly-Gomez, C. C., Regian, J. W., & Shebilske, W. L. (1996). Alternating task modules in isochronal distributed training of complex tasks. Human Factors, 38, 330-346.
27. Goldstein, I. L. (1991). Training in work organizations. In M. D. Dunnette and L. M. Hough (Eds.), Handbook of industrial and organizational psychology (2nd ed., Vol. 2, pp. 445-505). Palo Alto, CA: Consulting Psychologists Press.
28. Gopher, D., Weil, M., & Bareket, T. (1994). Transfer of skill from a computer game trainer to flight. Human Factors, 36, 387-405.
29. Gully, S. M., Payne, S. C., Koles, K. L. K., & Whiteman, J. K. (2002). The impact of error training and individual differences on training outcomes: An attribute-treatment interaction perspective. Journal of Applied Psychology, 87, 143-155.
30. Hanisch, K. A., & Hulin, C. L. (1994). Two-stage sequential selection procedures using ability and training performance: Incremental validity of behavioral consistency measures. Personnel Psychology, 47, 767-785.
31. Herold, D. M., Davis, W., Fedor, D. B., & Parsons, C. K. (2002). Dispositional influences on transfer of learning in multistage training programs. Personnel Psychology, 55, 851-869.
32. Hertenstein, E. J. (2001). Goal orientation and practice condition as predictors of training results. Human Resource Development Quarterly, 12, 403-419.
33. Holton, E. F., III. (1996). The flawed four-level evaluation model. Human Resource Development Quarterly, 7, 5-21.
34. Holton, E. F., III. (2003). What’s really wrong: Diagnosis for learning transfer system change. In E. Salas et al. (Eds.), Improving learning transfer in organizations (pp. 59-79). San Francisco, CA: Jossey-Bass.
35. Holton, E. F., III, & Baldwin, T. T. (2000). Making transfer happen: An action perspective on learning transfer systems. In E. F. Holton, S. S. Naquin, & T. T. Baldwin (Eds.), Managing and changing learning transfer systems: Advances in developing human resources #8 (pp. 1-6). San Francisco, CA: Berrett-Koehler.
36. Holton, E. F., III, Bates, R. A., & Ruona, W. E. A. (2000). Development of a generalized learning transfer system inventory. Human Resource Development Quarterly, 11, 333-360.
37. Karl, K. A., O’Leary-Kelly, A. M., & Martocchio, J. J. (1993). The impact of feedback and self-efficacy on performance in training. Journal of Organizational Behavior, 14, 379-394.
38. Kirkpatrick, D. L. (1976). Evaluation of training. In R. L. Craig (Ed.), Training and Development Handbook (2nd ed.). New York: McGraw-Hill.
39. Kraiger, K. (2002). Decision-based evaluation. In K. Kraiger (Ed.), Creating, implementing, and managing effective training and development (pp. 331-375). San Francisco, CA: Jossey-Bass.
40. Kraiger, K., Ford, J. K., & Salas, E. (1993). Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. Journal of Applied Psychology, 78, 311-328.
41. Krijger, N. L., & Pol, S. M. (1995). Changing leadership style: A training model for lasting effects. In M. Mulder, W. J. Nijhof, & R. O. Brinkerhoff (Eds.), Corporate training for effective performance: Evaluation in education and human services (pp. 111-133). Norwell, MA: Kluwer Academic.
42. Lorenz, R., Gregory, R. P., & Davis, D. L. (2000). Utility of a brief self-efficacy scale in clinical training program evaluation. Evaluations & the Health Professions, 23, 182-193.
43. Martocchio, J. J. (1994). Effects of conceptions of ability on anxiety, self-efficacy, and learning in training. Journal of Applied Psychology, 79, 819-825.
44. Martocchio, J. J., & Dulebohn, J. (1994). Performance feedback effects in training: The role of perceived controllability. Personnel Psychology, 47, 357-373.
45. Martocchio, J. J., & Judge, T. A. (1997). Relationship between conscientiousness and learning in employee training: Mediating influences of self-deception and self-efficacy. Journal of Applied Psychology, 82, 764-773.
46. Mathieu, J. E., & Martineau, J. W. (1997). Individual and situational influences on training motivation. In J. K. Ford (Ed.), Improving training effectiveness in work organizations (pp. 193-217). Mahwah, NJ: Lawrence Erlbaum.
47. Mathieu, J. E., Martineau, J. W., & Tannenbaum, S. I. (1993). Individual and situational influences on the development of self-efficacy: Implications for training effectiveness. Personnel Psychology, 46, 125-147.
48. May, G. L., & Kahnweiler, W. M. (2000). The effect of a mastery practice design on learning and transfer in behavior modeling training. Personnel Psychology, 53, 353-373.
49. Moreland, R. L., & Myaskovsky, L. (2000). Exploring the performance benefits of group training: Transactive memory or improved communication? Organizational Behavior and Human Decision Processes, 82, 2000.
50. Morin, L., & Latham, G. P. (2000). The effect of mental practice and goal setting as a transfer of training intervention on supervisors’ self-efficacy and communication skills: An exploratory study. Applied Psychology: An International Review, 49, 566-578.
51. Naquin, S. S., & Holton, E. F., III. (2002). The effects of personality, affectivity, and work commitment on motivation to improve work through learning. Human Resource Development Quarterly, 13, 357-376.
52. Noe, R. A., & Colquitt, J. A. (2002). Planning for training impact: Principles of training effectiveness. In K. Kraiger (Ed.), Creating, implementing, and managing effective training and development (pp. 53-79). San Francisco, CA: Jossey-Bass.
53. Peck, A. C., & Detweiler, C. (2000). Training concurrent multistep procedural tasks. Human Factors, 42, 379-389.
54. Quiñones, M. A. (1995). Pretraining context effects: Training assignment as feedback. Journal of Applied Psychology, 80, 226-238.
55. Ree, M. J., Carretta, T. R., & Teachout, M. S. (1995). Role of ability and prior knowledge in complex training performance. Journal of Applied Psychology, 80, 721-730.
56. Ricci, K. E., Salas, E., & Cannon-Bowers, J. A. (1996). Do computer-based games facilitate knowledge acquisition and retention? Military Psychology, 8, 295-307.
57. Richman-Hirsch, W. L. (2001). Posttraining interventions to enhance transfer: The moderating effects of work environments. Human Resource Development Quarterly, 12, 105-120.
58. Rouiller, J. Z., & Goldstein, I. L. (1993). The relationship between organizational transfer climate and positive transfer of training. Human Resource Development Quarterly, 4, 377-390.
59. Rynes, S., & Rosen, B. (1995). A field survey of factors affecting the adoption and perceived success of diversity training. Personnel Psychology, 48, 247-270.
60. Saks, A. M. (1995). Longitudinal field investigation of the moderating and mediating effects of self-efficacy on the relationship between training and newcomer adjustment. Journal of Applied Psychology, 80, 211-225.
61. Salas, E., & Cannon-Bowers, J. A. (2001). The science of training: A decade of progress. Annual Review of Psychology, 52, 471-499.
62. Silva, J. M., & White, L. A. (1993). Relation to cognitive aptitudes to success in foreign language training. Military Psychology, 5, 79-93.
63. Simon, S. J., & Werner, J. M. (1996). Computer training through behavior modeling, self-paced, and instructional approaches: A field experiment. Journal of Applied Psychology, 81, 648-659.
64. Smith-Jentsch, K. A., Salas, E., & Baker, D. (1996). Training team performance-related assertiveness. Personnel Psychology, 49, 909-936.
65. Stevens, C. K., & Gist, M. E. (1997). Effects of self-efficacy and goal-orientation training on negotiation skill maintenance: What are the mechanisms? Personnel Psychology, 50, 955-978.
66. Stewart, G. L., Carson, K. P., & Cardy, R. L. (1996). The joint effects of conscientiousness and self-leadership training on employee self-directed behavior in a service setting. Personnel Psychology, 49, 143-164.
67. Tannenbaum, S. I. (1997). Enhancing continuous learning: Diagnostic findings from multiple findings. Human Resource Management, 36, 437-452.
68. Tannenbaum, S. I., Cannon-Bowers, J. A., Salas, E., & Mathieu, J. E. (1993). Factors that influence training effectiveness: A conceptual model and longitudinal analysis (Technical Rep. No. 93-011). Orlando, FL: Naval Training Systems Center.
69. Tesluk, P. E., Farr, J. L., Mathieu, J. E., & Vance, R. J. (1995). Generalization of employee involvement training to the job setting: Individual and situational effects. Personnel Psychology, 48, 607-632.
70. Torres, R. T., & Preskill, H. (2001). Evaluation and organizational learning: Past, present, and future. American Journal of Evaluation, 22, 387-395.
71. Tracey, J. B., Hinkin, T. R., Tannenbaum, S., & Mathieu, J. E. (2001). The influence of individual characteristics and the work environment on varying levels of training outcomes. Human Resource Development Quarterly, 12, 5-23.
72. Tracey, J. B., Tannenbaum, S. I., & Kavanagh, M. J. (1995). Applying trained skills on the job: The importance of the work environment. Journal of Applied Psychology, 80, 239-252.
73. Warr, P., Allan, C., & Birdi, K. (1999). Predicting three levels of training outcome. Journal of Occupational & Organizational Psychology, 72, 351-375.
74. Warr, P., & Bunce, D. (1995). Trainee characteristics and the outcomes of open learning. Personnel Psychology, 48, 347-375.
75. Webster, J., & Martocchio, J. J. (1995). The differential effects of software training previews on training outcomes. Journal of Management, 21, 757-787.
76. Werner, J. M., O’Leary-Kelly, A. M., Baldwin, T. T., & Wexley, K. N. (1994). Augmenting behavior-modeling training: Testing the effects of pre- and post-training interventions. Human Resource Development Quarterly, 5, 169-183.