The flawed four-level evaluation model

Human Resource Development Quarterly

Volumn 7, Issue 1, 1996, Pages 5-21

  Holton, Elwood F ^a  

^a LOUISIANA STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85025341104     PISSN: 10448004     EISSN: 15321096     Source Type: Journal    
DOI: 10.1002/hrdq.3920070103     Document Type: Article

References (51)

1. Alliger, G. M., & Janak, E. A. (1989). Kirkpatrick's levels of training criteria: Thirty years later. Personal Psychology, 42, 331-340.
2. Baldwin, T. T., & Ford, J. K. (1988). Transfer of training: A review and directions for future research. Personnel Psychology, 41, 63-100.
3. Baldwin, T. T., Magjuka, R. J., & Loher, B. T. (1991). The perils of participation: Effects of choice of training on trainee motivation and learning. Personnel Psychology, 44, 51-65.
4. Baumgaitel, H., Reynolds, M., & Pathan, R. (1984). How personality and organizational/climate variables moderate the effectiveness of management development programmes: A review and some recent research findings. Management and Labour Studies, 9, 1-16.
5. Bobko, P., & Russell, C. (1991). A review of the role of taxonomies in human resources management. Human Resource Management Review, 4, 293-316.
6. Brinkerhoff, R. O. (1987). Achieving results from training. San Francisco: Jossey-Bass.
7. Broad, M. L., & Newstrom, J. W. (1992). Transfer of training. Reading, MA: Addison-Wesley.
8. Clark, C. S., Dobbins, G. H., & Ladd, R. T. (1993). Exploratory field study of training motivation. Group and Organization Management, 18, 292-307.
9. Clement, R. W. (1982). Testing the hierarchy theory of training evaluation: An expanded role for trainee reactions. Public Personnel Management Journal, 11, 176-184.
10. Cohen, D. J. (1990). The pretraining environment: A conceptualization of how contextual factors influence participation motivation. Human Resource Development Quarterly, 1, 387-398.
11. Dixon, N. M. (1990). The relationship between trainee responses on participation reaction forms and posttest scores. Human Resource Development Quarterly, 1, 129-137.
12. Dubin, R. (1976). Theory building in applied areas. In M. D. Dunnette (Ed.), Handbook of Industrial/Organizational Psychology. New York: Rand McNally.
13. Fleishman, E. A., & Mumford, M. D. (1989). Individual attributes and training performance. In I. L. Goldstein & Associates (Eds.), Training and development in organizations (pp. 183-255). San Francisco: Jossey-Bass.
14. Gist, M. E., Bavetta, A. G., & Stevens, C. K. (1990). Transfer training method: Its influence on skill generalization, skill repetition, and performance level. Personnel Psychology, 43, 501-523.
15. Gist, M. E., Stevens, C. K., & Bavetta, A. G. (1991). Effects of self-efficacy and posttraining intervention on the acquisition and maintenance of complex interpersonal skills. Personnel Psychology, 44, 837-861.
16. Glaser, B. G., and Strauss, A. L. (1967). The discovery of grounded theory: Strategies for qualitative research. Hawthorne, NY: Aldine.
17. Goldstein, I. L. (1985). The applicability of a training transfer model to issues concerning rater training. In E. Locke (Ed.), Generalizing from laboratory to field settings (pp. 83-98). San Francisco: New Lexington Press.
18. Hamblin, A. C. (1974). Evaluation and control of training. New York: McGraw-Hill.
19. Hicks, W. D., & Klimoski, R. J. (1987). Entry into training programs and its effects on training outcomes: A field experiment. Academy of Management Journal, 30, 542-552.
20. Hoiberg, A., & Berry, N. H. (1978). Expectations and perceptions of Navy life. Orgamzational Behavior and Human Performance, 21, 130-145.
21. Holton, E. F., III (1995). A snapshot of needs assessment. In J. J. Phillips and E. F. Holton III (Eds.), In action: Conducting needs assessment (pp. 1-12). Alexandria, VA: American Society for Training and Development.
22. Kanfer, R., & Ackerman, P. L. (1989). Motivation and cognitive abilities: An integrative/aptitude-treatment interaction approach to skill acquisition. Journal of Applied Psychology, 74, 657-690.
23. Kaufman, R., & Keller, J. M. (1994). Levels of evaluation: Beyond Kirkpatrick. Human Resource Development Quarterly, 5, 371-380.
24. Kimmerling, G. (1993, Sept.). Gathering the best practices. Training and Development, 29-36.
25. Kirkpatrick, D. L. (1976). Evaluation of training. In R. L. Craig (Ed.), Training and development handbook. New York: McGraw-Hill.
26. Kirkpatrick, D. L. (1994). Evaluating training programs: The four levels. San Francisco: Berrett-Koehler.
27. Klimoski, R. (1991). Theory presentation in human resource management. Human Resource Management Review, 4, 253-271.
28. Mathieu, J. E., Tannenbaum, S. L., & Salas, E. (1992). Influences on individual and situational characteristics on measures of training effectiveness. Academy of Management Journal, 35, 828-847.
29. Mosier, N. R. (1990). Financial analysis: The methods and their application to employer training. Human Resource Development Quarterly, 1, 45-63.
30. Noe, R. A. (1986). Trainee attributes and attitudes: Neglected influences on training effectiveness. Academy of Management Review, 11, 736-749.
31. Noe, R. A., & Schmid, N. (1986). The influence of trainee attitudes on training effectiveness: Test of a model. Personnel Psychology, 39, 497-523.
32. Patrick, J. (1992). Training research and practice. San Diego, CA: Academic Press.
33. Peters, L. H., O'Conner, E. J., & Eulberg, J. R. (1985). Situational constraints: Sources, consequences, and future considerations. In B. Rowland & G. Ferris (Eds.), Research in personnel and human resources management, Vol. 3 (pp. 79-113). Greenwich, CT: JAI Press.
34. Phillips, J. J. (1991). Handbook of training evaluation and measurement methods (2nd ed.). Houston, TX: Gulf Publishing.
35. Phillips, J. J. (1995). Return on investment—Beyond the four levels. In E. F. Holton III (Ed,), Academy of HRD 1995 Conference Proceedings.
36. Reber, R. A., & Wallin, J. A. (1984). The effects of training, goal setting, and knowledge of results on safe behavior: A component analysis. Academy of Management Journal, 27, 544-560.
37. Ree, M. J., & Earles, J. A. (1991). Predicting training success: Not much more than g. Personnel Psychology, 44, 321-332.
38. Rouillier, J. Z., & Goldstein, I. L. (1993). The relationship between organizational transfer climate and positive transfer of training. Human Resource Development Quarterly, 4, 377-390.
39. Rummler, G. A., & Brache, A. P. (1990). Improving performance: How to manage the white space on the organization chart. San Francisco: Jossey-Bass.
40. Steers, R. M., & Poner, L. W. (1991). Motivation and work. New York: McGraw-Hill.
41. Swanson, R. A. (1994). Analysis for improving performance. San Francisco: Berreti-Koehler.
42. Swanson, R. A., & Gradous, D. B. (1988). Forecosting financial benefits of human resource development. San Francisco: Jossey-Bass.
43. Tannenbaum, S. I., Mathieu, J. E., Salas, E., & Cannon-Bowers, J. A. (1991). Meeting trainees' expectations: The influence on the development of commitment, self-efficacy, and motivation. Journal of Applied Psychology, 76, 759-769.
44. Tett, R. P., Jackson, D. N., & Rothstein, M. (1991). Personality measures as predictors of job performance: A meta-analytic review. Personnel Psychology, 44, 703-742.
45. Tracy, J. B. (1992). The effects of organizational climate and culture on the transfer of training. Unpublished doctoral dissertation, State University of New York, Albany.
46. Tziner, A., Haccourt, R. R., & Kadish, A. (1991). Personal and situational characteristics influencing the effectiveness of transfer of training improvement strategies. Journal of Occupational Psychology, 64, 167-177.
47. Vroom, V. H. (1964). Work and motivation. New York: Wiley.
48. Wallace, M. (1983). Methodology, research practice, and progress in personnel and industrial relations. Academy of Management Review, 8, 6-13.
49. Warr, P., & Bunce, D. (1995). Trainee characteristics and the outcomes of open learning. Personnel Psychology, 48, 347-375.
50. Werner, J. M., Oleary-Kelly, A. M., Baldwin, T. T., & Wexley, K. N. (1994). Augmenting behavior modeling training: Testing the effects of pre- and posttraining interventions. Human Resource Development Quarterly, 5, 169-183.
51. Wexley, K. N., & Baldwin, T. T. (1986). Posttraining strategies for facilitating positive transfer: An empirical exploration. Academy of Management Journal, 29, 503-520.