Frame-of-Reference Training Effectiveness: Effects of Goal Orientation and Self-Efficacy on Affective, Cognitive, Skill-Based, and Transfer Outcomes

Journal of Applied Psychology

Volumn 95, Issue 6, 2010, Pages 1181-1191

  Dierdorff, Erich C ^a   Surface, Eric A ^b   Brown, Kenneth G ^c  

^a DEPAUL UNIVERSITY   (United States)

^b SWA Consulting Inc   (United States)

^c UNIVERSITY OF IOWA   (United States)

Author keywords

Frame of reference training; Goal orientation; Self efficacy; Training effectiveness; Training transfer

Indexed keywords

AFFECT; ARTICLE; CALIBRATION; CERTIFICATION; COGNITION; FEMALE; HUMAN; LANGUAGE; LEARNING; MALE; MOTIVATION; PERSONNEL MANAGEMENT; PROFESSIONAL COMPETENCE; SELF CONCEPT; TASK PERFORMANCE;

AFFECT; CALIBRATION; CERTIFICATION; COGNITION; EMPLOYEE PERFORMANCE APPRAISAL; FEMALE; GOALS; HUMANS; LANGUAGE; LEARNING; MALE; MOTIVATION; PROFESSIONAL COMPETENCE; SELF EFFICACY; TASK PERFORMANCE AND ANALYSIS;

EID: 78049479970     PISSN: 00219010     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0020856     Document Type: Article

References (83)

1. Aguinis H., Kraiger K. Benefits of training and development for individuals and teams, organizations, and society. Annual Review of Psychology 2009, 60:451-474.
2. Ames C. Classrooms: Goals, structures, and student motivation. Journal of Educational Psychology 1992, 84:267-271.
3. Arthur W., Bennett W., Edens P.S., Bell S.T. Effectiveness of training in organizations: A meta-analysis of design and evaluation features. Journal of Applied Psychology 2003, 88:234-245.
4. Arthur W., Woehr D.J., Maldegen R. Convergent and discriminant validity of assessment center dimensions: A conceptual and empirical re-examination of the assessment center construct-related validity paradox. Journal of Management 2000, 26:813-835.
5. Athey T.R., McIntyre R.M. Effect of rater training on rater accuracy: Levels of processing theory and social facilitation theory perspectives. Journal of Applied Psychology 1987, 72:567-572.
6. Attenweiler W.J., Moore D. Goal orientations: Two, three, or more factors?. Educational and Psychological Measurement 2006, 66:342-352.
7. Baldwin T.T., Ford J.K. Transfer of training: A review and directions for future research. Personnel Psychology 1988, 41:63-105.
8. Bandura A. Social learning theory 1977, General Learning Press, New York, NY.
9. Bandura A. Self-efficacy: The exercise of control 1997, Freeman, New York, NY.
10. Bandura A., Caprara G.V., Barbaranelli C., Pastorelli C., Regalia C. Sociocognitive self-regulatory mechanisms governing transgressive behavior. Journal of Personality and Social Psychology 2001, 80:125-135.
11. Bernardin H.J., Buckley M.R. Strategies in rater training. Academy of Management Review 1981, 6:205-212.
12. Bernardin H.J., Tyler C.L., Wiese D.S. A reconsideration of strategies for rater training. Research in personnel and human resources management 2001, 221-274. JAI Press, Stamford, CT. G.R. Ferris (Ed.).
13. Bouffard T., Bouchard M., Goulet G., Denoncourt I., Couture N. Influence of achievement goals and self-efficacy on students' self-regulation and performance. International Journal of Psychology 2005, 40:373-384.
14. Breiner-Sanders K., Lowe P., Miles J., Swender E. ACTFL proficiency guidelines: Speaking (revised 1999). Foreign Language Annals 2000, 33:13-18.
15. Breusch T.S., Pagan A.R. A simple test for heteroscedasticity and random coefficient variation. Econometrica 1979, 47:1287-1294.
16. Brown K.G. Using computers to deliver training: Which employees learn and why?. Personnel Psychology 2001, 54:271-296.
17. Brown K.G., Ford J.K. Using computer technology in training: Building an infrastructure for active learning. Creating, implementing, and maintaining effective training and development: State-of-the-art lessons for practice 2002, 192-233. Jossey-Bass, San Francisco, CA. K. Kraiger (Ed.).
18. Button S.B., Mathieu J.E., Zajac D.M. Goal orientation in organizational research: A conceptual and empirical foundation. Organizational Behavior and Human Decision Processes 1996, 67:26-48.
19. Cardy R.L., Keefe T.J. Observational purpose and evaluative articulation in frame-of-reference training: The effects of alternative processing modes on rating accuracy. Organizational Behavior and Human Decision Processes 1994, 57:338-357.
20. Chiaburu D.S., Marinova S.V. What predicts skill transfer? An exploratory study of goal orientation, training self-efficacy and organizational supports. International Journal of Training and Development 2005, 9:110-123.
21. Colquitt J.A., LePine J.A., Noe R.A. Toward an integrative theory of training motivation: A meta-analytic path analysis of 20 years of research. Journal of Applied Psychology 2000, 85:678-707.
22. Dandonoli P., Henning G. An investigation of the construct validity of the ACTFL proficiency guidelines and oral interview procedure. Foreign Language Annals 1990, 23:11-22.
23. Day D.V., Sulsky L.M. Effects of frame-of-reference training and ratee information configuration on memory organization and rating accuracy. Journal of Applied Psychology 1995, 80:158-167.
24. DeShon R.P., Gillespie J.Z. A motivated action theory account of goal orientation. Journal of Applied Psychology 2005, 90:1096-1127.
25. Diener C.I., Dweck C.S. An analysis of learned helplessness: Continuous changes in performance, strategy, and achievement conditions following failure. Journal of Personality and Social Psychology 1978, 36:451-462.
26. Dweck C.S. Motivational processes affecting learning. American Psychologist 1986, 41:1041-1048.
27. Dweck C.S., Leggett E.L. A social-cognitive approach to motivation and personality. Psychological Review 1988, 95:256-273.
28. Elliot, A. J. (1994). Approach and avoidance achievement goals: An intrinsic motivation analysis (Unpublished doctoral dissertation). University of Wisconsin-Madison.
29. Elliot A.J. Approach and avoidance motivation and achievement goals. Educational Psychologist 1999, 34:169-189.
30. Elliot A.J., Harackiewicz J.M. Approach and avoidance achievement goals and intrinsic motivation: A mediational analysis. Journal of Personality and Social Psychology 1996, 70:461-475.
31. Elliott E.S., Dweck C.S. Goals: An approach to motivation and achievement. Journal of Personality and Social Psychology 1988, 54:5-12.
32. Fisher S.L., Ford J.K. Differential effects of learner effort and goal orientation on two learning outcomes. Personnel Psychology 1998, 51:397-420.
33. Fisk J.E., Warr P. Age-related impairment in associative learning: The role of anxiety, arousal, and learning self-efficacy. Personality and Individual Differences 1996, 21:675-686.
34. Ford J.K., Smith E.M., Weissbein D.A., Gully S.M., Salas E. Relationships of goal orientation, metacognitive activity, and practice strategies with learning outcomes and transfer. Journal of Applied Psychology 1998, 83:218-233.
35. Ford J.K., Weissbein D.A. Transfer of training: An updated review and analysis. Performance Improvement Quarterly 1997, 10:22-41.
36. Gist M.E., Mitchell T.R. Self-efficacy: A theoretical analysis of its determinants and malleability. Academy of Management Review 1992, 17:183-211.
37. Gist M.E., Stevens C.K., Bavetta A.G. Effects of self-efficacy and post-training intervention on the acquisition and maintenance of complex interpersonal skills. Personnel Psychology 1991, 44:837-861.
38. Grant H., Dweck C.S. Clarifying achievement goals and their impact. Journal of Personality and Social Psychology 2003, 85:541-553.
39. Gully S.M., Chen G. Individual differences, aptitude-treatment interactions, and learning. Learning, training, and development in organizations 2009, 3-64. Routledge Academic, New York, NY. S.W.J. Kozlowski, E. Salas (Eds.).
40. Harackiewicz J.M., Barron K.E., Pintrich P.R., Elliot A.J., Thrash T.M. Revision of achievement goal theory: Necessary and illuminating. Journal of Educational Psychology 2002, 94:638-645.
41. Harackiewicz J.M., Barron K., Tauer J.C., Carter S.M., Elliot A. Short-term and long-term consequences of achievement goals: Predicting interest and performance over time. Journal of Educational Psychology 2000, 92:316-330.
42. Heimbeck D., Frese M., Sonnentag S., Keith N. Integrating errors into the training process: The function of error management instructions and the role of goal orientation. Personnel Psychology 2003, 56:333-361.
43. Hofmann D.A. The influence of goal orientation on task performance: A substantively meaningful suppressor variable. Journal of Applied Social Psychology 1993, 23:1827-1846.
44. Jackson D.J.R., Atkins S.G., Fletcher R.B., Stillman J.A. Frame of reference training for assessment centers: Effects on interrater reliability when rating behaviors and ability traits. Public Personnel Management 2005, 34:17-30.
45. Klein H.J., Noe R.A., Wang C. Motivation to learn and goal outcomes: The impact of delivery mode, learning goal orientation, and perceived barriers and enablers. Personnel Psychology 2006, 59:665-702.
46. Kozlowski S.W.J., Toney R.J., Mullins M.E., Weissbein D.A., Brown K.G., Bell B.S. Developing adaptability: A theory for the design of integrated-embedded training systems. Advances in human performance and cognitive engineering research 2001, 1:59-123. JAI Press, New York, NY. E. Salas (Ed.).
47. Kraiger K. Creating, implementing, and maintaining effective training and development: State-of-the-art lessons for practice 2002, Jossey-Bass, San Francisco, CA.
48. Kraiger K., Ford J.K., Salas E. Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. Journal of Applied Psychology 1993, 78:311-328.
49. Kulik C.C., Kulik J.A. Effectiveness of computer-based instruction: An updated analysis. Computers in Human Behavior 1991, 7:75-94.
50. Lievens F. Factors which improve the construct validity of assessment centers: A review. International Journal of Selection and Assessment 1998, 6:141-152.
51. Lievens F., Sanchez J.I. Can training improve the quality of inferences made by raters in competency modeling? A quasi-experiment. Journal of Applied Psychology 2007, 92:812-819.
52. Machin M.A. Planning, managing, and optimizing transfer of training. Creating, implementing, and managing effective training and development: State-of-the-art lessons for practice 2002, 263-301. Jossey-Bass, San Francisco, CA. K. Kraiger (Ed.).
53. Marx R.D. Relapse prevention for managerial training: A model for maintenance of behavior change. Academy of Management Review 1982, 7:433-441.
54. McIntyre R.M., Smith D.E., Hassett C.E. Accuracy of performance ratings as affected by rater training and perceived purpose of rating. Journal of Applied Psychology 1984, 69:147-156.
55. Nagelkerke N.J.D. A note on a general definition of the coefficient of determination. Biometrika 1991, 78:691-692.
56. Noe R.A. Employee training and development 2007, McGraw-Hill Irwin, New York, NY. 4th ed.
57. Noonan L.E., Sulsky L.M. Impact of frame-of-reference and behavioral observation training on alternative training effectiveness criteria in a Canadian military sample. Human Performance 2001, 14:3-26.
58. Payne S.C., Youngcourt S.S., Beaubien J.M. A meta-analytic examination of the goal orientation nomological net. Journal of Applied Psychology 2007, 92:128-150.
59. Porath C.L., Bateman T.S. Self-regulation: From goal orientation to job performance. Journal of Applied Psychology 2006, 91:185-192.
60. Potosky D., Ramakrishna H.V. The moderating role of updating climate perceptions in the relationship between goal orientation, self-efficacy, and job performance. Human Performance 2002, 15:275-297.
61. Pulakos E.D. A comparison of rater training programs: Error training and accuracy training. Journal of Applied Psychology 1984, 69:581-588.
62. Pulakos E.D. The development of training programs to increase accuracy with different rating tasks. Organizational Behavior and Human Decision Processes 1986, 38:76-91.
63. Quiñones M.A. Pretraining context effects: Training assignment as feedback. Journal of Applied Psychology 1995, 80:226-238.
64. Sackett P.R., Mullen E.J. Beyond formal experimental design: Towards an expanded view of the training evaluation process. Personnel Psychology 1993, 46:613-627.
65. Salas E., Cannon-Bowers J.A. The science of training: A decade of progress. Annual Review of Psychology 2001, 52:471-499.
66. Schleicher D.J., Day C.V., Mayes B.T., Riggio R.E. A new frame for frame-of-reference training: Enhancing the construct validity of assessment centers. Journal of Applied Psychology 2002, 87:735-746.
67. Schleicher D.J., Day D.V. A cognitive evaluation of frame-of-reference rater training: Content and process issues. Organizational Behavior and Human Decision Processes 1998, 73:76-101.
68. Schraw G., Horn C., Thorndike-Christ T., Bruning R. Academic goal orientations and student classroom achievement. Contemporary Educational Psychology 1995, 20:359-368.
69. Shute V., Towle B. Adaptive e-learning. Educational Psychologist 2003, 38:105-114.
70. Stamoulis D.T., Hauenstein N.M.A. Rater training and rating accuracy: Training for dimensional accuracy versus training for ratee differentiation. Journal of Applied Psychology 1993, 78:42-52.
71. Sulsky L.M., Day D.V. Frame-of-reference training and cognitive categorization: An empirical investigation of rater memory issues. Journal of Applied Psychology 1992, 77:501-510.
72. Sulsky L.M., Day D.V. The effects of frame-of-reference training on rating accuracy under alternative time delays. Journal of Applied Psychology 1994, 79:535-543.
73. Surface E.A., Dierdorff E.C. Reliability and the ACTFL Oral Proficiency Interview: Reporting indices of interrater consistency and agreement for 19 languages. Foreign Language Annals 2003, 36:507-519.
74. Swender E. Oral proficiency testing in the real world: Answers to frequently asked questions. Foreign Language Annals 2003, 36:520-526.
75. Tannenbaum S.I., Mathieu J.E., Salas E., Cannon-Bowers J.A. Meeting trainees' expectations: The influence of training fulfillment on the development of commitment, self-efficacy, and motivation. Journal of Applied Psychology 1991, 76:759-769.
76. Towler A.J., Dipboye R.L. Effects of trainer expressiveness, organization, and trainee goal orientation on training outcomes. Journal of Applied Psychology 2001, 86:664-673.
77. VandeWalle D. Development and validation of a work domain goal orientation instrument. Educational and Psychological Measurement 1997, 57:995-1015.
78. VandeWalle D., Cron W.L., Slocum J.W. The role of goal orientation following performance feedback. Journal of Applied Psychology 2001, 86:629-640.
79. VandeWalle D., Cummings L.L. A test of the influence of goal orientation on the feedback seeking process. Journal of Applied Psychology 1997, 82:390-400.
80. Woehr D.J. Understanding frame-of-reference training: The impact of training on the recall of performance information. Journal of Applied Psychology 1994, 79:525-534.
81. Woehr D.J., Huffcutt A.I. Rater training for performance appraisal: A quantitative review. Journal of Occupational & Organizational Psychology 1994, 67:189-205.
82. Wood R.E., Bandura A. Impact of conceptions of ability on self-regulatory mechanisms and complex decision-making. Journal of Personality and Social Psychology 1989, 56:407-415.
83. Yeo G., Loft S., Xiao T., Kiewitz C. Goal orientations and performance: Differential relationships across levels of analysis and as a function of task demands. Journal of Applied Psychology 2009, 94:710-726.