Assessor constructs in use as the missing component in validation of assessment center dimensions: A critique and directions for research

International Journal of Selection and Assessment

Volumn 16, Issue 3, 2008, Pages 229-238

  Jones, Robert G ^a   Born, Marise Ph ^b  

^a MISSOURI STATE UNIVERSITY   (United States)

^b ERASMUS UNIVERSITY ROTTERDAM   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 49749084357     PISSN: 0965075X     EISSN: 14682389     Source Type: Journal    
DOI: 10.1111/j.1468-2389.2008.00429.x     Document Type: Article

References (56)

1. Ackerman, P.L. Humphreys, L.G. (1990) Individual Differences in Industrial and Organizational Psychology. In : Dunnette, M.D. Hough, L.M. (eds), Handbook of Industrial and Organizational Psychology, Vol. 1 (2nd edn). Palo Alto, CA, USA : Consulting Psychologists Press, pp. 223 282.
2. Arthur, W. Jr., Day, E.A. McNelly, T.L. (2003) A Meta-Analysis of the Criterion-Related Validity of Assessment Center Dimensions. Personnel Psychology, 56, 1, 125 154.
3. Bartram, D. (2005) The Great Eight Competencies: A criterion-centric approach to validation. Journal of Applied Psychology, 90, 1185 1203.
4. Binning, J.F. Barrett, G.V. (1989) Validity of Personnel Decisions: A conceptual analysis of the inferential and evidential bases. Journal of Applied Psychology, 74, 478 494.
5. Borman, W.C. (1987) Personal Constructs, Performance Schemata, and "Folk Theories" of Subordinate Effectiveness: Explorations in an Army officer sample. Organizational Behavior and Human Decision Processes, 40, 3, 307 322.
6. Bray, D.W. Howard, A. (1983) Personality and the Assessment Center Method. In : Spielberger, C.D. Butcher, J.N. (eds), Advances in Personality Assessment, Vol. 3. Erlbaum : Hillsdale, NJ, pp. 1 34.
7. Byham, W.C. (1977a) Application of the Assessment Center Method. In : Moses, J.L. Byham, W.C. (eds), Applying the Assessment Center Method. (Chapter 3). New York : Pergamon p. 35.
8. Byham, W.C. (1977b) Assessor selection and training. In : Moses, J.L. Byham, W.C. (eds), Applying the Assessment Center Method. (Chapter 6). New York : Pergamon Press, p. 89.
9. Campbell, D.T. Fiske, D.W. (1959) Convergent and Discriminant Validation by the Multitrait-Multimethod Matrix. Psychological Bulletin, 56, 81 105.
10. Cronbach, L.J. Meehl, P.E. (1955) Construct Validity in Psychological Test, Psychological Bulletin, 52, 281 302.
11. De Meijer, L.A.L., Born, M.Ph., Van Zielst, J. Van der Molen, H.T. (2007) Analyzing Judgments of Ethnically Diverse Applicants During Personnel Selection: A study at the Dutch police. International Journal of Selection and Assessment, 15, 2, 139 152.
12. Dudley, N.M., Orvis, K.A. Lebiecki, J.E. (2006) A Meta-Analytic Investigation of Conscientiousness in the Prediction of Job Performance: Examining the intercorrelations and the incremental validity of narrow traits. Journal of Applied Psychology, 91, 40 57.
13. Ferris, G.R., Witt, L.A. Hochwater, W.A. (2001) Interaction of Social Skill and General Mental Ability on Job Performance and Salary. Journal of Applied Psychology, 86, 1075 1082.
14. Fletcher, C.A. Dulewicz, V. (1984) An Empirical Study of a U.K.-Based Assessment Center. Journal of Management Studies, 21, 83 97.
15. Foti, R.J. Lord, R.G. (1987) Prototypes and Scripts: The effects of alternative methods of processing information on rating accuracy. Organizational Behavior and Human Decision Processes, 39, 318 340.
16. Gaugler, B.B., Rosenthal, D.B., Thornton, G.C. Bentson, C. (1987) Meta-Analysis of Assessment Center Validity. Journal of Applied Psychology, 72, 493 511.
17. Ghiselli, E.E., Campbell, J.P. Zedeck, S. (1981) Measurement Theory for the Behavioral Sciences. San Francisco : W.H. Freeman.
18. Gniatczyk, L., Binning, J. Williams, K. (1996). An Idiographic Analysis of Assessor Validity Differences in an Operational Assessment Center. Paper presented at the annual conference of the Society for Industrial and Organizational Psychology, San Diego.
19. Golding, S.L. (1977) Method Variance, Inadequate Constructs, or Things that go Bump in the Night? Multivariate Behavioral Research, 12, 1, 89 98.
20. Grove, W.M., Zald, D.H., Lebow, B.S., Snitz, B.E. Nelson, C. (2000) Clinical Versus Mechanical Prediction: A meta-analysis. Psychological Assessment, 12, 19 30.
21. Guerin, B. Innes, J.M. (1989) Cognitive Tuning Sets: Anticipating the consequences of communication. Current Psychology: Research and Reviews, 8, 234 249.
22. Harvey, R.J. (1992) Job Analysis. In : The Handbook of Industrial and Organizational Psychology. (Chapter 2). Palo Alto, CA : Consulting Psychologists Press.
23. Hinrichs, J.P. (1978) An Eight-Year Follow-up of a Management Assessment Center. Journal of Applied Psychology, 63, 596 601.
24. Hoffman, C.C. Thornton, G.C. III. (1997) Examining Selection Utility Where Competing Predictors Differ in Adverse Impact. Personnel Psychology, 50, 2, 455 470.
25. Jackson, D.J.R., Stillman, J.A. Atkins, S.G. (2005) Rating Tasks Versus Dimensions in Assessment Centers: A psychometric comparison. Human Performance, 18, 3, 213 241.
26. Jansen, P.G.W. Stoop, B.A.M. (2001) The Dynamics of Assessment Center Validity: Results of a 7-year study. Journal of Applied Psychology, 86, 741 753.
27. Jones, R.G. (1992) Construct Validation of Assessment Center Final Dimension Ratings: Definition and measurement issues. Human Resources Management Review, 3, 2, 195 220.
28. Jones, R.G. Rittman, A. (2002) A Model of Emotional and Motivational Components of Interpersonal Interactions in Organizations. In : Ashkanasy, N. Hartel, C. Zerbe, W. (eds), Managing Emotions in the Workplace. Armonk, NY : Sharpe.
29. Jones, R.G. Whitmore, M.D. (1995) Evaluating Developmental Assessment centers as Interventions. Personnel Psychology, 48, 2, 377 388.
30. Jones, R.G., Chomiak, M., Rittman, A. Green, T. (2006) Distinguishing Motive through Perception of Emotions. Psichothema, 18, 67 71.
31. Klimoski, R.J. (1993) Predictor Constructs and their Measurement. In : Schmitt, N., Borman, W.C. associates (eds), Personnel Selection in Organizations. San Francisco : Jossey-Bass.
32. Klimoski, R.J. Brickner, M. (1987) Why Do Assessment Centers Work? The puzzle of assessment center validity. Personnel Psychology, 40, 243 260.
33. Kolk, N.J., Born, M.Ph. Van der Flier, H. (2004) Three Method Factors Explaining the Low Correlations Between Assessment Center Dimension Ratings and Scores on Personality Inventories. European Journal of Personality, 18, 2, 127 141.
34. Landy, F. (1986) Stamp Collecting Versus Science: Validation as hypothesis testing. American Psychologist, 41, 1183 1192.
35. Lievens, F. (2002) Trying to Understand the Different Pieces of the Construct Validity Puzzle of Assessment Centers: An examination of assessor and assessee effects. Journal of Applied Psychology, 87, 4, 675 686.
36. Lievens, F., Chasteen, C.S., Day, E.A. Christiansen, N.D. (2006) Large-Scale Investigation of the Role of Trait Activation Theory for Understanding Assessment Center Convergent and Discriminant Validity. Journal of Applied Psychology, 91, 247 258.
37. Lievens, F., Sanchez, J.I. De Corte, W. (2004) Easing the Inferential Leap in Competency Modelling: The effects of task-related information and subject matter expertise. Personnel Psychology, 57, 4, 881 904.
38. Lorenzo, R.V. (1984) Effects of Assessorship on Managers' Proficiency in Acquiring, Evaluating, and Communicating Information about People. Personnel Psychology, 37, 617 634.
39. MacCallum, R.C. Browne, M.W. (1993) The Use of Causal Indicators in Covariance Structure Models: Some practical issues. Psychological Bulletin, 114, 3, 533 541.
40. MacKinnon, D.W. (1977) From Selecting Spies to Selecting Managers - the OSS Assessment Program. In : Moses, J.L. Byham, W.C. (eds), Applying the Assessment Center Method (Chapter 3). New York : Pergamon Press, p. 13.
41. Messick, S. (1995) Validity of Psychological Assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 9, 741 749.
42. Robertson, I., Gratton, L. Sharpley, D. (1987) The Psychometric Properties and Design of Managerial Assessment Centres: Dimensions into exercises won't go. Journal of Occupational Psychology, 60, 3, 187 195.
43. Russell, C.J. (1985) Individual Decision Processes in an Assessment Center. Journal of Applied Psychology, 70, 737 746.
44. Russell, J.A. (1994) Is There Universal Recognition of Emotion from Facial Expression? A Review of the Cross-Cultural Studies. Psychological Bulletin, 115, 102 141.
45. Sackett, P.R. (1987) Assessment Centers and Content Validity: Some neglected issues. Personnel Psychology, 40, 1, 13 25.
46. Sackett, P.R Dreher, G.F. (1982) Constructs and Assessment Center Dimensions: Some troubling empirical findings. Journal of Applied Psychology, 67, 401 410.
47. Sackett, P.R. Hakel, M.D. (1979) Temporal Stability and Individual Differences in using Assessment Information to form Overall Ratings. Organizational Behavior & Human Performance, 23, 120 127.
48. Sackett, P.R. Tuzinski, K.A. (2001) The Role of Dimensions and Exercises in Assessment Center Judgments. In : London, M. (ed.), How People Evaluate Others in Organizations. Mahwah, NJ : Lawrence Erlbaum Associates, pp. 111 129.
49. Schmitt, N., Coyle, B.W. Saari, B.B. (1977) A Review and Critique of Analyses of Multitrait-Multimethod Matrices. Multivariate Behavioral Research, 12, 447 478.
50. Silverman, W.H., Dalessio, A., Woods, S.B. Johnson, R.L. (1986) Influence of Assessment Center Methods on Assessors' Ratings. Personnel Psychology, 39, 565 578.
51. Spector, P.E., Schneider, J.R. Vance, C.A. (2000) The Relation of Cognitive Ability and Personality Traits to Assessment Center Performance. Journal of Applied Social Psychology, 30, 7, 1474 1491.
52. Tett, R.P. Burnett, D.D. (2003) A Personality Trait-Based Interactionist Model of Job Performance. Journal of Applied Psychology, 88, 500 517.
53. Thornton, G.C. III. Rupp, D.E. (2006) Assessment Centers in Human Resource Management. Mahwah, NJ : Lawrence Erlbaum.
54. Turnage, J.J. Muchinsky, P.M. (1984) A Comparison of the Predictive Validity of Assessment Center Evaluations Versus Traditional Measures in Forecasting Supervisory Job Performance: Interpretive implications of criterion distortion for the assessment paradigm. Journal of Applied Psychology, 69, 4, 595 602.
55. Wernimont, P.F. Campbell, J.P. (1968) Signs, Samples, and Criteria. Journal of Applied Psychology, 52, 372 376.
56. Williams, K.J., DeNisi, A.S., Blencoe, A.G. Cafferty, T.P. (1985) The Role of Appraisal Purpose: Effects of purpose on information acquisition and utilization. Organizational Behavior and Human Decision Processes, 35, 314 339.