A triadic approach to the construct validity of the assessment center: The effect of categorizing dimensions into a feeling, thinking, and power taxonomy

European Journal of Psychological Assessment

Volumn 20, Issue 3, 2004, Pages 149-156

  Kolk, Nanja J ^a,d   Born, Marise Ph ^b   Van Der Flier, Henk ^c  

^a Berenschot   (Netherlands)

^b ERASMUS UNIVERSITY ROTTERDAM   (Netherlands)

^c VU UNIVERSITY AMSTERDAM   (Netherlands)

^d Berenschot Bus Mgmt Change Fact   (Netherlands)

Author keywords

Assessment centersss dimensions; Construct validity; Taxonomy

Indexed keywords

EID: 3142778557     PISSN: 10155759     EISSN: None     Source Type: Journal    
DOI: 10.1027/1015-5759.20.3.149     Document Type: Article

References (38)

1. Ackerman, P.L., & Humphreys, L.G. (1993). Individual differences in industrial and organizational psychology. In M.D. Dunnette & L.M. Hough (Eds.), Handbook of industrial and organizational psychology (2nd ed., Vol.1, pp. 223-282). Palo Alto, CA: Consulting Psychologists Press.
2. Ahmed, Y., Payne, T., & Whiddett, S. (1997). A process for assessment exercise design: A model of best practice. International Journal of Selection and Assessment, 5, 62-68.
3. Arthur Jr., W., Anthony Day, E., McNelly, T.L., & Edens, P.S. (2001, April). The criterion-related validity of assessment center dimensions: Distinguishing between methods and constructs. Paper presented at the 16th Annual Conference of the Society for Industrial and Organizational Psychology Conference, San Diego, CA.
4. Bycio, P., Alvares, K.M., & Hahn, J. (1987). Situational specificity in assessment center ratings: A confirmatory factor analysis. Journal of Applied Psychology, 72, 463-474.
5. Campbell, J.P., & Fiske, D.W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.
6. Chan, D. (1996). Criterion and construct validation of an assessment center. Journal of Occupational & Organizational Psychology, 69, 167-181.
7. Donahue, L.M., Truxillo, D.M., Cornwell, J.M., & Gerrity, M.J. (1997). Assessment center construct validity and behavioral checklists: Some additional findings. Journal of Social Behavior and Personality, 12, 85-108.
8. Fleenor, J.W. (1996). Constructs and developmental assessment centers: Further troubling empirical findings. Journal of Business & Psychology, 10, 319-335.
9. Gaugler, B.B., & Thornton, G.C. (1989). Number of assessment center dimensions as a determinant of assessor accuracy. Journal of Applied Psychology, 74, 611-618.
10. Jansen, P.G.W. (1991). Het beoordelen van managers. Effectiviteit van assessment center methoden bij selectie en ontwikkeling van managers [Management assessment: Effectiveness of assessment center methods for selecting and developing managers]. Baarn: Uitgeverij H. Nelissen.
11. Jöreskog, K.G., & Sörbom, D. (1989). LISREL 7: A guide to the program and applications (2nd ed.). Chicago, IL: SPSS Inc.
12. Joyce, L.W., Thayer, P.W., & Pond, S.B. (1994). Managerial functions: An alternative to traditional assessment center dimensions? Personnel Psychology, 47, 109-121.
13. Kenny, D.A., & Kashy, D.A. (1992). Analysis of the multitraitmultimethod matrix by confirmatory factor analysis. Psychological Bulletin, 112, 165-172.
14. Kleinmann, M., Exler, C., Kuptsch, C., & Koller, O. (1995). Unabhängigkeit und Beobachtbarkeit von Anforderungsdimensionen im Assessment Center als Moderatoren der Konstruktvalidität [Independence and observability of assessment center dimensions as moderators of construct validity]. Zeitschrift für Arbeits- und Organizationspsychologie, 39, 22-28.
15. Klimoski, R., & Brickner, M. (1987). Why do assessment centers work? The puzzle of assessment center validity. Personnel Psychology, 40, 243-260.
16. Kolk, N.J., Born, M.Ph., & Van der Flier, H. (2002). Common rater variance as explanation for the lack of construct validity of assessment center dimensions. Human Performance.
17. Kudisch, J.D., Ladd, R.T., & Dobbins, G.H. (1997). New evidence on the construct validity of diagnostic assessment centers: The findings may not be so troubling after all. Journal of Social Behavior & Personality, 12, 129-144.
18. Lance, C.E., Newbolt, W.H., Gatewood, R.D., Foster, M.R., French, N.R., & Smith, D.B. (2000). Assessment center exercise factors represent cross-situational specificity, not method bias. Human Performance, 13, 323-353.
19. Lievens, F. (2001). Assessor training strategies and their effects on accuracy, inter-rater reliability, and discriminant validity. Journal of Applied Psychology, 86, 255-264.
20. Lievens, P., & Conway, J.M. (2001). Dimension and exercise variance in assessment center scores: A large-scale evaluation of multitrait-multimethod studies. Journal of Applied Psychology, 86, 1202-1222.
21. Lievens, F. (1998). Factors which improve the construct validity of assessment centers: A review. International Journal of Selection and Assessment, 6, 141-152.
22. Lievens, F., & Goemaere, H. (1999). A different look at assessment centers: Views of assessment center users. International Journal of Selection and Assessment, 7, 215-219.
23. Neidig, R.D., & Neidig, P.J. (1984). Multiple assessment center exercises and job relatedness. Journal of Applied Psychology, 69, 182-186.
24. Reilly, R.R., Henry, S., & Smither, J.W. (1990). An examination of the effects of using behavior checklists on the construct validity of assessment center dimensions. Personnel Psychology, 43, 71-84.
25. Sackett, P.R., & Dreher, G.F. (1982). Constructs and assessment center dimensions: Some troubling empirical findings. Journal of Applied Psychology, 67, 401-410.
26. Sackett, P.R., & Hakel, M.D. (1979). Temporal stability and individual differences in using assessment information to form overall ratings. Organizational Behavior & Human Performance, 23, 120-137.
27. Sagie, A., & Magnezy, R. (1997). Assessor type, number of distinguishable dimension categories, and assessment center construct validity. Journal of Occupational and Organizational Psychology, 70, 103-108.
28. Schleicher, D.J., & Day, D.V. (1998). A cognitive evaluation of frame-of-reference rater training: Content and process issues. Organizational Behavior and Human Decision Processes, 73, 76-101.
29. Schneider, J.R., & Schmitt, N. (1992). An exercise design approach to understanding assessment center dimension and exercise constructs. Journal of Applied Psychology, 77, 32-41.
30. Shore, T.H., Thornton, G.C., & MacFarlane Shore, L.M. (1990). Construct validity of two categories of assessment center dimension ratings. Personnel Psychology, 43, 101-116.
31. Silverman, W.H., Dalessio, A., Woods, S.B., & Johnson, R.L. (1986). Influence of assessment center methods on assessors' ratings. Personnel Psychology, 39, 565-578.
32. Spychalski, A.C., Quinoñes, M.A., Gaugler, B.B., & Pohley, K. (1997). A survey of assessment center practices in organizations in the United States. Personnel Psychology, 50, 71-90.
33. Thornton, G.C. (1992). Assessment centers in human resource management. Reading, Massachusetts: Addison-Wesley.
34. Thornton, G.C.I., & Byham, W.C. (1982). Assessment centers and managerial performance. New York: Academic Press.
35. Widaman, K.F. (1985). Hierarchically nested covariance structure models for multitrait-multimethod data. Applied Psychological Measurement, 9, 1-26.
36. Wiggins, J. (1973). Personality and prediction: Principles of personality assessment. Reading, Massachusetts: Addison-Wesley.
37. Yukl, G. (1998). Leadership in organizations (4th ed.). Upper Sadle River, NJ: Prentice Hall.
38. Zand, D.E. (1997). The leadership triad: Knowledge, trust, and power. Oxford: Oxford University Press.