Do within-dimension ratings in assessment centers really lead to improved construct validity? A meta-analytic reassessment

Zeitschrift fur Personalpsychologie

Volumn 6, Issue 4, 2007, Pages 141-149

  Melchers, Klaus G ^a   Henggeler, Crista ^b   Kleinmann, Martin ^b  

^a UNIVERSITY OF ZURICH   (Switzerland)

^b NONE

Author keywords

Assessment center; Construct validity; Meta analysis; Personnel selection; Rating method

Indexed keywords

EID: 35448963865     PISSN: 16176391     EISSN: None     Source Type: Journal    
DOI: 10.1026/1617-6391.6.4.141     Document Type: Article

References (32)

1. Archambeau, D. J. (1979). Relationships among skill ratings assigned in an assessment center. Journal of Assessment Center Technology, 2, 7-19.
2. Arthur, W., Woehr, D. J. & Maldegen, R. (2000). Convergent and discriminant validity of assessment center dimensions: A conceptual and empirical reexamination of the assessment center construct-related validity paradox. Journal of Management, 26, 813-835.
3. Bycio, P., Alvares, K. M. & Hahn, J. (1987). Situational specificity in assessment center ratings: A confirmatory factor analysis. Journal of Applied Psychology, 72, 463-474.
4. Chan, D. (1996). Criterion and construct validation of an assessment centre. Journal of Occupational and Organizational Psychology, 69, 167-181.
5. Crawley, B., Pinder, R. & Herriot, P. (1990). Assessment centre dimensions, personality and aptitudes. Journal of Occupational Psychology, 63, 211-216.
6. DeNisi, A. S., Cafferty, T. P. & Meglino, B. M. (1984). A cognitive view of the performance appraisal process: A model and research propositions. Organizational Behavior and Human Decision Processes, 33, 360-396.
7. Donahue, L. M., Truxillo, D. M., Cornwell, J. M. & Gerrity, M. J. (1997). Assessment center construct validity and behavioral checklists: Some additional findings. Journal of Social Behavior and Personality, 12, 85-108.
8. Fleenor, J. W. (1996). Constructs and developmental assessment centers: Further troubling empirical findings. Journal of Business and Psychology, 10, 319-335.
9. Gaugler, B. B. & Thornton, G. C. (1989). Number of assessment center dimensions as a determinant of assessor accuracy. Journal of Applied Psychology, 74, 611-618.
10. Harris, M. M., Becker, A. S. & Smith, D. E. (1993). Does the assessment center scoring method affect the cross-situational consistency of ratings? Journal of Applied Psychology, 78, 675-678.
11. Henderson, F., Anderson, N. & Rick, S. (1995). Future competency profiling: Validating and redesigning the ICL graduate assessment centre. Personnel Review, 24, 19-31.
12. Hunter, J. E. & Schmidt, E L. (1990). Methods of meta-analysis. Newbury Park, CA: Sage.
13. Jansen, P. G. W. & Stoop, B. A. M. (2001). The dynamics of assessment center validity: Results of a 7-year study. Journal of Applied Psychology, 86, 741-753.
14. Joyce, L. W., Thayer, P. W. & Pond, S. B. (1994). Managerial functions: An alternative to traditional assessment center dimensions? Personnel Psychology, 47, 109-121.
15. Kleinmann, M., Andres, J., Fedtke, C., Godbersen, F. & Köller, O. (1994). Der Einfluß unterschiedlicher Auswertungsmethoden auf die Konstruktvalidität von Assessment-Centern [The influence of different rating procedures on the construct validity of assessment center methods]. Zeitschrift für Experimentelle und Angewandte Psychologie, 41, 184-210.
16. Kolk, N. J., Born, M. P. & van der Flier, H. (2002). Impact of common rater variance on construct validity of assessment center dimension judgments. Human Performance, 15, 325-338.
17. Kudisch, J. D., Ladd, R. T. & Dobbins, G. H. (1997). New evidence on the construct validity of diagnostic assessment centers: The findings may no be so troubling after all. Journal of Social Behavior and Personality, 12, 129-144.
18. Lammers, F. & Holling, H. (2000). Beobachterrotation und die Konstruktvalidität des Assessment Centers [Observation rotation and construct validity of assessment centers]. Zeitschrift für Differentielle und Diagnostische Psychologie, 21, 270-278.
19. Lance, C. E., Lambert, T. A., Gewin, A. G., Lievens, F. & Conway, J. M. (2004). Revised estimates of dimension and exercise variance components in assessment center postexercise dimension ratings. Journal of Applied Psychology, 89, 377-385.
20. Murphy, K. R., Martin, C. & Garcia, M. (1982). Do behavioral observation scales measure observation? Journal of Applied Psychology, 67, 562-567.
21. Reilly, R. R., Henry, S. & Smither, J. W. (1990). An examination of the effects of using behavior checklists on the construct validity of assessment center dimensions. Personnel Psychology, 43, 71-84.
22. Robertson, I., Gratton, L. & Sharpley, D. (1987). The psychometric properties and design of managerial assessment centres: Dimensions into exercises won't go. Journal of Occupational Psychology, 60, 187-195.
23. Robie, C., Osburn, H. G., Morris, M. A., Etchegaray, J. M. & Adams, K. A. (2000). Effects of the rating process on the construct validity of assessment center dimension evaluations. Human Performance, 13, 355-370.
24. Russell, C. J. (1987). Person characteristic versus role congruency explanations for assessment center ratings. Academy of Management Journal, 30, 817-826.
25. Sackett, P. R. & Dreher, G. F. (1982). Constructs and assessment center dimensions: Some troubling empirical findings. Journal of Applied Psychology, 67, 401-410.
26. Schmidt, F. L., Hunter, J. E. & Raju, N. S. (1988). Validity generalization and situational specificity: A second look at the 75% rule and Fisher's z transformation. Journal of Applied Psychology, 73, 665-672.
27. Schneider, J. R. & Schmitt, N. (1992). An exercise design approach to understanding assessment center dimension and exercise constructs. Journal of Applied Psychology, 77, 32-41.
28. Silverman, W. H., Dalessio, A., Woods, S. B. & Johnson, R. L. (1986). Influence of assessment center methods on assessors' ratings. Personnel Psychology, 39, 565-578.
29. Sulsky, L. M. & Day, D. V. (1994). Effects of frame-of-reference training on rater accuracy under alternative time delays. Journal of Applied Psychology, 79, 535-543.
30. Turnage, J. J. & Muchinsky, P. M. (1982). Transsituational variability in human performance within assessment centers. Organizational Behavior and Human Performance, 30, 174-200.
31. Woehr, D. J. & Arthur, W. (2003). The construct-related validity of assessment center ratings: A review and meta-analysis of the role of methodological factors. Journal of Management, 29, 231-258.
32. Woehr, D. J. & Lance, C. E. (1991). Paper people versus direct observation: An empirical examination of laboratory methodologies. Journal of Organizational Behavior, 12, 387-397.