Effects of the Rating Process on the Construct Validity of Assessment Center Dimension Evaluations

Human Performance

Volumn 13, Issue 4, 2000, Pages 355-370

  Robie, Chet ^a   Osburn, Hobart G ^b   Morris, Mark A ^b   Etchegaray, Jason M ^b   Adams, Kimberly A ^b  

^a Personnel Decisions International Corporation   (United States)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0346672721     PISSN: 08959285     EISSN: None     Source Type: Journal    
DOI: 10.1207/S15327043HUP1304_2     Document Type: Article

References (40)

1. Adams, K. A. (1997). The effect of the rating process on construct validity: Reexamination of the exercise effect in assessment center ratings. Unpublished master's thesis, University of Houston, Houston, TX.
2. Arbuckle, J. L. (1997). Amos user's guide (version 3.6). Chicago: Smallwaters.
3. Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238-246.
4. Berman, J. S., & Kenny, D. A. (1976). Correlational bias in observer ratings. Journal of Personality and Social Psychology, 34, 263-273.
5. Bray, D. W., Campbell, R. J., & Grant, D. L. (1974). Formative years in business: A long-term AT&T study of managerial lives. New York: Wiley.
6. Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136-162). Newbury Park, CA: Sage.
7. Bycio, P., Alvares, K. M., & Hahn, J. (1987). Situational specificity in assessment center ratings: A confirmatory factor analysis. Journal of Applied Psychology, 72, 463-474.
8. Cooper, W. H. (1981). Ubiquitous halo. Psychological Bulletin, 90, 218-244.
9. Cronbach, L. J. (1955). Processes affecting scores on understanding of others' and "assumed similarity." Psychological Bulletin, 59, 177-193.
10. Donahue, L. M., Truxillo, D. M., Cornwell, J. M., & Gerrity, M. J. (1997). Assessment center construct validity and behavioral checklists: Some additional findings. Journal of Social Behavior and Personality, 12, 85-108.
11. Feldman, J. M. (1981). Beyond attribution theory: Cognitive processes in performance appraisal. Journal of Applied Psychology, 66, 127-148.
12. Gaugler, B. B., Rosenthal, D. B., Thornton, G. C., III., & Bentson, C. (1987). Meta-analysis of assessment center validity. Journal of Applied Psychology, 72, 493-511.
13. Gaugler, B. B., & Rudolph, A. S. (1992). The influence of assessee performance variation on assessors' judgments. Personnel Psychology, 45, 77-98.
14. Gaugler, B. B., & Thornton, G. C., III. (1989). Number of assessment center dimensions as a determinant of assessor accuracy. Journal of Applied Psychology, 74, 611-618.
15. Harris, M. H., Becker, A. S., & Smith, D. E. (1993). Does the assessment center scoring method affect the cross-situational consistency of ratings? Journal of Applied Psychology, 78, 675-678.
16. Jöreskog, K. G. (1977). Structural equation models in the social sciences: Specification, estimation, and testing. In P. R. Krishnaiah (Ed.), Applications of statistics (pp. 265-287). Amsterdam: North-Holland.
17. Kasten, R., & Weintraub, Z. (1999). Rating errors and rating accuracy: A field experiment. Human Performance, 12, 137-153.
18. Murphy, K. R., & Balzer, W. K. (1989). Rating errors and rating accuracy. Journal of Applied Psychology, 74, 619-624.
19. Murphy, K. R., & Cleveland, J. N. (1995). Understanding performance appraisal: Social, organizational, and goal-based perspectives. Thousand Oaks, CA: Sage.
20. Murphy, K. R., Gracia, M., Kerkar, S., Martin, C., & Balzer, W. K. (1982). Relationship between observational accuracy and accuracy in evaluating performance. Journal of Applied Psychology, 67, 320-325.
21. Nathan, B. R., & Tippins, N. (1990). The consequences of halo "error" in performance ratings: A field study of the moderating effect of halo on test validation results. Journal of Applied Psychology, 75, 290-296.
22. Norton, S. D. (1977). The empirical and content validity of assessment centers vs. traditional methods of predicting managerial success. Academy of Management Review, 2, 442-453.
23. Reilly, R. R., Henry, S., & Smither, J. W. (1990). An examination of the effects of using behavior checklists on the construct validity of assessment center dimensions. Personnel Psychology, 43, 71-84.
24. Robertson, I., Gratton, L., & Sharpley, D. (1987). The psychometric properties and design of managerial assessment centres: Dimensions into exercises won't go. Journal of Occupational Psychology, 60, 187-195.
25. Russell, C. J. (1985). Individual decision processes in an assessment center. Journal of Applied Psychology, 70, 737-746.
26. Ryan, A. M., Daum, D., Bauman, T., Grisez, M., Mattimore, K., Nalodka, T., & McCormick, S. (1995). Direct, indirect, and controlled observation and rating accuracy. Journal of Applied Psychology, 80, 664-670.
27. Sackett, P. R. (1987). Assessment centers and content validity: Some neglected issues. Personnel Psychology, 40, 13-25.
28. Sackett, P. R., & Dreher, G. F. (1982). Constructs and assessment center dimensions: Some troubling empirical findings. Journal of Applied Psychology, 67, 401-410.
29. Sackett, P. R., & Hakel, M. D. (1979). Temporal stability and individual differences in using assessment information to form overall ratings. Organizational Behavior and Human Performance, 23, 120-137.
30. Sackett, P. R., & Harris, M. (1988). A further examination of the constructs underlying assessment center ratings. Journal of Business and Psychology, 3, 214-229.
31. Schmidt, F. L., Ones, D. S., & Hunter, J. E. (1992). Personnel selection. Annual Review of Psychology, 43, 627-670.
32. Schmitt, N. (1977). Interrater agreement in dimensionality and combination of assessment center judgments. Journal of Applied Psychology, 62, 171-176.
33. Silverman, W. H., Dalessio, A., Woods, S. B., & Johnson, R. L., Jr. (1986). Influence of assessment center methods on assessors' ratings. Personnel Psychology, 39, 565-578.
34. Spychalski, A. C., Quiñones, M. A., Gaugler, B. B., & Pohley, K. (1997). A survey of assessment center practices in organizations in the United States. Personnel Psychology, 50, 71-90.
35. Tanaka, J. S., & Huba, G. J. (1985). A fit index for covariance structure models under arbitrary GLS estimation. British Journal of Mathematical and Statistical Psychology, 38, 197-201.
36. Task Force on Assessment Center Guidelines. (1989). Guidelines and ethical considerations for assessment center operations. Public Personnel Management, 18, 457-470.
37. Thornton, G. C. (1992). Assessment centers and managerial performance. Reading, MA: Addison-Wesley.
38. Thornton, G. C., & Byham, W. C. (1982). Assessment centers and managerial performance. San Diego, CA: Academic.
39. Turnage, J. J., & Muchinsky, P. M. (1982). Transsituational variability in human performance within assessment centers. Organizational Behavior and Human Performance, 30, 174-200.
40. Zedeck, S. (1986). A process analysis of the assessment center method. In B. M. Staw & L. L. Cummings (Eds.), Research in organizational behavior (Vol. 8, pp. 259-296). Greenwich, CT: JAI.