Assessors and use of assessment centre dimensions: A fresh look at a troubling issue

Journal of Organizational Behavior

Volumn 22, Issue 3, 2001, Pages 203-221

  Lievens, Filip ^a  

^a GHENT UNIVERSITY   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0035631338     PISSN: 08943796     EISSN: None     Source Type: Journal    
DOI: 10.1002/job.65     Document Type: Article

References (48)

1. Barr SH, Hitt MA. 1986. A comparison of selection decision models in managers versus student samples. Personnel Psychology 39: 599-617.
2. Bernardin HJ, Buckley MR. 1981. Strategies in rater training. Academy of Management Review 6: 205-212.
3. Brannick MT, Michaels CE, Baker DP. 1989. Construct validity of in-basket scores. Journal of Applied Psychology 74: 957-963.
4. Brennan RL. 1992. Elements of Generalizability Theory. American College Testing Program: Iowa City, IA.
5. Bycio P, Alvares KM, Hahn J. 1987. Situational specificity in assessment centre ratings: a confirmatory factor analysis. Journal of Applied Psychology 72: 463-474.
6. Campbell DT, Fiske DW. 1959. Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin 56: 81-105.
7. Cardinet J, Tourneur Y, Allal L. 1976. The symmetry of generalizability theory: applications to educational measurement. Journal of Educational Measurement 13: 119-136.
8. Cardy RL, Bernardin HJ, Abbott JG, Senderak MP, Taylor K. 1987. The effects of individual performance schemata and dimension familiarization on rating accuracy. Journal of Occupational and Organisational Psychology 60: 197-205.
9. Chan D. 1996. Criterion and construct validation of an assessment centre. Journal of Occupational and Organisational Psychology 69: 167-181.
10. Crick JE, Brennan RL. 1983. Manual for GENOVA: A GENeralized analysis Of VAriance system (ACT Technical Bulletin No. 43). American College Testing Program: Iowa City, IA.
11. Cronbach LJ, Gleser GC, Nanda H, Rajaratnam N. 1972. The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles. John Wiley: New York.
12. Dugan B. 1988. Effects of assessor training on information use. Journal of Applied Psychology 73: 743-748.
13. Fleenor JW. 1996. Constructs and developmental assessment centers: further troubling empirical findings. Journal of Business and Psychology 10: 319-333.
14. Funder DC. 1987. Errors and mistakes: evaluating the accuracy of social judgment. Psychological Bulletin 101: 75-90.
15. Gaugler BB, Rosenthal DB, Thornton GC, Bentson C. 1987. Meta-analysis of assessment centre validity. Journal of Applied Psychology 72: 493-511.
16. Gaugler BB, Rudolph AS. 1992. The influence of assessee performance variation on assessors' judgments. Personnel Psychology 45: 77-98.
17. Gaugler BB, Thornton GC. 1989. Number of assessment centre dimensions as a determinant of assessor accuracy. Journal of Applied Psychology 74: 611-618.
18. Harris MM, Becker AS, Smith DE. 1993. Does the assessment centre scoring method affect the cross-situational consistency of ratings? Journal of Applied Psychology 78: 675-678.
19. Howard A. 1997. A reassessment of assessment centers, challenges for the 21st century. Journal of Social Behavior and Personality 12(5): 13-52.
20. Jones RG. 1992. Construct validation of assessment centre final dimension ratings: definition and measurement issues. Human Resource Management Review 2: 195-220.
21. Joyce LW, Thayer PW, Pond SB. 1994. Managerial functions: an alternative to traditional assessment centre dimensions? Personnel Psychology 47: 109-121.
22. Kane MT. 1982. A sampling model for validity. Applied Psychological Measurement 6: 125-160.
23. Kauffman JR, Jex SM, Love KG, Libkuman TM. 1993. The construct validity of assessment centre performance dimensions. International Journal of Selection and Assessment 1: 213-223.
24. Klimoski RJ, Brickner M. 1987. Why do assessment centers work? The puzzle of assessment centre validity. Personnel Psychology 40: 243-260.
25. Kraiger K, Teachout MS. 1990. Generalizability theory as construct-related evidence of the validity of job performance ratings. Human Performance 3: 19-35.
26. Kudisch JD, Ladd RT, and Dobbins GH. 1997. New evidence on the construct validity of diagnostic assessment centers: the findings may not be so troubling after all. Journal of Social Behavior and Personality 12: 129-144.
27. Lievens F. 1998. Factors which improve the construct validity of assessment centers: a review International Journal of Selection and Assessment 6: 141-152.
28. Lievens F. in press. Assessor training strategies and their effects on accuracy, inter-rater reliability, and discriminant validity. Journal of Applied Psychology.
29. Macan TH, Avedon MJ, Paese M, Smith DE. 1994. The effects of applicants' reactions to cognitive ability tests and an assessment center. Personnel Psychology 47: 715-738.
30. Marcoulides GA. 1989. The application of generalizability analysis to observational studies. Quality and Quantity 23: 115-127.
31. McHenry JJ, Schmitt N. 1994. Multimedia testing. In MJ Rumsey, CD Walker, J Harris (eds.) Personnel Selection and Classification Research, 193-222. Mahwah, NJ, Lawrence Erlbaum.
32. Neidig RD, Neidig PJ. 1984. Multiple assessment centre exercises and job relatedness. Journal of Applied Psychology 69: 182-186.
33. Reilly RR, Henry S, Smither JW. 1990. An examination of the effects of using behavior checklists on the construct validity of assessment centre dimensions. Personnel Psychology 43: 71-84.
34. Robertson I, Gratton L, Sharpley D. 1987. The psychometric properties and design of managerial assessment centres: dimensions into exercises won't go. Journal of Occupational Psychology 60: 187-195.
35. Ryan AM, Daum D, Bauman T, Grisez M, Mattimore K, Nalodka T, McCormick S. 1995. Direct, indirect, and controlled observation and rating accuracy. Journal of Applied Psychology 80: 664-670.
36. Sackett PR, and Dreher GF. 1982. Constructs and assessment centre dimensions: some troubling empirical findings. Journal of Applied Psychology 67: 401-410.
37. Sagie A, Magnezy R. 1997. Assessor type, number of distinguishable dimension categories, and assessment centre construct validity. Journal of Occupational and Organizational Psychology 70: 103-108.
38. Schneider JR, Schmitt N. 1992. An exercise design approach to understanding assessment center dimension and exercise constructs. Journal of Applied Psychology 77: 32-41.
39. Shavelson RJ, Webb NM. 1991. Generalizability theory: A primer. Sage: Newbury Park, CA.
40. Shore TH, Thornton GC III, Shore LM. 1990. Construct validity of two categories of assessment center ratings. Personnel Psychology 43: 101-116.
41. Spychalski AC, Quinones MA, Gaugler BB, Pohley KA. 1997. A survey of assessment center practices in organizations in the United States. Personnel Psychology 50: 71-90.
42. Sulsky LM, Balzer WK. 1988. The meaning and measurement of performance rating accuracy: some methodological concerns. Journal of Applied Psychology 73: 497-506.
43. Task Force on Assessment Center Guidelines. 1989. Guidelines and ethical considerations for assessment centre operations. Public Personnel Management 18: 457-470.
44. Thornton GC III. 1992. Assessment Centers in Human Resource Management. Addison-Wesley: Reading, MS.
45. Thornton GC III, Tziner A, Dahan M, Clevenger JP, Meir E. 1997. Construct validity of assessment centre judgments. Journal of Social Behavior and Personality 12: 109-128.
46. Turnage JJ, Muchinsky PM. 1982. Transsituational variability in human performance within assessment centers. Organizational Behavior and Human Performance 30: 174-200.
47. Woehr DJ, Huffcutt AI. 1994. Rater training for performance appraisal: a quantitative review. Journal of Occupational and Organisational Psychology 67: 189-205.
48. Zedeck S. 1986. A process analysis of the assessment centre method. Research in Organizational Behavior 8: 259-296.