The Moderating Effect of Raters' Opportunities to Observe Ratees' Job Performance on the Validity of an Assessment Centre

International Journal of Selection and Assessment

Volumn 7, Issue 3, 1999, Pages 133-141

  Moser, Klaus ^a   Schuler, Heinz ^a   Funke, Uwe ^a  

^a UNIVERSITY OF ERLANGEN NUREMBERG   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0033416288     PISSN: 0965075X     EISSN: None     Source Type: Journal    
DOI: 10.1111/1468-2389.00113     Document Type: Article

References (38)

1. Barrick, M.R. and Mount, M.K. (1991) The big five personality dimensions and job performance: A meta-analytic review. Personnel Psychology, 44, 1-26.
2. Brown, J.S. and de Kleer, J. (1981) Towards a theory of qualitative reasoning about mechanisms and its role in troubleshooting. In J. Rasmussen and W.B. Rouse (eds.) Human Detection and Diagnosis of System Failures (pp. 317-335). New York, Plenum.
3. DeNisi, A.S. and Williams, K.J. (1988) Cognitive approaches to performance appraisal. In G.R. Ferris and K.M. Rowland (eds.) Research in Personnel and Human Resources Management (pp. 109-155). Greenwich, CT, JAI Press.
4. Dipboye, R.L. (1985) Some neglected variables in research on discrimination in appraisals. Academy of Management Review, 10, 116-127.
5. Dunnette, M.D. (1966) Personnel Selection and Placement. Belmont, CA, Brooks-Cole.
6. Feltham, R. (1988) Assessment centre decision making: Judgmental vs. mechanical. Journal of Occupational Psychology, 61, 237-241.
7. Ferguson, L.W. (1949) The value of acquaintance ratings in criterion research. Personnel Psychology, 2, 93-102.
8. Ferris, G.R. and Judge, T.A. (1991) Personnel/human resources management: A political influence perspective. Journal of Management, 17, 447-488.
9. Freeberg, N.E. (1969) Relevance of rater-ratee-acquaintance in the validity and reliability of ratings. Journal of Applied Psychology, 53, 518-524.
10. Funke, U. (1995) Using complex problem solving tasks in personnel selection and training. In P. Frensch and J. Funke (Eds.) Complex Problem Solving: The European Perspective (pp. 219-240). Hillsdale, NJ, Erlbaum.
11. Harris, M. and Schaubroeck, J. (1988) A meta-analysis of self-supervisor, self-peer, and peer-supervisor ratings. Personnel Psychology, 41, 43-62.
12. Hirsh, H., Northrop, L. and Schmidt, F.L. (1986) Validity generalization results for law enforcement occupations. Personnel Psychology, 39, 399-420.
13. Hunter, J.E. and Hunter, R.F. (1984) Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96, 72-89.
14. Ilgen, D.R. (1993) Performance-appraisal accuracy: An illusive or sometimes misguided goal? In H. Schuler, J.L. Farr and M. Smith (eds.), Personnel Selection and Assessment (pp. 235-252). Hillsdale, NJ, Erlbaum.
15. Judge, T.A. and Ferris, G.R. (1993) Social context of performance evaluation decisions. Academy of Management Journal, 36, 80-105.
16. Kenny, D.A. (1991) A general model of consensus and accuracy in interpersonal perception. Psychological Review, 98, 155-163.
17. Kingstrom, P.O. and Mainstone, L.E. (1985) An investigation of the rater-ratee-acquaintance and rater bias. Academy of Management Journal, 28, 641-653.
18. Klieger, W.A. and Mosel, J.N. (1953) The effect of opportunity to observe and rater status on the reliability of performance ratings. Personnel Psychology, 6, 57-64.
19. Klimoski, R. and Brickner, M. (1987) Why do assessment centers work? The puzzle of assessment center validity. Personnel Psychology, 40, 243-260.
20. Klimoski, R. and Inks, L. (1990) Accountability forces in performance appraisal. Organizational Behaviour and Human Decision Processes, 45, 194-208.
21. Knight, F.B. (1923) The effect of the 'acquaintance factor' upon personnel judgments. Journal of Educational Psychology, 14, 129-142.
22. Levine, E.L. (1982) Everything You Always Wanted to Know about Job Analysis. Tampa, Mariner.
23. Mabe, P.A. III and West, S.W. (1982) Validity of self-evaluation of ability: Review and meta-analysis. Journal of Applied Psychology, 62, 280-296.
24. McClelland, G.H. and Judd, C.M. (1993) Statistical difficulties of detecting interactions and moderator effects. Psychological Bulletin, 114, 376-390.
25. Miles, R.E. (1964) Attitudes toward management theory as a factor in manager's relationships with their superiors. Academy of Management Journal, 7, 308-314.
26. Miller, V.D. and Jablin, F.M. (1991) Information seeking during organizational entry: Influences, tactics, and a model of the process. Academy of Management Review, 16, 92-120.
27. Moser, K. and Krauß, S. (1997) A meta-analysis of self-supervisory ratings. Poster presented at 1997 APA convention, Chicago.
28. Moser, K. and Schuler, H. (1989) The nature of psychological measurement. In P. Herriot (ed.) Handbook of Assessment in Organizations (pp. 281-305). New York, Wiley.
29. Nunnally, J.C. (1981) Psychometric Theory. New York, McGraw-Hill.
30. Paulhus, D.L. and Bruce, M.N. (1992) The effect of acquaintanceship on the validity of personality impressions: A longitudinal study. Journal of Personality and Social Psychology, 63, 816-824.
31. Rothstein, H.R. (1990) Interrater reliability of job performance ratings: Growth to asymptote level with increasing opportunity to observe. Journal of Applied Psychology, 75, 322-327.
32. Schmidt, F.L. and Hunter, J.E. (1996) Measurement error in psychological research: Lessons from 26 research scenarios. Psychological Methods, 1, 199-223.
33. Schmidt, F.L. and Kaplan, L.B. (1971) Composite vs. multiple criteria: A review and resolution of the controversy. Personnel Psychology, 24, 419-434.
34. Schuler, H. and Funke, U. (1989) The interview as a multimodal procedure. In R.W. Eder and G.R. Ferris (eds.) The Employment Interview (pp. 183-192). Newbury Park, CA, Sage.
35. Schuler, H., Funke, U., Moser, K. and Donat, M. (1995) Personalauswahl in Forschung und Entwicklung. Göttingen, Hogrefe.
36. Smith, P.C. and Kendall, L.M. (1963) Retranslation of expectations: An approach to the construction of unambiguous anchors for rating scales. Journal of Applied Psychology, 47, 149-155.
37. Sussmann, M. and Robertson, D.U. (1986) The validity of validity: An analysis of validation study designs. Journal of Applied Psychology, 71, 461-468.
38. Wood, R.E., Mento, A.J. and Locke, E.A. (1987) Task complexity as a moderator of goal effects: A meta-analysis. Journal of Applied Psychology, 72, 412-425.