Computerized adaptive rating scales for measuring managerial performance

International Journal of Selection and Assessment

Volumn 11, Issue 2-3, 2003, Pages 237-246

  Schneider, Robert J ^a   Goff, Maynard ^c   Anderson, Steve ^c   Borman, Walter C ^b  

^a Pers Decis Res Institutes Inc   (United States)

^b UNIVERSITY OF SOUTH FLORIDA   (United States)

^c NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0043174015     PISSN: 0965075X     EISSN: None     Source Type: Journal    
DOI: 10.1111/1468-2389.00247     Document Type: Article

References (31)

1. Blanz, R. and Ghiselli, E.E. (1972) The mixed standard scale: A new rating system. Personnel Psychology, 25, 185-200.
2. Borman, W.C. (1979) Format and training effects on rating accuracy and rater errors. Journal of Applied Psychology, 64, 410-421.
3. Borman, W.C. and Motowidlo, S.J. (1993) Expanding the criterion domain to include elements of contextual performance. In N. Schmitt and W.C. Borman (eds), Personnel Selection (pp. 71-98). San Francisco: Jossey-Bass.
4. Borman, W.C., Buck, D.E., Hanson, M.A., Motowidlo, S.J., Stark, S. and Drasgow, F. (2001) An examination of the comparative reliability, validity, and accuracy of performance ratings made using computerized adaptive rating scales. Journal of Applied Psychology, 86, 965-973.
5. Borman, W.C., Hanson, M.A., Kubisiak, U.C. and Buck, D.E., (2000). Computerized Adaptive Rating Scales (CARS): Development and evaluation of the concept (Institute Report #350). Tampa, FL: Personnel Decisions Research Institutes.
6. Coleman, V.I. and Borman, W.C. (2000) Investigating the underlying structure of the citizenship performance domain. Human Resource Management Review, 10, 25-44.
7. Coombs, C.H. (1950) Psychological scaling without a unit of measurement. Psychological Review, 57, 145-158.
8. Cronbach, L.J. (1955) Processes affecting scores on understanding of others and assumed 'similarity'. Psychological Bulletin, 52, 177-193.
9. DeNisi, A.S. (1996) A Cognitive Approach to Performance Appraisal: A Program of Research. London: Routledge.
10. Flanagan, J.C. (1954) The critical incident technique. Psychological Bulletin, 51, 327-355.
11. Freyd, M. (1923) The graphic rating scale. Journal of Educational Psychology, 14, 83-102.
12. Harvey, R.J. (1991) Job analysis. In M.D. Dunnette and L.M. Hough (eds), Handbook of Industrial and Organizational Psychology (Vol.2 2nd edn, pp.71-163). Palo Alto, CA: Consulting Psychologists Press.
13. Jeanneret, P.R., Borman, W.C., Kubisiak, U.C. and Hanson, M.A. (1999) Generalized work activities. In N.G. Peterson, M.D. Mumford, W.C. Borman, P.R. Jeanneret and E.A. Fleishman (eds), An Occupational Information System for the 21st Century: The development of O*NET. Washington, DC: American Psychological Association.
14. Johnson, J.W. (2003) Toward a better understanding of the relationship between personality and individual job performance. In M.R. Barrick and A.M. Ryan (eds), Personality and work. pp. 83-120, San Francisco: Jossey-Bass.
15. Kane, J.S. (1986) Performance distribution assessment. In R. Berk (ed), Performance Assessment: Methods and Applications (pp. 237-273). Baltimore, MD: Johns Hopkins University Press.
16. Landy, F.J. and Farr, J.L. (1980) Performance rating. Psychological Bulletin, 87, 72-107.
17. Landy, F.J. and Farr, J.L. (1983) The Measurement of Work Performance; Methods, Theory and Applications. New York: Academic Press.
18. Latham, G.P. and Wexley, K.N. (1981) Increasing Productivity Through Performance Appraisal. Reading, MA: Addison-Wesley.
19. Lord, F.M. (1980) Applications of Item Response Theory to Practical Testing Problems. Hillsdale, NJ: Earlbaum.
20. Motowidlo, S.J., Borman, W.C. and Schmit, M.J. (1997) A theory of individual differences in task and contextual performance. Human Performance, 10, 71-83.
21. McCormick, E.J. (1976) Job and task analysis. In M.D. Dunnette (ed), Handbook of Industrial and Organizational Psychology (pp. 651-696). Chicago: Rand-McNally.
22. Murphy, K.R. and Cleveland, J.N. (1995) Understanding Performance Appraisal: Social, Organizational, and Goal-Based Perspectives. Thousand Oaks, CA: Sage Publications Inc.
23. Paterson, D.G. (1923) The Scott Company graphic rating scale. Journal of Personnel Research, 1, 361-376.
24. Rugg, H. (1921). Is the rating of human character practicable? Journal of Educational Psychology 12, 425-438, 485-501
25. Schwab, D.P., Heneman, H.G. III and DeCotiis, T. (1975) Behaviorally anchored rating scales: A review of the literature. Personnel Psychology, 28, 549-562.
26. Smith, D.E. (1986) Training programs for performance appraisal: A review. Academy of Management Review, 11(1), 22-40.
27. Smith, P.C. and Kendall, L.M. (1963) Retranslation of expectations: An approach to the construction of unambiguous anchors for rating scales. Journal of Applied Psychology, 47, 149-155.
28. Stark, S. and Drasgow, F. (1998). Application of an IRT ideal point model to computer adaptive assessment of job performance. Paper presented at the Society for Industrial and Organizational Psychology Annual Conference, Dallas, TX.
29. Tett, R.P., Guterman, H.A., Bleier, A. and Murphy, P.J. (2000) Development and content validation of a 'hyperdimensional' taxonomy of managerial competence. Human Performance, 13, 205-251.
30. Thurstone, L.L. (1927) Psychophysical analysis. American Journal of Psychology, 38, 368-389.
31. Zinnes, J.L. and Griggs, R.A. (1974) Probabilistic, multidimensional unfolding analysis. Psychometrika, 39, 327-350.