Who will evaluate me? Rater selection in multi-source assessment contexts

International Journal of Selection and Assessment

Volumn 13, Issue 2, 2005, Pages 129-138

  Brutus, Stéphane ^a,d   Petosa, Sandra ^b   Aucoin, Emelie ^c  

^a Gina Cody School of Engineering and Computer Science   (Canada)

^b Société Pierre Boucher   (United States)

^c Standard Life ^*

^d John Molson School of Business   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 20744451880     PISSN: 0965075X     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.0965-075X.2005.00307.x     Document Type: Article

References (61)

1. Ashford, S.J. and Cummings, L.L. (1983) Feedback as an individual resource: Personal strategies of creating information. Organizational Behavior and Human Performance, 32, 370-398.
2. Ashford, S.J. and Northcraft, G.B. (1992) Conveying more (or less) than we realize: The role of impression-management in feedback-seeking. Organizational Behavior and Human Decision Processes, 53, 310-335.
3. Ashford, S.J. and Tsui, A.S. (1991) Self-regulation for managerial effectiveness: The role of active feedback seeking. Academy of Management Journal, 34, 251-280.
4. Atwater, L. and Waldman, D. (1998) Accountability in 360-degree feedback. HR Magazine, 43, 96-104.
5. Baumeister, R.F. and Jones, E.E. (1978) When self-presentation is constrained by the target's knowledge: Consistency and compensation. Journal of Personality and Social Psychology, 36, 608-618.
6. Beer, M. (1981) Performance appraisal: Dilemmas and possibilities. Organizational Dynamics, Winter 9, 24-36.
7. Bracken, D. and Timmreck, C. (2001) Guidelines for multisource feedback when used for decision-making. In D. Bracken, C.W. Timmreck and A. Church (Eds.), Handbook of multi-source feedback. Jossey-Bass: San Francisco.
8. Brutus, S. and Derayeh, M. (2002) Current practices in multi-source assessment. Human Resources Development Quarterly, 13, 187-202.
9. Burt, R.S. (1982) Toward a structural theory of action: Network models of social structure, perception, and action. New York: Academic Press.
10. Cardy, R.L. and Dobbins, G.H. (1986) Affect and appraisal accuracy: Liking as an integral dimension in evaluating performance. Journal of Applied Psychology, 71, 672-679.
11. Carver, C.S. and Scheier, M.F. (1981) Attention and self-regulation: A control-theory approach to human behavior. New York: Springer-Verlag.
12. Cawley, B.D., Keeping, L.M. and Levy, P.E. (1998) Participation in the performance appraisal process and employee reactions: A meta-analytic review of field investigations. Journal of Applied Psychology, 83, 615-633.
13. Conway, J.M., Lombardo, K. and Sanders, K.C. (2001) A meta-analysis of incremental validity and nomological networks for subordinate and peer ratings. Human Performance, 14, 267-303.
14. Church, A.H., Rogelberg, S.G. and Waclawski, J. (2000) Since when is no news good news? The relationship between performance and response rates in multirater feedback. Personnel Psychology, 53, 435-451.
15. Coates, D.E. (1998) Don't tie 360 feedback to pay. Training, 35, 68-78.
16. Dalessio, A.T. (1998) Using multi-source feedback for employee development and personnel decisions. In J.W. Smither (Ed.), Performance appraisal: State of the art in practice (pp. 278-330). San Francisco: Jossey-Bass.
17. Farr, J.L. and Newman, D.A. (2001) Rater selection: Sources of feedback. In D. Bracken, C.W. Timmereck and A. Church (Eds.), Handbook of multisource feedback. Jossey-Bass: San Francisco.
18. Ferguson, L.W. (1949) The effect upon appraisal scores of individual differences in the ability of superiors to appraise subordinates. Personnel Psychology, 2, 377-382.
19. Ferris, G.R., Judge, T.A., Rowland, K.M. and Fitzgibbons, D.E. (1994) Subordinate influence and the performance evaluation process: Test of a model. Organizational Behavior and Human Decision Processes, 58, 101-135.
20. Freeberg, N.E. (1969) Relevance of rater-ratee acquaintance in the validity and reliability of ratings. Journal of Applied Psychology, 53, 518-524.
21. Gilliland, S.W. and Langdon, J.C. (1998) Creating performance management systems that promote perceptions of fairness. In J.W. Smither (Ed.), Performance appraisal: State of the art and practice. San Francisco: Jossey-Bass.
22. Healy, M.C., Walsh, A.B. and Rose, D.S. (2003). A benchmarking study of North American 360-degree feedback practices. Paper presented at the 18th Annual Conference of the Society for Industrial and Organizational Psychology, Orlando, FL.
23. Heneman, R.L. and Wexley, K.N. (1983) The effect of delay in rating and amount of information observed on performance rating accuracy. Academy of Management Journal, 26, 677-686.
24. Heneman, R.L., Wexley, K.N. and Moore, M.L. (1987) Performance rating accuracy: A critical review. Journal of Business Research, 15, 431-448.
25. Herold, D.M. and Fedor, D.B. (1998) Individuals' interaction with their feedback environment: The role of domain-specific individual differences. Research in Personnel and Human Resources Management, 16, 215-254.
26. Jawahar, I.M. and Williams, C.R. (1997) Where all the children are above average: The performance appraisal purpose effect. Personnel Psychology, 50, 905-925.
27. Johns, G. (1999) A multi-level theory of self-serving behavior in and by organizations. In R.I. Sutton and B.M. Staw (Eds.), Research in organizational behavior (Vol. 21). Stamford, CT: JAI Press.
28. Kane, J.S. and Lawler, E.E. (1978) Methods of peer assessment. Psychological Bulletin, 85, 555-586.
29. Karoly, P. (1993) Mechanisms of self-regulation: A systems view. Annual Review of Psychology, 44, 23-52.
30. Kenny, D.A. and La Voie, L. (1984) The social relations model. In L. Berkowitz (Ed.), Advances in experimental social psychology (Vol. 18). Orlando, FL: Academic Press.
31. Kenny, D.A., Mohr, C.D. and Levesque, M.J. (2001) A social relations variance partitioning of dyadic behavior. Psychological Bulletin, 127, 128-141.
32. Kipnis, D. and Schmidt, S.M. (1988) Upward influence styles: Relationship with performance evaluations, salary, and stress. Administrative Science Quarterly, 33, 528-542.
33. Lefkowitz, J. (2000) The role of interpersonal affective regard in supervisory performance ratings: A literature review and proposed causal model. Journal of Occupational and Organizational Psychology, 73, 67-85.
34. Levy, P.E., Albright, M.D., Cawley, B.D. and Williams, J.R. (1995) Situational and Individual determinants of feedback seeking: A closer look at the process. Organizational Behavior and Human Decision Processes, 62, 23-37.
35. Linden, R.C. and Mitchell, T.R. (1988) Ingratiatory behaviors in organizational settings. Academy of Management Review, 13, 572-587.
36. London, M. (2001) The great debate: Should multisource feedback be used for administration or development only? In D. Bracken, C.W. Timmereck and A. Church (Eds.), Handbook of multisource feedback. Jossey-Bass: San Francisco.
37. Longenecker, C.O., Sims, H.P. and Gioia, D.A. (1987) Behind the mask: The politics of employee appraisal. Academy of Management Executive, 6, 18-28.
38. Maddala, G.S. (1983) Limited-dependent and qualitative variables in econometrics. Cambridge: Cambridge University Press.
39. Morrison, E.W. and Bies, R.J. (1991) Impression management in the feedback-seeking process: A literature review and research agenda. Academy of Management Review, 16, 522-541.
40. Murphy, K.R. and Cleveland, J.N. (1995) Understanding performance appraisal. Sage: Thousand Oaks, CA.
41. Northcraft, G.B. and Ashford, S.J. (1990) The preservation of self in everyday life: The effects of performance expectations and feedback context on feedback inquiry. Organizational Behavior and Human Decision Processes, 47, 42-64.
42. Oldham, G.R., Kulik, C.T., Stepina, L.P. and Ambrose, M.L. (1986) Relations between situational factors and the comparative referents used by employees. Academy of Management Journal, 29, 599-608.
43. O'Leary, R.S., Harkcom, K.R., Jackson, K.A. and Tears, R.S. (2003). Rater selection in performance evaluation: Does it make a difference? Paper presented at the 18th Annual Conference for the Society of Industrial and Organizational Psychology, Orlando, Fl.
44. Powers, W.T. (1973) Behavior: The control of perception. Chicago: Aldine.
45. Rothstein, H.R. (1990) Interrater reliability of job performance ratings: Growth to asymptote level with increasing opportunity to observe. Journal of Applied Psychology, 75, 322-326.
46. Schneier, C.E. and Beatty, R.W. (1978) The influence of role prescriptions on the performance appraisal process. Academy of Management Journal, 21,129-135.
47. Sederburg, M.E. and Rogelberg, S.G. (1998) Informed decisions: Research based practice notes- 360-degree feedback: Methodological advice from multiple sources. The Industrial-Organizational Psychologist, 37, 67-76.
48. Sedikides, C. (1993) Assessment, enhancement, and verification determinants of the self-evaluation process. Journal of Personality and Social Psychology, 65, 317-338.
49. Shah, P.P. (1998) Who are employees' social referents? Using a network perspective to determine referent others. Academy of Management Journal, 41, 249-268.
50. Steele, C.M. (1988) The psychology of self-affirmation: Sustaining the integrity of the self. In L. Berkowitz (Ed.), Advances in experimental social psychology (Vol. 21). San Diego, CA: Academic Press.
51. Stepanski, K.M. and Fisicaro, S.A. (1999). The effects of method of rater selections on ratings in 360-degree feedback. Paper presented at the 14th Annual Conference for the Society of Industrial and Organizational Psychology, Atlanta, GA.
52. Summers, L. (2001) Web technologies for administering multi-source feedback programs. In D. Bracken, C.W. Timmereck and A. Church (Eds.), Handbook of multi-source feedback. Jossey-Bass: San Francisco.
53. Tesser, A. (1988) Toward a self-evaluation maintenance model of social behavior. In L. Berkowitz (Ed.), Advances in experimental social psychology (Vol. 21). San Diego, CA: Academic Press.
54. Trope, Y. (1986) Self-enhancement, self-assessment, and achievement behavior. In R.M. Sorrentino and E.T. Higgins (Eds.), Handbook of motivation and cognition (pp. 350-378). New York: Guilford.
55. Tsui, A.S. and Ashford, S.J. (1994) Adaptive self-regulation: A process view of managerial effectiveness. Journal of Management, 20, 93-121.
56. Tsui, A.S. and Barry, B. (1986) Interpersonal affect and rating errors. Academy of Management Journal, 29, 586-599.
57. Varma, A., DeNisi, A.S. and Peters, L.H. (1996) Interpersonal affect and performance appraisal. Personnel Psychology, 49, 341-360.
58. Wayne, S.J. and Ferris, G.R. (1990) Influence tactics, affect, and exchange quality in supervisor/subordinate interactions: A laboratory experiment and field study. Journal of Applied Psychology, 75, 487-499.
59. Wayne, S.J. and Kacmar, M.K. (1991) The effects of impression management on the performance appraisal process. Organizational Behavior and Human Decision Processes, 48, 70-88.
60. Weiner, B. (1980) Human motivation. New York: Holt, Rinehart, & Winston.
61. Wheeler, L. and Miyake, K. (1992) Social comparison in everyday life. Journal of Personality and Social Psychology, 62, 760-773.