Is it all relative? Comparative judgments and the possible improvement of self-ratings and ratings of others

Perspectives on Psychological Science

Volumn 6, Issue 1, 2011, Pages 48-60

  Goffin, Richard D ^a   Olson, James M ^a  

^a UNIVERSITY OF WESTERN ONTARIO   (Canada)

Author keywords

Attitude measurement; Evolutionary psychology; Person perception; Personnel evaluation; Social judgments

Indexed keywords

EID: 80051809346     PISSN: 17456916     EISSN: 17456924     Source Type: Journal    
DOI: 10.1177/1745691610393521     Document Type: Article

References (79)

1. Albarracín, D., Johnson, B.T., & Zanna, M.P. (Eds.). (2005). The handbook of attitudes. Mahwah, NJ: Erlbaum.
2. Alicke, M.D., Klotz, M.L., Breitenbecher, D.L., Yurak, T.J., & Vredenburg, D.S. (1995). Personal contact, individuation, and the better-than-average effect. Journal of Personality and Social Psychology, 68, 804-825.
3. Bartoshuk, L.M., Duffy, V.B., Green, B.G., Hoffman, H.J., Ko, C.-W., Lucchina, L.A., et al. (2004). Valid across-group comparisons with labeled scales: The gLMS versus magnitude matching. Physiology & Behavior, 82, 109-114.
4. Bartoshuk, L.M., Fast, K., & Snyder, D.J. (2005). Differences in our sensory worlds: Invalid comparisons with labeled scales. Current Directions in Psychological Science, 14, 122-125.
5. Bennett, W., Lance, C.E., & Woehr, D.J. (2006). Performance measurement: Current perspectives and future challenges. Mahwah, NJ: Erlbaum.
6. Bente, G., Feist, A., & Elder, S. (1996). Person perception effects of computer-simulated male and female head movement. Journal of Nonverbal Behavior, 20, 213-228.
7. Bernardin, H.J., & Villanova, P. (1986). Performance appraisal. In E. Locke (Ed.), Generalizing from laboratory to field settings (pp. 43-62). Boston: Heath/Lexington.
8. Biernat, M. (2003). Toward a broader view of social stereotyping. American Psychologist, 58, 1019-1027.
9. Biernat, M., & Manis, M. (1994). Shifting standards and stereotypebased judgments. Journal of Personality and Social Psychology, 66, 5-20.
10. Bobko, P., & Stone-Romero, E.F. (1998). Meta-analysis may be another useful research tool, but it is not a panacea. In G.R. Ferris (Ed.), Research in personnel and human resources management (Vol. 16, pp. 359-397). Stamford, CT: JAI Press.
11. Bommer, W.H., Johnson, J.L., Rich, G.A., Podsakoff, P., & MacKenzie, S.B. (1995). On the interchangeability of objective and subjective measures of employee performance: A meta-analysis. Personnel Psychology, 48, 587-605.
12. Borman, W.C. (1977). Consistency of rating accuracy and rating errors in the judgment of human performance. Organizational Behavior and Human Performance, 20, 238-252.
13. Buss, D.M. (1995). Evolutionary psychology: A new paradigm for psychological science. Psychological Inquiry, 6, 1-30.
14. Buunk, A.P., & Gibbons, F.X. (2007). Social comparison: The end of a theory and the emergence of a field. Organizational Behavior and Human Decision Processes, 102, 3-21.
15. Campbell, J.P., McCloy, R.A., Oppler, S.H., & Sager, C.E. (1993). A theory of performance. In N. Schmitt & W.C. Borman (Eds.), Personnel selection in organizations (pp. 35-70). San Francisco: Jossey-Bass.
16. Cardy, R.L., & Dobbins, G.H. (1994). Performance appraisal: Alternative perspectives. Cincinnati, OH: South-Western.
17. Cascio, W.F., & Aguinis, H. (2005). Applied psychology in human resource management (6th ed.). Upper Saddle River, NJ: Prentice-Hall.
18. Catano, V.M., Wiesner, W.H., Hackett, R.D., & Methot, L.L. (2010). Recruitment and selection in Canada (5th ed.). Toronto, Canada: Nelson Education.
19. Cleveland, J.N., Murphy, K.R., & Williams, R.E. (1989). Multiple uses of performance appraisal: Prevalence and correlates. Journal of Applied Psychology, 74, 130-135.
20. Cohen, J. (1982). Set correlation as a general multivariate data analytic method. Multivariate Behavioral Research, 17, 301-341.
21. Cronbach, L.J. (1955). Processes affecting scores on "understanding of others" and "assumed similarity." Psychological Bulletin, 52, 177-193.
22. Dunning, D. (1993). Words to live by: The self and definitions of social concepts and categories. In J.M. Suls (Ed.), Psychological perspectives on the self (Vol. 4, pp. 99-126). Hillsdale, NJ: Erlbaum.
23. Dunning, D. (2000). Social judgment as implicit social comparison. In J. Suls & L.Wheeler (Eds.), Handbook of social comparison: Theory and research (pp. 353-378). New York: Kluwer.
24. Eagly, A.H., & Chaiken, S. (1993). The psychology of attitudes. Orlando, FL: Harcourt Brace Jovanovich College.
25. El-Alayli, A., Myers, C.J., Petersen, T.L., & Lystad, A.L. (2008). I don't mean to sound arrogant, but.": The effects of using disclaimers on person perception. Personality and Social Psychology Bulletin, 34, 130-143.
26. Fazio, R.H. (2000). Accessible attitudes as tools for object appraisal: Their costs and benefits. In G.R. Maio & J.M. Olson (Eds.), Why we evaluate: Functions of attitudes. (pp. 1-36). Mahwah, NJ: Erlbaum.
27. Festinger, L. (1954). A theory of social comparison processes. Human Relations, 7, 117-140.
28. Gawronski, B. (2009). Ten frequently asked questions about implicit measures and their frequently supposed, but not entirely correct answers. Canadian Psychology, 50, 141-150.
29. Gilbert, P., Price, J., & Allan, S. (1995). Social comparison, social attractiveness and evolution: How might they be related? New Ideas in Psychology, 13, 149-165.
30. Goff, P.A., Thomas, M.A., & Jackson, M.C. (2008). "Ain't I a woman?" Towards an intersectional approach to person perception and group-based harms. Sex Roles, 59, 392-403.
31. Goffin, R.D., Gellatly, I.R., Paunonen, S.V., Jackson, D.N., & Meyer, J.P. (1996). Criterion validation of two approaches to performance appraisal: The Behavioral Observation Scale and the Relative Percentile Method. Journal of Business and Psychology, 11, 23-33.
32. Goffin, R.D., Jelley, R.B., Powell, D.M., & Johnston, N.G. (2009). Taking advantage of social comparisons in performance appraisal: The relative percentile method. Human Resource Management, 48, 251-268.
33. Greenberg, J., Ashton-James, C.E., & Ashkanasy, N.M. (2007). Social comparison processes in organizations. Organizational Behavior and Human Decision Processes, 102, 22-41.
34. Greene, L., Bernardin, H.J., & Abbott, J. (1985). A comparison of rating formats after corrections for attenuation. Educational and Psychological Measurement, 45, 503-515.
35. Greenwald, A.G., McGhee, D.E., & Schwartz, J.L.K. (1998). Measuring individual differences in implicit cognition: The implicit association test. Journal of Personality and Social Psychology, 74, 1464-1480.
36. Heaton, A.W., & Kruglanski, A.W. (1991). Person perception by introverts and extraverts under time pressure: Effects of need for closure. Personality and Social Psychology Bulletin, 17, 161-165.
37. Hendriks, M.C.P., & Vingerhoets, A.J.J.M. (2006). Social messages of crying faces: Their influence on anticipated person perception, emotions and behavioural responses. Cognition&Emotion, 20, 878-886.
38. Heneman, R.L. (1986). The relationship between supervisory ratings and results-oriented measures of performance: A meta-analysis. Personnel Psychology, 39, 811-826.
39. Hunter, J.E., & Schmidt, F.L. (2004). Methods of meta-analysis. Thousand Oaks, CA: Sage.
40. Jelley, R.B., & Goffin, R.D. (2001). Can feedback accuracy be improved? Effects of rater priming and rating scale format on rating accuracy. Journal of Applied Psychology, 86, 134-144.
41. Jelley, R.B., Goffin, R.D., Powell, D., & Heneman, R. (2007, April). Incentives and alternative rating approaches: Roads to greater accuracy? Presented at the annual conference of the Society for Industrial and Organizational Psychology, New York City.
42. Jelley, R.B., Goffin, R.D., Powell, D.M., & Heneman, R.L. (2010). Incentives and alternative rating approaches: Roads to greater accuracy in job performance assessment? Manuscript submitted for publication.
43. Kenrick, D.T. (1994). Evolutionary social psychology: From sexual selection to social cognition. In M.P. Zanna (Ed.), Advances in experimental social psychology (Vol. 26, pp. 75-122). San Diego, CA: Academic Press.
44. Kenrick, D.T., Li, N.P., & Butner, J. (2003). Dynamical evolutionary psychology: Individual decision rules and emergent social norms. Psychological Review, 110, 3-28.
45. Klar, Y., & Giladi, E.E. (1997). No one in my group can be below the group's average: A robust positivity bias in favor of anonymous peers. Journal of Personality and Social Psychology, 73, 885-901.
46. Klein, W.M., & Weinstein, N.D. (1997). Social comparison and unrealistic optimism about personal risk. In B. Buunk & F.X. Gibbons (Eds.), Health, coping, and well-being: Perspectives from social comparison theory (pp. 25-61). Mahwah, NJ: Erlbaum.
47. Krosnick, J.A., Judd, C.M., & Wittenbrink, B. (2005). The measurement of attitudes. In D. Albarraci{dotless}́n,B.T. Johnson,&M.P.Zanna (Eds.), The handbook of attitudes (pp. 21-76). Mahwah, NJ: Erlbaum.
48. Kruglanski, A.W., & Mayseless, O. (1990). Classic and current social comparison research: Expanding the perspective. Psychological Bulletin, 108, 195-208.
49. Landy, F.J., & Farr, J.L. (1980). Performance rating. Psychological Bulletin, 87, 72-107.
50. Latham, G.P., & Wexley, K.N. (1977). Behavioral observation scales. Personnel Psychology, 30, 255-268.
51. Likert, R. (1932). A technique for the measurement of attitudes. Archives of Psychology, 22, 1-55.
52. Lippa, R.A., & Dietz, J.K. (2000). The relation of gender, personality, and intelligence to judges' accuracy in judging strangers' personality from brief video segments. Journal of Nonverbal Behavior, 24, 25-43.
53. Mabe, P.A., III, & West, S.G. (1982). Validity of self-evaluation of ability: A review and meta-analysis. Journal of Applied Psychology, 67, 280-296.
54. Mumford, M.D. (1983). Social comparison theory and the evaluation of peer evaluations: A review and some applied implications. Personnel Psychology, 36, 867-881.
55. Murphy, K.R., & Cleveland, J.N. (1995). Understanding performance appraisal. Thousand Oaks, CA: Sage.
56. Murphy, N.A. (2007). Appearing smart: The impression management of intelligence, person perception accuracy, and behavior in social interaction. Personality and Social Psychology Bulletin, 33, 325-339.
57. Nathan, B.R., & Alexander, R.A. (1988). A comparison of criteria for test validation: A meta-analytic investigation. Personnel Psychology, 41, 517-535.
58. Olson, J.M., Goffin, R.D., & Haynes, G. (2007). Relative versus absolute measures of explicit attitudes. Journal of Personality and Social Psychology, 93, 907-926.
59. Olson, J.M., & Maio, G.R. (2003). Attitudes in social behavior. In T. Millon & M.J. Lerner (Eds.), Handbook of psychology: Volume 5. Personality and social psychology (pp. 299-325). Hoboken, NJ: Wiley.
60. Osgood, C.E., Suci, G.J., & Tannenbaum, P.H. (1957). The measurement of meaning. Urbana, IL: University of Illinois Press.
61. Price, P.C., Pentecost, H.C., & Voth, R.D. (2002). Perceived event frequency and the optimistic bias: Evidence for a two-process model of personal risk judgments. Journal of Experimental Social Psychology, 38, 242-252.
62. Pronin, E., Lin, D.Y., & Ross, L. (2002). The bias blind spot: Perceptions of bias in self versus others. Personality and Social Psychology Bulletin, 28, 369-381.
63. Quinn, K.A., & Olson, J.M. (2003). Framing social judgment: Selfingroup comparison and perceived discrimination. Personality and Social Psychology Bulletin, 29, 228-236.
64. Quinn, K.A., Roese, N.J., Pennington, G.L., & Olson, J.M. (1999). The personal-group discrimination discrepancy: The role of informational complexity. Personality and Social Psychology Bulletin, 25, 1430-1440.
65. Roese, N.J., & Olson, J.M. (2007). Better, stronger, faster: Selfserving judgment, affect regulation, and the optimal vigilance hypothesis. Perspectives on Psychological Science, 2, 124-141.
66. Rothmann, I., & Cooper, C. (2008). Organizational and work psychology. London, England: Hodder Education.
67. Schwab, D.P., Heneman, H.G., & DeCotiis, T.A. (1975). Behaviorally anchored rating scales: A review of the literature. Personnel Psychology, 28, 549-562.
68. Scullen, S.E., Mount, M.K., & Goff, M. (2000). Understanding the latent structure of job performance ratings. Journal of Applied Psychology, 85, 956-970.
69. Sheppard, L.D., Goffin, R.D., Lewis, R., & Olson, J.M. (in press). The effect of target attractiveness and rating method on the accuracy of trait ratings. Journal of Personnel Psychology.
70. Smith, E.R., & Collins, E.C. (2009). Contextualizing person perception: Distributed social cognition. Psychological Review, 116, 343-364.
71. Smith, P.C., & Kendall, L.M. (1963). Retranslation of expectations: An approach to the construction of unambiguous anchors for rating scales. Journal of Applied Psychology, 47, 149-155.
72. Spector, P.E. (2008). Industrial and organizational psychology: Research and practice (5th ed.). Hoboken, NJ: Wiley.
73. Suls, J., & Wheeler, L. (Eds.). (2000). Handbook of social comparison: Theory and research. New York: Kluwer.
74. Taylor, D.M., Wright, S.C., & Porter, L.E. (1994). Dimensions of perceived discrimination: The personal-group discrimination discrepancy. In M.P. Zanna & J.M. Olson (Eds.), The psychology of prejudice: The Ontario symposium (Vol. 7, pp. 233-255). Hillsdale, NJ: Erlbaum.
75. Taylor, J.B., & Parker, H.A. (1964). Graphic ratings and attitude measurement: A comparison of research tactics. Journal of Applied Psychology, 48, 37-42.
76. Thornton, G.C., & Byham, W.C. (1982). Assessment centres and managerial performance. Orlando, FL: Academic Press.
77. Vasilyeva, M., Duffy, S., & Huttenlocher, J. (2007). Developmental changes in the use of absolute and relative information: The case of spatial extent. Journal of Cognition and Development, 8, 455-471.
78. Wagner, S.H., & Goffin, R.D. (1997). Differences in accuracy of individual and comparative performance appraisal methods. Organizational Behavior and Human Decision Processes, 70, 95-103.
79. Whitley, B.E., & Hern, A.L. (1991). Perceptions of vulnerability to pregnancy and the use of effective contraception. Personality and Social Psychology Bulletin, 17, 104-110.