Words versus numbers: A theoretical exploration of giving and receiving narrative comments in performance appraisal

Human Resource Management Review

Volumn 20, Issue 2, 2010, Pages 144-157

  Brutus, Stéphane ^a  

^a Dept of Electrical and Computer Engineering   (Canada)

Author keywords

Format; Narrative comments; Performance appraisal

Indexed keywords

EID: 76749108913     PISSN: 10534822     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.hrmr.2009.06.003     Document Type: Article

References (145)

1. Aiken L.R. Rating scales and checklists: Evaluating behaviors, personality, and attitudes (1996), John Wiley & Sons, New York, NY
2. Allen D.G., VanScooter J.R., and Otondo R.F. Recruitment communication media: Impact on prehire outcomes. Personnel Psychology 57 (2004) 143-171
3. Andrews M.C., and Kacmar K.M. Confirmation and extension of the source of feedback scale in service-based organizations. The Journal of Business Communication 38 (2001) 206-226
4. Antonioni D. Designing an effective 360-degree feedback appraisal process. Organizational Dynamics 25 (1996) 24-38
5. Ashford S.J., Blatt R., and VandeWalle D. Reflections on the looking glass: A review of research on feedback-seeking behavior in organizations. Journal of Management 29 (2003) 773-799
6. Ashford S.J., and Cummings L. Feedback as an individual resource: Personal strategies of creating information. Organizational Behavior and Human Performance 32 (1983) 370-398
7. Ashford S.J., and Tsui A.S. Self-regulation for managerial effectiveness: The role of feedback-seeking. Academy of Management Journal 34 (1991) 251-280
8. Atwater L., and Brett J. Feedback format: Does it influence managers' reactions to feedback?. Journal of Occupational and Organizational Psychology 79 (2006) 517-532
9. Atwater L., Ostroff C., Yammarino F., and Fleenor J. Self-other agreement: Does it really matter?. Personnel Psychology 51 (1998) 577-598
10. Atwater L., and Yammarino F. Self-other rating agreement: A review and model. Research in Personnel and Human Resources Management 15 (1997) 121-175
11. Audia P.G., and Locke E.A. Benefiting from negative feedback. Human Resource Management Review 13 (2003) 631-646
12. Austin J.T., and Villanova P. The criterion problem: 1917-1992. Journal of Applied Psychology 77 (1992) 836-875
13. Bargh J.A., and Thein R.D. Individual construct accessibility, person memory, and the recall-judgment link: The case of information overload. Journal of Personality and Social Psychology 49 (1985) 1129-1146
14. Barnes-Farrell J.L. Performance appraisal: Person perception processes and challenges. In: London M. (Ed). How people evaluate others in organizations: Person perception and interpersonal judgment in I/O psychology (2001), Lawrence Erlbaum, Mahwah, NJ 135-153
15. Baron R.A. Criticism informal negative feedback as a source of perceived unfairness in organizations: Effect, mechanisms, and countermeasures. In: Cropanzano R. (Ed). Justice in the workplace: Approaching fairness in human resource management (1993), Lawrence Erlbaum, Mahwah, NJ 155-170
16. Bennett N., Herold D.M., and Ashford S.J. The effects of tolerance for ambiguity on feedback-seeking behavior. Journal of Occupational Psychology 63 (1990) 343-348
17. Bernardin H.J., and Beatty R.W. Performance appraisal: Assessing human behavior at work (1984), Kent Publishing Company, Boston, MA
18. Bernardin H.J., Cooke D., Ross S., and Villanova P. Conscientiousness and agreeableness as predictors of rating leniency. Journal of Applied Psychology 85 (2000) 232-236
19. Bernardin J.H., and Villanova P. Performance appraisal. In: Locke E.A. (Ed). Generalizing from laboratory to field settings (1986), Lexington Books, Lenham, MD 43-62
20. Bernardin H.J., and Villanova P. Research streams in rater self-efficacy. Group and Organization Management 30 (2005) 61-88
21. Blau P.M. Exchange and power in social life (1964), John Wiley & Sons, New York, NY
22. Borman W.C. Job behaviour, performance, and effectiveness. In: Dunnette M.D., and Hough L.M. (Eds). Handbook of Industrial and Organizational Psychology Vol. 2 (1991), Consulting Psychologist Press, Palo Alto, Ca
23. Boyes W., Lynch A., and Mounts W. Why odd pricing. Journal of Applied Social Psychology 37 (2007) 1130-1140
24. Bretz R., Milkovich G.T., and Read W. Comparing the performance appraisals practices in large firms with the directions in research literature: Learning more and more about less and less. Center for Advanced Human Resources Studies Working Papers Series Working Paper #89-17 (1989)
25. Bretz R., Milkovich G.T., and Read W. The current state of performance appraisal research and practice. Journal of Management 18 (1992) 321-352
26. Burke K.A., and Gaylord T.W. Using 360° comments to direct and impact development plans. Presented at the 19th Annual Conference of the Society for Industrial and Organizational Psychology, Los Angeles, CA (2005)
27. Butler R. Task-involving and ego-evolving properties of evaluations: Effects of different feedback conditions on motivated perceptions, interest, and performance. Journal of Educational Psychology 79 (1987) 474-482
28. Butler R., and Nisan M. Effects of no feedback, task-related comments, and grades on intrinsic motivation and performance. Journal of Educational Psychology 78 (1986) 210-216
29. Cable D.M., and Yu K.Y. Managing job seekers' organizational image beliefs: The role of media richness and media credibility. Journal of Applied Psychology 91 (2006) 828-840
30. Campbell J.P., McCloy R.A., Oppler S.H., and Sager C.E. A theory of performance. In: Schmitt N., and Borman W. (Eds). Personnel selection in organizations (1993), Jossey-Bass, San Francisco
31. Cappelli P., and Scherer P.D. The missing role of context in OB: the need for a meso-level approach. Research in Organizational Behavior 13 (1991) 55-110
32. Chaiken S., and Eagly A.H. Communication modality as a determinant of message persuasiveness and message comprehensibility. Journal of Personality and Social Psychology 34 (1976) 605-614
33. Chaiken S., and Eagly A.H. Communication modality as a determinant of persuasion: The role of communicator salience. Journal of Personality and Social Psychology 45 (1983) 241-256
34. Chomsky N. Knowledge of language: Its nature, origin, and use (1986), Praeger, New York, NY
35. Christianson DeMay C., Chandonnet A., Rasinowich C., and Fenlason K.J. Application of an automated content analysis process to multisource comments. Paper presented at the 21st Annual Meeting of the Society for Industrial and Organizational Psychology, Dallas, TX (2006)
36. Conger J., and Toegel G. Action learning and multirater feedback as leadership development interventions: Popular but poorly deployed. Journal of Change Management 3 (2003) 332-348
37. Converse J.M. Survey research in the United States: Roots and emergence 1980-1960 (1987), University of California Press, Los Angeles, CA
38. Crano W.D., and Brewer M.B. Principles and methods of social research (1986), Allyn & Bacon, Boston, MA
39. Cureton L.W. The history of grading practices. Measurement in Education 2 (1971) 1-8
40. Daft R.L., and Lengel R.H. Information richness: A new approach to managerial behavior and organizational design. In: Cummings L.L., and Staw B.M. (Eds). Research in organizational behaviour (1984), JAI Press, Homewood, IL 191-233
41. Daft R.L., and Lengel R.H. Organizational information requirements, media richness, and structural design. Management Science 32 (1986) 554-571
42. Daft R.L., and Wiginton J.C. Language and organization. Academy of Management Review 4 (1979) 179-191
43. Dalessio A.T. Using multi-source feedback for employee development and personnel decisions. In: Smither J.W. (Ed). Performance appraisal: State of the art in practice (1998), Jossey-Bass, San Francisco, CA 278-330
44. DeNisi A.S., and Peters L.H. Organization of information in memory and the performance appraisal process: Evidence from the field. Journal of Applied Psychology 81 (1996) 717-737
45. DeNisi A.S., Robbins T., and Cafferty T.P. The organization of information used for performance appraisals: The role of diary-keeping. Journal of Applied Psychology 74 (1989) 124-129
46. DeNisi A.S., and Williams K.J. A cognitive approach to performance appraisal. In: Rowland K., and Ferris G. (Eds). Research in personnel and human resources management (1988), Elsevier, New-York, NY 109-156
47. DeNisi A.S., and Williams K.J. A cognitive approach to performance appraisal. In: Rowland K., and Ferris G. (Eds). Research in personnel and human resource management (1988), JAI Press, Greenwich, CT. 199-256
48. Eagly A.H. Comprehensibility of persuasive arguments as a determinant of opinion change. Journal of Personality and Social Psychology 29 (1974) 758-773
49. Fedor D.B. Recipient responses to performance feedback: A proposed model and its implications. In: Rowland K., and Ferris G. (Eds). Research in personnel and human resources management (1991), JAI Press, Greenwich, CT. 73-120
50. Fedor D.B., Rensvold R.B., and Adams S.M. An investigation of factors expected to affect feedback-seeking: A longitudinal field study. Personnel Psychology 45 (1992) 779-805
51. Feldman D. Instrumentation and training for performance appraisal: a perceptual-cognitive viewpoint. In: Rowland K., and Ferris G. (Eds). Research in personnel and human resources management (1986), JAI Press, Greenwich, Conn. 45-99
52. Ferris G.R., Munyon T.P., Basik K., and Buckley M.R. The performance evaluation context: Social, emotional, cognitive, political, and relationship components. Human Resource Management Review 18 (2008) 146-163
53. Ferstl K.L., and Bruskiewicz K.T. Self-other agreement and cognitive reactions to multirater feedback. Paper presented at 15th Annual Conference of the Society of Industrial and Organizational Psychology, New Orleans, LA (2000)
54. Field H., and Holley W. The relationship of performance appraisal system characteristics to verdicts in selected employment discrimination cases. Academy of Management Journal 25 (1982) 392-406
55. Fisher C.D. Transmission of positive and negative feedback to subordinates: A laboratory investigation. Journal of Applied Psychology 64 (1979) 533-540
56. Fitzer K. Review of theoretical and applied issues in written language expression. Canadian Journal of School Psychology 18 (2003) 203-221
57. Fried Y., Tiegs R.B., and Bellamy A.R. Personal and interpersonal predictors of supervisors' avoidance of evaluating subordinates. Journal of Applied Psychology 77 (1992) 462-468
58. Geer J.G. Do open-ended questions measure "salient" issues?. Public Opinion Quarterly 55 (1991) 360-370
59. Gijsbrechts E. Prices and pricing research in consumer marketing: Some recent developments. International Journal of Research in Marketing 10 (1993) 115-151
60. Giles H., Mulac A., Bradac J.J., and Johnson P. Speech accommodation theory: The first decade and beyond. In: McLaughlin M.L. (Ed). Communication yearbook (1987), Sage, Thousand Oaks, CA 13-48
61. Gilliland S.W., and Langdon J.C. Creating performance management systems that promote perceptions of fairness. In: Smither J.W. (Ed). Performance appraisal: State of the art and practice (1998), Jossey-Bass, San Francisco, CA 209-243
62. Gillipsie T., Rose D.S., and Robinson G.N. Narrative comments in 360 degree feedback: Who says what?. Paper presented at the 21st Annual Conference of the Society for Industrial and Organizational Psychology, Dallas, TX (2006)
63. Gupta A.K., and Govindarajan V. Knowledge flows within multinational corporations. Strategic Management Journal 21 (2000) 473-496
64. Hastie R., and Park B. The relationship between memory and judgment depends on whether the judgment is memory-based or on-line. Psychological Review 93 (1986) 258-268
65. Harris M.M. Rater motivation in the performance appraisal context: A theoretical framework. Journal of Management 20 (1994) 737-756
66. Hayes J.R., and Flower L.S. Identifying the organization of writing processes. In: Gregg L.W., and Steinberg E.R. (Eds). Cognitive processes in writing (1980), Lawrence Erlbaum Associates, Inc, Hillsdale, NJ 3-30
67. Heath C., Larrick R.P., and Klayman J. Cognitive repairs: How organizational practices can compensate for individual shortcomings. Research in Organization Behavior 20 (1998) 1-37
68. Herold D.M., and Fedor D.B. Individuals' interaction with their feedback environment: The role of domain-specific individual differences. Research in Personnel and Human Resources Management 16 (1998) 215-254
69. Herold D.M., and Parsons C.K. Assessing the feedback environment in work organizations: Development of the feedback survey. Journal of Applied Psychology 70 (1985) 290-305
70. Ilgen D.R., Fisher C.D., and Taylor S.M. Consequences of individual feedback on behavior in organizations. Journal of Applied Psychology 64 (1979) 359-371
71. Ilgen D.R., Barnes-Farrell J.L., and McKellin D.B. Performance appraisal process research in the 1980s: What has it contributed to appraisals in use?. Organizational Behavior and Human Decision Processes 54 (1993) 321-368
72. Jackson K.M., and Trochim W.M.K. Concept mapping as an alternative approach for the analysis of open-ended survey responses. Organizational Research Methods 5 (2002) 307-336
73. Jawahar I.M., and Williams C.R. Where all the children are above average: The performance appraisal purpose effect. Personnel Psychology 50 (1997) 905-925
74. Johns G. The essential impact of context on organizational behavior. Academy of Management Review 31 (2006) 386-408
75. Judge T.A., and Ferris G.R. Social context of job performance evaluation decisions. Academy of Management Journal 36 (1993) 80-105
76. Kagehiro D.K. Defining the standards of proof in jury instructions. Psychological Science 1 (1990) 194-200
77. Kaiser R.B., and Kaplan R.E. Overlooking overkill? Beyond the 1-to-5 rating scale. Human Resource Planning 28 (2005) 7-11
78. Kanfer R. Motivation theory and industrial/organizational psychology. In: Dunnette M.D., and Hough L. (Eds). Handbook of industrial and organizational psychology (1990), Consulting Psychologists Press, Palo Alto, CA 75-170
79. Kaufman J., and Agnew B. Improving the usefulness of multi-source comments at Dell. Paper presented at the 21st Annual Meeting of the Society for Industrial and Organizational Psychology, Dallas, TX (2006)
80. Keeping L.M., and Levy P.E. Performance appraisal reactions: Measurement, modeling, and method bias. Journal of Applied Psychology 85 (2000) 708-772
81. Kellog R.T. The psychology of writing (1994), Oxford University Press, New York, NY
82. Kidder D.L., and McLean Parks J. The good soldier: Who is s(he)?. Journal of Organizational Behavior 22 (2001) 939-959
83. Kirkland K., and Manoogian S. Ongoing feedback: How to get it, how to use it (1998), Center for Creative Leadership, Greensboro, NC
84. Klein H.J., Whitener E.M., and Ilgen D.R. The role of goal specificity in the goal-setting process. Motivation and Emotion 14 (1990) 179-193
85. Kluger A.N., and DeNisi A. The effects of feedback interventions on performance: A historical review, a meta-analysis and a preliminary feedback intervention theory. Psychological Bulletin 119 (1996) 254-284
86. Korsgaard M.A., Meglino B.M., and Lester S.W. Beyond helping: Do other-oriented values have broader implications in organizations. Journal of Applied Psychology 82 (1997) 160-177
87. Krosnick J.A. Survey research. Annual Review of Psychology 50 (1999) 537-567
88. Kulesa P., and Bishop R.J. What did they really mean? New and emerging methods for analyzing themes in open-ended comments. In: Kraut A.I. (Ed). Getting action from organizational surveys: New concepts, technologies, and applications (2006), Jossey-Bass, San Francisco, CA 239-263
89. Lance C.E., and Woehr D.J. Statistical control of halo: Clarification from two cognitive models of the performance appraisal process. Journal of Applied Psychology 71 (1986) 679-685
90. Landy F.J., and Farr J. Performance rating. Psychological Bulletin 87 (1980) 172-207
91. Larson J.R. The performance feedback process: A preliminary model. Organizational Behavior and Human Performance 33 (1984) 42-76
92. Lengel R.H., and Daft R.L. The selection of communication media as an executive skill. Academy of Management Executive 2 (1988) 225-232
93. Levy P.E., and Williams J.R. The social context of performance appraisal: A review and framework for the future. Journal of Management 30 (2004) 881-905
94. Lindberg E., and Gorling T. Prediction of preference for and choices between verbally and numerically described alternatives. Acta Psychologica 76 (1991) 165-176
95. London M. Job feedback: Giving, seeking, and using feedback for performance improvement (1997), Lawrence Erlbaum, Hillsdale, NJ
96. London M., and Smither J.W. Feedback orientation, feedback culture, and the longitudinal performance management process. Human Resource Management Review 12 (2002) 81-100
97. Longnecker C.O., Sims H.P., and Gioia D.A. Behind the mask: The politics of performance appraisal. Academy of Management Executive 1 (1987) 183-193
98. Magner E.S., Markham R., and Barnett C. Would reading an account of an event refresh your memory. Journal of Applied Psychology 96 (1996) 769-776
99. Malos S. Current legal issues in performance appraisal. In: Smither J.W. (Ed). Performance appraisal: State of the art and practice (1998), Jossey-Bass, San Francisco, CA 49-94
100. McCrosky J.C., and Richmond V.P. Applying reciprocity and accommodation theories to supervisor/subordinates communication. Journal of Applied Communication Research 28 (2000) 278-289
101. McLuhan M. The Gutenberg Galaxy: The making of typographic man (1962), University of Toronto Press, Toronto, ON
102. McLuhan M. Understanding media: The extensions of man (1964), MIT Press, Boston, Mass
103. Mento A.J., Steel R.P., and Karren R.J. A meta-analytic study of the effects of goal setting on task performance: 1966-1984. Organizational Behavior and Human Decision Processes, 39(1) 52 (1987) 32
104. Miller V.D., and Jablin F.M. Information seeking during organizational entry: Influences, tactics, and a model of the process. Academy of Management Review 16 (1991) 92-120
105. Mintzberg H. The nature of managerial work (1973), Harper & Row, New York, NY
106. Mohr J., and Spekman R. Characteristics of partnership success: Partnership attributes, communication behavior, and conflict resolution techniques. Strategic Management Journal 15 (1994) 135-152
107. Moore-Miller N., O'Farrell K., and Christianson DeMay C. Do comments characteristics help or hinder employee performance?. Paper presented at the 21st Annual Meeting of the Society for Industrial and Organizational Psychology, Dallas, TX (2006)
108. Mossholder K.W., Settoon R.P., Harris S.G., and Armenakis A.A. Measuring emotions in open-ended survey responses: An application of textual data analysis. Journal of Management 21 (1995) 335-355
109. Moxey L.M., and Sanford A.J. Communicating quantities: A review of psycholinguistic evidence of how expressions determine perspectives. Applied Cognitive Psychology 14 (2000) 237-255
110. Murphy K.R., and Cleveland J.N. Understanding performance appraisal: Social, organizational, and goal-based perspectives (1995), Sage, Thousand Oaks, CA
111. Newstead S.E., Pollard P., and Riezebos D. The effects of set size on the interpretation of quantifiers used in rating scales. Applied Ergonomics 18 (1987) 178-182
112. Nicholls J.G. Quality and equality in intellectual development: The role of motivation in education. American Psychologist 34 (1979) 1071-1084
113. Nicholls J.G. Conceptions of ability and achievement motivation: A theory and its implications for education. In: Paris S.G., Olson G.M., and Stevenson H.W. (Eds). Learning and motivation in the classroom (1983), Lawrence Erlbaum, Hillsdale, NJ
114. Olson D.R. Towards a psychology of literacy: On the relations between speech and writing. Cognition 60 (1996) 83-104
115. Patton M.Q. The nature of quantitative inquiry. Qualitative research and evaluation methods. (3rd ed.). (2002), Sage, Thousand Oaks, CA
116. Pearce J.L., and Porter L.W. Employee responses to formal performance appraisal feedback. Journal of Applied Psychology 71 (1986) 211-218
117. Petty R.E., and Cacioppo J.T. Communication and persuasion: Central and peripheral routes to attitude change (1986), Springer-Verlag, New York, NY
118. Poncheri R.M., Lindberg J.T., Thomson L.F., and Surface E.A. A comment on employee surveys: Negativity bias in open-ended responses. Organizational Research Methods 11 3 (2008) 614-630
119. Rose, D.S., Farrell, T., & Robinson, G.N. (2004). Are narrative comments in 360-degree feedback useful or useless? 3D Group technical report #8253.
120. Rose D.S., and Robinson G.N. Comments usefulness in the eyes of the feedback holder: Leaders speak. Paper presented at the 21st Annual Meeting of the Society for Industrial and Organizational Psychology, Dallas, TX (2006)
121. Rose, D.S., & Walsh, A.B. (2004). Current trends in 360° feedback. Technical report #8251. Data Driven Decisions, Inc.
122. Russ G.S., Daft R.L., and Lengel R.H. Media selection and managerial characteristics in organizational communications. Management Communication Quarterly 4 (1990) 151-175
123. Rynes S.L., Colbert A.E., and Brown K.G. HR professionals' beliefs about effective human resource practices: Correspondence between research and practice. Human Resource Management 41 (2002) 149-174
124. Salvati, N., Gosselin, A., Morin, D. et Morin, L. (2004). Performance feedback overload: An exploratory field study of its antecedents and consequences using structural equation modelling. Paper presented at the Annual Meeting of the Academy of Management. New Orleans. LA.
125. Sanford A.J., Fay N., Stewart A., and Moxley L. Perspectives in statements of quantity, with implications for consumer psychology. Psychological Science 13 (2002) 130-134
126. Schuler H. Is there a dilemma between validity and acceptance in the employment interview?. In: Nevo B., and Jaeger R.S. (Eds). Educational and psychological testing: The test taker's outlook (1993), Hogrefe & Huber, Kirkland, WA 239-250
127. Schmitt N., and Kunce C. The effects of required elaboration of answers to biodata questions. Personnel Psychology 55 (2002) 719-730
128. Schwarz N. Self-reports: How the questions shape the answers. American Psychologist 54 (1999) 93-105
129. Smith W.J., Harrington K.V., and Houghton J.D. Predictors of performance appraisal discomfort: A preliminary examination. Public Personnel Management 29 (2000) 1-22
130. Smither J.W. Performance appraisal: State of the art in practice (1998), Jossey-Bass, San Francisco, CA
131. Smither J.W., and Walker A.G. Are the characteristics of narrative comments related to improvement in multirater feedback over time?. Journal of Applied Psychology 89 (2004) 575-581
132. Smither J.W., Wohlers A.J., and London M. A field study of reactions to normative versus individualized upward feedback. Group and Organization Management 20 (1995) 61-89
133. Srull T.K., and Wyer R.S. Person memory and judgment. Psychological Review 96 (1989) 58-83
134. Steelman L.A., Levy P.E., and Snell A.F. The feedback environment scale FES: Construct definition, measurement, and validation. Educational and Psychological Measurement 64 (2004) 165-184
135. Sulsky L.M., and Keown J.L. Performance appraisal in the changing world of work: implications for the meaning and measurement of work performance. Canadian Psychology 39 (1998) 52-59
136. Timmreck C.W., and Bracken D.W. Upward feedback in the trenches: Challenges and realities. Paper presented at the 10th Annual Conference of the Society for Industrial and Organizational Psychology, Orlando, FL (1995)
137. Tubbs M.E. Goal-setting: A meta-analytic examination of the empirical evidence. Journal of Applied Psychology 71 3 (1986) 474-484
138. Tziner A., and Kopelman R.E. Is there a preferred performance rating format? A non-psychometric perspective. Applied Psychology: An International Perspective 51 (2002) 479-503
139. Varma A., DeNisi A.S., and Peters L.H. Interpersonal affect in performance appraisal: A field study. Personnel Psychology 49 (1996) 341-360
140. Villanova P., Bernardin H.J., Dahmus S.A., and Sims R.L. Rater leniency and performance appraisal discomfort. Educational and Psychological Measurement 53 (1993) 789-799
141. Waldman D.A., Atwater L.E., and Antonioni D. Has 360 degree feedback gone amok?. Academy of Management Executive 12 (1998) 86-94
142. Wherry R.J., and Bartlett C.J. The control of bias in ratings: A theory of rating. Personnel Psychology 35 (1982) 521-551
143. Wogalter M.S., Kalsher M.J., and Litynski D.M. Influence of food label quantifier terms on connoted amount and purchase intention. Proceedings of the Human Factors and Ergonomics Society 40th Annual Meeting. Santa Monica, CA (1996)
144. Wood R.E., and Locke E.A. Goal setting and strategy effects on complex tasks. In: Staw B.M., and Cummings L.L. (Eds). Research in organizational behavior (1990), JAI Press, Greenwich, CT 73-109
145. Woods R.H., Sciarini M., and Breiter D. Performance appraisal in hotels. Cornell Hotel and Restaurant Administration Quarterly 39 (1998) 25-29