Evidence-based answers to 15 questions about leveraging 360-degree feedback

Consulting Psychology Journal

Volumn 64, Issue 3, 2012, Pages 157-182

  Nowack, Kenneth M ^a   Mashihi, Sandra ^a  

^a Envisia Learning   (United States)

Author keywords

360 feedback; Behavioral change; Coaching; Feedback; Leadership development; Multirater feedback; Talent development

Indexed keywords

EID: 84874332145     PISSN: 10659293     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0030011     Document Type: Article

References (152)

1. Ajzen, I. (1991). The theory of planned behaviour. Organisational Behaviour and Human Decision Processes, 50, 179-211.
2. American Psychological Association. (2010). American Psychological Association ethical principles of psychologists and code of conduct. Retrieved from http://www.apa.org/ethics/code/index.aspx#
3. Arthur, W., Jr., Bennett, W., Jr., Stanush, P. L., & McNelly, T. L. (1998). Factors that influence skill decay and retention: A quantitative review and analysis. Human Performance, 11, 57-101.
4. Atkins, P. W. B., & Wood, R. E. (2002). Self- versus others' ratings as predictors of assessment center ratings: Validation evidence for 360-degree feedback programs. Personnel Psychology, 55, 871-904.
5. Atwater, L. E., & Brett, J. F. (2005). Antecedents and consequences of reactions to developmental 360-degree feedback. Journal of Vocational Behavior, 66, 532-548.
6. Atwater, L., & Brett, J. (2006). 360 degree feedback to managers: Does it result in changes in employee attitudes? Group & Organizational Management, 31, 578-600.
7. Atwater, L. A., Waldman, D., Atwater, D., & Cartier, P. (2000). An upward feedback field experiment. Supervisors' cynicism, follow-up and commitment to subordinates. Personnel Psychology, 53, 275-297.
8. Atwater, L., Brett, J., & Charles, A. (2007). Multi-source feedback: Lessons learned, and implications for practice. Human Resource Management Journal, 46, 285-307.
9. Atwater, L., Ostroff, C., Yammarino, F. J., & Fleenor, J. (1998). Self-other agreement: Does it really matter?. Personnel Psychology, 51, 577-598.
10. Atwater, L., Waldman, D., Ostroff, C., Robie, C., & Johnson, K. M. (2005). Self-other agreement: Comparing its relationship with performance in the U.S. and Europe. International Journal of Selection and Assessment, 13, 25-40.
11. Atwater, L., Wang, M., Smither, J., & Fleenor, J. (2009). Are cultural characteristics associated with the relationship between self and others' rating of leadership? Journal of Applied Psychology, 4, 876-886.
12. Bandalos, D. L., & Enders, C. K. (1996). The effects of non-normality and number of response categories on reliability. Applied Measurement in Education, 9, 151-160.
13. Bandura, A. (1977). Self-Efficacy: Toward a unifying theory of behavior change. Psychological Review, 84, 191-215.
14. Bartram, D. (2005). The Great 8 competencies: A criterion-centric approach to validation. Journal of Applied Psychology, 90, 1185-1203.
15. Becker, M. H. (1974). The Health Belief Model and Personal Health Behaviour. Health Education Monographs, 2, 324-473.
16. Beehr, T. A., Ivanitskaya, L., Hansen, C. P., Erofeev, D., & Gudanowski, D. M. (2001). Evaluation of 360 degree feedback ratings: Relationships with each other and with performance and selection predictors. Journal of Organizational Behavior, 22, 775-788.
17. Bell, S. T., & Arthur, W. A. (2008). Feedback acceptance in developmental assessment centers: The role of feedback message, participant personality, and affective response to the feedback session. Journal of Organizational Behavior, 29, 681-703.
18. Bonezzi, A., Brendl, C. M., & De Angelis, M. (2011). Stuck in the middle: The psychophysics of goal pursuit. Psychological Science, 22, 607-612.
19. Bono, J., & Colbert, A. (2005). Understanding responses to multi-source feedback: The role of core selfevaluations. Personnel Psychology, 58, 171-203.
20. Boyatzis, R. E. (2008). Leadership development from a complexity perspective. Consulting Psychology Journal: Practice and Research, 60, 298-313.
21. Boyatzis, R. E., & Akrivou, K. (2006). The ideal self as a driver of intentional change. Journal of Management Development, 25, 624-642.
22. Bracken, D. W., & Rose, D. S. (2011). When does 360-degree feedback create behavior change? And how would we know it when it does? Journal of Business and Psychology, 26, 183-192.
23. Bracken, D. W., Timmreck, C. W., Fleenor, J. W., & Summers, L. (2001). 360 feedback from another angle. Human Resources Management, 40, 3-20.
24. Brett, J., & Atwater, L. (2001). 360-degree feedback: Accuracy, reactions and perceptions of usefulness. Journal of Applied Psychology, 86, 930-942.
25. Caputo, P. M., & Roch, S. (2009, April). Rating formats and perceptions of performance appraisal fairness. Poster presented at the 24th meeting of the Society for Industrial and Organizational Psychology, New Orleans, LA.
26. Chang, L. (1994). A psychometric evaluation of 4-point and 6-point Likert-type scales in relation to reliability and validity. Applied Psychological Measurement, 18, 205-215.
27. Chemers, M. M., Watson, C. B., & May, S. T. (2000). Dispositional affect and leadership effectiveness: A comparison of self-esteem, optimism, and efficacy. Personality and Social Psychology Bulletin, 26, 267-277.
28. Chen, Z., Williams, K., Fitness, J., & Newton, N. (2008). When hurt will not heal. Exploring the capacity to relive social and physical pain. Psychological Perspectives, 19, 789-795.
29. Chiaburu, D. S., & Marinova, S. V. (2005). What predicts skill transfer? An exploratory study of goal orientation, training self-efficacy and organizational supports. International Journal of Training and Development, 9, 110-123.
30. Chiaburu, D. S., Van Dam, K., & Hutchins, H. M. (2010). Social support in the workplace and training transfer: A longintudinal analysis. International Journal of Selection and Assessment, 18, 187-200. doi:10.111/ j.1468-2389.2010.00500.x
31. Cicchetti, D. V., Showalter, D., & Tyrer, P. J. (1985). The effect of number of rating scale categories on levels of interrater reliability: A Monte Carlo investigation. Applied Psychological Measurement, 9, 31-36.
32. Conway, J., & Huffcutt, A. (1997). Psychometric properties of multi-source performance ratings: A metaanalysis of subordinate, supervisor, peer and self-ratings. Human Performance, 10, 331-360.
33. Conway, J. M., Lombardo, K., & Sanders, K. C. (2001). A meta-analysis of incremental validity and nomological networks for subordinate and peer ratings. Human Performance, 14, 267-303.
34. Cools, W., Hofmans, J., & Theuns, P. (2006). Context in category scales: Is "fully agree" equal to twice agree? European Review of Applied Psychology, 56, 223-229.
35. Craig, S. B., & Hannum, K. (2006). Research update: 360-degree performance assessment. Consulting Psychology Practice and Research, 58, 117-122.
36. Dai, G., Stiles, P., Hallenbeck, G., & De Meuse, K. P. (2007, August). Self-other agreement on leadership competency ratings: The moderating effects of rater perspectives and rating ambiguity. Paper presented at the 2007 Annual Meeting of the Academy of Management, Philadelphia, PA.
37. Dawes, J. (2008). Do data characteristics change according to the number of scale points used? An experiment using 5-point, 7-point and 10-point scales. International Journal of Market Research, 50, 61-77.
38. DeWall, C. N., MacDonald, G., Webster, G., Masten, C. L., Baumeister, R. F., Powell C, . . . Eisenberger, N. I. (2010). Acetaminophen reduces social pain: Behavioral and neural evidence. Psychological Science, 21, 931-937. doi:10.1177/0956797610374741
39. 3D Group. (2009). Current practices in 360-degree feedback: A benchmark study of North American Companies. 3D Group Tech. Rep. No. #8326. Berkeley, CA: Data Driven Decisions, Inc.
40. Dickerson, S., & Kemeny, M. (2004). Acute stressors and cortisol responses: A theoretical integration and synthesis of laboratory research. Psychological Bulletin, 130, 355-391.
41. Dunning, D., Heath, C., & Suls, J. (2004). Flawed self-assessment: Implications for health, education and the workplace. Psychological Science in the Public Interest, 5, 69-106.
42. Dweck, C. S. (1986). Motivational processes affecting learning. American Psychologist, 41, 1040-1048.
43. Eckert, R., Ekelund, B., Gentry, W., & Dawson, J. (2010). I don't see me like you see me but is that a problem? Cultural differences in rating discrepancy in 360-degree feedback instruments. European Journal of Work and Organizational Psychology, 19, 259-278.
44. Eisenberger, N. I., Lieberman, M. D., & Williams, K. D. (2003). Does rejection hurt? An fMRI study of social exclusion. Science, 302, 290-292.
45. English, A., Rose, D., & McClellan, J. (2009, June). Rating scale label effects on leniency bias in 360-degree feedback. Paper presented at the 24th Annual Meeting of the Society for Industrial Organizational Psychologist. New Orleans, LA.
46. Ericsson, K. (2006). The influence of experience and deliberate practice on the development of superior expert performance. In K. A. Ericsson et al., (Eds.), The Cambridge handbook of expertise and expert performance (pp. 683-703). New York, NY: Cambridge University.
47. Fleenor, J., Taylor, S., & Chappelow, C. (2008). Leveraging the impact of 360-degree feedback. New York, NY: Wiley.
48. Fredrickson, B. L., & Losada, M. (2005). Positive affect and the complex dynamics of human flourishing. American Psychologist, 60, 678-686.
49. Gentry, W. A., & Eckert, R. H. (2012). Integrating ILTs and fit into the development of global leaders: A 360-degree approach. Industrial and Organizational Psychology: Perspectives on Science and Practice, 5, 226-229.
50. Gentry, W. A., Hannum, K. M., Ekelund, B. Z., & de Jong, A. (2007). A study of the discrepancy between selfand observer-ratings on managerial derailment characteristics of European managers. European Journal of Work and Organizational Psychology, 16, 295-325.
51. Gentry, W. A., Yip, J., & Hannum, K. (2010). Self-observer rating discrepancies of managers in Asia: A study of derailment characteristics and behaviors in Southern Confucian Asia. International Journal of Selection and Assessment, 18, 237-250.
52. Goffin, R. D., & Anderson, D. W. (2002, June). Differences in self and superior ratings of performance: Personality provides clues. Paper presented at the Society for Industrial and Organizational Psychology, Toronto, Canada.
53. Goffin, R. D., & Anderson, D. W. (2007). The self-rater's personality and self-other disagreement in multisource performance ratings: Is disagreement healthy? Journal of Managerial Psychology, 22, 271-289.
54. Goffin, R. D., & Olson, J. M. (2011). Is it all relative? Comparative judgments and the possible improvement of self-ratings and ratings of others. Perspective on Psychological Science, 6, 48-60.
55. Goldsmith, M. (2009). How to spot the "uncoachables". Retrieved from http://blogs.hbr.org/goldsmith/2009/03/how_to_spot_the_uncoachables.html
56. Gollwitzer, P. M., & Sheeran, P. (2009). Self-regulation of consumer decision making and behavior: The role of implementation intentions. Journal of Consumer Psychology, 19, 593-607.
57. Gottman, J. M. (1994). What predicts divorce? The relationship between marital processes and marital outcomes. Hillsdale, NJ: Erlbaum.
58. Gregory, J. B., Levy, P. E., & Jeffers, M. (2008). Development of the feedback process within executive coaching. Consulting Psychology Journal: Practice and Research, 60, 42-56.
59. Greguras, G. J., & Robie, C. (1995). A new look at within-rater source inter-rater reliability of 360-degree feedback ratings. Journal of Applied Psychology, 83, 960-968.
60. Grossman, R., & Salas, E. (2011). The transfer of training: What really matters. International Journal of Training and Development, 15, 103-120.
61. Hannah, S., Avolio, B. J., Luthans, F., & Harms, P. (2008). Leadership efficacy: Review and future directions. Leadership Quarterly, 19, 669-692.
62. Harris, L. S., & Kuhnert, K. W. (2007). Looking through the lens of leadership: A constructive developmental approach. Leadership & Organization Development Journal, 29, 47-67.
63. Harris, M., & Schaubroeck, J. (1988). A meta-analysis of self-supervisor, self-peer and peer supervisor ratings. Personnel Psychology, 41, 43-62.
64. Heidemeier, H., & Moser, K. (2009). Self-other agreement in job performance ratings: A meta-analytic test of a process model. Journal of Applied Psychology, 94, 353-370.
65. Hirsh, J. B., & Inzlicht, H. (2008). The devil you know: Neuroticism predicts neural response to uncertainty. Psychological Science, 19, 962-967.
66. Hoffman, B. J., & Baldwin, S. P. (2012). Modern managerial assessment: A comparison of assessment centers and multisource feedback. In G. Thornton, & N. Povah (Eds.), Assessment centers and global talent management (pp. 143-162). Burlington, VT: Gower.
67. Hoffman, B. J., Gorman, C. A., Blair, C. A., Meriac, J. P., Overstreet, B., & Atchley, E. K. (2012). Evidence for the effectiveness of an alternative multisource performance rating methodology. Personnel Psychology, 65, 531-563.
68. Hoffman, B. J., Lance, C. E., Bynum, B., & Gentry, W. (2010). Rater source effects are alive and well after all. Personnel Journal, 63, 119-151.
69. Hoffman, B. J., & Woehr, D. J. (2009). Disentangling the meaning of multisource performance rating source and dimension factors. Personnel Psychology, 62, 735-765.
70. Hofstede, G., & McRae, R. R. (2004). Personality and culture revisited: Linking traits and dimensions of culture. Cross-Cultural Research, 38, 52-88. doi:10.1177/1069397103259443
71. Hogan, R. (2007). Personality and the fate of organizations. Hillsdale, NJ: Erlbaum.
72. Hogan, R., & Kaiser, R. (2005). What we know about leadership. Review of General Psychology, 9, 169-180.
73. Holt, K., & Seki, K. (2012). Global leadership: A developmental shift for everyone. Industrial and Organizational Psychology: Perspectives on Science and Practice, 5, 198-217.
74. Hooijberg, R., & Lane, N. (2009). Using multisource feedback coaching effectively in executive education. Academy of Management Learning and Education, 8, 483-493.
75. Hyman, D. J., Pavlik, V. N., Taylor, W. C., Goodrich, G. K., & Moye, L. (2007). Simultaneous versus sequential counseling for multiple behavioral change. Archives of Internal Medicine, 167, 1152-1158.
76. Ilgen, D., & Davis, C. (2000). Bearing bad news: Reactions to negative performance feedback. Applied Psychology: An International Review, 49, 550-565.
77. Inceoglu, I., & Externbrink, K. (2012, April). Leadership development: Who knows best how well the highflyers perform? Paper presented at the 27th Annual Conference of the Society for Industrial and Organizational Psychology, San Diego, CA.
78. Joo, B. K. (2005). Executive coaching: A conceptual framework from an integrative review of research and practice. Human Resource Development Review, 4, 134-144.
79. Jordan, A., & Audia, P. (2012). Self-enhancement and learning from performance feedback. Academy of Management Review, 37, 211-231.
80. Kaiser, R., & Overfield, D. (2011). Strengths, strengths overused, and lopsided leadership. Consulting Psychology Journal: Practice and Research, 63, 89-109.
81. Kaiser, R. B., & Craig, S. B. (2005). Building a better mouse trap: Item characteristics associated with rating discrepancies in 360-degree feedback. Consulting Psychology Journal: Practice and Research, 57, 235-245.
82. Kaplan, R. E., & Kaiser, R. B. (2009). Stop overdoing your strengths. Harvard Business Review, 87, 100-103.
83. Klockner, K., & Hicks, R. E. (2008). My next client: Understanding the Big Five and positive personality dispositions of those seeking psychological support interventions. International Coaching Psychology Review, 3, 148-163.
84. Kluger, A. N., & DeNisi, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback theory. Psychological Bulletin, 119, 254-284.
85. Lally, P., Van Jaarsveld, C., Potts, H., & Wardle, J. (2009). How are habits formed: Modeling habit formation in the real world. European Journal of Social Psychology, 1009, 998-1009.
86. Lance, C. E., Hoffman, B. J., Gentry, W., & Baranik, L. E. (2008). Rater source factors represent important subcomponents of the criterion construct space, not rater bias. Human Resources Management Review, 18, 223-232.
87. Law, K. S., Wong, C., & Song, L. J. (2004). The construct and criterion validity of emotional intelligence and its potential utility for management studies. Journal of Applied Psychology, 89, 483-496.
88. Lawton, R., Conner, M., & McEachan, R. (2009). Desire or reason: Predicting health behaviors from affective and cognitive attitudes. Health Psychology, 28, 56-65.
89. Le, H., OH, I. S., Shaffer, J. A., & Schmidt, F. L. (2007). Implications of methodological advances for the practice of personnel selection: How practitioners benefit from recent developments in meta-analysis. Academy of Management Perspectives, 21, 6-15.
90. Lebreton, J. M., Burgess, R. D., Kaiser, R. B., Atchley, E. K., & James, L. R. (2003). The restriction of variance hypothesis and interrater reliability and agreement: Are ratings from multiple sources really dissimilar? Organizational Research Methods, 6, 80-112.
91. Lehman, B. J., & Conley, K. M. (2010). Momentary reports of social-evaluative threat predict ambulatory blood pressure. Psychological Science and Personality Science, 1, 51-56. doi:10.1177/1948550609354924
92. Leonardelli, G. J., Herman, A. D., Lynch, M. E., & Arkin, R. M. (2003). The shape of self-evaluation: Implicit theories of intelligence and judgments of intellectual ability. Journal of Research in Personality, 37, 141-168.
93. Liao, S. C., Hunt, E. A., & Chen, W. Comparison between inter-rater reliability and inter-rater agreement in performance assessment. Annals of the Academy of Medicine, Singapore. 39, 613-618.
94. Libretto, J. M., Burgess, J. R. D., Kaiser, R. B., Archly, E. K., & James, L. R. (2003). The restriction of variance hypothesis and interpreter reliability and agreement: Are ratings from multiple sources really dissimilar? Organizational Research Methods, 6, 80-128.
95. London, M., & Smither, J. W. (2002). Feedback orientation, feedback culture and the longitudinal performance management process. Human Resource Management Review, 12, 81-100.
96. Losada, M., & Heaphy, E. (2004). The role of positivity and connectivity in the performance of business teams: A nonlinear dynamics model. American Behavioral Scientist, 47, 740-765.
97. Lozano, L. M., Garcia-Cueto, E., & Muniz, J. (2008). Effect of the number of response categories on the reliability and validity of rating scales. European Journal of Research Methods for the Behavioral and Social Sciences, 4, 73-79.
98. Martin, H. J. (2010). Workplace climate and peer support as determinants of training transfer. Human Resource Development Quarterly, 21, 87-104.
99. Mashihi, S., & Nowack, K. (2011). Clueless: Coaching people who just don't get it. Santa Monica, CA: Envisia Learning, Inc.
100. Morgeson, F. P., Mumford, T. V., & Campion, M. A. (2005). Coming full circle: Using research and practice to address 27 questions about 360-degree feedback programs. Consulting Psychology Journal: Practice and Research, 57, 3, 196-209.
101. Mund, M., & Mitte, K. (2011). The costs of repression: A meta-analysis on the relation between repressive coping and somatic diseases. Health Psychology, Advance online publication. doi:10.1037/a0026257
102. Murphy, K. R. (2008). Explaining the weak relationship between job performance and ratings of job performance. Industrial and Organizational Psychology, 1, 148-160.
103. Murphy, K. R., Cleveland, J. N., & Mohler, C. (2001). Reliability, validity and meaningfulness of multisource ratings. In D. Bracken, C. Timmreck, and A. Church (Eds.), Handbook of multisource feedback (pp. 130-148). San Francisco, CA: Jossey-Bass.
104. Nieman-Gonder, J., Metlay, W., Kaplan, I., & Wolfe, K. (2006, May). The effect of rater selection on rating accuracy. Poster presented at the 21st Annual Conference of the Society for Industrial and Organizational Psychology, Dallas, TX.
105. Nowack, K. (1992). Self-assessment and rater assessment as a dimension of management development. Human Resources Development Quarterly, 3, 141-155.
106. Nowack, K. (1999). 360 Degree feedback. Intervention: 50 performance technology tools (pp. 34-46). San Francisco, CA, Jossey-Bass, Inc.
107. Nowack, K. (2002). Does 360-degree feedback negatively affect company performance: Feedback varies with your point of view. HR Magazine, 47, 6.
108. Nowack, K. (2003). Executive coaching: Fad or future? California Psychologist, 36, 16-17.
109. Nowack, K. (2005, March). Longitudinal evaluation of a 360 degree feedback program: Implications for best practices. Paper presented at the 20th Annual Conference of the Society for Industrial and Organizational Psychology, Los Angeles.
110. Nowack, K. (2009). Leveraging multirater feedback to facilitate successful behavioral change. Consulting Psychology Journal: Practice and Research, 61, 280-297.
111. Nowack, K. (2011). Leveraging 360-degree feedback using an online goal setting and tracking system. Unpublished manuscript, Envisia Learning, Inc., Los Angeles, CA.
112. Nowack, K., Hartley, J., & Bradley, W. (1999). Evaluating results of your 360-degree feedback intervention. Training and Development, 53, 48-53.
113. Olivero, G., Bane, D., & Kopelman, R. (1997). Executive coaching as a transfer of training tool: Effects on productivity in a public agency. Public Personnel Management, 26, 461-469.
114. Ones, D. S., Viswesvaran, C., & Schmidt, F. L. (2008). No new terrain: Reliability and construct validity of job performance ratings. Industrial and Organizational Psychology, 1, 174-179.
115. Ostroff, C., Atwater, L., & Feinberg, B. (2004). Understanding self-other agreement: A look at rater and ratee characteristics, context and outcomes. Personnel Psychology, 57, 333-375.
116. Pearce, C. L., Sims, H. P., Cox, J. F., Ball, G., Schnell, E., Smith, K. A., & Trevino, L. (2003). Transactors, transformers, and beyond. Journal of Management Development, 22, 273-308.
117. Preston, C. C., & Colman, A. M. (2000). Optimal number of response categories in rating scales: Reliability, validity, discriminating power, and respondent preferences. Acta Psychologica, 104, 1-15.
118. Prochaska, J. O., & Velicer, W. F. (1997). The transtheoretical model of health behaviour change. American Journal of Health Promotion, 12, 38-48.
119. Quast, L. N., Center, B. A., Chung, C., Wohkittel, J. M., & Vue, B. (2011, February). Using multi-rater feedback to predict managerial career derailment: A model of self-boss rating patterns. Paper presented at the 2011 Academy of Human Resource Development International Research Conference in the Americas, Chicago, IL.
120. Quast, L. N., Wohkittel, J. M., Chung, C., & Center, B. A. (2011, December). Patterns of self-other rating discrepancies and predictions of managerial career derailment: Comparing Asia to the United States. Paper presented at the 10th International Conference of the Academy of HRD (Asia chap.) International Research Conference, Kuala Lumpur, Malaysia.
121. Rehbine, N. (2007). The impact of 360-degree feedback on leadership development. (Unpublished doctoral dissertation). Capella University, Minneapolis, MN.
122. Reilly, R. R., Smither, J. W., & Vasilopoulos, N. L. (1996). A longitudinal study of upward feedback. Personnel Psychology, 49, 599-612.
123. Rhodes, R. E., Plotnikoff, R. C., & Courneya, K. S. (2008). Predicting the physical activity intention-behaviorof adopters and maintainers using three social cognition models. Annals of Behavioral Medicine, 36, 244-252.
124. Robie, S., Kaster, K., Nilsen, D., & Hazucha, J. (2000). The right stuff: Understanding cultural differences in leadership performance. Unpublished manuscript, Personnel Decisions, Inc., Minneapolis, MN.
125. Roch, S. G., Sternburgh, A. M., & Caputo, P. M. (2007). Absolute vs. relative performance rating formats: Implications for fairness and organizational justice. International Journal of Selection and Assessment, 15, 302-316.
126. Rock, D. (2008). SCARF: A brain-based model for collaborating with and influencing others. Neuroleadership Journal, 1, 44-52.
127. Rutledge, T. (2006). Defensive personality effects on cardiovascular health: A review of the evidence. In D. Johns (Ed.), Stress and its impact on society (pp. 1-21). Hauppauge, NY: Nova Science Publishers.
128. Sala, F., & Dwight, S. (2002). Predicting executive performance with multi-rater surveys: Whom you ask makes a difference. Journal of Consulting Psychology: Research and Practice, 54, 166-172.
129. Schwartz, R. M., Reynolds, C. F., III., Thase, M. E., Frank, E., Fasiczka, A. L., & Haaga, D. A. F. (2002). Optimal and normal affect balance in psychotherapy of major depression: Evaluation of the balanced states of mind model. Behavioural and Cognitive Psychotherapy, 30, 439-450.
130. Scullen, S. E., Mount, M. K., & Goff, M. (2000). Understanding the latent structure of job performance ratings. Journal of Applied Psychology, 85, 956-970.
131. Sherman, S., & Freas, A. (2004). The Wild West of executive coaching. Harvard Business Review, 82, 82-90.
132. Shipper, F., Hoffman, R., & Rotondo, D. (2007). Does the 360 feedback process create actionable knowledge equally across cultures? Academy of Management Learning & Education, 6, 33-50.
133. Siefert, C., Yukl, G., & McDonald, R. (2003). Effects of multisource feedback and a feedback facilitator on the influence of behavior of managers toward subordinates. Journal of Applied Behavior, 88, 561-569.
134. Smither, J., Brett, J., & Atwater, L. (2008). What do leaders recall about multi- source feedback? Journal of Leadership and Organization Studies, 14, 202-218.
135. Smither, J., London, M., Flautt, R., Vargas, Y., & Kucine, I. (2003). Can working with an executive coach improve multisource feedback ratings over time? A quasi-experimental field study. Personnel Psychology, 56, 23-44.
136. Smither, J., London, M., & Reilly, R. (2005). Does performance improve following multisource feedback? A theoretical model, meta-analysis, and review of empirical findings. Personnel Psychology, 58, 33-66.
137. Smither, J., & Walker, A. G. (2004). Are the characteristics of narrative comments related to improvement in 360-degree feedback ratings over time? Journal of Applied Psychology, 89, 575-581.
138. Smither, J., Walker, A., & Yap, M. (2004). An examination of web based versus paper and pencil upward feedback ratings. Educational and Psychological Measurement, 64, 40-61.
139. Taylor, P., Taylor, H., & Russ-Eft, D. (2009). Transfer of management training from alternate perspectives. Journal of Applied Psychology, 94, 104-121.
140. Thach, E. (2002). The impact of executive coaching and 360-feedback on leadership effectiveness. Leadership and Organization Development Journal, 23, 205-214.
141. Varela, O. E., & Premeaux, S. F. (2008). Do cross-cultural values affect multisource feedback dynamics? The case of high power distance and collectivism in two Latin American countries. International Journal of Selection and Assessment, 16, 134-142.
142. Vecchio, R. P., & Anderson, R. J. (2009). Agreement in self- other ratings of leader effectiveness: The role of demographics and personality. International Journal of Selection and Assessment, 17, 165-179.
143. Viswanathan, M., Bergen, M., Dutta, S., & Childres, T. (1996). Does a single response category in a scale completely capture a response? Psychology and Marketing, 13, 457-479.
144. Viswesvaran, C., Schmidt, F. L., & Ones, D. S. (2002). The moderating influence of job performance dimensions on convergence of supervisory and peer ratings of job performance: Unconfounding construct-level convergence and rating difficulty. Journal of Applied Psychology, 87, 345-354.
145. Viswesvaran, C., Schmidt, F. L., & Ones, D. S. (2005). Is there a general factor in ratings of job performance? A meta-analytic framework for disentangling substantive and error influences. Journal of Applied Psychology, 90, 108-131.
146. Wanguri, D. M. (1995). A review, an integration, and a critique of cross-disciplinary research on performance appraisals, evaluations, and feedback: 1980-1990. The Journal of Business Communication, 32, 267-293.
147. Weng, L. (2004). Impact of the number of response categories and anchor labels on coefficient alpha and test-retest reliability. Educational and Psychological Measurement, 64, 956-972.
148. Wikman, A., & Warneryd, B. (1990). Measurement errors in survey questions: Explaining response variability. Social Indicators Research, 2, 199-212.
149. Wilson, A. E., & Ross, M. (2001). From chump to champ: People's appraisals of their earlier and present selves. Journal of Personality and Social Psychology, 80, 572-584
150. Woehr, D. J. (2008). On the relationship between job performance ratings and ratings of job performance: What do we really know? Industrial and Organizational Psychology: Perspectives on Science and Practice, 1, 161-166.
151. Woo, S., Sims, C., Rupp, D., & Gibbons, A. (2008). Development engagement within and following developmental assessment centers: Considering feedback favorability and self-assessor agreement. Personnel Psychology, 61, 727-759.
152. Yukl, G., Gordon, A., & Taber, T. (2002). A hierarchical taxonomy of leadership behavior: Integrating a half century of behavior research. Journal of Leadership and Organizational Studies, 9, 15-32.