Leader behaviors and career derailment potential: A multi-analytic method examination of rating source and self-other agreement

Leadership Quarterly

Volumn 25, Issue 2, 2014, Pages 373-390

  Braddy, Phillip W ^b   Gooty, Janaki ^a   Fleenor, John W ^b   Yammarino, Francis J ^c  

^a UNIVERSITY OF NORTH CAROLINA AT CHARLOTTE   (United States)

^b CENTER FOR CREATIVE LEADERSHIP   (United States)

^c BINGHAMTON UNIVERSITY   (United States)

Author keywords

Career derailment potential; Multi level issues; Multi source ratings; Self other rating agreement

Indexed keywords

EID: 84897649994     PISSN: 10489843     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.leaqua.2013.10.001     Document Type: Article

References (62)

1. Anand S., Vidyarthi P.R., Liden R.C., Rousseau D.M. Good citizens in poor-quality relationships: Idiosyncratic ideals as a substitute for relationship quality. Academy of Management Journal 2010, 53:970-988.
2. Atwater L., Ostroff C., Yammarino F., Fleenor J. Self-other agreement: Does it matter?. Personnel Psychology 1998, 51:577-598.
3. Atwater L., Roush P., Fischthal A. The influence of upward feedback on self- and follower ratings of leadership. Personnel Psychology 1995, 48:35-59.
4. Atwater L., Waldman D., Ostroff C., Robie C., Johnson K.M. Self-other agreement: Comparing its relationship with performance in the US and Europe. International Journal of Selection and Assessment 2005, 13(1):25-40.
5. Atwater L., Wang M., Smither J.W., Fleenor J.W. Are cultural characteristics associated with the relationship between self and others' ratings of leadership?. Journal of Applied Psychology 2009, 94:876-886.
6. Atwater L.E., Yammarino F.J. Does self-other agreement on leadership perceptions moderate the validity of leadership and performance predictions?. Personnel Psychology 1992, 45:141-164.
7. Bass B.M. Handbook of leadership 2008, Free Press, New York.
8. Bryk A.S., Raudenbush S.W. Hierarchical linear models 1992, Sage, Newbury Park, CA.
9. Carty H.M. Review of Benchmarks [revised]. The fifteenth mental measurements yearbook 2003, 123-124. Buros Institute of Mental Measurements, Lincoln, NE. B.S. Plake, J. Impara, R.A. Spies (Eds.).
10. Center for Creative Leadership Benchmarks facilitator's guide 2007, Center for Creative Leadership, Greensboro, NC.
11. Conway J.M., Huffcutt A.I. Psychometric properties of multi-source performance ratings: A meta-analysis of subordinate, supervisor, peer, and self-ratings. Human Performance 1997, 10:331-360.
12. Day D.V. Leadership development: A review in context. The Leadership Quarterly 2000, 11:581-614.
13. Derue D.S., Nahrgang J.D., Wellman N., Humphrey S.E. Trait and behavioral theories of leadership: An integration and meta-analytic test of their relative validity. Personnel Psychology 2011, 64:7-52.
14. Edwards J.R. The study of congruence in organizational behavior research: Critique and proposed alternative. Organizational Behavior and Human Decision Processes 1994, 58:51-100.
15. Edwards J.R. Excel file for plotting response surfaces Retrieved on Aug. 24, 2011 from. http://public.kenan-flagler.unc.edu/faculty/edwardsj/surface.xls.
16. Feinberg B., Ostroff C., Burke W.W. The role of within-group agreement in understanding transformational leadership. Journal of Occupational and Organizational Psychology 2005, 78:471-488.
17. Ferris G.R., Treadway D.C., Kolodinsky R.W., Hochwarter W.A., Kacmar C.J., Douglas C., et al. Development and validation of the political skill inventory. Journal of Management 2005, 31:126-152.
18. Fiedler F.E. A theory of leadership effectiveness 1967, McGraw-Hill Education, New York.
19. Fleenor J.W., McCauley C.D., Brutus S. Self-other rating agreement and leader effectiveness. The Leadership Quarterly 1996, 7:487-506.
20. Fleenor J.W., Smither J.W., Atwater L.E., Braddy P.W., Strum R.E. Self-other rating agreement in leadership: A review. The Leadership Quarterly 2010, 21:1005-1034.
21. Gentry W.A., Hannum K.M., Ekelund B.Z., de Jong A. A study of the discrepancy between self- and observer-ratings on leader derailment characteristics of European managers. European Journal of Work and Organizational Psychology 2007, 16:295-325.
22. Gentry W.A., Shanock L.R. Views of managerial derailment from above and below: The importance of a good relationship with upper management and putting people at ease. Journal of Applied Social Psychology 2008, 38:2469-2494.
23. Gerstner C.R., Day D.V. Meta-Analytic review of leader-member exchange theory: Correlates and construct issues. Journal of Applied Psychology 1997, 82(6):827.
24. Heidemeier H., Moser K. Self-other agreement in job performance ratings: A meta-analytic test of a process model. Journal of Applied Psychology 2009, 92:353-370.
25. Hoffman B., Lance C.E., Bynum B., Gentry W.A. Rater source effects are alive and well after all. Personnel Psychology 2010, 63(1):119-151.
26. Hollander E.P. Military research and industrial implications. Personnel Psychology 1954, 7:385-393.
27. Hooijberg R., Choi J. Which leadership roles matter to whom? An examination of rater effects on perceptions of effectiveness. The Leadership Quarterly 2000, 11:341-363.
28. Hu L., Bentler P.M. Cutoff criteria for fit indices in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling 1999, 6:1-55.
29. Johnson J.W. A heuristic method for estimating the relative weight of predictor variables in multiple regression. Multivariate Behavioral Research 2000, 35:1-19.
30. Johnson J.W. Determining the relative importance of predictors in multiple regression: Practical applications of relative weights. Advances in psychology research 2001, Vol. V:231-251. Nova Science Publishers, Inc., Huntington, NY.
31. Johnson J.W., LeBreton J.M. History and use of relative importance indices in organizational research. Organizational Research Methods 2004, 7:238-257.
32. Judge T.A., LePine J.A., Rich B.L. Loving yourself abundantly: Relationship of the narcissistic personality to self- and other perceptions of workplace deviance, leadership, and task and contextual performance. Journal of Applied Psychology 2006, 91:762-776.
33. Judge T.A., Piccolo R.F., Ilies R. The forgotten ones? The validity of consideration and initiating structure in leadership research. Journal of Applied Psychology 2004, 89:36-51.
34. Kamdar D., Van Dyne L. The joint effects of personality and workplace social exchange relationships in predicting task performance and citizenship performance. Journal of Applied Psychology 2007, 92:1286-1298.
35. Lance C.E., Hoffman B.J., Gentry W.A., Baranik L.E. Rater source factors represent important subcomponents of the criterion construct space, not rater bias. Human Resource Management Review 2008, 18:223-232.
36. LeBreton J.M., Burgess J.R., Kaiser R.B., Atchley E.K., James L.R. The restriction of variance hypothesis and interrater reliability and agreement: Are ratings from multiple sources really dissimilar?. Organizational Research Methods 2003, 6:80-128.
37. LeBreton J.M., Hargis M.B., Griepentrog B., Oswald F.L., Ployhart R.E. A multidimensional approach for evaluating variables in organizational research and practice. Personnel Psychology 2007, 60:475-498.
38. LeBreton J.M., Senter J.L. Answers to 20 questions about interrater reliability and agreement. Organizational Research Methods 2008, 11:815-852.
39. Leslie J.B., Fleenor J.W. Feedback to managers: A review and comparison of multi-rater instruments for management development 1998, Center for Creative Leadership, Greensboro, NC.
40. Leslie J.B., Van Velsor E. A look at derailment today: North America and Europe (No. 169) 1996, Center for Creative Leadership, Greensboro, NC.
41. Lewin A.Y., Zwany A. Peer nominations: A model, literature critique and a paradigm for research. Personnel Psychology 1976, 29:423-447.
42. Lindell M.K., Brandt C.J., Whitney D.J. A revised index of interrater agreement for multi-item ratings of a single target. Applied Psychological Measurement 1999, 23:127-135.
43. Linderbaum B.A., Levy P.E. The development and validation of the feedback orientation scale (FOS). Journal of Management 2010, 36:1372-1405.
44. Lombardo M.M., McCauley C.D. The dynamics of management derailment. (Report No. 34) 1988, Center for Creative Leadership, Greensboro, NC.
45. McCall M., Lombardo M. Off the track: Why and how successful executives get derailed 1983, Center for Creative Leadership, Greensboro, NC.
46. McCauley C.D., Lombardo M. Benchmarks: An instrument for diagnosing leader strengths and weaknesses. Measures of leadership 1990, 535-545. Leadership Library of America, West Orange, NJ. K.E. Clark, M.B. Clark (Eds.).
47. Morrison A.M., White R.P., Van Velsor E. Breaking the glass ceiling: Can women reach the top of America's largest corporations? 1987, Addison-Wesley, Reading, MA.
48. Mumford T.V., Campion M.A., Morgeson F.P. The leadership skills strataplex: Leadership skill requirements across organizational levels. The Leadership Quarterly 2007, 18:154-166.
49. Oltmanns T.F., Turkheimer E. Person perception and personality pathology. Current Directions in Psychological Science 2009, 18:32-36.
50. Ostroff C., Atwater L.E., Feinberg B.J. Understanding self-other agreement: A look at rater and ratee characteristics, context, and outcomes. Personnel Psychology 2004, 57:333-375.
51. Raudenbush S.W., Bryk A.S. Hierarchical linear models: Applications and data analysis methods 2002, Sage, Thousand Oaks, CA. 2nd ed.
52. Scullen S.E., Mount M.K., Judge T.A. Evidence of the construct validity of developmental ratings of managerial performance. Journal of Applied Psychology 2003, 88(1):50-66.
53. Shanock L.R., Baran B.E., Gentry W.A., Heggestad E.D., Pattison S.C. Polynomial regression with response surface analysis: A powerful approach for examining moderation and overcoming limitations of difference scores. Journal of Business and Psychology 2010, 25:543-554.
54. Smither J.W., London M., Reilly R.R. Does performance improve following multisource feedback? A theoretical model, meta-analysis and review of empirical findings. Personnel Psychology 2005, 58:33-66.
55. Spangler M. Review of Benchmarks [revised]. The fifteenth mental measurements yearbook 2003, 124-126. Buros Institute of Mental Measurements, Lincoln, NE. B.S. Plake, J. Impara, R.A. Spies (Eds.).
56. Stodgill R.M. Manual for Leadership Behavior Description, Questionnaire-Form XII: An experimental revision, Bureau of Business Research 1963, The Ohio State University, Columbus, OH.
57. Thompson B., Borrello G.M. The importance of structure coefficients in regression research. Educational and Psychological Measurement 1985, 45:203-209.
58. Tonidandel S., LeBreton J.M., Johnson J.W. Determining the statistical significance of relative weights. Psychological Methods 2009, 14:387-399.
59. Yammarino F.J., Dansereau F. Multi-level nature of and multi-level approaches to leadership. The Leadership Quarterly 2008, 19:135-141.
60. Yammarino F.J., Dionne S.D., Chun J.U., Dansereau F. Leadership and levels of analysis: A state-of-the-science review. The Leadership Quarterly 2005, 16:879-919.
61. Yukl G.A. Leadership in organizations 2010, Prentice Hall, Upper Saddle River, NJ.
62. Zedeck S. Review of Benchmarks. The twelfth mental measurements yearbook 1995, Vol. 1:128-129. Buros Institute of Mental Measurements, Lincoln, NE.