A meta-analytic comparison of managerial ratings and self-evaluations

Journal of Personal Selling and Sales Management

Volumn 25, Issue 4, 2005, Pages 315-328

  Jaramillo, Fernando ^a   Carrillat, François A ^b   Locander, William B ^c  

^a UNIVERSITY OF TEXAS AT ARLINGTON   (United States)

^b HEC MONTRÉAL   (Canada)

^c UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 31144435374     PISSN: 08853134     EISSN: 15577813     Source Type: Journal    
DOI: 10.1080/08853134.2005.10749067     Document Type: Article

References (74)

1. Studies included in the meta-analysis.
2. Adkins, Cheryl L., and Craig J. Russell (1997), “SupervisorSubordinate Work Value Congruence and Subordinate Performance: A Pilot Study,” Journal ofBusiness and Psychology, 12 (2), 205-218.
3. Ailawadi, Kusum L., Rajiv P. Dant, and Dhruv Grewal (2004), “The Difference Between Perceptual and Objective Performance Measures: An Empirical Analysis,” Marketing Science Institute, 103 (4), 1-25 (available at www.msi.org/msi/ publication_summary.cfm? publication=703).
4. Arthur, Winfred, Jr., Winston Bennett, Jr., and Allen I. Huffcutt (2001), Conducting Meta Analysis Using SAS, Mahwah, NJ: Lawrence Earlbaum.
5. Avila, Ramon A., Edward F. Fern, and O. Karl Mann (1988), “Unraveling Criteria for Assessing the Performance of Salespeople: A Causal Analysis,” Journal of Personal Selling & Sales Management, 8, 1 (May), 45-54.
6. Baehr, Melany E., and Glenn B. Williams (1968), “Prediction of Sales Success from Factorially Determined Dimensions of Personal Background Data,” Journal of Applied Psychology, 52, 2 (April), 98-103.
7. Barrick, Murray R., Michael K. Mount, and Judy P Strauss (1993), “Conscientiousness and Performance of Sales Representatives: Test of the Mediating Effects of Goal Setting,” Journal of Applied Psychology, 78, 5 (October), 715-722.
8. Behrman, Douglas N., and William D. Perreault (1982), “Measuring the Performance of Industrial Salespeople,” Journal of Business Research, 10, 3 (September), 355-370.
9. Bommer, William H., Johnathan L. Johnson, Gregory A. Rich, Philip M. Podsakoff, and Scott B. Mackenzie (1995), “On the Interchangeability of Objective and Subjective Measures of Employee Performance: A Meta-Analysis,” Personnel Psychology, 48 (3), 587-605.
10. Bone, Sterling A., John C. Mowen, and Tom J. Brown (2005), “Trait Agreeableness and Service Worker Performance: On the Moderating Role of Employee Perception of Organizational Risk Affinity,” Working Paper, Oklahoma State University, Spears School of Business, Stillwater.
11. Borman, Walter C., and W Robert Vallon (1974), “A View of What Can Happen When Behavioral Expectations Scales Are Developed in One Setting and Used in Another,” Journal of Applied Psychology, 59, 2 (April), 561-565.
12. Brown, Steven P, and Robert A. Peterson (1994), “The Effect of Effort on Sales Performance on Job Satisfaction,” Journal of Marketing, 58 (April), 70-80.
13. Chonko, Lawrence B., Terry N. Loe, James A. Roberts, and John F. Tanner (2000), “Sales Performance: Timing of Measurement and Type of Measurement Make a Difference,” Journal of Personal Selling & Sales Management, 20, 1 (Winter), 23-36.
14. Churchill, Gilbert A., Jr., Neil M. Ford, Steven W Hartley, and Orville C. Walker, Jr. (1985), “The Determinants of Salesperson Performance: A Meta-Analysis,” Journal of Marketing Research, 22, 2 (May), 103-118.
15. Cooper, William H. (1981), “Ubiquitous Halo,” Psychological Bulletin, 90, 2 (March), 218-244.
16. Cotham, James C. (1969), “Using Personal History Information in Retail Salesman Selection,” Journal of Retailing, 45, 2 (Summer), 119-129.
17. Cron, William L., and John W Slocum (1986), “The Influence of Career Stages on Salespeople’s Job Attitudes, Work Perceptions, and Performance,” Journal of Marketing Research, 13, 2 (May), 119-129.
18. Day, Nancy E. (1993), “Performance in Salespeople-The Impact of Age,” Journal of Managerial Issues, 5, 2 (Summer), 254-273.
19. Donaldson, Steward I., and Elisa J. Grant-Vallone (2002), “Understanding Self-Report Bias in Organizational Behavior Research,” Journal of Business and Psychology, 17 (1), 245-260.
20. Dubinsky, Alan J., Francis J. Yammarino, Marvin A. Jolson, and William D. Spangler (1995), “Transformational Leadership: An Initial Investigation in Sales Management,” Journal of Personal Selling & Sales Management, 15, 2 (Spring), 17-31.
21. Farh, Jing-Lih, James D. Werbel, and Arthur G. Bedeian (1988), “An Empirical Investigation of Self-Appraisal-Based Performance Evaluation,” Personnel Psychology, 41, 1 (Spring), 141-156.
22. Festinger, Leon (1954), “A Theory of Social Comparison Processes,” Human Relations, 7 (May), 117-140.
23. Hall, Steven M., and Michael T. Brannick (2002), “Comparison of Two Random-Effects Methods of Meta-Analysis,” Journal of Applied Psychology, 87, 2 (April), 377-389.
24. Harris, Michael M., and John Schaubroeck (1988), “A MetaAnalysis of Self-Supervisor, Self-Peer, and Peer-Supervisor Ratings,” Personnel Psychology, 41, 1 (Spring), 43-62.
25. Hart, Sandra Hile (1984), “An Empirical Investigation of Salespeople’s Behavior, Effort and Performance During Sales Contests,” Ph.D. Dissertation, Texas A&M University, College Station.
26. Heneman, Herbert G. (1986), “The Relationship Between Supervisory Ratings and Results-Oriented Measures of Performance: A Meta-Analysis,” Personnel Psychology, 39, 4 (Winter), 811-826.
27. Holbrook, Morris B., and Joel Huber (1979), “Separating Perceptual Dimension from Affective Overtones: An Application to Consumer Aesthetics,” Journal of Consumer Research, 5, 4 (March), 272-283.
28. Hunter, John E., and Frank L. Schmidt (2004), Methods of MetaAnalysis: Correcting Error and Bias in Research Findings, 2d ed., Thousand Oaks, CA: Sage.
29. Jackson, Donald W., John L. Shlacter, and William G. Wolfe (1995), “Examining the Bases Utilized for Evaluating Salespeople’s Performance,” Journal of Personal Selling & Sales Management, 15, 4 (Fall), 57-65.
30. Jaramillo, Fernando, François A. Carrillat, and William B. Locander (2003), “Starting to Solve the Method Puzzle in Salesperson Self-Report Evaluations,” Journal of Personal Selling & Sales Management, 23, 4 (Fall), 369-377.
31. Jaramillo, Fernando, François A. Carrillat, and William B. Locande (2004), “Response to Comment: Starting to Solve the Method Puzzle in Salesperson SelfReport Evaluation,” Journal of Personal Selling & Sales Management, 24, 2 (Spring), 141-155.
32. Jaramillo, Fernando, Jay P. Mulki, and Greg W. Marshall (2005), “A MetaAnalysis of the Relationship Between Organizational Commitment and Job Performance: 25 Years of Research,” Journal of Business Research, 58, 6 (June), 705-714.
33. Jex, Steve M. (2002), Organizational Psychology: A Scientist-Practitioner Approach, New York: John Wiley & Sons.
34. Johnson, Devon S., and Sundar Bharadwaj (2005), “Digitization of Selling Activity and Sales Force Performance: An Empirical Investigation,” Journal of the Academy of Marketing Science, 33, 1 (January), 3-18.
35. Johnston, Mark W, and Greg W. Marshall (2006), Churchill/ Ford/Walker’s Sales Force Management, 8th ed., New York: McGraw-Hill Irwin.
36. Judge, Timothy A., and Ronald F. Piccolo (2004), “Transformational and Transactional Leadership: A Meta-Analytic Test of Their Relative Validity,” Journal of Applied Psychology, 89, 5 (October), 755-765.
37. Kennedy, Ellen J., Leigh Lawton, and Leroy E. Plumlee (2002), “Blissful Ignorance: The Problem of Unrecognized Incompetence and Academic Performance,” Journal of Marketing Education, 24, 3 (August), 243-252.
38. Kirchner, Wayne K. (1960), “Predicting Ratings of Sales Success with Objective Performance Information,” Journal of AppliedPsychology, 44 (6), 398-403.
39. Kline, Rex B. (2004), Beyond Significance Testing: Reforming Data Analysis Methods in Behavioral Research, Washington, DC: American Psychological Association.
40. Krueger, Justin (1999), “Lake Wobegon Be Gone! The ‘Below-Average Effect’ and the Egocentric Nature of Comparative Ability Judgment,” Journal of Personality and Social Psychology, 77 (2), 221-232.
41. Krueger, Justin, and David Dunning (1999), “Unskilled and Unaware of It: How Difficulties in Recognizing One’s Own Incompetence Lead to Inflated Self-Assessment,” Journal of Personality and Social Psychology, 77 (6), 1121-1134.
42. Levy, Michael, and Arun Sharma (1993), “Relationships Among Measures of Retail Salesperson Performance,” Journal of the Academy of Marketing Science, 21, 3 (Summer), 231-238.
43. Liden, Robert C., Dean Stilwell, and Gerald R. Ferris (1996), “The Effects of Supervisor and Subordinate Age on Objective Performance and Subjective Performance Ratings,” Human Relations, 49 (3), 327-347.
44. Lipsey, Mark W., and David B. Wilson (2001), Practical MetaAnalysis, Thousands Oaks, CA: Sage.
45. Mabe, Paul A., and Stephen G. West (1982), “Validity of SelfEvaluation of Ability: A Review and Meta-Analysis,” Journal of Applied Psychology, 67, 3 (June), 280-296.
46. MacKenzie, Scott B., Philip M. Podsakoff, and Richard Fetter (1991), “Organizational Citizenship Behavior and Objective Productivity as Determinants of Managerial Evalua-tions of Salespersons’ Performance,” Organizational Behavior and Human Decision Processes, 50 (1), 123-150.
47. MacKenzie, Scott B., Philip M. Podsakoff, and Richard Fetter (1993), “The Impact of Organizational Citizenship Behavior on Evaluations of Salesperson Performance,” Journal of Marketing, 57, 1 (January), 70-80.
48. MacKenzie, Scott B., Philip M. Podsakoff, and Julie Beth Paine (1999), “Do Citizenship Behaviors Matter More for Managers than for Salespeople?” Journal of the Academy of Marketing Science, 27, 4 (Fall), 396-410.
49. Motowidlo, Stephan J. (1982), “Relationship Between Self-Rated Performance and Pay Satisfaction Among Sales Representatives,” Journal of Applied Psychology, 67, 2 (April), 209-213.
50. Mulki, Jay Prakash (2004), “Impact of Workplace Isolation on Organizational Commitment of Salespeople,” Ph.D. Dissertation, University of South Florida, Tampa.
51. National Research Council (1992), Combining Information: Statistical Issues and Opportunities for Research, Washington, DC: National Academy Press.
52. Nunnally, Jum C. (1978), Psychometric Theory, New York: MacGraw-Hill.
53. Park, Jeong-Eun, and Betsy B. Holloway (2003), “Adaptive Selling Behavior Revisited: An Empirical Examination of Learning Orientation, Sales Performance, and Job Satisfaction,” Journal of Personal Selling & Sales Management, 23, 3 (Summer), 239-251.
54. Posthuma, Richard A. (2000), “The Dimensionality of Supervisor Evaluations of Job Performance,” Journal ofBusiness and Psychology, 14 (3), 481-487.
55. Primoff, Ernest S. (1980), “The Use of Self-Assessment in Examining,” Personnel Psychology, 33, 2 (Summer), 283-289.
56. Raymark, Patrick H., William K. Balzer, and Felipe DeLaTorre (1999), “A Preliminary Investigation of the Sources of Information Used by Raters when Appraising Performance,” Journal ofBusiness and Psychology, 14 (2), 319-339.
57. Rich, Gregory A., William H. Bommer, Scott B. MacKenzie, Philip M. Podsakoff, and Jonathan L. Johnson (1999), “Methods in Sales Research: Apples and Apples or Apples and Oranges? A Meta-Analysis of Objective and Subjective Measures of Salesperson Performance,” Journal of Personal Selling & Sales Management, 19, 4 (Fall), 41-52.
58. Rush, Carl H. (1953), “A Factorial Study of Sales Criteria,” Personnel Psychology, 6 (Spring), 9-24.
59. Schenker, Nathaniel, and Jane F. Gentleman (2001), “On Judging the Significance of Differences by Examining the Overlap Between Confidence Intervals,” American Statistician, 55, 3 (August), 182-186.
60. Schwepker, Charles H., Jr., and David J. Good (2004), “Understanding Sales Quotas: An Exploratory Investigation of Consequences of Failure,” Journal ofBusiness and Industrial Marketing, 19 (1), 33-48.
61. Sharma, Arun, Gregory A. Rich, and Michael Levy (2004), “Comment: Starting to Solve the Method Puzzle in Salesperson Self-Report Evaluations,” Journal of Personal Selling & Sales Management, 24, 2 (Spring), 135-139.
62. Shore, Ted H., Lynn McFarlane Shore, and George C. Thornton, III (1992), “Construct Validity of Self- and Peer Evaluations of Performance Dimensions in an Assessment Center,” Journal of Applied Psychology, 77, 1 (February), 42-54.
63. Shrout, Patrick E., and Niall Bolger (2002), “Mediation in Experimental and Nonexperimental Studies: New Procedures and Recommendations,” Psychological Methods, 7 (4), 422-445.
64. Stark, Dennis Robert (1983), “The Relative Effectiveness of Personal-Psychological Versus Personal-Demographic Variables in Predicting Salespeople’s Job Outcomes,” Ph.D. Dissertation, Illinois Institute of Technology, Chicago.
65. Sundvik, Lilli, and Marjaana Linderman (1998), “Acquaintanceship and Discrepancy Between Supervisor and Self-Assessments,” Journal of Social Behavior and Personality, 13 (1), 117-126.
66. Taylor, Shelley E. (1989), Positive Illusions: Creative Self-Deceptions and the Healthy Mind, New York: Basic Books.
67. Thornton, George C. (1980), “Psychometric Properties of SelfAppraisals of Job Performance,” Personnel Psychology, 33, 2 (Summer), 263-271.
68. Tsui, Anne Shuk-Ying, and Patricia Ohlott (1988), “Multiple Assessment of Managerial Effectiveness: Interrater Agreement and Consensus in Effectiveness Models,” Personnel Psychology, 41, 4 (Winter), 779-803.
69. Turbe, Travis C., and Judith M. Collins (2000), “Jackson and Schuler (1985) Revisited: A Meta-Analysis of the Relation- ships Between Role Ambiguity, Role Conflict, and Job Performance,” Journal of Management, 26, 1 (January), 155- 169.
70. Walker, Orville C., Gilbert A. Churchill, and Neil M. Ford (1979), “Where Do We Go From Here? Some Selected Conceptual and Empirical Issues Concerning the Motivation and Performance of Industrial Salesforce,” in Critical Issues in Sales Management: State of the Art and Future Research Needs, Gerald Albaum and Gilbert A. Churchill, eds., Eugene: University of Oregon, 10-75.
71. Wang, Guangping, and Richard G. Netemeyer (2004), “Salesperson Creative Performance: Conceptualization, Measurement, and Nomological Validity,” Journal ofBusiness Research, 57 (July), 805-812.
72. Weitz, Barton A. (1978), “Relationship Between Salesperson Performance and Understanding of Customer Decision Making,” Journal of Marketing Research, 15, 4 (November), 501-516.
73. Whitener, Ellen M. (1990), “Confusion of Confidence Intervals and Credibility Intervals in Meta-Analysis,” Journal of Applied Psychology, 73, 3 (June), 315-321.
74. Williamson, Nicholas C. (1980), “A Model for Predicting Salesperson Motivation and Performance,” Ph.D. Dissertation, University of North Carolina, Chapel Hill