Comparative analysis of the reliability of job performance ratings

Journal of Applied Psychology

Volumn 81, Issue 5, 1996, Pages 557-574

  Viswesvaran, Chockalingam ^a   Ones, Deniz S ^b   Schmidt, Frank L ^b  

^a FLORIDA INTERNATIONAL UNIVERSITY   (United States)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0030487832     PISSN: 00219010     EISSN: None     Source Type: Journal    
DOI: 10.1037/0021-9010.81.5.557     Document Type: Review

References (253)

1. Albrecht, P. A., Glaser, E. M., & Marks, J. (1964). Validation of a multiple-assessment procedure for managerial personnel. Journal of Applied Psychology, 48, 351-360.
2. Anderson, H. E., Jr., Roush, S. L., & McClary, J. E. (1973). Relationships among ratings, production, efficiency, and the general aptitude test battery scales in an industrial setting. Journal of Applied Psychology, 58, 77-82.
3. Arvey, R. D., Landon, T. E., Nutting, S. M., & Maxwell, S. E. (1992). Development of physical ability tests for police officers: A construct validation approach. Journal of Applied Psychology, 77, 996-1009.
4. Ashford, S. J., & Tsui, A. S. (1991). Self-regulation for managerial effectiveness: The role of active feedback seeking. Academy of Management Journal, 34, 251-280.
5. Austin, J. T., & Villanova, P. (1992). The criterion problem: 1917-1992. Journal of Applied Psychology, 77, 836-874.
6. Baird, L. S. (1977). Self and superior ratings of performance: As related to self-esteem and satisfaction with supervision. Academy of Management Journal, 20, 291-300.
7. Bandura, A. (1977). Social learning theory. Englewood Cliffs, NJ: Prentice-Hall.
8. Barrick, M. R., Mount, M. K., & Strauss, J. P. (1993). Conscientiousness and performance of sales representatives: Test of the mediating effects of goal setting. Journal of Applied Psychology, 78, 715-722.
9. Bass, A. R., & Turner, J. N. (1973). Ethnic group differences in relationships among criteria of job performance. Journal of Applied Psychology, 57, 101-109.
10. Becker, T. E., & Vance, R. J. (1993). Construct validity of three types of organizational citizenship behavior: An illustration of the direct product model with refinements. Journal of Management, 19, 663-682.
11. Bernardin, H. J. (1987). Effect of reciprocal leniency on the relation between consideration scores from the leader behavior description questionnaire and performance ratings. Psychological Reports, 60, 479-487.
12. Bernardin, H. J., & Beatty, R. W. (1984). Performance appraisal: Assessing human behavior at work. Boston: Kent.
13. Bhagat, R. S., & Allie, S. M. (1989). Organizational stress, personal life style, and symptoms of life strains: An examination of the moderating role of sense of competence. Journal of Vocational Behavior, 35, 231-253.
14. Blank, W., Weitzel, J. R., & Green, S. G. (1990). A test of the situational leadership theory. Personnel Psychology, 43, 579-597.
15. Blanz, F., & Ghiselli, E. E. (1972). The mixed standard scale: A new rating system. Personnel Psychology, 25, 185-199.
16. Blau, G. (1986). The relationship of management level to effort level, direction of effort, and managerial performance. Journal of Vocational Behavior, 29, 226-239.
17. Blau, G. (1988). An investigation of the apprenticeship organizational socialization strategy. Journal of Vocational Behavior, 32, 176-195.
18. Blau, G. (1990). Exploring the mediating mechanisms affecting the relationship of recruitment source to employee performance. Journal of Vocational Behavior, 37, 303-320.
19. Bledsoe, J. C. (1981). Factors related to academic and job performance of graduates of practical nursing programs. Psychological Reports, 49, 367-371.
20. Blum, M. L., & Naylor, J. C. (1968). Industrial psychology: Its theoretical and social foundations. New York: Harper & Row.
21. Borman, W. C. (1974). The rating of individuals in organizations: An alternate approach. Organizational Behavior and Human Performance, 12, 105-124.
22. Borman, W. C. (1979). Format and training effects on rating accuracy and rater errors. Journal of Applied Psychology, 64, 410-412.
23. Borman, W. C., Hough, L. M., & Dunnette, M. D. (1976). Performance ratings: An investigation of reliability, accuracy, and relationship between individual differences and rater error. Minneapolis, MN: Personnel Decisions.
24. Breaugh, J. A. (1981a). Predicting absenteeism from prior absenteeism and work attitudes. Journal of Applied Psychology, 66, 555-560.
25. Breaugh, J. A. (1981b). Relationships between recruiting sources and employee performance, absenteeism, and work attitudes. Academy of Management Journal, 24, 142-147.
26. Brogden, H. E. (1946). An approach to the problem of differential prediction. Psychometrika, 11, 139-154.
27. Buckner, D. N. (1959). The predictability of ratings as a function of interrater agreement. Journal of Applied Psychology, 43, 60-64.
28. Buel, W. D., & Bachner, V. M. (1961). The assessment of creativity in a research setting. Journal of Applied Psychology, 45, 353-358.
29. Bushe, G. R., & Gibbs, B. W. (1990). Predicting organization development consulting competence from the Myers-Briggs type indicator and state of ego development. Journal of Applied Behavioral Science, 26, 337-357.
30. Butler, M. C., & Ehrlich, S. B. (1991). Positional influences on job satisfaction and job performance: A multivariate, predictive approach. Psychological Reports, 69, 855-865.
31. Callender, J. C., & Osburn, H. G. (1988). Unbiased estimation of the sampling variance of correlations. Journal of Applied Psychology, 73, 312-315.
32. Campbell, C. H., Ford, P., Rumsey, M. G., Pulakos, E. D., Borman, W. C., Felker, D. B., De Vera, M. V., & Riegelhaupt, B. J. (1990). Development of multiple job performance measures in a representative sample of jobs. Personnel Psychology, 43, 277-300.
33. Campbell, J. P. (1990). Modeling the performance prediction problem in industrial and organizational psychology. In M. Dunnette & L. M. Hough (Eds.), Handbook of industrial organizational psychology (2nd ed., Vol. 1, pp. 687-732). Palo Alto, CA: Consulting Psychologists Press.
34. Campbell, J. P., Dunnette, M. D., Arvey, R. D., & Hellervik, L. V. (1973). The development and evaluation of behaviorally based rating scales. Journal of Applied Psychology, 57, 15-22.
35. Campbell, J. P., Gasser, M. B., & Oswald, F. L. (1996). The substantive nature of job performance variability. In K. R. Murphy (Ed.), Individual differences and behavior in organizations (pp. 258-299). San Francisco: Jossey-Bass.
36. Campbell, J. P., McCloy, R. A., Oppler, S. H., & Sager, C. E. (1993). A theory of performance. In N. Schmitt & W. C. Borman (Eds.), Personnel selection in organizations (pp. 35-70). San Francisco: Jossey-Bass.
37. Cascio, W. F. (1991). Applied psychology in personnel management (4th ed.). Englewood Cliffs, NJ: Prentice-Hall.
38. Cascio, W. F., & Valenzi, E. R. (1977). Behaviorally anchored rating scales: Effects of education and job experience of raters and ratees. Journal of Applied Psychology, 62, 278-282.
39. Cascio, W. F., & Valenzi, E. R. (1978). Relations among criteria of police performance. Journal of Applied Psychology, 63, 22-28.
40. Cheloha, R. S., & Farr, J. L. (1980). Absenteeism, job involvement, and job satisfaction in an organizational setting. Journal of Applied Psychology, 65, 467-473.
41. Christensen, L. (1974). The influence of trait, sex, and information accuracy of personality assessment. Journal of Personality Assessment, 38, 130-135.
42. Churchill, G. A., Jr., & Peter, J. P. (1984). Research design effects on the reliability of rating scales: A meta-analysis. Journal of Marketing Research, 21, 360-375.
43. Cleveland, J. N., & Landy, F. J. (1981). The influence of rater and ratee age on two performance judgments. Personnel Psychology, 34, 19-29.
44. Cleveland, J. N., Murphy, K. R., & Williams, R. E. (1989). Multiple uses of performance appraisal: Prevalence and correlates. Journal of Applied Psychology, 74, 130-135.
45. Cleveland, J. N., & Shore, L. M. (1992). Self- and supervisory perspectives on age and work attitudes and performance. Journal of Applied Psychology, 77, 469-484.
46. Colarelli, S. M., Dean, R. A., & Konstans, C. (1987). Comparative effects of personal and situational influences on job outcomes of new professionals. Journal of Applied Psychology, 72, 558-566.
47. Cooper, R. (1966). Leader's task relevance and subordinate behaviour in industrial work groups. Human Relations, 19, 57-84.
48. Cooper, R., & Payne, R. (1967). Extraversion and some aspects of work behavior. Personnel Psychology, 20, 45-57.
49. Cortina, J. M., Doherty, M. L., Schmitt, N., Kaufman, G., & Smith, R. G. (1992). The "Big Five" personality factors in the IPI and MMPI: Predictors of police performance. Personnel Psychology, 45, 119-140.
50. Cotton, J., & Stoltz, R. E. (1960). The general applicability of a scale for rating research productivity. Journal of Applied Psychology, 44, 276-277.
51. Cronbach, L. J. (1947). Test reliability: Its meaning and determination. Psychometrika, 12, 1-16.
52. Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297-334.
53. David, F. R., Pearce, J. A., II, & Randolph, W. A. (1989). Linking technology and structure to enhance group performance. Journal of Applied Psychology, 74, 233-241.
54. Day, D. W., & Silverman, S. B. (1989). Personality and job performance: Evidence of incremental validity. Personnel Psychology, 42, 25-36.
55. Deadrick, D. L., & Madigan, R. M. (1990). Dynamic criteria revisited: A longitudinal study of performance stability and predictive validity. Personnel Psychology, 43, 717-744.
56. DeNisi, A. S., Cafferty, T. P., & Meglino, B. M. (1984). A cognitive view of the performance appraisal process: A model and research propositions. Organizational Behavior and Human Performance, 33, 360-396.
57. Dicken, C. F., & Black, J. D. (1965). Predictive validity of psychometric evaluations of supervisors. Journal of Applied Psychology, 49, 34-47.
58. Dickinson, T. L., & Tice, T. E. (1973). A multitrait-multimethod analysis of scales developed by retranslation. Organizational Behavior and Human Performance. 9, 421-438.
59. Distefano, M. K., Jr., Pryer, M. W., & Erffmeyer, R. C. (1983). Application of content validity methods to the development of a job-related performance rating criterion. Personnel Psychology, 36, 621-631.
60. Dreher, G. F. (1981). Predicting the salary satisfaction of exempt employees. Personnel Psychology, 34, 579-589.
61. Dunegan, K. J., Duchon, D., & Uhl-Bien, M. (1992). Examining the link between leader-member exchange and subordinate performance: The role of task analyzability and variety as moderators. Journal of Management, 18, 59-76.
62. Dunnette, M. D. (1963). A note on the criterion. Journal of Applied Psychology, 47, 251-253.
63. Edwards, P. K. (1979). Attachment to work and absence behavior. Human Relations, 32, 1065-1080.
64. Ekpo-Ufot, A. (1979). Self-perceived task-relevant abilities, rated job performance, and complaining behavior of junior employees in a government ministry. Journal of Applied Psychology, 64, 429-434.
65. Farh, J., Podsakoff, P. M., & Organ, D. W. (1990). Accounting for organizational citizenship behavior: Leader fairness and task scope versus satisfaction. Journal of Management, 16, 705-721.
66. Farh, J., Werbel, J. D., & Bedeian, A. G. (1988). An empirical investigation of self-appraisal-based performance evaluation. Personnel Psychology, 41, 141-156.
67. Farr, J.-L., O'Leary, B. S., & Bartlett, C. J. (1971). Ethnic group membership as a moderator of the prediction of job performance. Personnel Psychology, 24, 609-636.
68. Flanders, J. K. (1918). Mental tests of a group of employed men showing correlations with estimates furnished by employer. Journal of Applied Psychology, 2, 197-206.
69. Gardner, D. G., Dunham, R. B., Cummings, L. L., & Pierce, J. L. (1989). Focus of attention at work: Construct definition and empirical validation. Journal of Occupational Psychology, 62, 61-77.
70. Gerloff, E. A., Muir, N. K., & Bodensteiner, W. D. (1991). Three components of perceived environmental uncertainty: An exploratory analysis of the effects of aggregation. Journal of Management, 17, 749-768.
71. Ghiselli, E. E. (1942). The use of the Strong vocational interest blank and the Pressy senior classification test in the selection of casualty insurance agents. Journal of Applied Psychology, 26, 793-799.
72. Gough, H. G., Bradley, P., & McDonald, J. S. (1991). Performance of residents in anesthesiology as related to measures of personality and interests. Psychological Reports, 68, 979-994.
73. Graen, G., Dansereau, F., Jr., & Minami, T. (1972). An empirical test of the man-in-the-middle hypothesis among executives in a hierarchical organization employing a unit-set analysis. Organizational Behavior and Human Performance, 8, 262-285.
74. Graen, G., Novak, M. A., & Sommerkamp, P. (1982). The effects of leader-member exchange and job design on productivity and satisfaction: Testing a dual attachment model. Organizational Behavior and Human Performance, 30, 109-131.
75. Green, S. B., & Stutzman, T. (1986). An evaluation of methods to select respondents to structured job-analysis questionnaires. Personnel Psychology, 39, 543-564.
76. Greenhaus, J. H., Bedeian, A. G., & Mossholder, K. W. (1987). Work experiences, job performance, and feelings of personal and family well-being. Journal of Vocational Behavior, 31, 200-215.
77. Griffin, R. W. (1991). Effects of work redesign on employee perceptions, attitudes, and behaviors: A long-term investigation. Academy of Management Journal, 34, 425-435.
78. Guion, R. M. (1965). Synthetic validity in a small company: A demonstration. Personnel Psychology, 18, 49-63.
79. Gunderson, E. K. E., & Nelson, P. D. (1966). Criterion measures for extremely isolated groups. Personnel Psychology, 19, 67-80.
80. Gunderson, E. K. E., & Ryman, D. H. (1971). Convergent and discriminant validities of performance evaluations in extremely isolated groups. Personnel Psychology, 24, 115-724.
81. Hackman, J. R., & Lawler, E. E., III. (1971). Employee reactions to job characteristics [ Monograph]. Journal of Applied Psychology, 55, 259-286.
82. Hackman, J. R., & Porter, L. W. (1968). Expectancy theory predictions of work effectiveness. Organizational Behavior and Human Performance, 3, 417-426.
83. Hartigan, J. A., & Wigdor, A. K. (Eds.). (1989). Fairness in employee testing: Validity generalization, minority issues, and the General Aptitude Test Battery. Washington, DC: National Academy Press.
84. Hatcher, L., Ross, T. L., & Collins, D. (1989). Prosocial behavior, job complexity, and suggestion contribution under gainsharing plans. Journal of Applied Behavioral Science, 25, 231-248.
85. Hater, J. J., & Bass, B. M. (1988). Superiors' evaluations and subordinates' perceptions of transformational and transactional leadership. Journal of Applied Psychology, 73, 695-702.
86. Hausman, H. J., & Strupp, H. H. (1955). Non-technical factors in supervisors' ratings of job performance. Personnel Psychology, 8, 201-217.
87. Heneman, H. G., III. (1974). Comparisons of self- and superior ratings of managerial performance. Journal of Applied Psychology, 59, 638-642.
88. Heron, A. (1954). Satisfaction and satisfactoriness: Complementary aspects of occupational adjustment. Occupational Psychology, 28, 140-153.
89. Hilton, A. C., Bolin, S. F., Parker, J. W., Jr., Taylor, E. K., & Walker, W. B. (1955). The validity of personnel assessments by professional psychologists. Journal of Applied Psychology, 39, 287-293.
90. Hoffman, C. C., Nathan, B. R., & Holden, L. M. (1991). A comparison of validation criteria: Objective versus subjective performance measures and self-versus supervisor ratings. Personnel Psychology, 44, 601-619.
91. Hogan, J., Hogan, R., & Busch, C. M. (1984). How to measure service orientation. Journal of Applied Psychology, 69, 167-173.
92. Hough, L. M. (1984). Development and evaluation of the "accomplishment record" method of selecting and promoting professionals. Journal of Applied Psychology, 69, 135-146.
93. Huck, J. R., & Bray, D. W. (1976). Management assessment center evaluations and subsequent job performance of white and black females. Personnel Psychology, 29, 13-30.
94. Hughes, G. L., & Prien, E. P. (1986). An evaluation of alternate scoring methods for the mixed standard scale. Personnel Psychology, 39, 839-847.
95. Hunter, J. E. (1983). Test validation for 12,000 jobs: An application of job classification and validity generalization to General Aptitude Test Battery (U.S. Employment Service Test Research Report No. 45). Washington, DC: U.S. Department of Labor.
96. Hunter, J. E., & Schmidt, F. L. (1990). Methods of meta-analysis: Correcting for error and bias in research findings. Newbury Park, CA: Sage.
97. Ivancevich, J. M. (1980). A longitudinal study of behavioral expectation scales: Attitudes and performance. Journal of Applied Psychology, 65, 139-146.
98. Ivancevich, J. M. (1983). Contrast effects in performance evaluation and reward practices. Academy of Management Journal, 26, 465-476.
99. Ivancevich, J. M. (1985). Predicting absenteeism from prior absence and work attitudes. Academy of Management Journal, 28, 219-228.
100. Ivancevich, J. M., & McMahon, J. T. (1977). Black-white differences in a goal-setting program. Organizational Behavior and Human Performance, 20, 287-300.
101. Ivancevich, J. M., & McMahon, T. J. (1982). The effects of goal setting, external feedback, and self-generated feedback on outcome variables: A field experiment. Academy of Management Journal, 25, 359-372.
102. Ivancevich, J. M., & Smith, S. V. (1981). Goal setting interview skills training: Simulated and on-the-job analyses. Journal of Applied Psychology, 66, 697-705.
103. Ivancevich, J. M., & Smith, S. V. (1982). Job difficulty as interpreted by incumbents: A study of nurses and engineers. Human Relations, 35, 391-412.
104. Jamal, M. (1984). Job stress and job performance controversy: An empirical assessment. Organizational Behavior and Human Performance, 33, 1-21.
105. James, L. R., & Ellison, R. L. (1973). Creation composites for scientific creativity. Personnel Psychology, 26, 147-161.
106. Jensen, A. R. (1980). Bias in mental testing. New York: Free Press.
107. Johnson, J. A., & Hogan, R. (1981). Vocational interests, personality and effective police performance. Personnel Psychology, 34, 49-53.
108. Jones, J. W., & Terris, W. (1983). Predicting employees' theft in home improvement centers. Psychological Reports, 52, 187-201.
109. Jordan, J. L. (1989). Effects of race on interrater reliability of peer ratings. Psychological Reports, 64, 1221-1222.
110. Jurgensen, C. E. (1950). Intercorrelations in merit rating traits. Journal of Applied Psychology, 34, 240-243.
111. Keller, R. T. (1984). The role of performance and absenteeism in the prediction of turnover. Academy of Management Journal, 27, 176-183.
112. King, L. M., Hunter, J. E., & Schmidt, F. L. (1980). Halo in a multidimensional forced-choice performance evaluation scale. Journal of Applied Psychology, 65, 507-516.
113. Klaas, B. S. (1989). Managerial decision making about employee grievances: The impact of the grievant's work history. Personnel Psychology, 42, 53-68.
114. Klaas, B. S., & DeNisi, A. S. (1989). Managerial reactions to employee dissent: The impact of grievance activity on performance ratings. Academy of Management Journal, 32, 705-717.
115. Klimoski, R. J., & Hayes, N. J. (1980). Leader behavior and subordinate motivation. Personnel Psychology, 33, 543-555.
116. Knauft, E. B. (1949). A selection battery for bake shop managers. Journal of Applied Psychology, 33, 304-315.
117. Kubany, A. J. (1957). Use of sociometric peer nominations in medical education research. Journal of Applied Psychology, 41, 389-394.
118. Landy, F. J., & Guion, R. M. (1970). Development of scales for the measurement of work motivation. Organizational Behavior and Human Performance, 5, 93-103.
119. Latham, G. P., Fay, C. H., & Saari, L. M. (1979). The development of behavioral observation scales for appraising the performance of foremen. Personnel Psychology, 32, 299-311.
120. Latham, G. P., & Wexley, K. N. (1977). Behavioral observation scales for performance appraisal purposes. Personnel Psychology, 30, 255-268.
121. Lawshe, C. H., & McGinley, A. D., Jr. (1951). Job performance criteria studies: I. The job performance of proofreaders. Journal of Applied Psychology, 35, 316-320.
122. Lee, R., Malone, M., & Greco, S. (1981). Multitrait-multimethod-multirater analysis of performance ratings for law enforcement personnel. Journal of Applied Psychology, 66, 625-632.
123. Love, K. G. (1981). Comparison of peer assessment methods: Reliability, validity, friendship bias, and user reaction. Journal of Applied Psychology, 66, 451-457.
124. Love, K. G., & O'Hara, K. (1987). Predicting job performance of youth trainees under a job training partnership act program (JTPA): Criterion validation of a behavior-based measure of work maturity. Personnel Psychology, 40, 323-340.
125. MacKenzie, S. B., Podsakoff, P. M., & Fetter, R. (1991). Organizational citizenship behavior and objective productivity as determinants of managerial evaluations of salespersons' performance. Organizational Behavior and Human Decision Processes, 50, 123-150.
126. Matteson, M. T., Ivancevich, J. M., & Smith, S. V. (1984). Relation of type A behavior to performance and satisfaction among sales personnel. Journal of Vocational Behavior, 25, 203-214.
127. Mayfield, E. C. (1970). Management selection: Buddy nominations revisited. Personnel Psychology, 23, 377-391.
128. McCarrey, M. W., & Edwards, S. A. (1973). Organizational climate conditions for effective research scientist role performance. Organizational Behavior and Human Performance, 9, 439-459.
129. McCauley, C. D., Lombardo, M. M., & Usher, C. J. (1989). Diagnosing management development needs: An instrument based on how managers develop. Journal of Management, 15, 389-403.
130. McCloy, R. A., Campbell, J. P., & Cudeck, R. (1994). A confirmatory test of a model of performance determinants. Journal of Applied Psychology, 79, 493-505.
131. McDaniel, M. A., Whetzel, D. L., Schmidt, F. L., & Maurer, S. D. (1994). The validity of employment interviews: A comprehensive review and meta-analysis. Journal of Applied Psychology, 79, 599-616.
132. McEvoy, G. M., & Beatty, R. W. (1989). Assessment centers and subordinate appraisals of managers: A seven-year examination of predictive validity. Personnel Psychology, 42, 37-52.
133. Meglino, B. M., Ravlin, E. C., & Adkins, C. L. (1989). A work values approach to corporate culture: A field test of the value congruence process and its relationship to individual outcomes. Journal of Applied Psychology, 74, 424-432.
134. Meredith, G. M. (1990). Dossier evaluation in screening candidates for excellence in teaching awards. Psychological Reports, 67, 879-882.
135. Meyer, J. P., Paunonen, S. V., Gellatly, I. R., Goffin, R. D., & Jackson, D. N. (1989). Organizational commitment and job performance: It's the nature of the commitment that counts. Journal of Applied Psychology, 74, 152-156.
136. Miner, J. B. (1970). Executive and personnel interviews as predictors of consulting success. Personnel Psychology, 23, 521-538.
137. Miner, J. B. (1970). Psychological evaluations as predictors of consulting success. Personnel Psychology, 23, 393-405.
138. Mitchell, T. R., & Albright, D. W. (1972). Expectancy theory predictions of the satisfaction, effort, performance, and retention of naval aviation officers. Organizational Behavior and Human Decision Processes, 8, 1-20.
139. Morgan, R. B. (1993). Self- and co-worker perceptions of ethics and their relationships to leadership and salary. Academy of Management Journal, 36, 200-214.
140. Morse, J. J., & Wagner, F. R. (1978). Measuring the process of managerial effectiveness. Academy of Management Journal, 21, 23-35.
141. Mossholder, K. W., Bedeian, A. G., Norris, D. R., Giles, W. F., & Feild, H. S. (1988). Job performance and turnover decisions: Two field studies. Journal of Management, 14, 403-414.
142. Motowidlo, S. J. (1982). Relationship between self-rated performance and pay satisfaction among sales representatives. Journal of Applied Psychology, 67, 209-213.
143. Mount, M. K. (1984). Psychometric properties of subordinate ratings of managerial performance. Personnel Psychology, 37, 687-702.
144. Nathan, B. R., Morman, A. M., Jr., & Milliman, J. (1991). Interpersonal relations as a context for the effects of appraisal interviews on performance and satisfaction: A longitudinal study. Academy of Management Journal, 34, 352-369.
145. Nealey, S. M., & Owen, T. W. (1970). A multitrait-multimethod analysis of predictors and criteria of nursing performance. Organizational Behavior and Human Performance, 5, 348-365.
146. Niehoff, B. P., & Moorman, R. H. (1993). Justice as a mediator of the relationship between methods of monitoring and organizational citizenship behavior. Academy of Management Journal, 36, 527-556.
147. Noe, R. A., & Schmitt, N. (1986). The influence of trainee attitudes on training effectiveness: Test of a model. Personnel Psychology, 39, 497-523.
148. Norris, D. R., & Niebuhr, R. E. (1984). Organization tenure as a moderator of the job satisfaction-job performance relationship. Journal of Vocational Behavior, 24, 169-178.
149. Nunnally, J. C. (1978). Psychometric theory. New York: McGraw Hill.
150. O'Connor, E. J., Peters, L. H., Pooyan, A., Weekley, J., Frank, B., & Erenkrantz, B. (1984). Situational constraint effects on performance, affective reactions, and turnover: A field replication and extension. Journal of Applied Psychology, 69, 663-672.
151. Oldham, G. R. (1976). The motivational strategies used by supervisors: Relationships to effectiveness indicators. Organizational Behavior and Human Performance, 15, 66-86.
152. Ones, D. S., & Viswesvaran, C. (in press). Bandwidth-fidelity dilemma in personality measurement for personnel selection. Journal of Organizational Behavior.
153. Organ, D. W., & Konovsky, M. (1989). Cognitive versus affective determinants of organizational citizenship behavior. Journal of Applied Psychology, 74, 157-164.
154. Otten, M. W., & Kahn, M. (1975). Effectiveness of crisis center volunteers and the personal orientation inventory. Psychological Reports, 37, 1107-1111.
155. Parker, J. W., Taylor, E. K., Barrett, R. S., & Martens, L. (1959). Rating scale content: III. Relationship between supervisory- and self-ratings. Personnel Psychology, 12, 49-63.
156. Parsons, C. K., Herold, D. M., & Leatherwood, M. L. (1985). Turnover during initial employment: A longitudinal study of the role of causal attributions. Journal of Applied Psychology, 70, 337-341.
157. Penley, L. E., & Hawkins, B. L. (1980). Organizational communication, performance, and job satisfaction as a function of ethnicity and sex. Journal of Vocational Behavior, 16, 368-384.
158. Peterson, R. A. (1994). A meta-analysis of Cronbach's coefficient alpha. Journal of Consumer Research, 21, 381-391.
159. Podsakoff, P. M., Niehoff, B. P., MacKenzie, S. B., & Williams, M. L. (1993). Do substitutes for leadership really substitute for leadership? An empirical examination of Kerr and Jermier's situational leadership model. Organizational Behavior and Human Decision Processes, 54, 1-44.
160. Podsakoff, P. M., Todor, W. D., & Skov, R. (1982). Effects of leader contingent and noncontingent reward and punishment behaviors on subordinate performance and satisfaction. Academy of Management Journal, 25, 810-821.
161. Prien, E. P., & Kult, M. (1968). Analysis of performance criteria and comparison of a priori and empirically-derived keys for a forced-choice scoring. Personnel Psychology, 21, 505-513.
162. Prien, E. P., & Liske, R. E. (1962). Assessments of higher level personnel: III. Rating criteria: A comparative analysis of supervisor ratings and incumbent self-ratings of job performance. Personnel Psychology, 15, 187-194.
163. Puffer, S. M. (1987). Prosocial behavior, noncompliant behavior, and work performance among commission salespeople. Journal of Applied Psychology, 72, 615-621.
164. Pulakos, E. D., Borman, W. C., & Hough, L. M. (1988). Test validation for scientific understanding: Two demonstrations of an approach to studying predictor-criterion linkages. Personnel Psychology, 41, 703-716.
165. Pulakos, E. D., & Wexley, K. N. (1983). The relationship among perceptual similarity, sex, and performance ratings in manager-subordinate dyads. Academy of Management Journal, 26, 129-139.
166. Pym, D. L. A., & Auld, H. D. (1965). The self-rating as a measure of employee satisfactoriness. Occupational Psychology, 39, 103-113.
167. Rabinowitz, S., & Stumpf, S. A. (1987). Facets of role conflict, role-specific performance, and organizational level within the academic career. Journal of Vocational Behavior, 30, 72-83.
168. Ronan, W. W. (1963). A factor analysis of eleven job performance measures. Personnel Psychology, 16, 255-267.
169. Rosinger, G., Myers, L. B., Levy, G. W., Loar, M., Mohrman, S. A., & Stock, J. R. (1982). Development of a behaviorally based performance appraisal system. Personnel Psychology, 35, 75-88.
170. Ross, P. F., & Dunfield, N. M. (1964). Selecting salesmen for an oil company. Personnel Psychology, 17, 75-84.
171. Rosse, J. G. (1987). Job-related ability and turnover. Journal of Business and Psychology, 1, 326-336.
172. Rosse, J. G., & Kraut, A. I. (1983). Reconsidering the vertical dyad linkage model of leadership. Journal of Occupational Psychology, 56, 63-71.
173. Rosse, J. G., Miller, H. E., & Barnes, L. K. (1991). Combining personality and cognitive ability predictors for hiring service-oriented employees. Journal of Business and Psychology, 5, 431-445.
174. Rothstein, H. R. (1990). Interrater reliability of job performance ratings: Growth to asymptote level with increasing opportunity to observe. Journal of Applied Psychology, 75, 322-327.
175. Rothstein, H. R., Schmidt, F. L., Erwin, F. W., Owens, W. A., & Sparks, C. P. (1990). Biographical data in employment selection: Can validities be made generalizable? Journal of Applied Psychology, 75, 175-184.
176. Rousseau, D. M. (1978). Relationship of work to nonwork. Journal of Applied Psychology, 63, 513-517.
177. Rush, C. H. Jr. (1953). A factorial study of sales criteria. Personnel Psychology, 6, 9-24.
178. Russell, C. J. (1990). Selecting top corporate leaders: An example of biographical information. Journal of Management, 16, 73-86.
179. Russell, C. J., Mattson, J., Devlin, S. E., & Atwater, D. (1990). Predictive validity of biodata items generated from retrospective life experience essays. Journal of Applied Psychology, 75, 569-580.
180. Sackett, P. R., Zedeck, S., & Fogli, L. (1988). Relations between measures of typical and maximum job performance. Journal of Applied Psychology, 73, 482-486.
181. Salancik, G. R., & Pfeffer, J. (1978). A social information processing approach to job attitudes and task design. Administrative Science Quarterly, 23, 224-253.
182. Schaubroeck, J., Ganster, D. C., Sime, W. E., & Ditman, D. (1993). A field experiment testing supervisory role clarification. Personnel Psychology, 46, 1-25.
183. Schippmann, J. S., & Prien, E. P. (1986). Psychometric evaluation of an integrated assessment procedure. Psychological Reports, 59, 111-122.
184. Schmidt, F. L., & Hunter, J. E. (1992). Development of a causal model of processes determining job performance. Current Directions in Psychological Science, 1, 89-92.
185. Schmidt, F. L., & Hunter, J. E. (1996). Measurement error in psychological research: Lessons from 26 research scenarios. Psychological Methods, 1, 199-223.
186. Schmidt, F. L., Ones, D. S., & Hunter, J. E. (1992). Personnel selection. In M. R. Rosenzweig & L. W. Porter (Eds.), Annual review of psychology (pp. 627-670). Palo Alto, CA: Annual Reviews.
187. Schuerger, J. M., Kochevar, K. F., & Reinwald, J. E. (1982). Male and female correction officers: Personality and rated performance. Psychological Reports, 51, 223-228.
188. Scullen, S. E., Mount, M. K., & Sytysma, M. R. (1995). Comparison of self, peer, direct report and boss ratings of managers' performance. Unpublished manuscript.
189. Seybolt, J. W., & Pavett, C. M. (1979). The prediction of effort and performance among hospital professionals: Moderating effects of feedback on expectancy theory formulations. Journal of Occupational Psychology, 52, 91-105.
190. Siegel, A. I., Schultz, D. G., Fischl, M. A., & Lanterman, R. S. (1968). Absolute scaling of job performance. Journal of Applied Psychology, 52, 313-318.
191. Siegel, L. (1982). Paired comparison evaluations of managerial effectiveness by peers and supervisors. Personnel Psychology, 35, 843-852.
192. Slocum, J. W., Jr., & Cron, W. L. (1985). Job attitudes and performance during three career stages. Journal of Vocational Behavior, 26, 126-145.
193. Smircich, L., & Chesser, R. J. (1981). Superiors' and subordinates' perceptions of performance: Beyond disagreement. Academy of Management Journal, 24, 198-205.
194. Sneath, F. A., White, G. C., & Randell, G. A. (1966). Validating a workshop reporting procedure. Occupational Psychology, 40, 15-29.
195. Soar, R. S. (1956). Personal history as a predictor of success in service station management. Journal of Applied Psychology, 40, 383-385.
196. South, J. C. (1974). Early career performance of engineers -Its composition and measurement. Personnel Psychology, 27, 225-243.
197. Spector, P. E., Dwyer, D. J., & Jex, S. M. (1988). Relation of job stressors to affective, health, and performance outcomes: A comparison of multiple data sources. Journal of Applied Psychology, 73, 11-19.
198. Spencer, D. G., & Steers, R. M. (1981). Performance as a moderator of the job satisfaction-turnover relationship. Journal of Applied Psychology, 66, 511-514.
199. Spitzer, M. E., & McNamara, W. J. (1964). A managerial selection study. Personnel Psychology, 17, 19-40.
200. Sprecher, T. B. (1959). A study of engineers' criteria for creativity. Journal of Applied Psychology, 43, 141-148.
201. Springer, D. (1953). Ratings of candidates for promotion by co-workers and supervisors. Journal of Applied Psychology, 37, 347-351.
202. Steel, R. P., & Mento, A. J. (1986). Impact of situational constraints on subjective and objective criteria of managerial job performance. Organizational Behavior and Human Decision Processes, 37, 254-265.
203. Steel, R. P., Mento, A. J., & Hendrix, W. H. (1987). Constraining forces and the work performance of finance company cashiers. Journal of Management, 13, 473-482.
204. Steel, R. P., & Ovalle, N. K. (1984). Self-appraisal based upon supervisory feedback. Personnel Psychology, 37, 667-685.
205. Steel, R. P., Shane, G. S., & Kennedy, K. A. (1990). Effects of social-system factors on absenteeism, turnover, and job performance. Journal of Business and Psychology, 4, 423-430.
206. Stout, S. K., Slocum, J. W., Jr., & Cron, W. L. (1987). Career transitions of superiors and subordinates. Journal of Vocational Behavior, 30, 124-137.
207. Stuit, D. B., & Wilson, J. T. (1946). The effect of an increasingly well defined criterion on the prediction of success at naval training school (tactical radar). Journal of Applied Psychology, 30, 614-623.
208. Stumpf, S. A. (1981). Career roles, psychological success, and job attitudes. Journal of Vocational Behavior, 19, 98-112.
209. Stumpf, S. A., & Rabinowitz, S. (1981). Career stage as a moderator of performance relationships with facets of job satisfaction and role perceptions. Journal of Vocational Behavior, 18, 202-218.
210. Sulkin, H. A., & Pranis, R. W. (1967). Comparison of grievants with non-grievants in a heavy machinery company. Personnel Psychology, 20, 111-119.
211. Swaroff, P. G., Barclay, L. A., & Bass, A. R. (1985). Recruiting sources: Another look. Journal of Applied Psychology, 70, 720-728.
212. Szilagyi, A. D. (1980). Causal inferences between leader reward behaviour and subordinate performance, absenteeism, and work satisfaction. Journal of Occupational Psychology, 53, 195-204.
213. Taylor, E. K., Schneider, D. E., & Symons, N. A. (1953). A short forced-choice evaluation form for salesmen. Personnel Psychology, 6, 393-401.
214. Taylor, R. L., & Wilsted, W. D. (1974). Capturing judgment policies: A field study of performance appraisal. Academy of Management Journal, 17, 440-449.
215. Taylor, R. L., & Wilsted, W. D. (1976). Capturing judgment policies in performance rating. Industrial Relations, 15, 216-224.
216. Taylor, S. M., & Schmidt, D. W. (1983). A process-oriented investigation of recruitment source effectiveness. Personnel Psychology, 36, 343-354.
217. Tenopyr, M. L. (1969). The comparative validity of selected leadership scales relative to success in production management. Personnel Psychology, 22, 77-85.
218. Thompson, D. E., & Thompson, T. A. (1985). Task-based performance appraisal for blue-collar jobs: Evaluation of race and sex effects. Journal of Applied Psychology, 70, 747-753.
219. Thomson, H. A. (1970). Comparison of predictor and criterion judgments of managerial performance using the multitrait-multimethod approach. Journal of Applied Psychology, 54, 496-502.
220. Toops, H. A. (1944). The criterion. Educational and Psychological Measurement, 4, 271-297.
221. Tsui, A. S., & Ohlott, P. (1988). Multiple assessment of managerial effectiveness: Interrater agreement and consensus in effectiveness models. Personnel Psychology, 41, 779-803.
222. Tucker, M. F., Cline, V. B., & Schmitt, J. R. (1967). Prediction of creativity and other performance measures from biographical information among pharmaceutical scientists. Journal of Applied Psychology, 51, 131-138.
223. Turner, W. W. (1960). Dimensions of foreman performance: A factor analysis of criterion measures. Journal of Applied Psychology, 44, 216-223.
224. Validity information exchange. (1954). No. 7-045. Personnel Psychology, 7, 279.
225. Validity information exchange. (1954). No. 7-089. Personnel Psychology, 7, 565-566.
226. *Validity information exchange. (1956). No. 9-32. Personnel Psychology, 9, 375-377.
227. Validity information exchange. (1958). No. 11-10. Personnel Psychology, 11, 121-123.
228. Validity information exchange. (1958). No. 11-27. Personnel Psychology, 11, 583-584.
229. Validity information exchange. (1958). No. 11-30. Personnel Psychology, 11, 587-590.
230. Validity information exchange. (1960). No. 13-03. Personnel Psychology, 13, 449-450.
231. Validity information exchange. (1963). No. 16-04. Personnel Psychology, 16, 181-183.
232. Validity information exchange. (1963). No. 16-05. Personnel Psychology, 16, 283-288.
233. Vecchio, R. P. (1987). Situational leadership theory: An examination of a prescriptive theory. Journal of Applied Psychology, 72, 444-451.
234. Vecchio, R. P., & Gobdel, B. C. (1984). The vertical dyad linkage model of leadership: Problems and prospects. Organizational Behavior and Human Performance, 34, 5-20.
235. Villanova, P., & Bernardin, J. H. (1990). Work behavior correlates of interviewer job compatibility. Journal of Business and Psychology, 5, 179-195.
236. Viswesvaran, C. (1993). Modeling job performance: Is there a general factor? Unpublished doctoral dissertation, University of Iowa, Iowa City.
237. Viswesvaran, C., & Ones, D. S. (1995). Theory testing: Combining psychometric meta-analysis and structural equations modeling. Personnel Psychology, 48, 865-887.
238. Waldman, D. A., Yammarino, F. J., & Avolio, B. J. (1990). A multiple level investigation of personnel ratings. Personnel Psychology, 43, 811-835.
239. Wanous, J. P., Stumpf, S. A., & Bedrosian, H. (1979). Job survival of new employees. Personnel Psychology, 32, 651-662.
240. Wayne, S. J., & Ferris, G. R. (1990). Influence tactics, affect, and exchange quality in supervisor-subordinate interactions: A laboratory experiment and field study. Journal of Applied Psychology, 75, 487-499.
241. Wernimont, P. F., & Kirchner, W. K. (1972). Practical problems in the revalidation of tests. Occupational Psychology, 46, 25-30.
242. Wexley, K. N., Alexander, R. A., Greenawalt, J. P., & Couch, M. A. (1980). Attitudinal congruence and similarity as related to interpersonal evaluations in manager-subordinate dyads. Academy of Management Journal, 23, 320-330.
243. Wexley, K. N., & Pulakos, E. D. (1982). Sex effects on performance ratings in manager-subordinate dyads: A field study. Journal of Applied Psychology, 67, 433-439.
244. Wexley, K. N., & Youtz, M. A. (1985). Rater beliefs about others: Their effects on rating errors and rater accuracy. Journal of Occupational Psychology, 58, 265-275.
245. Williams, C. R., Labig, C. E., Jr., & Stone, T. H. (1993). Recruitment sources and posthire outcomes for job applicants and new hires: A test of two hypotheses. Journal of Applied Psychology, 78, 163-172.
246. Williams, L. J., & Anderson, S. E. (1991). Job satisfaction and organizational commitment as predictors of organizational citizenship and in-role behaviors. Journal of Management, 17, 601-617.
247. Williams, W. E., & Seiler, D. A. (1973). Relationship between measures of effort and job performance. Journal of Applied Psychology, 57, 49-54.
248. Wohlers, A. J., & London, M. (1989). Ratings of managerial characteristics: Evaluation difficulty, co-worker agreement, and self-awareness. Personnel Psychology, 42, 235-261.
249. Woodmansee, J. J. (1978). Validation of the nurturance scale of the Edwards Personal Preference Schedule. Psychological Reports, 42, 495-498.
250. Worbois, G. M. (1975). Validation of externally developed assessment procedures for identification of supervisory potential. Personnel Psychology, 28, 77-91.
251. Yammarino, F. J., & Dubinsky, A. J. (1990). Salesperson performance and managerially controllable factors: An investigation of individual and work group effects. Journal of Management, 16, 87-106.
252. Yukl, G. A., & Latham, G. P. (1978). Interrelationships among employee participation, individual differences, goal difficulty, goal acceptance, goal instrumentality, and performance. Personnel Psychology, 31, 305-323.
253. Zedeck, S., & Baker, H. T. (1972). Nursing performance as measured by behavioral expectation scales: A multitrait-multirater analysis. Organizational Behavior and Human Decision Processes, 7, 457-466.