Ethnie group differences in measures of job performance: A new meta-analysis

Journal of Applied Psychology

Volumn 88, Issue 4, 2003, Pages 694-706

  Roth, Philip L ^a   Huffcutt, Allen I ^b   Bobko, Philip ^c  

^a CLEMSON UNIVERSITY   (United States)

^b BRADLEY UNIVERSITY   (United States)

^c NONE

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CLINICAL TRIAL; EMPLOYMENT; ETHNIC GROUP; HUMAN; META ANALYSIS; METHODOLOGY; PERSONNEL MANAGEMENT;

EMPLOYEE PERFORMANCE APPRAISAL; EMPLOYMENT; ETHNIC GROUPS; HUMANS;

EID: 0042829154     PISSN: 00219010     EISSN: None     Source Type: Journal    
DOI: 10.1037/0021-9010.88.4.694     Document Type: Article

References (81)

1. Arnold, B. C. (1968). Comparison of Caucasian and Negro subgroups on criterion indices of overall job effectiveness (AAT 6912449), Unpublished doctoral dissertation, Colorado State University, Fort Collins.
2. Baehr, M. E. (1976). National validation of a selection test battery for male transit bus operators (Technical Report No. UMTA-MA-06-011-771). Washington, DC: U.S. Department of Transportation.
3. Baehr, M. E., Saunders, D. R., Furcon, J. E., & Froemel, E. C. (1971, September). The prediction of performance for Black and White police patrolmen. Professional Psychology, 46-57,
4. Bartlett, C. J., Goldstein, I. L., Mosier, S., Hannan, R., Buxton, V., Simmons, V., et al. (1977). An analysis of the validity of the PPA police examination for entry level selection in the Prince George's County police department. College Park, MD: Training and Educational Research Programs.
5. Bass, A. R., & Turner, J, N. (1973), Ethnic group differences in relationships among criteria of job performance. Journal of Applied Psychology, 57, 101-109.
6. Bernardin, H. J. (1984). An analysis of Black-White differences in job performance. Paper presented at the meeting of the Academy of Management, Boston.
7. Bobko, P. (2001). Correlation and regression: Principles and applications for industrial/organizational psychology and management (2nd ed.). London: Sage.
8. Bobko, P., Roth, P. L., & Potosky, D. (1999). Derivation and implications of a meta-analytic matrix incorporating cognitive ability, alternative predictors, and job performance. Personnel Psychology, 62, 561-589.
9. Borman, W, C., Penner, L. A., Alien, T. D., & Motowidlo, S. J. (2001). Personality predictors of citizenship behavior. International Journal of Selection and Assessment, 9, 52-69.
10. Campbell, J. P. (1990), Modeling the performance prediction problem in industrial and organizational psychology. In M. Dunnette & L. Hough (Eds.), Handbook of industrial and organizational psychology (2nd ed., Vol. 1, pp. 687-732). Palo Alto, CA: Consulting Psychologists Press.
11. Campbell, J. T., Crooks, L. A., Mahoney, M. H., & Rock, D. A. (1973). An investigation of sources of bias in the prediction of job performance: A six-year study (Final Project Report PR-73-37). Princeton, NJ: ETS.
12. Cascio, W. F. (1997). Applied psychology in human resource management. Upper Saddle River, NJ: Prentice Hall.
13. Cascio, W. F., & Phillips, N. F. (1979). Performance testing: A rose among thorns. Personnel Psychology, 32, 751-766.
14. Confidential Industry Technical Report.
15. Confidential Industry Technical Report.
16. Confidential Industry Technical Report.
17. Distefano, M. K., Pryer, M. W., & Craig, S. H. (1976). Predictive validity of general ability tests with black and white psychiatric attendants. Personnel Psychology, 29, 197-204.
18. Distefano, M. K., Pryer, M. W., & Craig, S. H. (1980). Job-relatedness of a post-training job knowledge criterion used to assess validity and test fairness. Personnel Psychology, 33, 785-793.
19. DuBois, C. L. Z., Sackett, P. R., Zedeck, S., & Fogli, L. (1993). Further exploration of typical and maximum performance criteria: Definitional issues, prediction, and White-Black differences. Journal of Applied Psychology, 78, 205-211.
20. Equal Employment Opportunity Commission. (1978). Uniform guidelines on employee selection procedures, 43, 38290-38309.
21. Farr, J. L., O'Leary, B. S., & Bartlett, C. J. (1971). Ethnic group membership as moderator of the prediction of job performance. Personnel Psychology, 24, 609-636.
22. Feild, H. S., Bayley, G. A., & Bayley, S. M. (1977). Employment test validation for minority and non-minority production workers. Personnel Psychology, 30, 37-46.
23. Ford, J. K., & Kraiger, K. (1993). Police officer selection validation project: The multi-jurisdictional police officer examination. Journal of Business and Psychology, 7, 421-429.
24. Ford, J. K., Kraiger, K., & Schechtman, S. L. (1986). Study of race effects in objective indices and subjective evaluations of performance: A metaanalysis of performance criteria. Psychological Bulletin, 99, 330-337.
25. Ford, K. A. (1976). Ethnic group differences in employment test-job performance relationships. Unpublished doctoral dissertation, University of Southern California, Los Angeles.
26. Fox, H., & Lefkowitz, J. (1974). Differential validity: Ethnic group as a moderator in predicting job performance. Personnel Psychology, 27, 209-223.
27. Gael, S., & Grant, D. L. (1972). Employment test validation for minority and non-minority telephone company service representatives. Journal of Applied Psychology, 56, 135-139.
28. Gael, S., & Grant, D. L., & Ritchie, R. J. (1975). Employment test validation for minority and nonminority clerks with work sample criteria. Journal of Applied Psychology, 60, 420-426.
29. Gael, S., & Grant, D. L., & Ritchie, R. J. (1975). Employment test validation for minority and nonminority telephone operators. Journal of Applied Psychology, 60, 411-419.
30. Goldstein, I. L. (1974). Training: Program development and evaluation. Monterey, CA: Brooks/Cole.
31. Grant, D. L., & Bray, D. W. (1970). Validation of employment tests for telephone company installation and repair occupations. Journal of Applied Psychology, 54, 7-14.
32. Grant-Vallone, E. J. (1998). Work and family conflict: The importance of supportive work environments. Unpublished doctoral dissertation, Claremont Graduate University, Claremont, CA.
33. Guinn, N., Tupes, E. C., & Alley, W. E. (1970). Cultural subgroup differences in the relationships between Air Force aptitude composites and training criteria (Technical Report No. AFHRL-TR-70-35). Lackland Air Force Base, TX: Personnel Research Division.
34. Hattrup, K., & Schmitt, N. (1990). Prediction of trade apprentices' performance on job sample criteria. Personnel Psychology, 43, 453-466.
35. Huck, J. R., & Bray, D. W. (1976). Management assessment center evaluations and subsequent job performance of white and black females. Personnel Psychology, 29, 13-30.
36. Huffcutt, A. I., & Roth, P. L. (1998). Racial group differences in interview evaluations. Journal of Applied Psychology, 83, 288-297.
37. Hunter, J. E. (1983a). A causal analysis of cognitive ability, job knowledge, and job performance, and supervisory ratings. In R. Landy, S. Zedeck, & J. Cleveland (Eds.), Performance measurement and theory (pp. 257-266). Hillsdale, NJ: Erlbaum.
38. Hunter, J. E. (1983b). Test validation for 13,000 jobs: An application of job classification and validity generalization to the General Aptitude Test Battery (CATB) (USES Test Research Report No. 450). Washington, DC: U.S. Department of Labor.
39. Hunter, J. E., & Hunter, R. F. (1984). Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96, 72-98.
40. Hunter, J. E., & Schmidt, F. L. (1990). Methods of meta-analysis: Correcting for error and bias in research findings. Newbury Park, CA: Sage.
41. Ivancevich, J. M., & McMahon, J. T. (1977). Black-White differences in a goal-setting program. Organizational Behavior and Human Performance, 20, 287-300.
42. Kahn, E. (1977). A study of the use of work sample criterion in test validation research. Unpublished doctoral dissertation, University of Houston, University Park, TX.
43. Kesselman, G. A., & Lopez, F. E. (1979). The impact of job analysis on employment test validation for minority and nonminority accounting personnel. Personnel Psychology, 32, 91-107.
44. Kirkpatrick, J. J., Ewen, R. B., Barrett, R. S., & Katzell, R. A. (1968). Testing and fair employment. New York: New York University Press.
45. Kraiger, K. (1981). Measuring police officer performance: Criterion development for the Columbus police officer selection validation project. Columbus, OH.
46. Kraiger, K., & Ford, J. K. (1985). A meta-analysis of ratee race effects in performance ratings, Journal of Applied Psychology, 70, 56-65.
47. Lance, C. E., Johnson, C. D., Southitt, S. S., Bennett, W., Jr., & Harville, D. L. (2000). Good news: Work sample administrator's global performance judgments are (about) as valid as we've suspected. Human Performance, 13, 253-277.
48. Lopez, F. M. (1966). Current problems in test performance of job applicants: 1. Personnel Psychology, 19, 10-18.
49. Martocchio, J. J., & Whitener, E. M. (1992). Fairness in personnel selection: A meta-analysis and policy implications. Human Relations, 45, 489-506.
50. McDaniel, M. A., Whetzel, D. L., Schmidt, F. L., & Maurer, S. D. (1994). The validity of employment interviews: A comprehensive review and meta-analysis. Journal of Applied Psychology, 79, 599-616.
51. Mills, A. (1990). Predicting police performance for differing gender and ethnic groups: A longitudinal study. Unpublished doctoral dissertation, California School of Professional Psychology, Los Angeles.
52. Mobley, W. H. (1982). Supervisor and employee race and sex effects on performance appraisals: A field study of adverse impact and generalizability. Academy of Management Journal, 25, 598-606.
53. Morstain, B. R. (1984). Minority-White differences on a police aptitude exam: EEO implications for police selection. Psychological Reports, 55, 515-525.
54. Motowidlo, S. J., & Schmit, M. J. (1997). Performance assessment and interview procedures for store manager and store associate positions (Final Technical Report). Gainesville, FL: University of Florida, Human Resource Research Center.
55. Mount, M. K., Sytsma, M. R., Hazucha, J. F., & Holt, K. E. (1997). Rater-ratee race effects in developmental performance ratings of managers. Personnel Psychology, 50, 51-69.
56. Neidt, C. O. (1968). Report on the differential predictive validity of specified selection techniques within designated subgroups of applicants for civil service positions. Fort Collins, CO: Colorado Civil Rights Commission.
57. Ostroff, C., & Harrison, D. A. (1999). Meta-analysis, level of analysis, and best estimates of population correlations: Cautions for interpreting metaanalytic results in organizational behavior. Journal of Applied Psychology, 84, 260-270.
58. Plamondon, K. E., & Schmitt, N. (2000, April). Validity and subgroup differences of combinations of predictors as a function of research design. Paper presented at the 15th Annual Meeting of the Society for Industrial and Organizational Psychology, New Orleans, LA.
59. Podsakoff, P. M., MacKenzie, S. B., Paine, J. B., & Bachrach, J. B. (2000). Organizational citizenship behaviors: A critical review of the theoretical and empirical literature and suggestions for future research. Journal of Management, 26, 513-564.
60. Pulakos, E. D., & Schmitt, N. (1995). Experience-based and situational interview questions: Studies of validity. Personnel Psychology, 48, 289-308.
61. Pulakos, E. D., Schmitt, N., & Chan, D. (1996). Models of performance ratings: An examination of ratee race, ratee gender, and rater level effects. Human Performance, 9, 103-119.
62. Pulakos, E. D., White, L. A., Oppler, S. H., & Borman, W. C. (1989). Examination of race and sex effects on performance ratings. Journal of Applied Psychology, 74, 770-780.
63. Ree, M. J., Carretta, T. R., & Teachout, M. S. (1995). Role of ability and prior job knowledge in complex training performance. Journal of Applied Psychology, 80, 721-730.
64. Roth, P. L., Be Vier, C. A., Bobko, P., Switzer, F. S., III, & Tyler, P. (2001). Ethnic group differences in cognitive ability in employment and educational settings: A meta-anaJysis. Personnel Psychology, 54, 297-330.
65. Rotundo, M., & Sackett, P. R. (1999). Effect of rater race on conclusions regarding differential prediction in cognitive ability tests. Journal of Applied Psychology, 84, 815-822.
66. Sackett, P. R., & Dubois, C. L. Z. (1991). Rater-ratee race effects on performance evaluation: Challenging meta-analytic conclusions. Journal of Applied Psychology, 76, 873-877.
67. Sackett, P. R., & Wilk, S. L. (1994). Within-group norming and other forms of score adjustment in preemployment testing. American Psychologist, 49, 929-954.
68. Salgado, J. F., Viswesvaran, C., & Onss, D. S. (2001). Predictors used for personnel selection: An overview of constructs, methods, and techniques. In N. Anderson, D. Ones, H. Sinangil, & C. Viswesvaran (Eds.) Handbook of industrial, work, & organizational psychology (pp. 165199). London: Sage.
69. Schmidt, F. L., Greenthal, A. L., Hunter, J. E., Berner, J. G., & Seaton, F. W. (1977). Job sample versus paper and pencil trades and technical tests: Adverse impact and examinee attitudes. Personnel Psychology, 30, 187-197.
70. Schmidt, F. L., & Hunter, J. E. (1981). Employment testing: Old theories and new research findings. American Psychologist, 36, 1128-1137.
71. Schmit, M. J., & Motowidlo, S. J. (1995). Development and validation of a situational interview and personality test for selecting sales associates (Final Technical Report). Gainesville, FL: University of Florida, Human Resource Research Center.
72. Schmitt, N., Clause, C. S., & Pulakos, E. D. (1996). Subgroup differences associated with different measures of some common job relevant constructs. In C. L. Cooper & I. T. Robertson (Eds.), International review of industrial and organizational psychology (Vol. 11, pp. 115-139). New York: Wiley.
73. Seifert, M. K. (1995). The relationship of role problems, work trauma, cynicism, social support, and spiritual support to the physical and mental health, work performance, and absenteeism of correctional officers (AAT 9531303). Unpublished doctoral dissertation, University of Maryland, Baltimore County.
74. Tenopyr, M. L. (1967, September). Race and socioeconomic status as moderators in predicting machine-shop training success. Paper presented at the 75th Annual Convention of the American Psychological Association, Washington, DC.
75. Toole, D. L., Gavin, J. F., Murdy, L. B., & Sells, S. B. (1972). The differential validity of personality, personal history, and aptitude data for minority and nonminority employees. Personnel Psychology, 25, 661-672.
76. Viswesvaran, C. (2001). Assessment of individual job performance: A review of the past century and a look ahead. In N. Anderson, D. S. Ones, H. K. Sinangil, & C. Viswesvaran (Eds.), Handbook of industrial, work, and organizational psychology (Vol. 1, pp. 110-126). London; Sage.
77. Viswesvaran, C., Ones, D. S., & Schmidt, F. L. (1996). Comparative analysis of the reliability of job performance ratings. Journal of Applied Psychology, 81, 557-574.
78. Waldman, D. A., & Avolio, B. J. (1991). Race effects in performance evaluations: Controlling for ability, education, and experience. Journal of Applied Psychology, 76, 897-901.
79. Weekly, J. A., & Jones, C. (1999). Further studies of situational tests. Personnel Psychology, 52, 679-700.
80. Wing, H. (1981). Estimation of the adverse impact of a police promotion exam. Personnel Psychology, 34, 503-511.
81. Yu, C. (1998). A study of the relationships between the self-directed learning readiness and job performance for high school principals. Unpublished doctoral dissertation, Ohio State University, Columbus.