General mental ability, job performance, and red herrings: Responses to Osterman, Hauser, and Schmitt

Academy of Management Perspectives

Volumn 21, Issue 4, 2007, Pages 64-76

  Schmidt, Frank ^a   Le, Huy ^b   Oh, In Sue ^a   Shaffer, Jonathan ^a  

^a UNIVERSITY OF IOWA   (United States)

^b UNIVERSITY OF CENTRAL FLORIDA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 38349051047     PISSN: 15589080     EISSN: None     Source Type: Journal    
DOI: 10.5465/AMP.2007.27895340     Document Type: Note

References (63)

1. Alexander, R. A., Carson, K. P., Alliger, G. M., & Cronshaw, S. F. (1989). Empirical distributions of range restricted SDx values in validity studies. Journal of Applied Psychology, 74, 253-258.
2. American Educational Research Association, American Psychological Association, and the National Council on Measurement in Education. (1999). Standards for educational and psychological testing (5th ed.). Washington, DC: American Educational Research Association.
3. Becker, B. E., & Huselid, M. A. (1992). Direct estimates of SDy and the implications for utility analysis. Journal of Applied Psychology, 77, 227-233.
4. Bertua, C., Anderson, N., & Salgado, J. F. (2005). The predictive validity of cognitive ability tests: A UK meta-analysis. Journal of Occupational and Organizational Psychology, 78, 387-409.
5. Bobko, P., Karren, R., & Parkington, J. J. (1983). Estimation of standard deviations in utility analysis: An empirical test. Journal of Applied Psychology, 68, 170-176.
6. Brogden, H. E. (1946). On the interpretation of the correlation coefficient as a measure of predictive efficiency. Journal of Educational Psychology, 37, 65-76.
7. Brogden, H. E. (1949). When testing pays off. Personnel Psychology, 2, 171-183.
8. Burke, M. J., & Frederick, J. T. (1986). A comparison of economic utility estimates for alternative SDy estimation procedures. Journal of Applied Psychology, 71, 334-339.
9. Cascio, W. F., & Ramos, R. A. (1986). Development and applications of a new method of assessing job performance in behavioral/economic terms. Journal of Applied Psychology, 71, 20-28.
10. Cesare, S. J., Blankenship, M. H., & Giannetto, P. W. (1994). A dual focus of SDy estimations: A test of the linearity assumption and multivariate application. Human Performance, 7, 235-255.
11. Cohen, J. (1977). Statistical power analysis for the behavioral sciences (rev. ed.). New York: Academic Press.
12. Coward, W. M., & Sackett, P. R. (1990). Linearity of ability-performance relationships: A reconfirmation. Journal of Applied Psychology, 75, 297-300.
13. Dreher, G. F., & Bretz, R. D. (1991). Cognitive ability and career attainment: The moderating effects of early career success. Journal of Applied Psychology, 76, 392-397.
14. Eaton, N. K., Wing, H., & Mitchell, K. J. (1985). Alternate methods of estimating the dollar value of performance. Personnel Psychology, 38, 27-40.
15. Hartigan, J. A., & Wigdor, A. K. (Eds.). (1989). Fairness in employee testing: Validity generalization, minority issues, and the General Aptitude Test Battery. Washington, DC: National Academy Press.
16. Hauser, R. M. (2007). Will practitioners benefit from meta-analysis? Academy of Management Perspectives, 21(3), 24-28.
17. Hawk, J. (1970). Linearity of criterion-GATB aptitude relationships. Measurement and Evaluation in Guidance, 2, 249-251.
18. Hazer, J. T., & Highhouse, S. (1997). Factors influencing managers' reactions to utility analysis: Effects of SD-sub(y) method, information frame, and focal intervention. Journal of Applied Psychology, 82, 104-112.
19. Hunter, J. E. (1983). Test validation for 12,000 jobs: An application of job classification and validity generalization analysis to the General Aptitude Test Battery (GATB), Test Research Report No. 45, U.S. Department of Labor, U.S. Employment Service, Washington, DC.
20. Hunter, J. E. (1986). Cognitive ability: Cognitive aptitude, job knowledge, and job performance. Journal of Vocational Behavior, 29, 340-362.
21. Hunter, J. E., & Hunter, R. F. (1984). Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96, 73-98.
22. Hunter, J. E., & Schmidt, F. L. (1982). Quantifying the effects of psychological interventions on employee job performance and workforce productivity. American Psychologist, 38, 473-478.
23. Hunter, J. E., Schmidt, F. L., & Judiesch, M. K. (1990). Individual differences in output variability as a function of job complexity. Journal of Applied Psychology, 75, 28-42.
24. Hunter, J. E., Schmidt, F. L., & Le, H. (2006). Implications of direct and indirect range restriction for meta-analysis methods and findings. Journal of Applied Psychology, 91, 594-612.
25. Huselid, M. A. (1995). The impact of human resource management practices on turnover, productivity, and corporate financial performance. Academy of Management Journal, 38, 635-672.
26. Judge, T. A., Higgins, C.A., Thoresen, C. J., & Barrick, M. R. (1999). The Big Five personality traits, general mental ability, and career success across the life span. Personnel Psychology, 52, 621-652.
27. Le, H., Oh, I.-S., Shaffer, J. A., & Schmidt, F. L. (2007). Implications of methodological advances for the practice of personnel selection: How practitioners benefit from recent developments in meta-analysis. Academy of Management Perspectives, 21(3), 6-15.
28. Johnston, W. B., & Packer, A. H. (1987). Workforce 2000: Work and workers for the 21st century. Indianapolis, IN: Hudson Institute.
29. Mathieu, J. E., & Tannenbaum, S. I. (1989). A process-tracing approach toward understanding supervisors' SDy estimates: Results from five job classes. Journal of Occupational Psychology, 62, 246-256.
30. Morgeson, F. P., Campion, M. A., Dipboye, R. L., Hollenbeck, J. R., Murphy, K., & Schmitt, N. (2007). Reconsidering the use of personality tests in personnel contexts. Personnel Psychology, 60, 683-729.
31. Morgeson, F. P., Campion, M. A., Dipboye, R. L., Hollenbeck, J. R., Murphy, K., & Schmitt, N. (in press). Are we getting fooled again? Coming to terms with limitations in the use of personality tests for personnel selection. Personnel Psychology.
32. Murphy, K. R., & DeShon, R. P. (2000). Interrater correlations do not estimate the reliability of job performance ratings. Personnel Psychology, 53, 873-900.
33. Murray, C. (1998). Income and inequality. Washington, DC: AEI Press.
34. National Commission on Excellence in Education. (1983). A nation at risk: The imperative for educational reform. Washington, DC: U.S. Department of Education.
35. Neal, D. A., & Johnson, W. R. (1996). The role of premarket factors in Black-White wage differences. Journal of Political Economy, 104, 869-895.
36. Osterman, P. (2007). Comment on Le, Oh, Shaffer, and Schmidt. Academy of Management Perspectives, 21(3), 16-18.
37. Pearlman, K., Schmidt, F. L., & Hunter, J. E. (1980). Validity generalization results for tests used to predict job proficiency and training success in clerical occupations. Journal of Applied Psychology, 65, 373-406.
38. Raju, N. S., Edwards, J. E., & Loverde, M. A. (1985). Corrected formulas for computing sample sizes under indirect range restriction. Journal of Applied Psychology, 70, 565-566.
39. Reilly, R. R., & Smither, J. W. (1985). An examination of two alternative techniques to estimate the standard deviation of job performance in dollars. Journal of Applied Psychology, 70, 651-661.
40. Roth, P. L., Bobko, P., & Mabon, H. (2002). Utility analysis: A review and analysis at the turn of the century. In N. Anderson & D. Ones (Eds.), Handbook of industrial, work, and organizational psychology (pp. 363-384). London: Sage Publications.
41. Roth, P. L., Pritchard, R. L., Stout, J. D., & Brown, S. H. (1994). Estimating the impact of variable costs on SDy in complex situations. Journal of Business and Psychology, 8, 437-454.
42. Rothe, H. F. (1978). Output rates among industrial employees. Journal of Applied Psychology, 63, 40-46.
43. Rothstein, H. R. (1990). Interrater reliability of job performance ratings: Growth to asymptote level with increasing opportunity to observe. Journal of Applied Psychology, 75, 322-327.
44. Sackett, P. R., & Ostgaard, D. J. (1994). Job-specific applicant pools and national norms for cognitive ability tests: Implications for range restriction corrections in validation research. Journal of Applied Psychology, 79, 680-684.
45. Salgado, J. F., Anderson, N., Moscoso, S., Bertua, C., & de Fruyt, F. (2003a). International validity generalization of GMA and cognitive abilities: A European community meta-analysis. Personnel Psychology, 56, 573-605.
46. Salgado, J. F., Anderson, N., Moscoso, S., Bertua, C., de Fruyt, F., & Rolland, J. P. (2003b). A meta-analytic study of general mental ability validity for different occupations in the European community. Journal of Applied Psychology, 88, 1068-1081.
47. Schmidt, F. L. (2002). The role of general cognitive ability and job performance: Why there cannot be a debate. Human Performance, 15, 187-202.
48. Schmidt, F. L., & Hunter, J. E. (1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications for 85 years of research findings. Psychological Bulletin, 124, 262-274.
49. Schmidt, F. L., & Hunter, J. E. (2004). General mental ability in the world of work: Occupational attainment and job performance. Journal of Personality and Social Psychology, 86, 162-173.
50. Schmidt, F. L., Hunter, J. E., Pearlman, K., & Shane, G. S. (1979). Further tests of the Schmidt-Hunter Bayesian Validity Generalization Model. Personnel Psychology, 32, 257-281.
51. Schmidt, F. L., Hunter, J. E., McKenzie, R. C., & Muldrow, T. W. (1979). Impact of valid selection procedures on workforce productivity. Journal of Applied Psychology, 64, 609-626.
52. Schmidt, F. L., Hunter, J. E., & Outerbridge, A. N. (1986). Impact of job experience and ability on job knowledge, work sample performance, and supervisory ratings of performance. Journal of Applied Psychology, 71, 432-439.
53. Schmidt, F. L., Hunter, J. E., & Urry, V. W. (1976). Statistical power in criterion-related validity studies. Journal of Applied Psychology, 61, 473-485.
54. Schmidt, F. L., Oh, I.-S., & Le, H. (2006). Increasing the accuracy of corrections for range restriction: Implications for selection procedure validities and other research results. Personnel Psychology, 59, 281-305.
55. Schmidt, F. L., Shaffer, J. A., & Oh, I.-S. (in press). Increased accuracy of range restriction corrections: Implications for the role of personality and general mental ability in job and training performance. Personnel Psychology.
56. Schmidt, F. L., Viswesvaran, C., & Ones, D. S. (2000). Reliability is not validity and validity is not reliability. Personnel Psychology, 53, 901-912.
57. Schmitt, N. (2007). The value of personnel selection: Reflections on some remarkable claims. Academy of Management Perspective, 21(3), 19-23.
58. Scullin, M. H., Peters, E., Williams, W. M., & Ceci, S. J. (2000). The role of IQ and education in predicting later labor market outcomes: Implications for affirmative action. Psychology, Public Policy, and Law, 6, 63-89.
59. Smith, M. (1989). Some British data concerning the standard deviation of performance. Journal of Occupational Psychology, 62, 189-190.
60. Society for Industrial and Organizational Psychology. (2003). Principles for the validation and use of personnel selection procedures (4th ed.). Bowling Green, OH: Society for Industrial and Organizational Psychology.
61. Viswesvaran, C., Schmidt, F. L., & Ones, D. S. (2005). Is there a general factor in ratings of job performance? A meta-analytic framework for disentangling substantive and error influences. Journal of Applied Psychology, 90, 108-131.
62. Wilk, S. L., Desmarais, L. B., & Sackett, P. R. (1995). Gravitation to jobs commensurate with ability: Longitudinal and cross-sectional tests. Journal of Applied Psychology, 80, 79-85.
63. Wilk, S. L., & Sackett, P. R. (1996). Longitudinal analysis of ability-job complexity fit and job change. Personnel Psychology, 49, 937-967.