Pitfalls of Ability Research

International Journal of Selection and Assessment

Volumn 9, Issue 4, 2001, Pages 325-335

  Carretta, Thomas R ^a   Ree, Malcolm James ^b  

^a AIR FORCE RESEARCH LABORATORY   (United States)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0035733597     PISSN: 0965075X     EISSN: None     Source Type: Journal    
DOI: 10.1111/1468-2389.00184     Document Type: Article

References (62)

1. Agresti, A. and Finlay, B. (1997) Statistical Methods for the Social Sciences (3rd edn). Upper Saddle River, NJ: Prentice-Hall, 624-629.
2. Aiken, L.R. Jr. (1966) Another look at weighting test items. Journal of Educational Measurement, 3, 183-185.
3. Brand, C. (1987) The importance of general intelligence. In S. Modgil and C. Modgil (eds.) Arthur Jensen: Consensits and Controversy. New York: Falmer Press.
4. Carretta, T.R. (1997) Group differences on US Air Force pilot selection tests. International Journal of Selection and Assessment 5, 115-127.
5. Carretta, T.R., Perry, D.C., Jr. and Ree, M.J. (1996) Predicting situational awareness in F-15 pilots. The International Journal of Aviation Psychology, 6, 21-41.
6. Carretta, T.R. and Ree, M.J. (1995) Air Force Officer Qualifying Test validity for predicting pilot training performance. Journal of Business and Psychology, 9, 379-388.
7. Carretta, T.R. and Ree, M.J. (1996) Factor structure of the Air Force Officer Qualifying Test: Analysis and comparison. Military Psychology, 8, 29-42.
8. Carroll, J.B. (1978) How shall we study individual differences in cognitive abilities? Methodological and theoretical perspectives. Intelligence, 2, 87-115.
9. Cohen, J. (1983) The cost of dichotomization. Applied Psychological Measurement, 7, 249-253.
10. Cohen, J. (1987) Statistical Power Analysis for the Behavioral Sciences (revised edition). Hillsdale, NJ: Lawrence Erlbaum Associates.
11. Dansereau, F., Alutto, J.A. and Yammarino, F.J. (1984) Theory Testing in Organizational Behavior: The Variant Approach. Englewood Cliffs, NJ: Prentice-Hall.
12. Donchin, E., Fabiani, M. and Sanders, A. (eds) (1989) The learning strategies program: An examination of the strategies in skill acquisition [Special Issue]. Ada Psychologica, 71.
13. French, J.W., Ekstrom, R.B. & Price, L.A. (1969) Manual for Kit of Reference Tests for Cognitive Factors (revised). Princeton, NJ: Educational Testing Service.
14. Fuller, W.A. (1987) Measurement Error Models. New York: Wiley.
15. Goldberg, S. (1991) When Wish Replaces Thought. Buffalo, NY: Prometheus.
16. Gulliksen, H. and Wilks, S.S. (1950) Regression tests for several samples. Psychotnetrika, 15, 91-114.
17. Heim, A.W. and Batts, V. (1948) Upward and downward selection in intelligence testing. British Journal of Psychology, 39, 22-29.
18. Hogan, J.C (1991) Physical abilities. In M.N. Dunnette and L.M. Hough (eds) Handbook of Industrial and Organizational Psychology. 2nd edn. Vol. 2 (pp. 753-871). Palo Alto, CA: Consulting Psychologists Press.
19. Houck, M.R., Whitaker, L.A. and Kendall, R.R. (1991) Behavioral Taxonomy for Air Combat: F-15 Defensive Counter-air Mission (UDR-TR-91-147). Dayton, OH: University of Dayton Research Institute.
20. Houck, M.R., Whitaker, L.A. and Kendall, R.R. (1993) An Information Processing Classification of Beyond Visual Range Air Intercepts (AL/HR-TR-1993-0061). Williams AFB, AZ: Armstrong Laboratory, Human Resources Directorate.
21. Hunter, J.E. (1986) Cognitive ability, cognitive aptitudes, job knowledge & job performance. Journal of Vocational Behavior, 29, 340-362.
22. Hunter, J.E. and Schmidt, F.L. (1990) Methods of Meta-analysis. Newbury Park, CA: Sage.
23. Jensen, A.R. (1980) Bias in Mental Testing. New York: Free Press.
24. Johnson, J.T. and Ree, M.J. (1994) RANGEJ: A Pascal program to compute the multivariate correction for range restriction. Educational and Psychological Measurement, 54, 693-695.
25. Jones, G.E. and Ree, M.J. (1998) Aptitude test validity: No moderating effects due to job ability requirements. Educational and Psychological Measurement, 58, 282-292.
26. Kass, R.A., Mitchell, K.J., Grafton, F.C. and Wing, H. (1983) Factorial validity of the Armed Services Vocational Aptitude Battery (ASVAB), forms 8, 9 & 10: 1981 Army applicant sample. Educational and Psychological Measurement, 43, 1077-1087.
27. Kennedy, E. (1988) Estimation of the squared crossvalidity coefficients in the context of best subtest regression. Applied Psychological Measurement, 12, 231-237.
28. Lawley, D.N. (1943) A note on Karl Pearson's selection formulae. Proceedings of the Royal Society of Edinburgh, Section A, 62 (Pt.1), 28-30.
29. Linn, R.L., Harnish, D.L. and Dunbar, S. (1981) Corrections for range restriction: An empirical investigation of conditions resulting in conservative corrections. Journal of Applied Psychology, 66, 655-663.
30. Martinussen, M. (1997) Pilot selection and range restriction: A red herring or a real problem? Proceedings of the Ninth International Symposium on Aviation Psychology, Columbus, OH, 1314-1318.
31. Morrison, T. and Morrison, M. (1995) A meta-analytic assessment of the predictive validity of the quantitative and verbal composites of the Graduate Record Examination with graduate grade point average representing the criterion of graduate success. Educational and Psychological Measurement, 55, 309-316.
32. Mosier, C.I. (1951) Problems and designs of crossvalidation. Educational and Psychological Measurement, 11, 5-11.
33. Murphy, K.R. (1983) Fooling yourself with crossvalidation: single-sample designs. Personnel Psychology, 36, 111-118.
34. Olea, M.M. and Ree, M.J. (1994) Predicting pilot and navigator criteria: Not much more than g. Journal of Applied Psychology, 79, 845-851.
35. Rabbitt, P., Banerji, N. and Szymanski, A. (1989) Space Fortress as an IQ test? Predictions of learning and of practiced performance in a complex interactive video-game. Acta Psychologica, 71, 243-257.
36. Ree, M.J. (1995) Nine rules for doing ability research wrong. The Industrial-Organizational Psychologist, 32, 64-68.
37. Ree, M.J. and Carretta, T.R. (1994) Factor analysis of the ASVAB: Confirming a Vernon-like structure. Educational and Psychological Measurement, 54, 459-463.
38. Ree, M.J. and Carretta, T.R. (1997) What makes an aptitude test valid? In R. F. Dillon (ed.) Handbook on testing (pp. 65-81). Westport, CT: Greenwood Press.
39. Ree, M.J., Carretta, T.R. and Earles, J.A. (1998) In top-down decisions, weighting variables does not matter: A consequence of Wilks' theorem. Organizational Research Methods, 1, 407-420.
40. Ree, M.J., Carretta, T.R. and Earles, E.A. (1999) In validation, sometimes two sexes are one too many: A tutorial. Human Performance, 12, 79-88.
41. Ree, M.J., Carretta, T.R., Earles, J.A. and Albert, W. (1994) Sign changes when correcting for range restriction: A note on Pearson's and Lawley's selection formulas. Journal of Applied Psychology, 79, 298-301.
42. Ree, M.J., Carretta, T.R. and Teachout, M.S. (1995) Role of ability and prior job knowledge in complex training performance. Journal of Applied Psychology, 80, 721-730.
43. Ree, M.J. and Earles, J.A. (1991) Predicting training success: Not much more than g. Personnel Psychology, 44, 327-332.
44. Ree, M.J. and Earles, J.A. (1993) g is to psychology what carbon is to chemistry: A reply to Sternberg and Wagner, McClelland and Calfee. Current Directions in Psychological Science, 2, 11-12.
45. Ree, M.J., Earles, J.A. and Teachout, M.S. (1994) Predicting job performance: Not much more than g. Journal of Applied Psychology, 79, 518-524.
46. Reynolds, C.E. (1982) Methods for detecting construct and predictive bias. In R.A. Bork (ed.) Handbook of Methods for Detecting Test Bias (pp. 199-277). Baltimore, MD: Johns Hopkins University Press.
47. Schmid, J. and Leiman, J.M. (1957) The development of hierarchical factor solutions. Psychometrika, 22, 55-61.
48. Schmidt, F.L. and Hunter, J.E. (1978) Moderator research and the law of small numbers. Personnel Psychology, 31, 215-232.
49. Schmidt, F.L., Hunter, J.E. and Urry, V.W. (1976) Statistical power in criterion-related validation studies. Journal of Applied Psychology, 61, 473-485.
50. Sedlmeier, P. and Gigerenzer, G. (1989) Do studies of statistical power have an effect on the power of studies? Psychological Bulletin, 105, 309-316.
51. Seymour, R.T. (1988) Why plaintiffs' councils challenge tests and how they can successfully challenge the theory of 'Validity Generalization' Journal of Vocational Behavior, 33, 331-364.
52. Skinner, J. and Ree, M.J. (1987) Air Force Officer Qualifying Test (AFOQT): Item and Factor Analysis of Form O (AFHRL-TR-86-68). Brooks AFB, TX: Manpower and Personnel Division, Air Force Human Resources Laboratory.
53. Society for Industrial-Organizational Psychology (1987) Principles for the Validation and Use of Personnel Selection Procedures (3rd edn.). College Park, MD: Author
54. Spearman, C. (1904) 'General intelligence' objectively defined and measured. American Journal of Psychology, 15, 201-293.
55. Spearman, C. (1927) The Abilities of Man: Their Nature and Measurement. New York: Macmillan.
56. Stein, C. (1960) Multiple regression. In I. Olkin et al. (eds.) Contributions to Probability and Statistics. Stanford, CA: Stanford University Press.
57. Thorndike, R.L. (1949) Personnel Selection. New York: Wiley.
58. Wainer, H. (1976) Estimating coefficients in linear models: It don't make no nevermind. Psychological Bulletin, 83, 213-217.
59. Wainer, H. (1978) On the sensitivity of regression and regressons. Psychological Bulletin, 85, 267-273.
60. Walters, L.C., Miller, M. and Ree, M.J. (1993) Structured interviews for pilot selection: No incremental validity. The International Journal of Aviation Psychology, 3, 25-38.
61. Wherry, R.J. (1975) Underprediction from overfitting: 45 years of shrinkage. Personnel Psychology, 29, 1-18.
62. Wilks, S.S. (1938) Weighting systems for linear functions of correlated variables when there is no dependent variable. Psychometrika, 3, 23-40.