Degradation of validity over time: A test and extension of Ackerman's model

Psychological Bulletin

Volumn 127, Issue 5, 2001, Pages 673-691

  Keil, Charles T ^a   Cortina, Jose M ^b  

^a AMERICAN INSTITUTES FOR RESEARCH   (United States)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

HUMAN; NONLINEAR SYSTEM; PSYCHOMETRY; PSYCHOMOTOR PERFORMANCE; REACTION TIME; REPRODUCIBILITY; REVIEW; STATISTICAL MODEL;

HUMANS; MODELS, STATISTICAL; NONLINEAR DYNAMICS; PSYCHOMETRICS; PSYCHOMOTOR PERFORMANCE; REACTION TIME; REPRODUCIBILITY OF RESULTS;

EID: 0035464986     PISSN: 00332909     EISSN: None     Source Type: Journal    
DOI: 10.1037//0033-2909.127.5.673     Document Type: Article

References (85)

1. Ackerman, P. L. (1987). Individual differences in skill learning: An integration of psychometric and information processing perspectives. Psychological Bulletin, 102, 3-27.
2. *Ackerman, P. L. (1988). Determinants of individual differences during skill acquisition: Cognitive abilities and information processing. Journal of Experimental Psychology: General, 117, 288-318.
3. Ackerman, P. L. (1989). Within-task intercorrelations of skilled performance: Implications for predicting individual differences? (A comment on Henry & Hulin, 1987). Journal of Applied Psychology, 74, 360-364.
4. *Ackerman, P. L. (1990). A correlational analysis of skill specificity: Learning, abilities, and individual differences. Journal of Experimental Psychology: Learning, Memory, and Cognition, 16, 883-901.
5. Ackerman, P. L. (1992). Predicting individual differences in complex skill acquisition: Dynamics of ability determinants. Journal of Applied Psychology, 77, 598-614.
6. *Ackerman, P. L., & Kanfer, R. (1993). Integrating laboratory and field study for improving selection: Development of a battery for predicting air traffic controller success. Journal of Applied Psychology, 78, 413-432.
7. *Ackerman, P. L., Kanfer, R., & Goff, M. (1995). Cognitive and noncognitive determinants and consequences of complex skill acquisition. Journal of Experimental Psychology: Applied, 1, 270-304.
8. Ackerman, P. L., & Schneider, W. (1985). Individual differences in automatic and controlled information processing. In R. F. Dillon (Ed.), Individual differences in cognition (Vol. 2, pp. 35-66). New York: Academic Press.
9. *Ackerman, P. L., & Woltz, D. J. (1994). Determinants of learning and performance in an associative memory/substitution task: Task constraints, individual differences, volition, and motivation. Journal of Educational Psychology, 86, 487-515.
10. Adams, J. A. (1957). The relationship between certain measures of ability and the acquisition of a psychomotor response. Journal of General Psychology, 56, 121-134.
11. Adams, J. A. (1964). Motor skills. Annual Review of Psychology, 15, 181-202.
12. *Alvares, K. M., & Hulin, C. L. (1972). Two explanations of temporal changes in ability-skill relationships: A literature review and theoretical analysis. Human Factors, 14, 295-308.
13. Barrett, G. V., Alexander, R. A., & Doverspike, D. (1992). The implications for personnel selection of apparent declines in predictive validities over time: A critique of Hulin, Henry, and Noon. Personnel Psychology, 45, 601-617.
14. Berry, W. D. (1993). Understanding regression assumptions. Newbury Park, CA: Sage.
15. *Bilodeau, E. A. (1953). Speed of acquiring a simple motor response as a function of the systematic transformation of knowledge of results. American Journal of Psychology, 66, 409-420.
16. Boles, S. (1990). A model of routine and creative problem solving. Journal of Creative Behavior, 24, 171-189.
17. Busemeyer, J. R., & Jones, L. E. (1983). Analysis of multiplicative combination rules when the causal variables are measured with error. Psychological Bulletin, 93, 549-562.
18. *Butler, R. P., & McCauley, C. (1987). Extraordinary stability and ordinary predictability of academic success at the United States military academy. Journal of Educational Psychology, 79, 83-86.
19. Campbell, J. P. (1990). The role of theory in industrial and organizational psychology. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (2nd ed., Vol. 1, pp. 39-73). Palo Alto, CA: Consulting Psychologists Press.
20. *Campbell, J. P., & Zook, L. M. (1990). Building and retaining the career force: New procedures for assessing and assigning enlisted personnel, annual report, 1990 fiscal year (Tech. Rep. No. 952). Alexandria, VA: Army Research Institutes for the Behavioral Sciences.
21. Carroll, J. B. (1993). Human cognitive abilities: A survey of factor-analytic studies. New York: Cambridge University Press.
22. Cortina, J. M. (1993). Interaction, nonlinearity, and multicollinearity: Implications for multiple regression. Journal of Management, 19, 915-922.
23. Cortina, J. M. (2000). Apples and oranges (and pears, oh my!): The search for moderators in meta-analysis. Manuscript submitted for publication.
24. Cortina, J. M., & Gully, S. M. (1999. Spring). Ethics of outlier elimination: So the great dragon was cast out . . . who deceives the whole world. The Academy of Management: Research Methods Division Newsletter, 14, 1, 4, 13, 15.
25. *Deadrick, D. L., & Madigan, R. M. (1990). Dynamic criteria revisited: A longitudinal study of performance stability and predictive validity. Personnel Psychology, 43, 117-744.
26. *Dennis, W. (1954). Predicting scientific productivity in later maturity from records of earlier decades. Journal of Gerontology, 9, 465-467.
27. *Dennis, W. (1956, April 27). Age and productivity among scientists. Science, 123, 724-725.
28. *Dunham, R. B. (1974). Ability-skill relationships: An empirical explanation of change over time. Organizational Behavior and Human Performance, 12, 372-382.
29. Dwyer, P. S. (1937). The determination of the factor loadings of a given test from the known factor loadings of other tests. Psychometrika, 2, 173-178.
30. *Fleishman, E. A. (1953). A factor analysis of intra-task performance on two psychomotor tests. Psychometrika, 18, 45-55.
31. *Fleishman, E. A. (1960). Abilities at different stages of practice in rotary pursuit performance. Journal of Experimental Psychology, 60, 162-171.
32. Fleishman, E. A. (1972). On the relation between abilities, learning, and human performance. American Psychologist, 27, 1017-1032.
33. *Fleishman, E. A., & Hempel, W. E., Jr. (1954). Changes in factor structure of a complex psychomotor test as a function of practice. Psychometrika, 19, 239-252.
34. *Fleishman, E. A., & Hempel, W. E., Jr. (1955). The relation between abilities and improvement with practice in a visual discrimination reaction task. Journal of Experimental Psychology, 49, 301-312.
35. *Fleishman, E. A., & Rich, S. (1963). Role of kinesthetic and spatial-visual abilities in perceptual-motor learning. Journal of Experimental Psychology, 66, 6-11.
36. Ghiselli, E. E. (1956). Dimensional problems of criteria. Journal of Applied Psychology, 40, 1-4.
37. *Ghiselli, E. E., & Haire, M. (1960). The validation of selection tests in light of the dynamic character of criteria. Personnel Psychology, 13, 225-231.
38. *Goska, R. E., & Ackerman, P. L. (1996). An aptitude-treatment interaction approach to transfer within training. Journal of Educational Psychology, 88, 249-259.
39. *Gough, H. G., & Hall, W. B. (1975). The prediction of academic and clinical performance in medical school. Research in Higher Education, 3, 301-314.
40. Guastello, S. J. (1981). Catastrophe modeling of equity in organizations. Behavioral Science, 26, 63-74.
41. Guastello, S. J. (1982). Color matching and shift work: An industrial application of the cusp-difference equation. Behavioral Science, 27, 131-139.
42. Guastello, S. J. (1984). A catastrophe theory evaluation of a policy to control job absence. Behavioral Science, 29, 263-269.
43. Guastello, S. J. (1985). Euler bucking in a wheelbarrow obstacle course: A catastrophe with complex lag. Behavioral Science, 30, 204-212.
44. Guastello, S. J. (1987). A butterfly catastrophe model of motivation in organizations: Academic performance. Journal of Applied Psychology, 72, 165-182.
45. Guastello, S. J. (1995). Chaos, catastrophe, and human affairs: Applications of nonlinear dynamics to work, organisations, and social evolution. Mahwah, NJ: Erlbaum.
46. Guastello, S. J., & Dizadji, D. M. (1984. May). Catastrophe modeling of the accident process: Systemic control of risk in open pit and underground mines. Paper presented at the meeting of the Midwestern Psychological Association, Chicago.
47. Guastello, S. J., & Guastello, D. D. (1998). Origins of coordination and team effectiveness: A perspective from game theory and nonlinear dynamics. Journal of Applied Psychology, 83, 423-437.
48. Guastello, S. J., & McGee, D. W. (1987). Catastrophe modeling of fatigue in physically demanding jobs. Journal of Mathematical Psychology, 31, 248-269.
49. Guttman, L. (1955). A generalized simplex for factor analysis. Psychometrika, 20, 173-192.
50. *Hathaway, J. C. (1984). The mythical meritocracy of law school admissions. Journal of Legal Education, 34, 86-96.
51. *Henry, R. A., & Hulin, C. L. (1987). Stability of skilled performance across time: Some generalizations and limitations on utility. Journal of Applied Psychology, 72, 457-462.
52. *Hicks, R. E. (1976). Effect of information feedback upon intertrial consistency of time judgment. Acta Psychologica, 40, 265-270.
53. *Hinrichs, J. R. (1970). Ability correlates in learning a psychomotor task. Journal of Applied Psychology, 54, 56-64.
54. *Hinrichs, J. R. (1978). An eight-year follow-up of a management assessment center. Journal of Applied Psychology, 63, 596-601.
55. *Hoffman, C. C., Nathan, B. R., & Holden, L. M. (1991). A comparison of validation criteria: Objective versus subjective performance measures and self-versus supervisor ratings. Personnel Psychology, 44, 601-619.
56. *Hollander, E. P. (1965). Validity of peer nominations in predicting a distant performance criterion. Journal of Applied Psychology, 49, 434-438.
57. Hulin, C. L., Henry, R. A., & Noon, S. L. (1990). Adding a dimension: Time as a factor in the generalizability of predictive relationships. Psychological Bulletin, 107, 328-340.
58. *Humphreys, L. G. (1960). Investigations of the simplex. Psychometrika, 25, 313-323.
59. *Humphreys, L. G. (1968). The fleeting nature of the prediction of college academic success. Journal of Educational Psychology, 59, 375-380.
60. Humphreys, L. G. (1979). The construct of general intelligence. Intelligence, 3, 105-120.
61. *Humphreys, L. G., & Taber, T. (1973). Postdiction study of the Graduate Record Examination and eight semesters of college grades. Journal of Educational Measurement, 10, 179-184.
62. *Jones, M. B. (1968). Intertrial correlations under variations in effort. Ergonomics, 11, 175-181.
63. *Jones, M. B. (1970). A two-process theory of individual differences in motor learning. Psychological Review, 77, 353-360.
64. *Kaufman, H. G. (1972). Relations of ability and interest to currency of professional knowledge among engineers. Journal of Applied Psychology, 6, 495-499.
65. Köhler, W. (1927). The mentality of apes. New York: Harcourt, Brace.
66. Langan-Fox, J., Waycott, J., & Galna, C. (1997). Ability-performance relations during skill acquisition. Australian Psychologist, 32, 153-158.
67. *Lin, P., & Humphreys, L. G. (1977). Prediction of academic performance in graduate and professional school. Applied Psychological Measurement, 1, 249-257.
68. *Madden, H. L. (1953). An evaluation of a multi-point two-hand coordination test for selecting aviation cadets in the Air Force. Unpublished master's thesis, Yale University, New Haven, CT.
69. *Mael, F. A., & Hirsch, A. C. (1993). Rainforest empiricism and quasirationality: Two approaches to objective biodata. Personnel Psychology, 46, 719-738.
70. Marshalek, B., Lohman, D. F., & Snow, R. E. (1983). The complexity continuum in the radex and hierarchical models of intelligence. Intelligence, 7, 107-127.
71. *McEvoy, G. M., & Beatty, R. W. (1989). Assessment centers and subordinate appraisals of managers: A seven-year examination of predictive validity. Personnel Psychology, 42, 37-52.
72. *Merenda, P. F., & Clarke, W. V. (1959). AVA validity for textile workers. Journal of Applied Psychology, 43, 162-165.
73. *Mitchel, J. O. (1975). Assessment center validity: A longitudinal study. Journal of Applied Psychology, 60, 573-579.
74. *Noble, C. E. (1970). Acquisition of pursuit tracking skill under extended training as a joint function of sex and initial ability. Journal of Experimental Psychology, 86, 360-373.
75. *Parker, J. F., & Fleishman, E. A. (1960). Ability factors and component performance measures as predictors of complex tracking behavior. Psychological Monographs: General and Applied, 74, 1-36.
76. *Paulsen, G. B. (1935a). The reliability and consistency of individual differences in motor control: I. Journal of Applied Psychology, 19, 29-42.
77. *Paulsen, G. B. (1935b). The reliability and consistency of individual differences in motor control: H. Journal of Applied Psychology, 19, 166-179.
78. *Powers, D. E. (1982). Long-term predictive and construct validity of two traditional predictors of law school performance. Journal of Educational Psychology, 74, 568-576.
79. *Reynolds, B. (1952). The effect of learning on the predictability of psychomotor performance. Journal of Experimental Psychology, 44, 189-198.
80. *Rothe, H. F. (1946). Output rates among butter wrappers: I. Work curves and their stability. Journal of Applied Psychology, 30, 199-211.
81. Snow, R. E., Kyllonen, P. C., & Marshalek, B. (1984). The topography of ability and learning correlations. In R. J. Sternberg (Ed.), Advances in the psychology of human intelligence (Vol. 2, pp. 47-103). Hillsdale, NJ: Erlbaum.
82. Tabachnick, B. G., & Fidell, L. S. (1996). Using multivariate statistics (3rd ed.). New York: HarperCollins.
83. *Thomas, J. R., & Halliwell, W. (1976). Individual differences in motor skill acquisition. Journal of Motor Behavior, 8, 89-99.
84. *Viteles, M. S. (1933). The influence of training on motor test performance. Journal of Experimental Psychology, 16, 556-564.
85. *Wilson, J. E. (1959). Evaluating a four-year sales selection program. Personnel Psychology, 12, 97-104.