Validity of measures of cognitive processes and general ability for learning and performance on highly complex computerized tutors: Is the g factor of intelligence even more general?

Journal of Applied Psychology

Volumn 85, Issue 6, 2000, Pages 940-955

  Roznowski, Mary ^d   Dickter, David N ^b   Hong, Sehee ^a   Sawin, Linda L ^c   Shute, Valerie J ^d  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b AT AND T LABS RESEARCH   (United States)

^c BOEING COMPANY   (United States)

^d Boeing ^*

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CLINICAL TRIAL; COGNITION; FACTORIAL ANALYSIS; FEMALE; HUMAN; INTELLIGENCE TEST; LEARNING; MALE; REACTION TIME; REGRESSION ANALYSIS; TEACHING;

COGNITION; COMPUTER-ASSISTED INSTRUCTION; FACTOR ANALYSIS, STATISTICAL; FEMALE; HUMANS; INTELLIGENCE TESTS; LEARNING; MALE; REACTION TIME; REGRESSION ANALYSIS;

EID: 0034540926     PISSN: 00219010     EISSN: None     Source Type: Journal    
DOI: 10.1037/0021-9010.85.6.940     Document Type: Article

References (73)

1. Ackerman, P. L. (1988). Determinants of individual differences during skill acquisition: Cognitive abilities and information processing perspectives. Journal of Experimental Psychology: General, 117, 288-318.
2. Ackerman, P. L., & Kanfer, R. (1993). Integrating laboratory and field study for improving selection: Development of a battery for predicting air traffic controller success. Journal of Applied Psychology, 78, 413-432.
3. Allport, G. W. (1937). Personality: A psychological interpretation. New York: Holt, Rinehart and Winston.
4. Allport, G. W. (1966). Traits revisited. American Psychologist, 21, 1-10.
5. Anderson, J. R. (1983). The architecture of cognition. Mahwah, NJ: Erlbaum.
6. Anderson, J. R., Boyle, C. F., & Reiser, B. J. (1985, April). Intelligent tutoring systems. Science, 228, 456-462.
7. Arthur, W., Barrett, G. V., & Doverspike, D. (1990). The validity of an information-processing-based test battery for the prediction of handling accidents among petroleum-product transport drivers. Journal of Applied Psychology, 75, 621-628.
8. Arvey, R. D., Strickland, W., Drauden, G., & Martin, C. (1990). Motivational components of test-taking. Personnel Psychology, 43, 695-716.
9. Baddeley, A. (1986). Working memory. Oxford. England: Clarendon Press.
10. Boring, E. G. (1923, June 6). Intelligence as the tests test it. The New Republic, 35-37.
11. Boring, E. G. (1950). A history of experimental psychology (Rev. ed.). New York: Appleton-Century-Crofts.
12. Brody, N. (1992). Intelligence. San Diego, CA: Academic Press.
13. Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Lang (Eds.), Testing structural equation models (pp. 136-162). Newbury Park, CA: Sage.
14. Campbell, J. P. (1990). An overview of the Army selection and classification project (Project A). Personnel Psychology, 43, 231-239.
15. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin. 56, 81-105.
16. Cattin, P. (1980). Estimation of the predictive power of a regression model. Journal of Applied Psychology, 65, 407-414.
17. Christal, R. E. (1991). Comparative validities of ASVAB and LAMP tests for logic gates learning (Report No. AL-TP-1991-0031). Brooks Air Force Base, TX: Manpower and Personnel Division, Air Force Human Resources Laboratory.
18. Cronbach, L. J. (1989). Construct validation after thirty years. In R. Linn (Ed.), Intelligence: Measurement, theory, and public policy. Proceedings of a symposium in honor of Lloyd G. Humphreys (pp. 147-171). Urbana, IL: University of Illinois Press.
19. Detterman, D. K. (1982). Does "g" exist? Intelligence, 6, 99-108.
20. Dunnette, M. D. (1976). Aptitudes, abilities, and skills. In M. D. Dunnette (Ed.), Handbook of industrial and organizational psychology (1st ed., pp. 473-520). Chicago: Rand McNally.
21. Embretson, S. E. (1983). Construct validity: Construct representation and nomothetic span. Psychological Bulletin, 93, 179-197.
22. Fiske, D. W., & Campbell, D. T. (1992). Citations do not solve problems. Psychological Bulletin, 112, 393-395.
23. Guilford, J. P. (1967). The nature of human intelligence. New York: McGraw-Hill.
24. Guilford, J. P. (1985). The structure of intellect model. In B. B. Wolman (Ed.), Handbook of intelligence: Theories, measurements, and applications (pp. 225-266). New York: Wiley.
25. Holland, J. H., Holyoak, K. J., Nisbett, R. E., & Thagard, P. R. (1986). Induction: Processes of inference, learning and discovery. Cambridge, MA: MIT Press.
26. Humphreys, L. G. (1971). Theory of intelligence. In R. Cancro (Ed.), Intelligence: Genetic and environmental influences (pp. 31-42). New York: Grune & Stratton.
27. Humphreys, L. G. (1979). The construct of general intelligence. Intelligence, 3, 105-120.
28. Humphreys, L. G. (1981). The primary mental ability. In M. P. Friedman, J. P. Das, & N. O'Connor (Eds.), Intelligence and learning (pp. 87-120). New York: Plenum.
29. Humphreys, L. G. (1984). General intelligence. In C. R. Reynolds & R. T. Brown (Eds.), Perspectives in mental testing (pp. 221-248). New York: Plenum.
30. Humphreys, L. G. (1985). Attenuated hypothesis or attenuated test of hypothesis? Intelligence, 9(3), 291-295.
31. Humphreys, L. G. (1989). The first factor extracted is an unreliable estimate of Spearman's "g": The case of discrimination reaction time. Intelligence, 13, 319-324.
32. Humphreys, L. G., & Parsons, C. K. (1979). Piagetian tasks measure intelligence and intelligence tests assess cognitive development. Intelligence, 3, 369-382.
33. Hunt, E., & Pellegrino, J. W. (1985). Using interactive computing to expand intelligence testing. Intelligence, 9, 207-236.
34. Hunter, J. E. (1986). Cognitive ability, cognitive aptitudes, job knowledge, and job performance. Journal of Vocational Behavior, 29, 340-362.
35. Hunter, J. E., & Hunter, R. F. (1984). Validity and utility of alternate predictors of job performance. Psychological Bulletin, 96, 72-98.
36. Irvine, S. H., Anderson, J. D., & Dann, P. L. (1990). Towards a theory of algorithm-determined cognitive test construction. British Journal of Psychology, 81, 173-195.
37. Jensen, A. R. (1998). The general factor in human intelligence. New York: Praeger.
38. Kyllonen, P. C. (1991). Principles for creating a computerized test battery. Intelligence, 15, 1-15.
39. Kyllonen, P. C. (1994). Cognitive abilities, testing: An agenda for the 1990s. In M. G. Rumsey, C. B. Walker, & J. H. Harris (Eds.), Personnel selection and classification (pp. 103-125). Hillsdale, NJ: Erlbaum.
40. Kyllonen, P. C., & Christal, R. E. (1989). Cognitive modeling of learning abilities: A status report of LAMP. In R. F. Dillon & J. W. Pellegrino (Eds.), Testing: Theoretical and applied perspectives, (pp. 146-173). New York: Praeger.
41. Kyllonen, P. C., & Christal, R. E. (1990). Reasoning ability is (little more than) working memory capacity?! Intelligence, 14, 389-433.
42. Kyllonen, P. C., Woltz, D. J., Christal, R. E., Tirre, W. C., Shute, V. J., & Chaiken, S. (1990). CAM-4: Computerized battery of cognitive ability tests. Unpublished computer program, Brooks Air Force Base, TX.
43. Lesgold, A., Busszo, M. S., McGinnis, T., & Eastman, R. (1989). Windy, the flight engineering tutor [Unpublished computer software]. Learning Research and Development Center, University of Pittsburgh, PA.
44. Loftus, E. F. (1983). Activation of semantic memory. American Journal of Psychology, 86, 331-337.
45. Lubinski, D., & Dawis, R. V. (1992). Aptitudes, skills, and proficiencies. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (Vol. 3, pp. 1-59). Palo Alto, CA: Consulting Psychologists Press.
46. Lubinski, D., & Humphreys, L. G. (1990). A broadly based analysis of mathematical giftedness. Intelligence, 14, 327-355.
47. Lubinski, D., & Humphreys, L. G. (1992). Some bodily and medical correlates of mathematical giftedness and commensurate levels of socioeconomic status. Intelligence, 16, 99-115.
48. Marsh, H. W., & Hocevar, D. (1985). Application of confirmatory factor analysis to the study of self-concept: First-and higher order factor models and their invariance across groups. Psychological Bulletin, 97, 562-582.
49. Mead, A. D., & Drasgow, F. (1993). Equivalence of computerized and paper-and-pencil cognitive ability tests: A meta-analysis. Psychological Bulletin, 114, 449-458.
50. Meehl, P. E. (1986). Trait language and behaviorese. In T. Thompson & M. Zeiler (Eds.), Analysis and integration of behavioral units (pp. 335-354). Hillsdale, NJ: Erlbaum.
51. Meehl, P. E., & Cronbach, L. J. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281-302.
52. Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741-749.
53. Pintner, R. (1921). Contribution to "Intelligence and its measurement." Journal of Educational Psychology, 12, 139-143.
54. Ree, M. J., & Carretta, T. R. (1994). Factor analysis of the ASVAB: Confirming a Vernon-like structure. Educational and Psychological Measurement, 54, 459-463.
55. Ree, M., & Earles, J. (1991). Predicting training success: Not much more than g. Personnel Psychology, 44, 321-332.
56. Ree, M., & Earles, J. (1992). Intelligence is the best predictor of job performance. Current Directions in Psychological Science, I, 86-89.
57. Roznowski, M. (1993). Measures of cognitive processes: Their stability and other psychometric and measurement properties. Intelligence, 17, 361-388.
58. Roznowski, M. (1998). The Graduate Record Examination: Testing:: Yale: Academics. American Psychologist, 53, 570-572.
59. Schmidt, F. L., & Hunter, J. E. (1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124, 262-274.
60. Shute, V. J. (1991). Who is likely to acquire programming skills? Journal of Educational Computing Research, 7, 1-24.
61. Shute, V. J. (1993a). A comparison of learning environments: All that glitters. . . . In S. P. Lajoie & S. J. Deny (Eds.), Computers as cognitive tools (pp. 47-73). Hillsdale, NJ: Erlbaum.
62. Shute, V. J. (1993b). A macrcadaptive approach to tutoring. Journal of Artificial Intelligence and Education, 4, 61-93.
63. Shute, V. J., & Psotka, J. (1996). Intelligent tutoring systems: Past, present, and future. In D. Jonassen (Ed.), Handbook of research for educational communications and technology (pp. 570-600). New York: Macmillan.
64. Snow, R. E., Kyllonen, P. C., & Marshalek, B. (1984). The topography of ability and learning correlations. In R. J. Sternberg (Ed.), Advances in the psychology of human intelligence (Vol. 2, pp. 47-103). Hillsdale, NJ: Erlbaum.
65. Society for Industrial and Organizational Psychology. (1987). Principles for the validation and use of personnel selection procedures: Third edition. College Park, MD: Author.
66. Spearman, C. (1904). "General intelligence": Objectively determined and measured. American Journal of Psychology, 15, 201-292.
67. Spearman, C. (1923). The nature of intelligence and the principles of cognition. London: Macmillan.
68. Spearman, C. (1927). Abilities of man: Their nature and measurement. New York: MacMillan.
69. Stauffer, J. M., Ree, M. J., & Carretta, T. R. (1996). Cognitive-components tests are not much more than g: An extension of Kyllonen's analyses. The Journal of General Psychology, 23, 193-205.
70. Sternberg, R. J. (1981). Test ng and cognitive psychology. American Psychology, 36, 1181-1189.
71. Vernon, P. E. (1969). Intelligence and cultural environment. London: Methuen.
72. Wigdor, A. K., & Green, B. F., Jr. (1991). Performance assessment in the workplace. Washington, DC National Academy Press.
73. Woltz, D. J. (1988). An investigation of the role of working memory in procedural skill acquisition. Journal of Experimental Psychology: General, 117, 319-331.