A knowledge-based theory of rising scores on "Culture-Free" tests

Journal of Experimental Psychology: General

Volumn 142, Issue 3, 2013, Pages 979-1000

  Fox, Mark C ^a   Mitchum, Ainsley L ^b  

^a FLORIDA STATE UNIVERSITY   (United States)

^b SR Research   (Canada)

Author keywords

Cognitive aging; Flynn effect; Indeterminacy; Measurement invariance; Raven's matrices

Indexed keywords

ARTICLE; COGNITION; CULTURAL ANTHROPOLOGY; HUMAN; INTELLIGENCE; INTELLIGENCE TEST; KNOWLEDGE; MALE; THINKING;

COGNITION; CULTURE; HUMANS; INTELLIGENCE; INTELLIGENCE TESTS; KNOWLEDGE; MALE; THINKING;

EID: 84887585176     PISSN: 00963445     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0030155     Document Type: Article

References (83)

1. Abad, F. J., Colom, R., Rebollo, I.,&Escorial, S. (2004). Sex differential item functioning in the Raven's Advanced Progressive Matrices: Evidence for bias. Personality and Individual Differences, 36, 1459-1470.
2. Adams, R., Wilson, M.,&Wang, W. (1997). The multidimensional random coefficients multinomial logit model. Applied Psychological Measurement, 21, 1-23.
3. Andrich, D. (2004). Controversy and the Rasch model: A characteristic of incompatible paradigms? Medical Care, 42, I-7-I-16.
4. Arthur, W.,&Day, D. V. (1994). Development of a short form for the Raven Advanced Progressive Matrices Test. Educational and Psychological Measurement, 54, 394-403.
5. Babcock, R. L. (2002). Analysis of age differences in types of errors on the Raven's Advanced Progressive Matrices. Intelligence, 30, 485-503.
6. Beaujean, A. A.,&Osterlind, S. J. (2008). Using item response theory to assess the Flynn effect in the National Longitudinal Study of Youth 79 Children and Young Adults data. Intelligence, 36, 455-463.
7. Boag, S. (2011). Explanation in personality psychology: "Verbal magic" and the five-factor model. Philosophical Psychology, 24, 223-243.
8. Boot, W. R., Champion, M., Blakely, D. P., Wright, T., Souders, D. J., & Charness, N. (2012). Video game interventions as a means to address cognitive aging: Perceptions, attitudes, and effectiveness. Manuscript submitted for publication.
9. Borsboom, D., Mellenbergh, G. J.,&van Heerden, J. (2003). The theoretical status of latent variables. Psychological Review, 110, 203-219.
10. Borsboom, D., Mellenbergh, G. J.,&van Heerden, J. (2004). The concept of validity. Psychological Review, 111, 1061-1071.
11. Brouwers, S. A., Van de Vijver, F. J. R.,&Van Hemert, D. A. (2009). Variation in Raven's Progressive Matrices scores across time and place. Learning and Individual Differences, 19, 330-338.
12. Bunge, M. (1997). Mechanism and explanation. Philosophy of the Social Sciences, 27, 410-465.
13. Carpenter, P. A., Just, M. A.,&Shell, P. (1990). What one intelligence test measures: A theoretical account of the processing in the Raven Progressive Matrices Test. Psychological Review, 97, 404-431.
14. Chalmers, D. J., French, R. M.,&Hofstadter, D. R. (1992). High-level perception, representation, and analogy: A critique of artificial intelligence methodology. Journal of Experimental&Theoretical Artificial Intelligence, 4, 185-211.
15. Colom, R., Lluis-Font, J. M.,&Andrés-Pueyo, A. (2005). The generational intelligence gains are caused by decreasing variance in the lower half of the distribution: Supporting evidence for the nutrition hypothesis. Intelligence, 33, 83-91.
16. Daley, T. C., Whaley, S. E., Sigman, M. D., Espinosa, M. P.,&Neumann, C. (2003). IQ on the rise: The Flynn effect in rural Kenyan children. Psychological Science, 14, 215-219.
17. Dickinson, M. D.,&Hiscock, M. (2010). Age-related IQ decline is reduced markedly after adjustment for the Flynn effect. Journal of Clinical and Experimental Neuropsychology, 32, 865-870.
18. Embretson, S. E. (1998). A cognitive design system approach to generating valid tests: Application to abstract reasoning. Psychological Methods, 3, 380-396.
19. Ericsson, K. A.,&Kintsch, W. (1995). Long-term working memory. Psychological Review, 102, 211-245.
20. Ericsson, K. A.,&Simon, H. A. (1980). Verbal reports as data. Psychological Review, 87, 215-251.
21. Ericsson, K. A.,&Simon, H. A. (1993). Protocol analysis: Verbal reports as data (Rev. ed.). Cambridge, MA: MIT Press.
22. Flynn, J. R. (1984). The mean IQ of Americans: Massive gains 1932 to 1978. Psychological Bulletin, 95, 29-51.
23. Flynn, J. R. (1987). Massive IQ gains in 14 nations: What IQ tests really measure. Psychological Bulletin, 101, 171-191.
24. Flynn, J. R. (1999). Searching for justice: The discovery of IQ gains over time. American Psychologist, 54, 5-20.
25. Flynn, J. R. (2007). What is intelligence? Beyond the Flynn effect.
26. Flynn, J. R.,&Weiss, L. G. (2007). American IQ gains from 1932 to 2002: The WISC subtests and educational progress. International Journal of Testing, 7, 209-224.
27. Forbes, A. R. (1964). An item analysis of the Advanced Matrices. British Journal of Educational Psychology, 34, 223-236.
28. Fox, M. C., Ericsson, K. A.,&Best, R. (2011). Do procedures for verbal reporting of thinking have to be reactive? A meta-analysis and recommendations for best reporting methods. Psychological Bulletin, 137, 316-344.
29. Freund, P. A., Hofer, S.,&Holling, H. (2008). Figural matrix items explaining and controlling for the psychometric properties of computergenerated matrix items. Applied Psychological Measurement, 32, 195-210.
30. Gallini, J. K. (1983). A Rasch analysis of Raven item data. Journal of Experimental Education, 52, 27-32.
31. Green, K. E.,&Kluever, R. C. (1992). Components of item difficulty of Raven's Matrices. Journal of General Psychology, 119, 189-199.
32. Henrich, J., Heine, S. J.,&Norenzayan, A. (2010). The weirdest people in the world? Behavioral and Brain Sciences, 33, 61-83.
33. Hidalgo, M. D.,&Gomez, J. (2006). Nonuniform DIF detection using discriminant logistic analysis and multinomial regression: A comparison for polytomous items. Quality&Quantity, 40, 805-823.
34. Hiscock, M. (2007). The Flynn effect and its relevance to neuropsychology. Journal of Clinical and Experimental Neuropsychology, 29, 514-529.
35. Hofer, S. M.,&Sliwinski, M. S. (2001). Understanding ageing. Gerontology, 47, 341-352.
36. Kane, H.,&Oakland, T. D. (2000). Secular declines in Spearman's g: Some evidence from the United States. The Journal of Genetic Psychology: Research and Theory on Human Development, 161, 337-345.
37. Kelderman, H. (1996). Multidimensional models for partial-credit scoring. Applied Psychological Measurement, 20, 155-168.
38. Khaleefa, O., Abdelwahid, S. B., Abdulradi, F.,&Lynn, R. (2008). The increase of intelligence in Sudan 1964-2006. Personality and Individual Differences, 45, 412-413.
39. Lamiell, J. T. (2007). On sustaining critical discourse with mainstream personality investigators: Problems and prospects. Theory&Psychology, 17, 169-185.
40. Linhares, A. (2000). A glimpse at the metaphysics of Bongard problems. Artificial Intelligence, 121, 251-270.
41. Lynn, R. (1990). The role of nutrition in secular increases in intelligence. Personality and Individual Differences, 11, 273-285.
42. Lynn, R., Hampson, S. L.,&Millineux, J. C. (1987, August 27). A long-term increase in the fluid intelligence of English children. Nature, 328, 797.
43. Mackintosh, N. J.,&Bennett, E. S. (2005). What do Raven's Matrices measure? An analysis in terms of sex differences. Intelligence, 33, 663-674.
44. Maraun, M. D. (1996). Metaphor taken as math: Indeterminacy in the factor analysis model. Multivariate Behavioral Research, 31, 517-538.
45. Maraun, M. D. (1998). Measurement as a normative practice: Implications of Wittgenstein's philosophy for measurement in psychology. Theory & Psychology, 8, 435-461.
46. Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149-174.
47. Maze, J. R. (1954). Do intervening variables intervene? Psychological Review, 61, 226-234.
48. Meo, M., Roberts, M. J.,&Marucci, F. S. (2007). Element salience as a predictor of item difficulty for the Raven's Progressive Matrices. Intelligence, 35, 359-368.
49. Michell, J. (2011). Constructs, inferences, and mental measurement. New Ideas in Psychology. Advance online publication.
50. Miller, T. R.,&Spray, J. A. (1993). Logistic discriminant function-analysis for DIF identification of polytomously scored items. Journal of Educational Measurement, 30, 107-122.
51. Millsap, R. E. (2007). Invariance in measurement and prediction revisited. Psychometrika, 72, 461-473.
52. Mingroni, M. A. (2007). Resolving the IQ paradox: Heterosis as a cause of the Flynn effect and other trends. Psychological Review, 114, 806-829.
53. Mitchum, A. L.,&Kelley, C. M. (2010). Solve the problem first: Constructive solution strategies can influence the accuracy of retrospective confidence judgments. Journal of Experimental Psychology: Learning, Memory, and Cognition, 36, 699-710.
54. Must, O., te Nijenhuis, J., Must, A.,&van Vianen, A. E. M. (2009). Comparability of IQ scores over time. Intelligence, 37, 25-33.
55. Primi, R. (2002). Complexity of geometric inductive reasoning tasks: Contribution to the understanding of fluid intelligence. Intelligence, 30, 41-70.
56. Rodgers, J. L. (1998). A critique of the Flynn effect: Massive IQ gains, methodological artifacts, or both? Intelligence, 26, 337-356.
57. Rushton, J. P., Skuy, M.,&Bons, T. A. (2004). Construct validity of Raven's Advanced Progressive Matrices for African and non-African engineering students in South Africa. International Journal of Selection and Assessment, 12, 220-229.
58. Salthouse, T. A. (1993). Influence of working memory on adult age differences in matrix reasoning. British Journal of Psychology, 84, 171-199.
59. Schaie, K. W. (2009). "When does age-related cognitive decline begin?" Salthouse again reifies the "cross-sectional fallacy." Neurobiology of Aging, 30, 528-529.
60. Schoenthaler, S. J., Amos, S. P., Eysenck, H. J., Peritz, E.,&Yudkin, J. (1991). Controlled trial of vitamin-mineral supplementation: Effects on intelligence and performance. Personality and Individual Differences, 12, 351-362.
61. Sigman, M.,&Whaley, S. E. (1998). The role of nutrition in the development of intelligence. In U. Neisser (Ed.), The rising curve: Long-term gains in IQ and related measures (pp. 155-182).
62. Smith, A. B., Rush, R., Fallowfield, L. J., Velikova, G.,&Sharpe, M. (2008). Rasch fit statistics and sample size considerations for polytomous data. BMC Medical Research Methodology, 8, 33.
63. Su, Y. H.,&Wang, W. C. (2005). Efficiency of the Mantel, generalized Mantel-Haenszel, and logistic discriminant function analysis methods in detecting differential item functioning for polytomous items. Applied Measurement in Education, 18, 313-350.
64. Sundet, J. M., Eriksen, W., Borren, I.,&Tambs, K. (2010). The Flynn effect in sibships: Investigating the role of age differences between siblings. Intelligence, 38, 38-44.
65. Teasdale, T. W.,&Owen, D. R. (2005). A long-term rise and recent decline in intelligence test performance: The Flynn effect in reverse. Personality and Individual Differences, 39, 837-843.
66. te Nijenhuis, J., Murphy, R.,&van Eeden, R. (2011). The Flynn effect in South Africa. Intelligence, 39, 456-467.
67. Unsworth, N.,&Engle, R. W. (2005). Working memory capacity and fluid abilities: Examining the correlations between Operation Span and Raven. Intelligence, 33, 67-81.
68. van der Ven, A.,&Ellis, J. (2000). A Rasch analysis of Raven's standard progressive matrices. Personality and Individual Differences, 29, 45-64.
69. Vigneau, F.,&Bors, D. A. (2005). Items in context: Assessing the dimensionality of Raven's Advanced Progressive Matrices. Educational and Psychological Measurement, 65, 109-123.
70. Vigneau, F.,&Bors, D. A. (2008). The quest for item types based on information processing: An analysis of Raven's Advanced Progressive Matrices, with a consideration of gender differences. Intelligence, 36, 702-710.
71. Wallach, M. A.,&Wallach, L. (1998). When experiments serve little purpose: Misguided research in mainstream psychology. Theory&Psychology, 8, 183-194.
72. Wechsler, D. (1955). Wechsler Adult Intelligence Scale. New York, NY: Psychological Corporation.
73. Wechsler, D. (1981). Wechsler Adult Intelligence Scale-Revised. San Antonio, TX: Psychological Corporation.
74. Wechsler, D. (1997). The Wechsler Adult Intelligence Scale-Third Edition. San Antonio, TX: Psychological Corporation.
75. Wicherts, J. M.,&Bakker, M. (2012). Publish (your data) or (let the data) perish! Why not publish your data too? Intelligence, 40, 73-76.
76. Wicherts, J. M., Dolan, C. V., Carlson, J. S.,&van der Maas, H. L. J. (2010). Raven's test performance of sub-Saharan Africans: Average performance, psychometric properties, and the Flynn effect. Learning and Individual Differences, 20, 135-151.
77. Wicherts, J. M., Dolan, C. V., Hessen, D. J., Oosterveld, P., van Baal, G. C., Boomsma, D. I.,&Span, M. M. (2004). Are intelligence tests measurement invariant over time? Intelligence, 32, 509-537.
78. Wicherts, J. M.,&Johnson, W. (2009). Group differences in the heritability of items and test scores. Proceedings of the Royal Society B: Biological Sciences, 276, 2675-2683.
79. Wiley, J., Jarosz, A. F., Cushen, P. J.,&Colflesh, G. J. H. (2011). New rule use drives the relation between working memory capacity and Raven's Advanced Progressive Matrices. Journal of Experimental Psychology: Learning, Memory, and Cognition, 37, 256-263.
80. Wright, B. D. (1977). Solving measurement problems with the Rasch model. Journal of Educational Measurement, 14, 97-116.
81. Wright, B. D., & Masters, G. (1982). Rating scale analysis. Chicago, IL: MESA.
82. Yates, A. J. (1961). Item analysis of progressive matrices: 1947. British Journal of Educational Psychology, 31, 152-157.
83. Zelinski, E. M.,&Kennison, R. F. (2007). Not your parents' test scores: Cohort reduces psychometric aging effects. Psychology and Aging, 22, 546-557.