Are intelligence tests measurement invariant over time? Investigating the nature of the Flynn effect

Intelligence

Volumn 32, Issue 5, 2004, Pages 509-537

  Wicherts, Jelte M ^a   Dolan, Conor V ^a   Hessen, David J ^a   Oosterveld, Paul ^a   van Baal, G Caroline M ^b   Boomsma, Dorret I ^b   Span, Mark M ^c  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b VU UNIVERSITY AMSTERDAM   (Netherlands)

^c Swets Test Publishers   (Netherlands)

Author keywords

Factorial invariance; Flynn effect; Intelligence tests

Indexed keywords

ADULT; AGE; ANALYTICAL ERROR; APTITUDE; ARTICLE; CHILD; COHORT ANALYSIS; CONTROLLED STUDY; FACTORIAL ANALYSIS; HUMAN; HUMAN EXPERIMENT; INTELLIGENCE TEST; MEASUREMENT; NETHERLANDS; RATING SCALE; TIME;

EID: 4444271803     PISSN: 01602896     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.intell.2004.07.002     Document Type: Article

References (87)

1. P.M. Bentler Comparative fix indexes in structural models Psychological Bulletin 107 1990 238-246
2. N. Bleichrodt renth J.N. Zaal W.C.M. Resing Revisie Amsterdamse kinder intelligentie test Revised Amsterdam Child Intelligence Test 1984 Swets and Zeitlinger Lisse, The Netherlands
3. K.A. Bollen Structural equations with latent variables 1989 John Wiley and Sons Oxford, England
4. K.A. Bollen J.S. Long Introduction K.A. Bollen J.S. Long Testing structural equation models 1993 Sage Publications Thousand Oaks, CA 1-9
5. C.R. Brand Bryter still and Bryter? Nature 328 1987 110
6. C.R. Brand A "gross" underestimate of a "massive" IQ rise? A rejoinder to Flynn Irish Journal of Psychology 11 1990 52-56
7. C.R. Brand S. Freshwater W.B. Dockrell Has there been a massive rise in IQ levels in the West - Evidence from Scottish children Irish Journal of Psychology 10 1989 388-393
8. M.W. Browne R. Cudeck Alternative ways of assessing model fit in: K.A. Bollen J.S. Long (Eds.) Testing structural equation models 1993 Sage Publications Thousand Oaks, CA 136-162
9. B.M. Byrne R.J. Shavelson B. Muthen Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance Psychological Bulletin 105 1989 456-466
10. D.W. Catron C.C. Thompson Test-retest gains in WAIS scores after four retest intervals Journal of Clinical Psychology 35 1979 352-357
11. R. Colom A. Andres-Pueyo M. Juan-Espinosa Generational IQ gains: Spanish data Personality and Individual Differences 25 1998 927-935
12. R. Colom O. García-López Secular gains in fluid intelligence: Evidence from the culture-fair intelligence test Journal of Biosocial Science 35 2003 33-39
13. R. Colom M. Juan Espinosa L.F. Garcia The secular increase in test scores is a "Jensen effect" Personality and Individual Differences 30 2001 553-559
14. E.C. Davenport Significance testing of congruence coefficients: A good idea? Educational and Psychological Measurement 50 1990 289-296
15. W.T. Dickens J.R. Flynn Heritability estimates versus large environmental effects: The IQ paradox resolved Psychological Review 108 2001 346-369
16. C.V. Dolan Investigating Spearman's hypothesis by means of multi-group confirmatory factor analysis Multivariate Behavioral Research 35 2000 21-50
17. C.V. Dolan E.L. Hamaker Investigating Black-White differences in psychometric IQ: Multi-group confirmatory factor analyses of the WISC-R and K-ABC and a critique of the method of correlated vectors in: Frank Columbus (Ed.) Advances in Psychology Research vol. 6 2001 Nova Science Publishers Huntington, NY 31-59
18. C.V. Dolan G.H. Lubke Viewing Spearman's hypothesis from the perspective of multigroup PCA: A comment on Schoenemann's criticism Intelligence 29 2001 231-245
19. C.V. Dolan W. Roorda J.M. Wicherts Two failures of Spearman's hypothesis: The GAT-B in Holland and the JAT in South Africa Intelligence 32 2004 155-173
20. I. Emanuelsson S.E. Reuterberg A. Svensson Changing differences in intelligence? Comparisons between groups of 13-year-olds tested from 1960 to 1990 Scandinavian Journal of Educational Research 37 1993 259-277
21. I. Emanuelsson A. Svensson Changes in intelligence over a quarter of a century Scandinavian Journal of Educational Research 34 1990 171-187
22. A. Evers W. Lucassen Handleiding DAT'83 (DAT '83 Manual) 1992 Swets and Zeitlinger Lisse, The Netherlands
23. A. Flieller Application du modele de Rasch a un probleme de comparaison de generations Applications of the Rasch model to a problem of intergenerational comparison Bulletin de Psychologie 42 1988 86-91
24. J.R. Flynn The mean IQ of Americans: Massive gains 1932 to 1978 Psychological Bulletin 95 1984 29-51
25. J.R. Flynn Massive IQ gains in 14 nations: What IQ tests really measure Psychological Bulletin 101 1987 171-191
26. J.R. Flynn Massive IQ gains on the Scottish WISC - Evidence against Brand et al's hypothesis Irish Journal of Psychology 11 1990 41-51
27. J.R. Flynn IQ gains over time: Toward finding the causes in: U. Neisser (Ed.) The rising curve: Long-term gains in IQ and related measures 1998 American Psychological Association Washington, DC 25-66
28. J.R. Flynn Israeli military IQ tests: Gender differences small; IQ gains large Journal of Biosocial Science 30 1998 541-553
29. J.R. Flynn WAIS-III and WISC-III IQ gains in the United States from 1972 to 1995: How to compensate for obsolete norms Perceptual and Motor Skills 86 1998 1231-1239
30. J.R. Flynn Evidence against Rushton: The genetic loading of WISC-R subtests and the causes of between-group IQ differences Personality and Individual Differences 26 1999 373-379
31. J.R. Flynn Reply to Rushton: A gang of g s overpowers factor analysis Personality and Individual Differences 26 1999 391-393
32. J.R. Flynn Searching for justice - The discovery of IQ gains over time American Psychologist 54 1999 5-20
33. J.R. Flynn IQ gains and fluid g American Psychologist 55 2000 543
34. J.R. Flynn IQ gains, WISC subtests and fluid g : g Theory and the relevance of Spearman's hypothesis to race in: G.R. Bock J.A. Goode K. Webb (Eds.) The Nature Of Intelligence: Novartis Foundation Symposium vol. 233 2000 Wiley Chichester, UK 202-227
35. P.M. Greenfield The cultural evolution of IQ in: U. Neisser (Ed.) The rising curve: Long term gains in IQ and related measures 1998 American Psychological Association Washington, DC, US 81-123
36. J.L. Horn J.J. McArdle A practical and theoretical guide to measurement invariance in aging research Experimental Aging Research 18 1992 117-144
37. R.W. Howard Preliminary real-world evidence that average human intelligence really is rising Intelligence 27 1999 235-250
38. R.W. Howard Searching the real world for signs of rising population intelligence Personality and Individual Differences 30 2001 1039-1058
39. T. Husén A. Tuijnman The contribution of formal schooling to the increase in intellectual capital Educational Researcher 20 1991 17-25
40. A.R. Jensen Secular trends in IQ: Additional hypothesis in: D.K. Detterman (Ed.) The environment Current Topics in Human Intelligence vol. 5 1996 Ablex Publishing Westport, CT 147-150
41. A.R. Jensen The g factor: The science of mental ability 1998 Praeger Publishers/Greenwood Publishing Group Westport CT, US
42. K.G. Jöreskog Testing structural equation models in: K.A. Bollen J.S. Long (Eds.) Testing structural equation models 1993 Sage Publications Thousand Oaks, CA 294-316
43. K.G. Jöreskog D. Sörbom LISREL 8: Structural equation modeling with the SIMPLIS command language 2002 Scientific Software International Chicago, IL
44. T.D. Little Mean and covariance structures (MACS) analyses of cross-cultural data: Practical and theoretical issues Multivariate Behavioral Research 32 1997 53-76
45. G.H. Lubke C.V. Dolan Can unequal residual variances across groups mask measurement invariance in the common factor model? Structural Equation Modeling 10 2003 175-192
46. G.H. Lubke C.V. Dolan H. Kelderman Investigating group differences on cognitive tests using Spearman's hypothesis: An evaluation of Jensen's method Multivariate Behavioral Research 36 2001 299-324
47. G.H. Lubke C.V. Dolan H. Kelderman G.J. Mellenbergh On the relationship between sources of within- and between-group differences and measurement invariance in the common factor model Intelligence 31 2003 543-566
48. R. Lynn A nutrition theory of the secular increases in intelligence - Positive correlations between height, head size and IQ British Journal of Educational Psychology 59 1989 372-377
49. R. Lynn The role of nutrition in secular increases in intelligence Personality and Individual Differences 11 1990 273-285
50. R. Lynn S. Hampson The rise of national intelligence: Evidence from Britain, Japan and the USA Personality and Individual Differences 7 1986 23-32
51. R. Lynn S. Hampson Secular increases in reasoning and mathematical abilities in Britain, 1972-84 School Psychology International 10 1989 301-304
52. R. Martorell Nutrition and the worldwide rise in IQ scores in: Ulric Neisser (Ed.) The rising curve: Long term gains in IQ and related measures 1998 American Psychological Association Washington, DC, US 183-206
53. R.G. Matarazzo A.N. Wiens J.D. Matarazzo T.S. Manaugh Test-retest reliability of the WAIS in a normal population Journal of Clinical Psychology 29 1973 194-197
54. G.J. Mellenbergh Item bias and item response theory International Journal of Educational Research 13 1989 127 143
55. G.J. Mellenbergh F.G. Kok Finding the biasing traits in: J.M. Collins (Ed.) Advances in computer-based human assessment 1991 Kluwer Academic Publishers Dordrecht, the Netherlands 291-306
56. W. Meredith Measurement invariance, factor analysis and factorial invariance Psychometrika 58 1993 525-543
57. R.E. Millsap Invariance in measurement and prediction: Their relationship in the single-factor case Psychological Methods 2 1997 248-260
58. R.E. Millsap H.T. Everson Methodology review: Statistical approaches for assessing measurement bias Applied Psychological Measurement 17 1993 297-334
59. M.A. Mingroni The secular rise in IQ: Giving heterosis a closer look Intelligence 32 2004 65-83
60. O. Must A. Must V. Raudik The secular rise in IQs: In Estonia the Flynn effect is not a Jensen effect Intelligence 167 2003 1-11
61. B.O. Muthén Factor structure in groups selected on observed scores British Journal of Mathematical and Statistical Psychology 42 1989 81-90
62. NCBS 2003 Beroepsbevolking naar onderwijsniveau 1993. Retrieved May 14th 2003 from http://statline.cbs.nl
63. U. Neisser The rising curve: Long-term gains in IQ and related measures 1998 American Psychological Association Washington, DC, US
64. P. Oosterveld Questionnaire design methods 1996 University of Amsterdam Amsterdam, The Netherlands
65. M.J.H. Rietveld G.C.M. van Baal C.V. Dolan D.I. Boomsma Genetic factor analyses of specific cognitive abilities in 5-year-old Dutch children Behavior Genetics 30 2000 29-40
66. J.L. Rodgers A critique of the Flynn effect: Massive IQ gains, methodological artifacts or both? Intelligence 26 1998 337-356
67. J.P. Rushton Secular gains in IQ not related to the g factor and inbreeding depression - Unlike Black-White differences: A reply to Flynn Personality and Individual Differences 26 1999 381-389
68. J.P. Rushton Flynn effects not genetic and unrelated to race differences American Psychologist 55 2000 542-543
69. W. Satzger E. Dragon R.R. Engel The equivalence of the German version of the Wechsler Adult Intelligence Scale-Revised (HAWIE-R) and the original German version (HAWIE) Diagnostica 42 1996 119-138
70. U. Schallberger HAWIK und HAWIK-R: Ein empirischer Vergleich HAWIK and HAWIK-R: An empirical comparison Diagnostica 33 1987 1-13
71. C. Schooler Environmental complexity and the Flynn effect in: U. Neisser (Ed.) The rising curve: Long term gains in IQ and related measures 1998 American Psychological Association Washington, DC, US 67-79
72. D. Sórbom A general method for studying differences in factor means and factor structure between groups British Journal of Mathematical & Statistical Psychology 27 1974 229-239
73. H.H. Spitz Variations in Wechsler interscale IQ disparities at different levels of IQ Intelligence 13 1989 157-167
74. J.B.E.M. Steenkamp H. Baumgartner Assessing measurement invariance in cross-national consumer research Journal of Consumer Research 25 1998 78-90
75. J. Stinissen De constructie van de nederlandstalige WAIS 1977 Katholieke Universiteit Leuven Leuven, Belgium
76. J. Stinissen P.J. Willems P. Coetsier W.L.L. Hulsman Handleiding bij de nederlandstalige bewerking van de Wechsler Adult Intelligence Scale (WAIS) 1970 Swets and Zeitlinger Lisse, The Netherlands
77. Swets Test Publishers 2003 Aanvullend normonderzoek WAIS-III Retrieved May 7th 2003 from http://www.swetstest.nl/info/WAIS-III/
78. T.W. Teasdale D.R. Owen National secular trends in intelligence and education: A twenty-year cross-sectional study Nature 325 1987 119-121
79. T.W. Teasdale D.R. Owen Continuing secular increases in intelligence and a stable prevalence of high intelligence levels Intelligence 13 1989 255-262
80. T.W. Teasdale D.R. Owen Forty-year secular trends in cognitive abilities Intelligence 28 2000 115-120
81. P.J. Tellegen De kwaliteit van de normen van de WAIS-III Quality of the WAIS-III norms De Psycholoog 37 2002 463-465
82. R.D. Tuddenham Soldier intelligence in World Wars I and II American Psychologist 3 1948 54-56
83. D. Wechsler WAIS manual 1955 The Psychological Corporation New York
84. D. Wechsler WAIS-III. Nederlandstalige bewerking. Technische handleiding 2000 Swets Test Publishers Lisse, The Netherlands
85. K.F. Widaman S.P. Reise Exploring the measurement invariance of psychological instruments: Applications in the substance use domain in: K.J. Bryant M. Windle (Eds.) The science of prevention: Methodological advances from alcohol and substance abuse research 1997 American Psychological Association Washington, DC 281-324
86. K.F. Widaman J.S. Thompson On specifying the null model for incremental fit indices in structural equation modeling Psychological Methods 8 2003 16-37
87. R.B. Zajonc P.R. Mullally Birth order: Reconciling conflicting effects American Psychologist 52 1997 685 699