Assessing the flynn effect in the wechsler scales

Journal of Individual Differences

Volumn 35, Issue 2, 2014, Pages 63-78

  Beaujean, Alexander ^a   Sheng, Yanyan ^a  

^a BAYLOR UNIVERSITY   (United States)

Author keywords

Flynn effect; measurement invarience; multi group confirmatory factor analysis; Wechsler Intelligent Scale

Indexed keywords

EID: 84902168216     PISSN: 16140001     EISSN: 21512299     Source Type: Journal    
DOI: 10.1027/1614-0001/a000128     Document Type: Article

References (118)

1. Aiken, L. S., & West S. G. (1991). Multiple regression: Testing and interpreting interactions. Newbury Park, CA: Sage.
2. Alfonso, V. C., Oakland, T. D., LaRocca R., & Spanakos A. (2000). The course on individual cognitive assessment. School Psychology Review, 29 52-64.
3. American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (Revised 4th ed.). Washington, DC: Author.
4. Archer, R. P., & Newsom C. R. (2000). Psychological test usage with adolescent clients: Survey update. Assessment, 7 227-235. doi: 10.1177/107319110000700303
5. Atkins v. Virginia. (2002). 536 U.S. 304.
6. Baxendale S. (2010). The Flynn effect and memory function. Journal of Clinical and Experimental Neuropsychology 32, 699-703. doi: 10.1080/ 13803390903493515
7. Beaujean, A. A. (2008). Mediation, moderation, and the study of individual differences. In J. W.Osborne (Ed.) Best practices in quantitative methods (pp. 422-442). Thousand Oaks, CA: Sage.
8. Beaujean, A. A., & Osterlind S. J. (2008). Using item response theory to assess the Flynn effect in the National Longitudinal Study of Youth 79 Children and Young Adults data. Intelligence, 36 455-463. doi: 10.1016/j.intell.2007.10.004
9. Beaujean, A. A., & Sheng Y. (2010). Examining the Flynn effect in the general social survey vocabulary test using item response theory. Personality and Individual Differences, 48 294-298. doi: 10.1016/j.paid.2009.10.019
10. Becker, K. A. (2003). History of the Stanford-Binet Intelligence Scales: Content and psychometrics. Itasca, IL: Riverside.
11. Boake C. (2002). From the Binet-Simon to the Wechsler-Bellevue: Tracing the history of intelligence testing. Journal of Clinical and Experimental Neuropsychology, 24 383-405. doi: 10.1076/jcen.24.3.383.981 (Pubitemid 34496861)
12. Bontempo, D. E., & Hofer S. M. (2007). Assessing factorial invariance in cross-sectional and longitudinal studies. In A. D.Ong, & M.van Dulmen (Eds.) Handbook of methods in positive psychology (pp. 153-175). New York, NY: Oxford University Press.
13. Brown, T. A. (2006). Confirmatory factor analysis for applied research. New York, NY: Guilford Press.
14. Browne, M. W., & Cudeck R. (1993). Alternative ways of assessing model fit. In K. A.Bollen, & J. S.Long (Eds.) Testing structural equation models (pp. 136-162). Newbury Park, CA: Sage.
15. Byrne, B. M., Shavelson R. J., & Muthen, B. O. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105 456-466. doi: 10.1037/0033-2909.105.3.456
16. Camara, W. J., Nathan, J. S., & Puente A. E. (2000). Psychological test usage: Implications in professional psychology. Professional Psychology: Research and Practice, 31 141-154. doi: 10.1037/0735-7028.31.2.141
17. Carroll, J. B. (1993). Human cognitive abilities: A survey of factor-analytic studies. New York, NY: Cambridge University Press.
18. Chan D. (1998). The conceptualization and analysis of change over time: An integrative approach incorporating longitudinal mean and covariance structures analysis (LMACS) and multiple indicator latent growth modeling (MLGM). Organizational Research Methods 1, 421-483. doi: 10.1177/109442819814004 (Pubitemid 128543459)
19. Chou C.-P., & Huh J. (2012). Model modification in structural equation modeling. In R. A.Hoyle (Ed.) Handbook of structural equation modeling (pp. 232-246). New York, NY: Guilford.
20. Coalson D., & Weiss L. G. (2002). The evolution of Wechsler intelligence scales in historical perspective. Assessment Focus Newsletter, 11 1-3.
21. Colom, R. Lluis-Font, J. M., & Andrés-Pueyo A. (2005). The generational intelligence gains are caused by decreasing variance in the lower half of the distribution: Supporting evidence for the nutrition hypothesis. Intelligence 33 83-91. (Pubitemid 40003935)
22. Cudeck R. (1989). Analysis of correlation matrices using covariance structure models. Psychological Bulletin 105, 317-327. doi: 10.1037/0033-2909. 105.2.317
23. Floyd, R. G., Clark, M. H., & Shadish W. R. (2008). The exchangeability of IQs: Implications for professional psychology. Professional Psychology: Research and Practice, 39 414-423. doi: 10.1037/0735-7028.39.4.414
24. Flynn, J. R. (1982). Lynn, the Japanese, and environmentalism. Bulletin of the British Psychological Society 35 409-413.
25. Flynn, J. R. (1983). Now the great augmentation of the American IQ. Nature, 301, 65. doi: 10.1038/301655a0
26. Flynn, J. R. (1984). The mean IQ of Americans: Massive gains 1932 to 1978. Psychological Bulletin, 95 29-51. doi: 10.1037/0033-2909.95.1.29
27. Flynn, J. R. (1987). Massive IQ gains in 14 nations: What IQ tests really measure. Psychological Bulletin 101, 171-191. doi: 10.1037/0033-2909.101.2.171
28. Flynn, J. R. (2000). The hidden history of IQ and special education: Can the problems be solvedPsychology, Public Policy, and Law, 6 191-198. doi: 10.1037/1076-8971.6.1.191
29. Flynn, J. R. (2003). Movies about intelligence: The limitations of g. Current Directions in Psychological Science, 12 95-99. (Pubitemid 36837187)
30. Flynn, J. R. (2006). Tethering the elephant: Capital cases, IQ, and the Flynn effect. Psychology, Public Policy, and Law 12, 170-189. doi: 10.1037/1076-8971.12.2.170 (Pubitemid 44212063)
31. Flynn, J. R. (2007). What is intelligence Beyond the Flynn effect. New York, NY: Cambridge University.
32. Flynn, J. R. (2009). The WAIS-III and WAIS-IV: Daubert motions favor the certainly false over the approximately true. Applied Neuropsychology 16, 98-104. doi: 10.1080/09084280902864360
33. Flynn, J. R., & Weiss L. G. (2007). American IQ gains from 1932 to 2002: The WISC subtests and educational progress. International Journal of Testing, 7 209-224. doi: 10.1080/15305050701193587
34. Flynn, J. R., & Widaman K. F. (2008). The Flynn effect and the shadow of the past: Mental retardation and the indefensible and indispensible role of IQ. In L. M.Glidden (Ed.) International review of mental retardation, Vol. 35, (pp. 121-149). Boston, MD: Elsevier.
35. Golembiewski, R. T., Billingsley K., & Yeager S. (1976). Measuring change and persistence in human affairs: Types of change generated by OD designs. The Journal of Applied Behavioral Science, 12 133-157. doi: 10.1177/002188637601200201
36. Gottfredson, L. S. (2002). g: Highly general and highly practical. In R. J.Sternberg, & E. L.Grigorenko (Eds.) The general factor of intelligence: How general is it (pp. 331-380). Mahwah, NJ: Erlbaum.
37. Hagan, L. D., Drogin, E. Y., & Guilmette T. J. (2010). IQ scores should not be adjusted for the Flynn effect in capital punishment cases. Journal of Psychoeducational Assessment, 28 474-476. doi: 10.1177/0734282910373343
38. Herrnstein, R. J., & Murray C. (1996). The Bell curve: Intelligence and class structure in American life. New York, NY: Free Press.
39. Hoyle, R. H. (2011). Structural equation modeling for social and personality psychology. London, UK: Sage.
40. Hu, L.-T. & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6 1-55. doi: 10.1080/10705519909540118
41. Jensen, A. R. (1998). The g factor: The science of mental ability. Westport, CT: Praeger/Greenwood.
42. Kanaya, T. & Ceci, S. J. (2007a). Are all IQ scores created equal The differential costs of IQ cutoff scores for at-risk children. Child Development Perspectives, 1 52-56.
43. Kanaya, T. & Ceci, S. J. (2007b). Mental retardation diagnosis and the Flynn effect: General intelligence, adaptive behavior, and context. Child Development Perspectives, 1 62-63. doi: 10.1111/j.1750-8606.2007.00013.x
44. Kanaya, T. & Ceci, S. J. (2011). The Flynn effect in the WISC subtests among school children tested for special education services. Journal of Psychoeducational Assessment, 29 125-136. doi: 10.1177/0734282910370139
45. Kanaya, T. Ceci, S. J., & Scullin M. H. (2003). The rise and fall of IQ in special ed.: Historical trends and their implications. Journal of School Psychology, 41 453-465. (Pubitemid 37449777)
46. Kane, H. D. (2000). A secular decline in Spearman's g: Evidence from the WAIS WAIS-R and WAIS-III. Personality and Individual Differences, 29 561-566. doi: 10.1016/s0191-8869(99)00217-2
47. Kane, H. D., & Oakland T. D. (2000). Secular declines in Spearman's g: Some evidence from the United States. The Journal of Genetic Psychology: Research and Theory on Human Development, 161 337-345. doi: 10.1080/ 00221320009596716
48. Kaufman, A. S. (2010). "In what way are apples and oranges alike" A critique of Flynn's interpretation of the Flynn effect. Journal of Psychoeducational Assessment, 28 382-398. doi: 10.1177/0734282910373346
49. Kaufman, A. S., & Weiss L. G. (2010). Guest editors' introduction to the special issue of JPA on the Flynn effect. Journal of Psychoeducational Assessment, 28 379-381. doi: 10.1177/0734282910373344
50. Kelley, K. & Preacher, K. J. (2012). On effect size. Psychological Methods 17, 137-152. doi: 10.1037/a0028086
51. Khaleefa O., Sulman A., & Lynn R. (2009). An increase of intelligence in Sudan 1987-2007. Journal of Biosocial Science 41, 279-283. doi: 10.1017/s0021932008003180
52. Kolen, M. J., & Brennan R. L. (2004). Test equating, scaling, and linking: Methods and practices (2nd ed.). New York NY: Springer.
53. Kuncel, N. R., Hezlett, S. A., & Ones D. S. (2004). Academic performance, career potential creativity, and job performance: Can one construct predict them allJournal of Personality and Social Psychology, 86 148-161. doi: 10.1037/0022-3514.86.1.148 (Pubitemid 38142815)
54. Lei, P.-W. & Wu Q. (2007). Introduction to structural equation modeling: Issues and practical considerations. Educational Measurement: Issues and Practice, 26 33-43. doi: 10.1111/j.1745-3992.2007.00099.x
55. Lewis, M. Sanborn K., McGreevy S. Tarquin, K. & Truscott, S. D. (2004). What every school psychologist should know about the Flynn effect. NASP Communiqué 32 29-32.
56. Linn, R. L. (1993). Linking results of distinct assessments. Applied Measurement in Education, 6 83-102. doi: 10.1207/s15324818ame0601-5
57. Little, T. D., & Slegers D. W. (2005). Factor analysis: Multiple Groups. In B. S.Everitt, & D. C.Howell (Eds.) Encyclopedia of Statistics in Behavioral Science, Vol. 2, (pp. 617-623). Chichester, UK: Wiley.
58. Lubin, B. & Lubin, A. W. (1972). Patterns of Psychological Services in the U.S.: 1959-1969. Professional Psychology 3, 63-65. doi: 10.1037/h0021498
59. Lynn R. (1982). IQ in Japan and the United States shows a growing disparity. Nature, 306 291-292.
60. Lynn R. (1987). Japan: Land of the rising IQ: A reply to Flynn. Bulletin of the British Psychological Society 40 464-468.
61. Lynn R. (1990). Differential rates of secular increase of five major primary abilities. Biodemography and Social Biology 37, 137-141. doi: 10.1080/19485565.1990.9988753
62. Lynn R. (2009). Fluid intelligence but not vocabulary has increased in Britain 1979-2008. Intelligence 37, 249-255. doi: 10.1016/j.intell.2008.09.007
63. Lynn R. (2009). What has caused the Flynn effect Secular increases in the development quotients of infants. Intelligence 37, 16-24. doi: 10.1016/j.intell.2008.07.008
64. Marsh, H. W., Hau K.-T., & Grayson D. (2005). Goodness of fit in structural equation models. In A.Maydeu-Olivares, & J. J.McArdle (Eds.) Contemporary psychometrics: A festschrift for Roderick P. McDonald (pp. 275-340). Mahwah, NJ: Erlbaum.
65. McDonald, R. P., & Ho M.-H. R. (2002). Principles and practice in reporting structural equation analyses. Psychological Methods, 7 64-82. doi: 10.1037/1082-989X.7.1.64
66. Millsap, R. E. (2011). Statistical approaches to measurement invariance. New York, NY: Routledge.
67. Millsap, R. E., & Hartog S. B. (1988). Alpha, beta, and gamma change in evaluation research: A structural equation approach. Journal of Applied Psychology, 73 574-584. doi: 10.1037/0021-9010.73.3.574
68. Mislevy, R. J. (1992). Linking educational assessments: Concepts, issues, methods, and prospects. Princeton, NJ: Educational Testing Service.
69. Must, O. te Nijenhuis J., Must A., & van Vianen, A. E. M. (2009). Comparability of IQ scores over time. Intelligence, 37: 25-33. doi: 10.1016/j.intell.2008.05.002.
70. Muthén, L. K., & Muthén B. O. (2010). Mplus (version 6) [Computer software]. Los Angeles CA: Muthén and Muthén.
71. Neisser, U. (Ed.). (1998). The rising curve: Long-term gains in IQ and related measures. Washington, DC: American Psychological Association.
72. Nettelbeck T., & Wilson C. (2004). The Flynn effect: Smarter not faster. Intelligence, 32 85-93. doi: 10.1016/S0160-2896(03)00060-6 (Pubitemid 37555148)
73. Nugent, W. R. (2006). The comparability of the standardized mean difference effect size across different measures of the same construct. Educational and Psychological Measurement, 66 612-623. doi: 10.1177/ 0013164405284032 (Pubitemid 44060236)
74. Nunnally, J. C., & Bernstein I. H. (1994). Psychometric Theory (3rd ed.). New York, NY: McGraw-Hill.
75. Pedhazur, E. J. (1997). Multiple regression in behavioral research (3rd ed.). Fort Worth, TX: Harcourt Brace.
76. Ployhart, R. E., & Vandenberg R. J. (2010). Longitudinal research: The theory, design, and analysis of change. Journal of Management 36, 94-120. doi: 10.1177/0149206309352110
77. R Development Core Team. (2013). R: A language and environment for statistical computing. Vienna, AustriaR Foundation for Statistical ComputingAvailable fromhttp://www.R-project.org
78. Reschly, D. J., Myers, T. G., & Hartel C. R. (2002). Mental retardation: Determining eligibility for social security benefits. Washington DC: National Academies Press.
79. Reynolds, C. R., Niland J., Wright J. E., & Rosenn M. (2010). Failure to apply the Flynn correction in death penalty litigation: Standard practice of today maybe, but certainly malpractice of tomorrow. Journal of Psychoeducational Assessment, 28 477-481. doi: 10.1177/0734282910373348
80. Rodgers, J. L. (1998). A critique of the Flynn effect: Massive IQ gains, methodological artifacts, or bothIntelligence, 26 337-356. doi: 10.1016/s0160-2896(99)00004-5 (Pubitemid 128340446)
81. Roid, G. H. (2003). Stanford-Binet intelligence scales (5th ed.). Itasca, IL: Riverside.
82. Rosseel Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software 48 1-36.
83. Rudnick A. (2001). Ethics of ECT for children. Journal of the American Academy of Child & Adolescent Psychiatry 40 387-388.
84. Sanborn, K. J., Truscott S. D. Phelps, L. & McDougal, J. L. (2003). Does the Flynn effect differ by IQ level in samples of students classified as learning disabledJournal of Psycheducational Assessment, 21 145-159. (Pubitemid 37155862)
85. Schaie, K. W., Willis, S. L., & Pennak S. (2005). An historical framework for cohort differences in intelligence. Research in Human Development 2 43-67.
86. Shayer, M. Ginsburg D., & Coe R. (2007). Thirty years on-a large anti-Flynn effect The Piagetian test Volume Heaviness norms 1975-2003. British Journal of Educational Psychology, 77 25-41. doi: 10.1348/000709906x96987
87. Shiu, W. & Beaujean, A. A. (2010). The Flynn effect in adults: A meta-analysis. DecemberPoster presented at the annual meeting of the International Society for Intelligence Research, Arlington, VA.
88. Sivo, S. A., Fan X., Witta E. L., & Willse, J. T. (2006). The search for "optimal" cutoff properties: Fit index criteria in structural equation modeling. Journal of Experimental Education, 74 267-288. doi: 10.3200/JEXE.74.3.267-288 (Pubitemid 44757331)
89. Steenkamp, J.-B. E. M., & Baumgartner H. (1998). Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research 25, 78-107. doi: 10.1086/209528 (Pubitemid 128088455)
90. Stinnett, T. A., Havey, J. M., & Oehler-Stinnett J. (1994). Current test usage by practicing school psychologists: A national survey. Journal of Psychoeducational Assessment 12, 331-350. doi: 10.1177/073428299401200403
91. Teasdale, T. W., & Owen D. R. (1989). Continuing secular increases in intelligence and a stable prevalence of high intelligence levels. Intelligence, 13 255-262.
92. Teasdale, T. W., & Owen D. R. (2005). A long-term rise and recent decline in intelligence test performance: The Flynn effect in reverse. Personality and Individual Differences, 39 837-843. doi: 10.1016/j.paid.2005.01. 029 (Pubitemid 41015328)
93. Teasdale, T. W., & Owen D. R. (2008). Secular declines in cognitive test scores: A reversal of the Flynn effect. Intelligence 36, 121-126. doi: 10.1016/j.intell.2007.01.007
94. te Nijenhuis J. (2013). The Flynn effect, group differences, and g loadings. Personality and Individual Differences, 55 224-228. doi: 10.1016/j.paid.2011.12.023
95. te Nijenhuis J., Murphy R., & van Eeden, R. (2011). The Flynn effect in South Africa. Intelligence, 39 456-467. doi: 10.1016/j.intell.2011.08.003
96. Thorndike, R. L., & Lohman D. (1990). A century of ability testing. Chicago IL: Riverside.
97. Truscott, S. D., & Frank A. J. (2001). Does the Flynn effect affect IQ scores of students classified as LDJournal of School Psychology, 89 319-334. (Pubitemid 33376593)
98. Truscott, S. D., & Volker M. A. (2005). The Flynn effect and LD classification: Empirical evidence of IQ score changes that could affect diagnosis. In A.Columbus (Ed.) Advances in psychology research, Vol. 35, (pp. 173-204). New York, NY: Nova Science.
99. Tuddenham, R. D. (1948). Soldier intelligence in World Wars I and II. American Psychologist, 3 54-56.
100. Vandenberg, R. J., & Lance C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3 4-70. doi: 10.1177/109442810031002
101. VandenBos, G. R. (Ed.). (2007). APA dictionary of psychology. Washington, DC: American Psychological Association.
102. Wai, J. & Putallaz M. (2012). The Flynn effect puzzle: A 30-year examination from the right tail of the ability distribution provides some missing pieces. Intelligence, 39 443-455. doi: 10.1016/j.intell.2011.07.006
103. Wechsler D. (1949). Wechsler Intelligence Scale for children. San Antonio, TX: Psychological Corporation.
104. Wechsler D. (1955). Wechsler adult intelligence scale. New York NY: The Psychological Corporation.
105. Wechsler D. (1967). Wechsler preschool and primary scale of intelligence. New York, NY: The Psychological Corporation.
106. Wechsler D. (1974). Wechsler intelligence scale for children (Revised ed.). New York, NY: The Psychological Corporation.
107. Wechsler D. (1981). The psychometric tradition: Developing the wechsler adult intelligence scale. Contemporary Educational Psychology, 6 82-85. doi: 10.1016/0361-476X(81)90035-7
108. Wechsler D. (1981). Wechsler adult intelligence scale (Revised ed.). San Antonio, TX: The Psychological Corporation.
109. Wechsler D. (1989). Wechsler preschool and primary scale of intelligence (Revised ed.). San Antonio TX: The Psychological Corporation.
110. Wechsler D. (1991). Wechsler intelligence scale for children (3rd ed.). San Antonio, TX: The Psychological Corporation.
111. Wechsler D. (1997). Wechsler adult intelligence scale (3rd ed.). San Antonio, TX: The Psychological Corporation.
112. Wechsler D. (2002). Wechsler preschool and primary scale of intelligence (3rd ed.). San Antonio TX: The Psychological Corporation.
113. Wechsler D. (2003). Wechsler intelligence scale for children (4th ed.). San Antonio, TX: The Psychological Corporation.
114. Wechsler D. (2008). Wechsler adult intelligence scale (4th ed.). San Antonio, TX: The Psychological Corporation.
115. Weiss, K. J., Haskins B., & Hauser, M. J. (2004). Commentary: Atkins and clinical practice. Journal of American Academic Psychiatry Law 32 309-313. (Pubitemid 39281685)
116. Wicherts, J. M., & Dolan C. V. (2010). Measurement invariance in confirmatory factor analysis: An illustration using IQ test performance of minorities. Educational Measurement: Issues and Practice, 29 39-47. doi: 10.1111/j.1745-3992.2010.00182.x
117. Wicherts, J. M., Dolan, C. V., Hessen D. J. Oosterveld P., van Baal G. C. M. Boomsma, D. I., & Span M. M. (2004). Are intelligence tests measurement invariant over time Investigating the nature of the Flynn effect. Intelligence, 32 509-537. doi: 10.1016/j.intell.2004.07.002 (Pubitemid 39186203)
118. Yu C.-Y. (2002). Evaluating cutoff criteria of model fit indices for latent variable models with binary and continuous outcomes. Unpublished doctoral dissertation.