The relationships between WAIS-IV factor index scores and educational level: A bifactor model approach

Psychological Assessment

Volumn 28, Issue 8, 2016, Pages 987-1000

  Abad, Francisco J ^a   Sorrel, Miguel A ^a   Román, Francisco J ^a   Colom, Roberto ^a  

^a UNIVERSIDAD AUTÓNOMA DE MADRID   (Spain)

Author keywords

Educational attainment; Intelligence; Invariance; WAIS IV

Indexed keywords

ACADEMIC ACHIEVEMENT; ADOLESCENT; ADULT; AGED; ARTICLE; CONTROLLED STUDY; EDUCATIONAL STATUS; FEMALE; FULL SCALE INTELLIGENCE QUOTIENT; HUMAN; INTELLECTUAL ASSESSMENT; INTELLIGENCE QUOTIENT; MALE; PERCEPTUAL REASONING INDEX; PROCESSING SPEED INDEX; RELIABILITY; SPAIN; VALIDITY; VERBAL COMPREHENSION INDEX; WECHSLER ADULT INTELLIGENCE SCALE; WORKING MEMORY INDEX; INTELLIGENCE; MIDDLE AGED; WECHSLER INTELLIGENCE SCALE; YOUNG ADULT;

ADOLESCENT; ADULT; AGED; EDUCATIONAL STATUS; FEMALE; HUMANS; INTELLIGENCE; MALE; MIDDLE AGED; SPAIN; WECHSLER SCALES; YOUNG ADULT;

EID: 84940475051     PISSN: 10403590     EISSN: 1939134X     Source Type: Journal    
DOI: 10.1037/pas0000228     Document Type: Article

References (67)

1. Abad, F. J., Colom, R., Juan-Espinosa, M., & García, L. F. (2003). Intelligence differentiation in adult samples. Intelligence, 31, 157-166. http://dx.doi.org/10.1016/S0160-2896(02)00141-1.
2. Artman, L., Cahan, S., & Avni-Babad, D. (2006). Age, schooling and conditional reasoning. Cognitive Development, 21, 131-145. http://dx .doi.org/10.1016/j.cogdev.2006.01.004.
3. Banks, J., & Mazzonna, F. (2012). The effect of education on old age cognitive abilities: Evidence from a regression discontinuity design. The Economic Journal, 122, 418-448. http://dx.doi.org/10.1111/j.1468-0297.2012.02499.x
4. Beaujean, A. A., Parkin, J., & Parker, S. (2014). Comparing Cattell-Horn-Carroll models for predicting language achievement: Differences between bifactor and higher order factor models. Psychological Assessment, 26, 789-805. http://dx.doi.org/10.1037/a0036745.
5. Benson, N., Hulac, D. M., & Kranzler, J. H. (2010). Independent examination of the Wechsler Adult Intelligence Scale-Fourth Edition (WAISIV): What does the WAIS-IV measure? Psychological Assessment, 22, 121-130. http://dx.doi.org/10.1037/a0017767.
6. Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238-246. http://dx.doi.org/10.1037/0033-2909. .107.2.238.
7. Berry, C. M., & Sackett, P. R. (2009). Individual differences in course choice result in underestimation of the validity of college admissions systems. Psychological Science, 20, 822-830. http://dx.doi.org/10.1111/j.1467-9280.2009.02368.x
8. Bowden, S. C., Saklofske, D. H., & Weiss, L. G. (2011). Invariance of the measurement model underlying the Wechsler Adult Intelligence Scale-IV in the United States and Canada. Educational and Psychological Measurement, 71, 186-199. http://dx.doi.org/10.1177/0013164410387382.
9. Brinch, C. N., & Galloway, T. A. (2012). Schooling in adolescence raises IQ scores. Proceedings of the National Academy of Sciences of the United States of America, 109, 425-430. http://dx.doi.org/10. .1073/pnas.1106077109.
10. Bryant, F. B., & Satorra, A. (2013). EXCEL macro file for conducting scaled difference chi-square tests via LISREL 8, LISREL 9, EQS, and Mplus. Available from the authors.
11. Canivez, G. L. (in press). Bifactor modeling in construct validation of multifactored tests: Implications for understanding multidimensional constructs and test interpretation. In K. Schweizer & C. DiStefano (Eds.), Principles and methods of test construction: Standards and recent advancements. Gottingen, Germany: Hogrefe.
12. Canivez, G. L., & Watkins, M. W. (2010a). Investigation of the factor structure of the Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV): Exploratory and higher order factor analyses. Psychological Assessment, 22, 827-836. http://dx.doi.org/10.1037/a0020429.
13. Canivez, G. L., & Watkins, M. W. (2010b). Exploratory and higher-order factor analyses of the Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV) adolescent subsample. School Psychology Quarterly, 25, 223-235. http://dx.doi.org/10.1037/a0022046.
14. Ceci, S. (1991). How much does schooling influence general intelligence and its cognitive components? A reassessment of the evidence. Developmental Psychology, 27, 703-722. http://dx.doi.org/10.1037/0012-1649.27.5.703.
15. Cliffordson, C., & Gustafsson, J.-E. (2008). Effects of age and schooling on intellectual performance: Estimates obtained from analysis of continuous variation in age and length of schooling. Intelligence, 36, 143-152. http://dx.doi.org/10.1016/j.intell.2007.03.006.
16. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
17. Colom, R., Abad, F. J., García, L. F., & Juan-Espinosa, M. (2002). Education, Wechsler's Full Scale IQ, and g. Intelligence, 30, 449-462. http://dx.doi.org/10.1016/S0160-2896(02)00122-8.
18. Deary, I. J., Egan, V., Gibson, G. J., Austin, E. J., Brand, C. R., & Kellaghan, T. (1996). Intelligence and the differentiation hypothesis. Intelligence, 23, 105-132. http://dx.doi.org/10.1016/S0160-2896(96)90008-2.
19. Dolan, C. V., Colom, R., Abad, F. J., Wicherts, J. M., Hessen, D. J., & van de Sluis, S. (2006). Multi-group covariance and mean structure modeling of the relationship between the WAIS-III common factors and sex and educational attainment in Spain. Intelligence, 34, 193-210. http://dx.doi .org/10.1016/j.intell.2005.09.003.
20. Falch, T., & Massih, S. S. (2011). The effect of education on cognitive ability. Economic Inquiry, 49, 838-856. http://dx.doi.org/10.1111/j .1465-7295.2010.00312.x
21. Farmer, R. L., Floyd, R. G., Reynolds, M. R., & Kranzler, J. H. (2014). IQs are very strong but imperfect indicators of psychometric g: Results from joint confirmatory factor analysis. Psychology in the Schools, 51, 801-813. http://dx.doi.org/10.1002/pits.21785.
22. Floyd, R. G., Keith, T. Z., Taub, G. E., & McGrew, K. S. (2007). Cattell-Horn-Carroll cognitive abilities and their effects on reading decoding skills: G has indirect effects, more specific abilities have direct effects. School Psychology Quarterly, 22, 200-233. http://dx.doi.org/10. .1037/1045-3830.22.2.200.
23. Floyd, R. G., Reynolds, M. R., Farmer, R. L., & Kranzler, J. H. (2013). Are the general factors from different child and adolescent intelligence tests the same? Results from a five-sample, six-test analysis. School Psychology Review, 42, 383-401.
24. Gignac, G. E. (2008). Higher-order models versus direct hierarchical models: G as superordinate or breadth factor? Psychology Science, 50, 21-43.
25. Gignac, G. E., & Watkins, M. W. (2013). Bifactor modeling and the estimation of model-based reliability in the WAIS-IV. Multivariate Behavioral Research, 48, 639-662. http://dx.doi.org/10.1080/00273171. .2013.804398.
26. Glutting, J. J., Watkins, M. W., Konold, T. R., & McDermott, P. A. (2006). Distinctions without a difference the utility of observed versus latent factors from the WISC-IV in estimating reading and math achievement on the WIAT-II. The Journal of Special Education, 40, 103-114. http://dx.doi.org/10.1177/00224669060400020101.
27. Grégoire, J. (2013). Measuring components of intelligence: Mission impossible? Journal of Psychoeducational Assessment, 31, 138-147. http://dx.doi.org/10.1177/0734282913478034.
28. Gustafsson, J.-E. (2001). Schooling and intelligence: Effects of track of study on level and profile of cognitive abilities. International Education Journal, 2, 166-186.
29. Herrnstein, R. J., & Murray, C. (1994). The bell curve. Intelligence and class structure in American life. New York, NY: The Free Press.
30. Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55. http://dx.doi.org/10.1080/10705519909540118.
31. Hunt, E. B. (2011). Human intelligence. Cambridge, UK: Cambridge University Press.
32. Instituto Nacional de Estadística. (2001). Censo de población y Viviendas [National Institute of Statistics (2001). Population and Housing Census]. Retrieved from http://www.ine.es/censo2001/
33. Johnson, W., & Bouchard, T. J., Jr. (2005). The structure of human intelligence: It's verbal, perceptual, and image rotation (VPR), not fluid and crystallized. Intelligence, 33, 393-416. http://dx.doi.org/10.1016/j .intell.2004.12.002.
34. Johnson, W., Nijenhuis, J., & Bouchard, T. J., Jr. (2008). Still just 1 g: Consistent results from five test batteries. Intelligence, 36, 81-95. http://dx.doi.org/10.1016/j.intell.2007.06.001.
35. Kan, K.-J., Kievit, R. A., Dolan, C., & van der Maas, H. L. J. (2011). On the interpretation of the CHC factor Gc. Intelligence, 39, 292-302. http://dx.doi.org/10.1016/j.intell.2011.05.003.
36. Kaufman, A. S., Kaufman, J. C., Liu, X., & Johnson, C. K. (2009). How do educational attainment and gender relate to fluid intelligence, crystallized intelligence, and academic skills at ages 22-90 years? Archives of Clinical Neuropsychology, 24, 153-163. http://dx.doi.org/10.1093/arclin/acp015.
37. Kaufman, A. S., & Lichtenberger, E. O. (2006). Assessing adolescent and adult intelligence (3rd ed.). Hoboken, NJ: Wiley.
38. Keith, T. Z., Kranzler, J. H., & Flanagan, D. P. (2001). What does the Cognitive Assessment System (CAS) measure? Joint confirmatory factor analysis of the CAS and the Woodcock-Johnson Tests of Cognitive Ability (3rd edition). School Psychology Review, 30, 89-119.
39. Kranzler, J. H., Benson, N., & Floyd, R. G. (2015). Using estimated factor scores from a bifactor analysis to examine the unique effects of the latent variables measured by the WAIS-IV on academic achievement. Psychological Assessment. Advance online publication. http://dx.doi.org/10. .1037/pas0000119.
40. Kvist, A. V., & Gustafsson, J.-E. (2008). The relation between fluid intelligence and the general factor as a function of cultural background: A test of Cattell's investment theory. Intelligence, 36, 422-436. http://dx.doi.org/10.1016/j.intell.2007.08.004.
41. Leech, N. L., & Onwuegbuzie, A. J. (2002, November). A call for greater use of nonparametric statistic. Paper presented at the Annual Meeting of the Mid-South Educational Research Association, Chattanooga, TN.
42. Major, J. T., Johnson, W., & Bouchard, T. J., Jr. (2011). The dependability of the general factor of intelligence: Why small single-factor models do not adequately represent g. Intelligence, 39, 418-433. http://dx.doi.org/10.1016/j.intell.2011.07.002.
43. Major, J. T., Johnson, W., & Deary, I. J. (2012). Comparing models of intelligence in Project TALENT: The VPR model fits better than the CHC and extended Gf-Gc models. Intelligence, 40, 543-559. http://dx .doi.org/10.1016/j.intell.2012.07.006.
44. Mardia, K. V. (1970). Measures of multivariate skewness and kurtosis with applications. Biometrika, 57, 519-530. http://dx.doi.org/10.1093/biomet/57.3.519.
45. McDonald, R. P. (1989). An index of goodness of fit based on noncentrality. Journal of Classification, 6, 97-103. http://dx.doi.org/10.1007/BF01908590.
46. Meade, A. W., Johnson, E. C., & Braddy, P. W. (2008). Power and sensitivity of alternative fit indices in tests of measurement invariance. Journal of Applied Psychology, 93, 568-592. http://dx.doi.org/10.1037/0021-9010.93.3.568.
47. Morgan, G. B., Hodge, K. J., Wells, K. E., & Watkins, M. W. (2015). Are fit indices biased in favor of bi-factor models in cognitive ability research?: A comparison of fit in correlated factors, higher-order, and bi-factor models via Monte Carlo simulations. Journal of Intelligence, 3, 2-20. http://dx.doi.org/10.3390/jintelligence3010002.
48. Murray, A. L., & Johnson, W. (2013). The limitations of model fit in comparing the bi-factor versus higher-order models of human cognitive ability structure. Intelligence, 41, 407-422. http://dx.doi.org/10.1016/j .intell.2013.06.004.
49. Muthén, L. K., & Muthén, B. O. (1998-2012). Mplus user's guide (7th ed.). Los Angeles, CA: Author.
50. Reeve, C. L. (2004). Differential ability antecedents of general and specific dimensions of declarative knowledge: More than g. Intelligence, 32, 621-652. http://dx.doi.org/10.1016/j.intell.2004.07.006.
51. Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47, 667-696. http://dx.doi.org/10. .1080/00273171.2012.715555.
52. Reynolds, M. R., Ingram, P. B., Seeley, J. S., & Newby, K. D. (2013). Investigating the structure and invariance of the Wechsler Adult Intelligence Scales, Fourth Edition in a sample of adults with intellectual disabilities. Research in Developmental Disabilities, 34, 3235-3245. http://dx.doi.org/10.1016/j.ridd.2013.06.029.
53. Ritchie, S. J., Bates, T. C., & Deary, I. J. (2015). Is education associated with improvements in general cognitive ability, or in specific skills? Developmental Psychology, 51, 573-582. http://dx.doi.org/10.1037/a0038981.
54. Salthouse, T. A. (2014). Evaluating the correspondence of different cognitive batteries. Assessment, 21, 131-142. http://dx.doi.org/10.1177/1073191113486690.
55. Salthouse, T. A., & Saklofske, D. H. (2010). Do the WAIS-IV tests measure the same aspects of cognitive functioning in adults under and over 65? In L. G. Weiss, D. H. Saklofske, D. Coalson, & S. E. Raiford (Eds.), WAIS-IV clinical use and interpretation (pp. 217-235). New York, NY: Elsevier. http://dx.doi.org/10.1016/B978-0-12-375035-8. .10008-4.
56. Satorra, A., & Bentler, P. M. (1994). Corrections to test statistics and standard errors in covariance structure analysis. In A. von Eye & C. C. Clogg (Eds.), Latent variables analysis: Applications for developmental research (pp. 399-419). Thousand Oaks, CA: Sage.
57. Satorra, A., & Bentler, P. M. (2010). Ensuring positiveness of the scaled difference chi-square test statistic. Psychometrika, 75, 243-248. http://dx.doi.org/10.1007/s11336-009-9135-y
58. Schneider, W. J., & Newman, D. A. (2015). Intelligence is multidimensional: Theoretical review and implications of specific cognitive abilities. Human Resource Management Review, 25, 12-27. http://dx.doi.org/10.1016/j.hrmr.2014.09.004.
59. Steiger, J. H., & Lind, J. C. (1980, May). Statistically based tests for the number of common factors. Paper presented at the annual Spring Meeting of the Psychometric Society, Iowa City, IA.
60. Stelzl, I., Merz, F., Ehlers, T., & Remer, H. (1995). The effect of schooling on the development of fluid and crystallized intelligence: A quasiexperimental study. Intelligence, 21, 279-296. http://dx.doi.org/10. .1016/0160-2896(95)90018-7.
61. TEA, S. A. (1998). Manual del WAIS III [Handbook for the WAIS III]. Madrid, Spain: TEA Ediciones.
62. Ward, L. C., Bergman, M. A., & Hebert, K. R. (2012). WAIS-IV subtest covariance structure: Conceptual and statistical considerations. Psychological Assessment, 24, 328-340. http://dx.doi.org/10.1037/a0025614.
63. Watkins, M. W., & Beaujean, A. A. (2014). Bifactor structure of the Wechsler Preschool and Primary Scale of Intelligence-Fourth Edition. School Psychology Quarterly, 29, 52-63. http://dx.doi.org/10.1037/spq0000038.
64. Wechsler, D. (2012). WAIS-IV. Escala de inteligencia de Wechsler para adultos-IV. Manual técnico y de interpretación [WAIS-IV. Wechsler Adult Intelligence Scale-Fourth Edition. Technical and interpretative manual.]. Madrid, Spain: Pearson.
65. Weiss, L. G., Keith, T. Z., Zhu, J., & Chen, H. (2013). WAIS-IV and clinical validation of the four-and five-factor interpretative approaches. Journal of Psychoeducational Assessment, 31, 94-113. http://dx.doi .org/10.1177/0734282913478030.
66. Winship, C., & Korenman, S. (1997). Does staying in school make you smarter? In B. Devlin, S. E. Fienberg, D. P. Resnick, & K. Roeder (Eds.), Intelligence, genes and success: Scientists respond to the bell curve (pp. 215-234). New York, NY: Springer-Verlag. http://dx.doi.org/10.1007/978-1-4612-0669-9_10.
67. Zinbarg, R. E., Revelle, W., Yovel, I., & Li, W. (2005). Cronbach's, Revelle's, and McDonald'sH: Their relations with each other and two alternative conceptualizations of reliability. Psychometrika, 70, 123-133. http://dx.doi.org/10.1007/s11336-003-0974-7.