Evaluating dimensional distinctness with correlated-factor models: Limitations and suggestions

Intelligence

Volumn 62, Issue , 2017, Pages 138-147

  Gignac, Gilles E ^a   Kretzschmar, André ^b  

^a UNIVERSITY OF WESTERN AUSTRALIA   (Australia)

^b UNIVERSITY OF TÜBINGEN   (Germany)

Author keywords

Confirmatory factor analysis; Correlated factor model; Factorial validity; Higher order model; Reliability

Indexed keywords

EID: 85017430930     PISSN: 01602896     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.intell.2017.04.001     Document Type: Article

References (73)

1. Aberson, C.L., Applied power analysis for the behavioral sciences. 2010, Routledge, New York.
2. Adrover-Roig, D., Sesé, A., Barceló, F., Palmer, A., A latent variable approach to executive control in healthy ageing. Brain and Cognition 78:3 (2012), 284–299.
3. Alloway, T.P., Gathercole, S.E., Pickering, S.J., Verbal and visuospatial short-term and working memory in children: Are they separable?. Child Development 77:6 (2006), 1698–1716.
4. Arbuckle, J.L., Amos (version 21.0) [computer program]. 2012, IBM SPSS, Chicago.
5. Beaujean, A.A., Parkin, J., Parker, S., Comparing Cattell-Horn-Carroll factor models: Differences between bifactor and higher order factor models in predicting language achievement. Psychological Assessment 26:3 (2014), 789–805.
6. Bollen, K.A., Structural equations with latent variables. 1989, John Wiley, New York.
7. Brown, T.A., Confirmatory factor analysis for applied research. 2nd ed., 2015, Guilford Press, New York.
8. Brunner, M., Süß, H.-M., Analyzing the reliability of multidimensional measures: An example from intelligence research. Educational and Psychological Measurement 65 (2005), 227–240.
9. Brunner, M., Nagy, G., Wilhelm, O., A tutorial on hierarchically structured constructs. Journal of Personality 80:4 (2012), 796–846.
10. Burt, C., Group factor analysis. British Journal of Statistical Psychology 3:1 (1950), 40–75.
11. Byrne, B.M., Structural equation modeling with Amos: Basic concepts, applications, and programming. 3rd ed., 2010, Taylor and Francis Group, New York, NY.
12. Canivez, G.L., Construct validity of the WISC-IV with a referred sample: Direct versus indirect hierarchical structures. School Psychology Quarterly 29:1 (2014), 38–51.
13. Chen, F.F., West, S.G., Sousa, K.H., A comparison of bifactor and second-order models of quality of life. Multivariate Behavioral Research 41:2 (2006), 189–225.
14. Conway, A.R.A., Kovacks, K., Individual differences in intelligence and working memory: A review of latent variable models. Ross, B.H., (eds.) The psychology of learning and motivation, 2013, Academic Press, San Diego, CA, 233–270.
15. Janssen, R., De Boeck, P., Vander Steene, G., Verbal fluency and verbal comprehension abilities in synonym tasks. Intelligence 22:3 (1996), 291–310.
16. Conway, A.R., Cowan, N., Bunting, M.F., Therriault, D.J., Minkoff, S.R., A latent variable analysis of working memory capacity, short-term memory capacity, processing speed, and general fluid intelligence. Intelligence 30:2 (2002), 163–183.
17. Deary, I.J., McCrimmon, R.J., Bradshaw, J., Visual information processing and intelligence. Intelligence 24:3 (1997), 461–479.
18. Engel de Abreu, P.M.J., Conway, A.R.A., Gathercole, S.E., Working memory and fluid intelligence in young children. Intelligence 38:6 (2010), 552–561.
19. Friedman, N.P., Miyake, A., Corley, R.P., Young, S.E., DeFries, J.C., Hewitt, J.K., Not all executive functions are related to intelligence. Psychological Science 17:2 (2006), 172–179.
20. Friedman, N.P., Miyake, A., Young, S.E., DeFries, J.C., Corley, R.P., Hewitt, J.K., Individual differences in executive functions are almost entirely genetic in origin. Journal of Experimental Psychology: General 137:2 (2008), 201–225.
21. Fry, A.F., Hale, S., Processing speed, working memory, and fluid intelligence: Evidence for a developmental cascade. Psychological Science 7:4 (1996), 237–241.
22. Gignac, G.E., The WAIS-III as a nested factors model: A useful alternative to the more conventional oblique and higher-order models. Journal of Individual Differences 27 (2006), 73–86.
23. Gignac, G.E., Multi-factor modeling in individual differences research: Some recommendations and suggestions. Personality and Individual Differences 42:1 (2007), 37–48.
24. Gignac, G.E., Higher-order models versus bifactor models: g as superordinate or breadth factor?. Psychology Science 50:1 (2008), 21–43.
25. Gignac, G.E., Modeling the balanced inventory of desirable responding: Evidence in favor of a revised model of socially desirable responding. Journal of Personality Assessment 95:6 (2013), 645–656.
26. Gignac, G.E., On the inappropriateness of using items to calculate total scale score reliability via coefficient alpha for multidimensional scales. European Journal of Psychological Assessment 30:2 (2014), 130–139.
27. Gignac, G.E., The higher-order model imposes a proportionality constraint: That is why the bifactor model tends to fit better. Intelligence 55 (2016), 57–68.
28. Gignac, G.E., Watkins, M.W., Bifactor modeling and the estimation of model-based reliability in the WAIS-IV. Multivariate Behavioral Research 48:5 (2013), 639–662.
29. Giofrè, D., Mammarella, I.C., Cornoldi, C., The structure of working memory and how it relates to intelligence in children. Intelligence 41:5 (2013), 396–406.
30. Gray, S., Green, S., Alt, M., Hogan, T., Kuo, T., Brinkley, S., Cowan, N., The structure of working memory in young children and its relation to intelligence. Journal of Memory and Language 92 (2017), 183–201.
31. Greiff, S., Wüstenberg, S., Molnar, G., Fischer, A., Funke, J., Csapo, B., Complex problem solving in educational contexts—something beyond g: Concept, assessment, measurement invariance, and construct validity. Journal of Educational Psychology 105:2 (2013), 364–379.
32. Hegarty, M., A dissociation between mental rotation and perspective-taking spatial abilities. Intelligence 32:2 (2004), 175–191.
33. Hicks, K.L., Harrison, T.L., Engle, R.W., Wonderlic, working memory capacity, and fluid intelligence. Intelligence 50 (2015), 186–195.
34. Jones, J.A., Waller, N.G., Computing confidence intervals for standardized regression coefficients. Psychological Methods 18:4 (2013), 435–453.
35. Jöreskog, K.G., Testing structural equation models. Bollen, K.A., Long, J.S., (eds.) Testing structural equation models, 1993, Sage, Newbury Park, CA, 294–317.
36. Kail, R., Hall, L.K., Distinguishing short-term memory from working memory. Memory & Cognition 29:1 (2001), 1–9.
37. Kline, R.B., Principles and practice of structural equation modeling. 3rd ed., 2011, Guildford Press, New York.
38. Kovacs, K., Conway, A.R., Process overlap theory: A unified account of the general factor of intelligence. Psychological Inquiry 27:3 (2016), 151–177.
39. Kretzschmar, A., Neubert, J.C., Wüstenberg, S., Greiff, S., Construct validity of complex problem solving: A comprehensive view on different facets of intelligence and school grades. Intelligence 54 (2016), 55–69.
40. Loehlin, J.C., Latent variable models: An introduction to factor, path, and structural equation analysis. 2004, Lawrence Erlbaum, Mahway, NJ.
41. van der Maas, H.L., Dolan, C.V., Grasman, R.P., Wicherts, J.M., Huizenga, H.M., Raijmakers, M.E., A dynamical model of general intelligence: The positive manifold of intelligence by mutualism. Psychological Review 113:4 (2006), 842–861.
42. Mackintosh, N., Bennett, E.S., The fractionation of working memory maps onto different components of intelligence. Intelligence 31:6 (2003), 519–531.
43. McAuley, T., White, D.A., A latent variables examination of processing speed, response inhibition, and working memory during typical development. Journal of Experimental Child Psychology 108:3 (2011), 453–468.
44. Miyake, A., Friedman, N.P., The nature and organization of individual differences in executive functions four general conclusions. Current Directions in Psychological Science 21:1 (2012), 8–14.
45. Miyake, A., Friedman, N.P., Emerson, M.J., Witzki, A.H., Howerter, A., Wager, T.D., The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: A latent variable analysis. Cognitive Psychology 41:1 (2000), 49–100.
46. Miyake, A., Friedman, N.P., Rettinger, D.A., Shah, P., Hegarty, M., How are visuospatial working memory, executive functioning, and spatial abilities related? A latent-variable analysis. Journal of Experimental Psychology: General 130:4 (2001), 621–640.
47. Mogle, J.A., Lovett, B.J., Stawski, R.S., Sliwinski, M.J., What's so special about working memory? An examination of the relationships among working memory, secondary memory, and fluid intelligence. Psychological Science 19:11 (2008), 1071–1077.
48. Nelson, J.M., Canivez, G.L., Watkins, M.W., Structural and incremental validity of the Wechsler Adult Intelligence Scale-with a clinical sample. Psychological Assessment 25:2 (2013), 618–630.
49. Neubert, J.C., Kretzschmar, A., Wüstenberg, S., Greiff, S., Extending the assessment of complex problem solving to finite state automata: Embracing heterogeneity. European Journal of Psychological Assessment 31:3 (2015), 181–194.
50. R Core Team, R: A language and environment for statistical computing. 2016, R Foundation for Statistical Computing, Vienna, Austria.
51. Reise, S.P., The rediscovery of bifactor measurement models. Multivariate Behavioral Research 47:5 (2012), 667–696.
52. Reise, S.P., Scheines, R., Widaman, K.F., Haviland, M.G., Multidimensionality and structural coefficient bias in structural equation modeling: A bifactor perspective. Educational and Psychological Measurement 73:1 (2012), 5–26.
53. Reise, S.P., Bonifay, W.E., Haviland, M.G., Scoring and modeling psychological measures in the presence of multidimensionality. Journal of Personality Assessment 95:2 (2013), 129–140.
54. Rindskopf, D., Rose, T., Some theory and applications of confirmatory second-order factor analysis. Multivariate Behavioral Research 23:1 (1988), 51–67.
55. Rodriguez, A., Reise, S.P., Haviland, M.G., Applying bifactor statistical indices in the evaluation of psychological measures. Journal of Personality Assessment 98:3 (2016), 223–237.
56. Rodriguez, A., Reise, S.P., Haviland, M.G., Evaluating bifactor models: Calculating, interpreting, and applying statistical indices. Psychological Methods 21:2 (2016), 137–150.
57. Rosseel, Y., Lavaan: An R package for structural equation modeling. Journal of Statistical Software 48 (2012), 1–36.
58. Santos, N.C., Costa, P.S., Amorim, L., Moreira, P.S., Cunha, P., Cotter, J., Sousa, N., Exploring the factor structure of neurocognitive measures in older individuals. PloS One, 10(4), 2015, e0124229.
59. Schmid, J., Leiman, J.M., The development of hierarchical factor solutions. Psychometrika 22 (1957), 53–61.
60. Shelton, J.T., Elliott, E.M., Matthews, R.A., Hill, B.D., Gouvier, W.D., The relationships of working memory, secondary memory, and general fluid intelligence: Working memory is special. Journal of Experimental Psychology: Learning, Memory, and Cognition 36:3 (2010), 813–820.
61. Sinharay, S., How often do subscores have added value? Results from operational and simulated data. Journal of Educational Measurement 47:2 (2010), 150–174.
62. Spearman, C., “General Intelligence,” objectively determined and measured. American Journal of Psychology 15:2 (1904), 201–292.
63. Steiger, J.H., Shapiro, A., Browne, M.W., On the multivariate asymptotic distribution of sequential chi-square statistics. Psychometrika 50:3 (1985), 253–263.
64. Swanson, H.L., Orosco, M.J., Lussier, C.M., Growth in literacy, cognition, and working memory in English language learners. Journal of Experimental Child Psychology 132 (2015), 155–188.
65. Thomson, G.H., The factorial analysis of human ability. 5th ed., 1951, University of London Press, London.
66. Tulving, E., Are there 256 different kinds of memory?. Nairne, J.S., (eds.) The foundations of remembering: Essays in honor of Henry L. Roediger, III, 2007, Psychology Press, New York, 39–52.
67. Unsworth, N., Spillers, G.J., Brewer, G.A., Examining the relations among working memory capacity, attention control, and fluid intelligence from a dual-component framework. Psychology Science Quarterly 51:4 (2009), 388–402.
68. Watkins, M.W., Structure of the Wechsler Intelligence Scale for children–fourth edition among a national sample of referred students. Psychological Assessment 22 (2010), 782–787.
69. Watkins, M.W., Omega [computer software]. 2013, Ed & Psych, Phoenix, AZ.
70. Wechsler, D., Wechsler Adult Intelligence Scale—fourth edition: Technical and interpretive manual. 2008, Pearson Assessment, San Antonio, TX.
71. Yuan, K.H., Hayashi, K., Standard errors in covariance structure models: Asymptotics versus bootstrap. British Journal of Mathematical and Statistical Psychology 59:2 (2006), 397–417.
72. Zeller, R.A., Carmines, E.G., Measurement in the social sciences: The link between theory and data. 1980, Cambridge University Press, Cambridge.
73. h for structures containing two group factors: Perils and prospects. Applied Psychological Measurement 31:2 (2007), 135–157.