Executive Functions: Formative Versus Reflective Measurement

Measurement

Volumn 12, Issue 3, 2014, Pages 69-95

  Willoughby, Michael ^a   Holochwost, Steven J ^b   Blanton, Zane E ^c   Blair, Clancy B ^d  

^a UNIVERSITY OF NORTH CAROLINA   (United States)

^b GEORGETOWN UNIVERSITY   (United States)

^c University of North Carolina at Chapel Hill   (United States)

^d NEW YORK UNIVERSITY   (United States)

Author keywords

confirmatory factor analysis; executive function; formative measurement; maximal reliability

Indexed keywords

EID: 84906537323     PISSN: 15366367     EISSN: 15366359     Source Type: Journal    
DOI: 10.1080/15366367.2014.929453     Document Type: Article

References (73)

1. Aarnoudse-Moens, C. S. H., Weisglas-Kuperus, N., van Goudoever, J. B., & Oosterlaan, J. (2009). Meta-analysis of neurobehavioral outcomes in very preterm and/or very low birth weight children. Pediatrics, 124(2), 717-728.
2. Alderman, N., Burgess, P. W., Knight, C., & Henman, C. (2003). Ecological validity of a simplified version of the multiple errands shopping test. Journal of the International Neuropsychological Society, 9(1), 31-44. doi:10.1017/S1355617703910046
3. Arnsten, A. F. T. (2000). Stress impairs prefrontal cortical function in rats and monkeys: Role of dopamine D1 and norepinephrine alpha-1 receptor mechanisms. Progress in Brain Research, 126, 183-192.
4. Arnsten, A. F. T. (2009). Stress signalling pathways that impair prefrontal cortex structure and function. Nature Reviews Neuroscience, 10(6), 410-422. doi:10.1038/Nrn2648
5. Arnsten, A. F. T., & Simon, F. (2000). Through the looking glass: Differential noradenergic modulation of prefrontal cortical function. Neural Plasticity, 7(1-2), 133-146. doi:10.1155/Np.2000.133
6. Baumeister, R. F., Bratslavsky, E., Muraven, M., & Tice, D. M. (1998). Ego depletion: Is the active self a limited resource? Journal of Personality and Social Psychology, 74(5), 1252-1265. doi:10.1037/0022-3514.74.5.1252
7. Bernier, A., Carlson, S. M., & Whipple, N. (2010). From external regulation to self-regulation: Early parenting precursors of young children's executive functioning. Child Development, 81(1), 326-339.
8. Best, J. R. (2010). Effects of physical activity on children's executive function: Contributions of experimental research on aerobic exercise. Developmental Review, 30(4), 331-351. doi:10.1016/J.Dr.2010.08.001
9. Best, J. R., & Miller, P. H. (2010). A developmental perspective on executive function. Child Development, 81(6), 1641-1660. doi:10.1111/j.1467-8624.2010.01499.x
10. Blair, C. (2002). School readiness-Integrating cognition and emotion in a neurobiological conceptualization of children's functioning at school entry. American Psychologist, 57(2), 111-127.
11. Blair, C., Granger, D. A., Willoughby, M., Mills-Koonce, R., Cox, M., Greenberg, M. T.,. Investigators, F. (2011). Salivary cortisol mediates effects of poverty and parenting on executive functions in early childhood. Child Development, 82(6), 1970-1984. doi:10.1111/j.1467-8624.2011.01643.x
12. Bollen, K., & Lennox, R. (1991). Conventional wisdom on measurement-A structural equation perspective. Psychological Bulletin, 110(2), 305-314.
13. Bollen, K. A. (1984). Multiple indicators: Internal consistency or no necessary relationship? Quality and Quantity, 18, 377-385.
14. Bollen, K. A. (1989). Structural equations with latent variables. New York, NY: John Wiley.
15. Bollen, K. A., & Bauldry, S. (2011). Three Cs in measurement models: Causal indicators, composite indicators, and covariates. Psychological Methods, 16(3), 265-284. doi:10.1037/A0024448
16. Bollen, K. A., Lennox, R. D., & Dahly, D. L. (2009). Practical application of the vanishing tetrad test for causal indicator measurement models: An example from health-related quality of life. Statistics in Medicine, 28(10), 1524-1536. doi:10.1002/Sim.3560
17. Bollen, K. A., & Ting, K. F. (2000). A tetrad test for causal indicators. Psychological Methods, 5(1), 3-22.
18. Bollen, K. A., & Ting, K. F. (1993). Confirmatory tetrad analysis. Sociological Methodology, 23, 147-175.
19. Bollen, K. A., & Ting, K. F. (1998). Bootstrapping a test statistic for vanishing tetrads. Sociological Methods & Research, 27(1), 77-102.
20. Bryck, R. L., & Fisher, P. A. (2012). Training the brain practical applications of neural plasticity from the intersection of cognitive neuroscience, developmental psychology, and prevention science. American Psychologist, 67(2), 87-100. doi:10.1037/A0024657
21. Callicott, J. H., Mattay, V. S., Bertolino, A., Finn, K., Coppola, R., Frank, J. A.,. Weinberger, D. R. (1999). Physiological characteristics of capacity constraints in working memory as revealed by functional MRI. Cerebral Cortex, 9(1), 20-26. doi:10.1093/cercor/9.1.20
22. Canfield, R. L., Gendle, M. H., & Cory-Slechta, D. A. (2004). Impaired neuropsychological functioning in lead-exposed children. Developmental Neuropsychology, 26(1), 513-540.
23. Carlson, S. A. (2005). Developmentally sensitive measures of executive function in preschool children. Developmental Neuropsychology, 28(2), 595-616.
24. Chaddock, L., Pontifex, M. B., Hillman, C. H., & Kramer, A. F. (2011). A review of the relation of aerobic fitness and physical activity to brain structure and function in children. Journal of the International Neuropsychological Society, 17(6), 975-985. doi:10.1017/S1355617711000567
25. Chan, R. C. K., Shum, D., Toulopoulou, T., & Chen, E. Y. H. (2008). Assessment of executive functions: Review of instruments and identification of critical issues. Archives of Clinical Neuropsychology, 23(2), 201-216. doi:10.1016/j.acn.2007.08.010
26. Davidson, M. C., Amso, D., Anderson, L. C., & Diamond, A. (2006). Development of cognitive control and executive functions from 4-13 years: Evidence from manipulations of memory, inhibition, and task switching. Neuropsychologia, 44, 2037-2078.
27. Dawson, D. R., Anderson, N. D., Burgess, P., Cooper, E., Krpan, K. M., & Stuss, D. T. (2009). Further development of the multiple errands test: Standardized scoring, reliability, and ecological validity for the baycrest version. Archives of Physical Medicine and Rehabilitation, 90(11), S41-S51. doi:10.1016/j.apmr.2009.07.012
28. De Luca, C. R., & Leventer, R. J. (2008). Developmental trajectories of executive functions across the life span. In V. Anderson, R. Jacobs, & P. J. Anderson (Eds.), Executive functions and the frontal lobes (pp. 22-56). New York, NY: Taylor & Francis.
29. Diamantopoulos, A., Riefler, P., & Roth, K. P. (2008). Advancing formative measurement models. Journal of Business Research, 61(12), 1203-1218. doi:10.1016/j.jbusres.2008.01.009
30. Diamond, A. (2012). Activities and programs that improve children's executive functions. Current Directions in Psychological Science, 21(5), 335-341.
31. Durston, S., Davidson, M. C., Tottenham, N., Galvan, A., Spicer, J., Fossella, J. A., & Casey, B. J. (2006). A shift from diffuse to focal cortical activity with development. Developmental Science, 9(1), 1-8.
32. Edwards, J. R. (2011). The fallacy of formative measurement. Organizational Research Methods, 14(2), 370-388. doi:10.1177/1094428110378369
33. Eslinger, P. J., Blair, C., Wang, J. L., Lipovsky, B., Realmuto, J., Baker, D.,. Yang, Q. X. (2009). Developmental shifts in fMRI activations during visuospatial relational reasoning. Brain and Cognition, 69(1), 1-10. doi:10.1016/j.bandc.2008.04.010
34. Ettenhofer, M. L., Hambrick, D. Z., & Abeles, N. (2006). Reliability and stability of executive functioning in older adults. Neuropsychology, 20(5), 607-613.
35. Franke, G. R., Preacher, K. J., & Rigdon, E. E. (2008). Proportional structural effects of formative indicators. Journal of Business Research, 61(12), 1229-1237. doi:10.1016/j.jbusres.2008.01.011
36. Friedman, N. P., Miyake, A., Young, S. E., DeFries, J. C., Corley, R. P., & Hewitt, J. K. (2008). Individual differences in executive functions are almost entirely genetic in origin. Journal of Experimental Psychology-General, 137(2), 201-225. doi:10.1037/0096-3445.137.2.201
37. Garon, N., Bryson, S. E., & Smith, I. M. (2008). Executive function in preschoolers: A review using an integrative framework. Psychological Bulletin, 134(1), 31-60.
38. Graham, J. W. (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549-576.
39. Gur, R. C., Richard, J., Calkins, M. E., Chiavacci, R., Hansen, J. A., Bilker, W. B.,. Gur, R. E. (2012). Age group and sex differences in performance on a computerized neurocognitive battery in children age 8-21. Neuropsychology, 26(2), 251-265. doi:10.1037/A0026712
40. Haase, R. F., McCaffrey, R. J., Santiago-Rivera, A. L., Morse, G. S., & Tarbell, A. (2009). Evidence of an age-related threshold effect of polychlorinated biphenyls (PCBs) on neuropsychological functioning in a Native American population. Environmental Research, 109(1), 73-85.
41. Hackman, D. A., Farah, M. J., & Meaney, M. J. (2010). Socioeconomic status and the brain: Mechanistic insights from human and animal research. Nature Reviews Neuroscience, 11(9), 651-659.
42. Hagger, M. S., Wood, C., Stiff, C., & Chatzisarantis, N. L. D. (2010). Ego depletion and the strength model of self-control: A meta-analysis. Psychological Bulletin, 136(4), 495-525. doi:10.1037/A0019486
43. Hancock, G. R. (2001). Effect size, power, and sample size determination for structured means modeling and mimic approaches to between-groups hypothesis testing of means on a single latent construct. Psychometrika, 66(3), 373-388.
44. Hancock, G. R., & Mueller, R. O. (2001). Rethinking construct reliability within latent variable systems. In R. Cudeck, S. du Toit, & D. Sörbom (Eds.), Structural equation modeling: present and future-A festschrift in honor of Karl Jöreskog. Lincolnwood, IL: Scientific Software International.
45. Hancock, G. R., & Mueller, R. O. (2011). The reliability paradox in assessing structural relations within covariance structure models. Educational and Psychological Measurement, 71(2), 306-324. doi:10.1177/0013164410384856
46. Hipp, J. R., Bauer, D. J., & Bollen, K. A. (2005). Conducting tetrad tests of model fit and contrasts of tetrad-nested models: A new SAS macro. Structural Equation Modeling-A Multidisciplinary Journal, 12(1), 76-93.
47. Howell, R. D., Breivik, E., & Wilcox, J. B. (2007). Reconsidering formative measurement. Psychological Methods, 12(2), 205-218. doi:10.1037/1082-989x.12.2.205
48. Huizinga, M., Dolan, C. V., & van der Molen, M. W. (2006). Age-related change in executive function: Developmental trends and a latent variable analysis. Neuropsychologia, 44(11), 2017-2036.
49. Jarvis, C. B., MacKenzie, S. B., & Podsakoff, P. M. (2003). A critical review of construct indicators and measurement model misspecification in marketing and consumer research. Journal of Consumer Research, 30(2), 199-218. doi:10.1086/376806
50. Levin, H. S., & Hanten, G. (2005). Executive functions after traumatic brain injury in children. Pediatric Neurology, 33(2), 79-93.
51. Lillard, A. S. (2012). Preschool children's development in classic Montessori, supplemented Montessori, and conventional programs. Journal of School Psychology, 50(3), 379-401. doi:10.1016/j.jsp.2012.01.001
52. MacCallum, R. C., & Browne, M. W. (1993). The use of causal indicators in covariance structure models: Some practical issues. Psychological Bulletin, 114(3), 533-541.
53. McCormack, T., & Atance, C. M. (2011). Planning in young children: A review and synthesis. Developmental Review, 31(1), 1-31. doi:10.1016/J.Dr.2011.02.002
54. Mischel, W., Shoda, Y., & Rodriguez, M. L. (1989). Delay of gratification in children. Science, 244(4907), 933-938.
55. Miyake, A., & Friedman, N. P. (2012). The nature and organization of individual differences in executive functions: Four general conclusions. Current Directions in Psychological Science, 21, 8-14.
56. Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000). The unity and diversity of executive functions and their contributions to complex "frontal lobe" tasks: A latent variable analysis. Cognitive Psychology, 41(1), 49-100.
57. Moffitt, T. E., Arseneault, L., Belsky, D., Dickson, N., Hancox, R. J., Harrington, H., Caspi, A. (2011). A gradient of childhood self-control predicts health, wealth, and public safety. Proceedings of the National Academy of Sciences of the United States of America, 108(7), 2693-2698. doi:10.1073/pnas.1010076108
58. Moran, S., & Gardner, H. (2007). Hill, skill and will. Executive function from a multiple-intelligences perspective. In L. Meltzer (Ed.), Executive function in education. From theory to practice (pp. 19-37). New York, NY: Guilford.
59. Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric Theory (3rd ed.). New York, NY: McGraw-Hill.
60. Penev, S., & Raykov, T. (2006). On the relationship between maximal reliability and maximal validity of linear composites. Multivariate Behavioral Research, 41(2), 105-126.
61. Pennington, B. F., & Ozonoff, S. (1996). Executive functions and developmental psychopathology. Journal of Child Psychology and Psychiatry, 37(1), 51-87.
62. Rabbitt, P. (1997). Introduction: Methodologies and models in the study of executive function. In P. Rabbitt (Ed.), Methodology of frontal and executive function (pp. 1-38). Psychology Press.
63. Romine, C. B., & Reynolds, C. R. (2005). Model of the development of frontal lobe functioning: Findings from a meta-analysis. Applied Neuropsychology, 12(4), 190-201.
64. Rypma, B., Berger, J. S., Prabhakaran, V., Bly, B. M., Kimberg, D. Y., Biswal, B. B., & D'Esposito, M. (2006). Neural correlates of cognitive efficiency. Neuroimage, 33(3), 969-979. doi:10.1016/j.neuroimage.2006.05.065
65. Shing, Y. L., Lindenberger, U., Diamond, A., Li, S. C., & Davidson, M. C. (2010). Memory maintenance and inhibitory control differentiate from early childhood to adolescence. Developmental Neuropsychology, 35(6), 679-697.
66. Spreen, O., Risser, A. T., & Edgell, D. (1995). Developmental neuropsychology. New York, NY: Oxford University Press.
67. Tanaka, K., Kon, N., Ohkawa, N., Yoshikawa, N., & Shimizu, T. (2009). Does breastfeeding in the neonatal period influence the cognitive function of very-low-birth-weight infants at 5 years of age? Brain & Development, 31(4), 288-293. doi:10.1016/j.braindev.2008.05.011
68. Vestberg, T., Gustafson, R., Maurex, L., Ingvar, M., & Petrovic, P. (2012). Executive functions predict the success of top-soccer players. Plos One, 7(4). doi:ARTN e3473110.1371/journal.pone.0034731
69. Wiebe, S. A., Espy, K. A., & Charak, D. (2008). Using confirmatory factor analysis to understand executive control in preschool children: I. Latent structure. Developmental Psychology, 44(2), 575-587.
70. Willoughby, M. T., & Blair, C. B. (2011). Test-retest reliability of a new executive function battery for use in early childhood. Child Neuropsychology, 17(6), 564-579.
71. Willoughby, M. T., Pek, J., & Blair, C. B. (2013). Measuring executive function in early childhood: A focus on maximal reliability and the derivation of short forms. Psychological Assessment, 25(2), 664-670. doi:10.1037/a0031747
72. Willoughby, M. T., Wirth, R. J., Blair, C. B., & Investigators, F. L. P. (2012). Executive function in early childhoood: Longitudinal measurement invariance and developmental change. Psychological Assessment, 24(2), 418-431.
73. Wirth, R. J., & Edwards, M. C. (2007). Item factor analysis: Current approaches and future directions. Psychological Methods, 12(1), 58-79.