The measurement of executive function at age 5: Psychometric properties and relationship to academic achievement

Psychological Assessment

Volumn 24, Issue 1, 2012, Pages 226-239

  Willoughby, Michael T ^a   Blair, Clancy B ^b   Wirth, R J ^c   Greenberg, Mark ^d  

^a UNIVERSITY OF NORTH CAROLINA   (United States)

^b NEW YORK UNIVERSITY   (United States)

^c Vector Psychometric Group   (United States)

^d PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

Academic achievement; Early childhood; Executive function; Psychometrics

Indexed keywords

ACADEMIC ACHIEVEMENT; AFRICAN AMERICAN; ANIMAL GO NO-GO; ARTICLE; AWARENESS; BIRTH; CHILD; CHILDHOOD; CONTROLLED STUDY; CRITERION RELATED VALIDITY; EARLY CHILDHOOD LONGITUDINAL PROGRAM KINDERGARTEN MATH ASSESSMENT; EXECUTIVE FUNCTION; FAMILY; FEMALE; HUMAN; LETTER WORD IDENTIFICATION; LONGITUDINAL STUDY; LOWEST INCOME GROUP; MALE; MATHEMATICS; NAMED INVENTORIES, QUESTIONNAIRES AND RATING SCALES; PERFORMANCE; PHONETICS; PICK THE PICTURE; PRESCHOOL CHILD; PROSPECTIVE STUDY; PSYCHOLOGIC ASSESSMENT; PSYCHOLOGIC TEST; PSYCHOMETRY; SCORING SYSTEM; SILLY SOUNDS STROOP; SKILL; SOMETHINGS THE SAME; SPATIAL CONFLICT ARROWS; TEST OF PRESCHOOL EARLY LITERACY; WOODCOCK-JOHNSON III TESTS OF ACHIEVEMENT; WORKING MEMORY SPAN; ACHIEVEMENT; CHILD DEVELOPMENT; EDUCATIONAL STATUS; FACTORIAL ANALYSIS; INDIVIDUALITY; NEUROPSYCHOLOGICAL TEST; PHYSIOLOGY; POVERTY; PROFESSIONAL PRACTICE; PSYCHOLOGICAL ASPECT; SPEECH PERCEPTION; STATISTICAL MODEL; STATISTICS; UNITED STATES; VALIDATION STUDY;

ACHIEVEMENT; AFRICAN AMERICANS; CHILD DEVELOPMENT; CHILD, PRESCHOOL; EDUCATIONAL STATUS; EXECUTIVE FUNCTION; FACTOR ANALYSIS, STATISTICAL; FEMALE; HOUSE CALLS; HUMANS; INDIVIDUALITY; MALE; MATHEMATICS; MODELS, STATISTICAL; NEUROPSYCHOLOGICAL TESTS; NORTH CAROLINA; PENNSYLVANIA; POVERTY; PROSPECTIVE STUDIES; PSYCHOMETRICS; SPEECH PERCEPTION;

EID: 84862765964     PISSN: 10403590     EISSN: 1939134X     Source Type: Journal    
DOI: 10.1037/a0025361     Document Type: Article

References (75)

1. Anderson, P. (2002). Assessment and development of executive function (EF) during childhood. Child Neuropsychology, 8, 71-82. doi:10.1076/ chin.8.2.71.8724
2. Becker, M. G., Isaac, W., & Hynd, G. W. (1987). Neuropsychological development of nonverbal behaviors attributed to "frontal lobe" functioning. Developmental Neuropsychology, 3, 275-298. doi:10.1080/ 87565648709540381
3. Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B, 57, 289-300.
4. Bierman, K. L., Nix, R. L., Greenberg, M. T., Blair, C., & Domitrovich, C. E. (2008). Executive functions and school readiness intervention: Impact, moderation, and mediation in the Head Start REDI program. Development and Psychopathology, 20, 821-843. doi:10.1017/ S0954579408000394
5. Bierman, K. L., Torres, M. M., Domitrovich, C. E., Welsh, J. A., & Gest, S. D. (2009). Behavioral and cognitive readiness for school: Crossdomain associations for children attending Head Start. Social Development, 18, 305-323. doi:10.1111/j.1467-9507.2008.00490.x
6. Blair, C. (2002). School readiness; Integrating cognition and emotion in a neurobiological conceptualization of children's functioning at school entry. American Psychologist, 57, 111-127. doi:10.1037/0003-066X.57.2.111
7. Blair, C., & Diamond, A. (2008). Biological processes in prevention and intervention: The promotion of self-regulation as a means of preventing school failure. Development and Psychopathology, 20, 899-911. doi: 10.1017/S0954579408000436
8. Blair, C., & Razza, R. P. (2007). Relating effortful control, executive function, and false belief understanding to emerging math and literacy ability in kindergarten. Child Development, 78, 647-663. doi:10.1111/ j.1467-8624.2007.01019.x
9. Blair, C., Zelazo, P. D., & Greenberg, M. T. (2005). The measurement of executive function in early childhood. Developmental Neuropsychology, 28, 561-571. doi:10.1207/s15326942dn2802_1
10. Brock, L. L., Rimm-Kaufman, S. E., Nathanson, L., & Grimm, K. J. (2009). The contributions of "hot" and "cool" executive function to children's academic achievement, learning-related behaviors, and engagement in kindergarten. Early Childhood Research Quarterly, 24, 337-349. doi:10.1016/j.ecresq.2009.06.001
11. Bull, R., Espy, K. A., & Wiebe, S. A. (2008). Short-term memory, working memory, and executive functioning in preschoolers: Longitudinal predictors of mathematical achievement at age 7 years. Developmental Neuropsychology, 33, 205-228. doi:10.1080/87565640801982312
12. Bull, R., & Scerif, G. (2001). Executive functioning as a predictor of children's mathematics ability: Inhibition, switching, and working memory. Developmental Neuropsychology, 19, 273-293. doi:10.1207/ S15326942DN1903_3
13. Cai, L., du Toit, S. H. C., & Thissen, D. (in press). IRTPRO: Flexible, multidimensional, multiple categorical IRT modeling. Chicago, IL: Scientific Software International.
14. Carlson, S. M. (2005). Developmentally sensitive measures of executive function in preschool children. Developmental Neuropsychology, 28, 595-616. doi:10.1207/s15326942dn2802_3
15. Chen, F. N., Bollen, K. A., Paxton, P., Curran, P. J., & Kirby, J. B. (2001). Improper solutions in structural equation models: Causes, consequences, and strategies. Sociological Methods & Research, 29, 468-508. doi: 10.1177/0049124101029004003
16. Conway, A. R. A., Kane, M. J., Bunting, M. F., Hambrick, D. Z., Wilhelm, O., & Engle, R. W. (2005). Working memory span tasks: A methodological review and user's guide. Psychonomic Bulletin & Review, 12, 769-786. doi:10.3758/BF03196772
17. Cook K., Kallen, M., & Amtmann, D. (2009). Having a fit: Impact of number of items and non-normality on tests of IRT's unidimensionality assumption. Quality of Life Research, 18, 447-460.
18. Cragg, L., & Nation, K. (2007). Self-ordered pointing as a test of working memory in typically developing children. Memory, 15, 526-535. doi: 10.1080/09658210701390750
19. Davidson, M. C., Amso, D., Anderson, L. C., & Diamond, A. (2006). Development of cognitive control and executive functions from 4-13 years: Evidence from manipulations of memory, inhibition, and task switching. Neuropsychologia, 44, 2037-2078. doi:10.1016/j.neuropsychologia.2006.02.006
20. Diamond, A., Barnett, W. S., Thomas, J., & Munro, S. (2007, November 30). Preschool program improves cognitive control. Science, 318, 1387-1388.
21. Dill, B. T. (2001). Rediscovering rural America. In J. R. Blau (Ed.), The Blackwell companion to sociology (pp. 196-210). Malden, MA: Blackwell.
22. Durston, S., Thomas, K. M., Yang, Y. H., Ulug, A. M., Zimmerman, R. D., & Casey, B. J. (2002). A neural basis for the development of inhibitory control. Developmental Science, 5, F9-F16.
23. Espy, K. A. (1997). The shape school: Assessing executive function in preschool children. Developmental Neuropsychology, 13, 495-499. doi: 10.1080/87565649709540690
24. Espy, K. A., Bull, R., Martin, J., & Stroup, W. (2006). Measuring the development of executive control with the shape school. Psychological Assessment, 18, 373-381. doi:10.1037/1040-3590.18.4.373
25. Espy, K. A., & Cwik, M. F. (2004). The development of a trail making test in young children: The TRAILS-P. The Clinical Neuropsychologist, 18, 411-422. doi:10.1080/138540409052416
26. Espy, K. A., Kaufmann, P. M., & Glisky, M. L. (1999). Neuropsychological function in toddlers exposed to cocaine in utero: A preliminary study. Developmental Neuropsychology, 15, 447-460. doi:10.1080/ 87565649909540761
27. Espy, K. A., Kaufmann, P. M., Glisky, M. L., & McDiarmid, M. D. (2001). New procedures to assess executive functions in preschool children. The Clinical Neuropsychologist, 15, 46-58. doi:10.1076/clin.15.1.46.1908
28. Espy, K. A., Kaufmann, P. M., McDiarmid, M. D., & Glisky, M. L. (1999). Executive functioning in preschool children: Performance on a-not-b and other delayed response format tasks. Brain and Cognition, 41, 178-199. doi:10.1006/brcg.1999.1117
29. Espy, K. A., McDiarmid, M. M., Cwik, M. F., Stalets, M. M., Hamby, A., & Senn, T. E. (2004). The contribution of executive functions to emergent mathematic skills in preschool children. Developmental Neuropsychology, 26, 465-486. doi:10.1207/s15326942dn2601_6
30. Espy, K. A., Sheffield, T. D., Wiebe, S., Clark, C. A. C., & Moehr, M. (2011). Executive control and dimensions of problem behaviors in preschool children. Journal of Child Psychology and Psychiatry, 52, 33-46. doi:10.1111/j.1469-7610.2010.02265.x
31. Fletcher, J. M., & Taylor, H. G. (1984). Neuropsychological approaches to children: Towards a developmental neuropsychology. Journal of Clinical Neuropsychology, 6, 39-56. doi:10.1080/01688638408401195
32. Fuster, J. M. (1997). The prefrontal cortex. Anatomy, physiology and neuropsychology of the frontal lobe. New York, NY: Lippincott-Raven Press.
33. Garon, N., Bryson, S. E., & Smith, I. M. (2008). Executive function in preschoolers: A review using an integrative framework. Psychological Bulletin, 134, 31-60. doi:10.1037/0033-2909.134.1.31
34. Gerardi-Caulton, G. (2000). Sensitivity to spatial conflict and the development of self-regulation in children 24-36 months of age. Developmental Science, 3, 397-404.
35. Gerstadt, C., Hong, Y., & Diamond, A. (1994). The relationship between cognition and action: Performance of children 3 1/2-7 years old on a Stroop-like day-night test. Cognition, 53, 129-153.
36. Gibbons, R. D., Bock, R. D., Hedeker, D., Weiss, D. J., Segawa, E., Bhaumik,...Stover, A. (2007). Full-information item bifactor analysis of graded response data. Applied Psychological Measurement, 31, 4-19.
37. Gibbons, R. D., & Hedeker, D. (1992). Full-information item bifactor analysis. Psychometrika, 57, 423-436.
38. Hill, C. D., Edwards, M. C., Thissen, D., Langer, M. M., Wirth, R. J., Burwinkle, T. M., & Varni, J. W. (2007). Practical issues in the application of item response theory: A demonstration using the Pediatric Quality of Life Inventory (PedsQLTM) 4.0 Generic Core Scales. Medical Care 45 S39-S47.
39. Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional versus new alternatives. Structural Equation Modeling, 6, 1-55.
40. Hughes, C., Ensor, R., Wilson, A., & Graham, A. (2010). Tracking executive function across the transition to school: A latent variable approach. Developmental Neuropsychology, 35, 20-36. doi:10.1080/ 87565640903325691
41. Jacques, S., & Zelazo, P. D. (2001). The Flexible Item Selection Task (FIST): A measure of executive function in preschoolers. Developmental Neuropsychology, 20, 573-591.
42. Korkman, M., Kirk, U., & Kemp, S. (1998). NEPSY: A developmental neuropsychological assessment manual. San Antonio, TX: Psychological Corporation.
43. Lonigan, C. J., Wagner, R. K., Torgesen, J. K., & Rashotte, C. A. (2007). TOPEL: Test of Preschool Early Literacy. Austin, TX: PRO-ED.
44. Lubke, G. H., & Muthén, B. (2005). Investigating population heterogeneity with factor mixture models. Psychological Methods, 10, 21-39. doi: 10.1037/1082-989X.10.1.21
45. Luciana, M., Conklin, H. M., Hooper, C. J., & Yarger, R. S. (2005). The development of nonverbal working memory and executive control processes in adolescents. Child Development, 76, 697-712. doi:10.1111/ j.1467-8624.2005.00872.x
46. Luciana, M., & Nelson, C. A. (1998). The functional emergence of prefrontallyguided working memory systems in fourto eight-year-old children. Neuropsychologia, 36, 273-293. doi:10.1016/S0028-3932(97)00109-7
47. MacCallum, R. C., Zhang, S., Preacher, K. J., & Rucker, D. D. (2002). On the practice of dichotomization of quantitative variables. Psychological Methods, 7, 19-40. doi:10.1037/1082-989X.7.1.19
48. Matthews, J. S., Ponitz, C. C., & Morrison, F. J. (2009). Early gender differences in self-regulation and academic achievement. Journal of Educational Psychology, 101, 689-704. doi:10.1037/a0014240
49. Maxwell, S. E., & Delaney, H. D. (1993). Bivariate median splits and spurious statistical significance. Psychological Bulletin, 113, 181-190. doi:10.1037/0033-2909.113.1.181
50. McClelland, M. M., Cameron, C. E., Connor, C. M., Farris, C. L., Jewkes, A. M., & Morrison, F. J. (2007). Links between behavioral regulation and preschoolers' literacy, vocabulary, and math skills. Developmental Psychology, 43, 947-959. doi:10.1037/0012-1649.43.4.947
51. Miller, E. K., & Cohen, J. D. (2001). An integrative theory of prefrontal cortex function. Annual Review of Neuroscience, 24, 167-202. doi: 10.1146/annurev.neuro.24.1.167
52. Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000). The unity and diversity of executive functions and their contributions to complex "frontal lobe" tasks: A latent variable analysis. Cognitive Psychology, 41, 49-100. doi:10.1006/cogp.1999.0734
53. Muthén, L. K., & Muthén, B. O. (2007). Mplus users guide (5th ed.). Los Angeles, CA: Muthén & Muthén.
54. Passler, M. A., Isaac, W., & Hynd, G. W. (1985). Neuropsychological development of behavior attributed to frontal lobe functioning in children. Developmental Neuropsychology, 1, 349-370. doi:10.1080/ 87565648509540320
55. Petrides, M., & Milner, B. (1982). Deficits on subject-ordered tasks after frontaland temporal-lobe lesions in man. Neuropsychologia, 20, 249-262. doi:10.1016/0028-3932(82)90100-2
56. Ponitz, C. C., McClelland, M. M., Matthews, J. S., & Morrison, F. J. (2009). A structured observation of behavioral self-regulation and its contribution to kindergarten outcomes. Developmental Psychology, 45, 605-619. doi:10.1037/a0015365
57. Rock, D. A., & Pollack, J. M. (2002). Early Childhood Longitudinal Study-Kindergarten Class of 1998-99 (ECLS-K): Psychometric report for kindergarten through first grade (Working Paper No. 2002-05). Washington, DC: U.S. Department of Education, National Center for Education Statistics. Retrieved from http://nces.ed.gov/pubs2002/200205.pdf
58. Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores [Monograph No. 17]. Richmond, VA: Psychometric Society.
59. Satorra, A., & Bentler, P. M. (1999). A scaled difference chi square test statistic for moment structure analysis (UCLA Statistics Series No. 260). Retrieved from http://preprints.stat.ucla.edu/download.php?paper=260
60. Shallice, T., & Burgess, P. (1996). The domain of supervisory processes and temporal organization of behaviour. Philosophical Transactions of the Royal Society B: Biological Sciences, 351, 1405-1412. doi:10.1098/ rstb.1996.0124
61. Shing, Y. L., Lindenberger, U., Diamond, A., Li, S. C., & Davidson, M. C. (2010). Memory maintenance and inhibitory control differentiate from early childhood to adolescence. Developmental Neuropsychology, 35, 679-697. doi:10.1080/87565641.2010.508546
62. Smith-Donald, R., Raver, C. C., Hayes, T., & Richardson, B. (2007). Preliminary construct and concurrent validity of the Preschool Self-Regulation Assessment (PSRA) for field-based research. Early Childhood Research Quarterly, 22, 173-187. doi:10.1016/j.ecresq.2007.01.002
63. Stuss, D., & Knight, R. (Eds.). (2002). Principles of frontal lobe function. New York, NY: Oxford.
64. Thorell, L. B., & Wahlstedt, C. (2006). Executive functioning deficits in relation to symptoms of ADHD and/or ODD in preschool children. Infant and Child Development, 15, 503-518. doi:10.1002/icd.475
65. Toga, A. W., Thompson, P. M., & Sowell, E. R. (2006). Mapping brain maturation. Trends in Neurosciences, 29, 148-159. doi:10.1016/j.tins.2006.01.007
66. Vernon-Feagans, L., Cox, M., & the Family Life Project Key Investigators (2011). The Family Life Project: An epidemiological and developmental study of young children living in poor rural communities. Manuscript submitted for publication.
67. Welsh, J. A., Nix, R. L., Blair, C., Bierman, K. L., & Nelson, K. E. (2010). The development of cognitive skills and gains in academic school readiness for children from low-income families. Journal of Educational Psychology, 102, 43-53. doi:10.1037/a0016738
68. Wiebe, S. A., Espy, K. A., & Charak, D. (2008). Using confirmatory factor analysis to understand executive control in preschool children: I. Latent structure. Developmental Psychology, 44, 575-587. doi:10.1037/0012-1649.44.2.575
69. Willoughby, M. T., & Blair, C. B. (2011). Test-retest reliability of a new executive function battery for SSE in early childhood. Child Neuropsychology. Advance online publication. doi:10.1080/09297049.2011.554390
70. Willoughby, M. T., Kupersmidt, J. B., & Voegler-Lee, M. E. (in press). Is preschool executive function causally related to academic achievement? Child Neuropsychology. doi:10.1080/09297049.2011.578572
71. Willoughby, M., Kupersmidt, J., Voegler-Lee, M., & Bryant, D. (2011). Contributions of hot and cool self-regulation to preschool disruptive behavior and academic achievement. Developmental Neuropsychology, 36, 162-180. doi:10.1080/87565641.2010.549980
72. Willoughby, M. T., Wirth, R. J., Blair, C. B., Greenberg, M., & The Family Life Project Investigators. (2010). The measurement of executive function at age 3 years: Psychometric properties and criterion validity of a new battery of tasks. Psychological Assessment, 22, 306-317. doi:10.1037/a0018708
73. Woodcock, R. W., McGrew, K. S., & Mather, N. (2001). Examiner's manual: Woodcock-Johnson III Tests of Achievement. Itasca, IL: Riverside.
74. Yung, Y. (1997). Finite mixtures in confirmatory factor analysis models. Psychometrika, 62, 297-330. doi:10.1007/BF02294554
75. Zelazo, P. D., & Müller, U. (2002). Executive function in typical and atypical development. In U. Goswami (Ed.), Handbook of childhood cognitive development (pp. 445-469). Oxford, England: Blackwell. doi: 10.1002/9780470996652.ch20.