Psychometric properties and convergent and predictive validity of an executive function test battery for two-year-olds

Frontiers in Psychology

Volumn 5, Issue JUL, 2014, Pages

  Mulder, Hanna ^a   Hoofs, Huub ^a,b   Verhagen, Josje ^a   van der Veen, Ineke ^c   Leseman, Paul P M ^a  

^a UTRECHT UNIVERSITY   (Netherlands)

^b MAASTRICHT UNIVERSITY   (Netherlands)

^c UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Delay of gratification; Executive function; Psychometrics; Selective attention; Toddlers; Validity; Working memory

Indexed keywords

EID: 84904736382     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2014.00733     Document Type: Article

References (87)

1. Allan, N. P., and Lonigan, C. J. (2011). Examining the dimensionality of effortful control in preschool children and its relation to academic and socioemotional indicators. Dev. Psychol. 47, 905-915. doi: 10.1037/a0023748
2. Bassett, H. H., Denham, S., Wyatt, T. M., and Warren-Khot, H. K. (2012). Refining the preschool self-regulation assessment for use in preschool classrooms. Infant Child Dev. 21, 596-616. doi: 10.1002/icd.1763
3. Beck, D. M., Schaefer, C., Pang, K., and Carlson, S. M. (2011). Exeutive function in preschool children: test-retest reliability. J. Cogn. Dev. 12, 169-193. doi: 10.1080/15248372.2011.563485
4. Blair, C., and Diamond, A. (2008). Biological processes in prevention and intervention: the promotion of self-regulation as a means of preventing school failure. Dev. Psychopathol. 20, 899-911. doi: 10.1017/S0954579408000436
5. Blair, C., Granger, D., and Peters Razza, R. (2005). Cortisol reactivity is positively related to executive function in preschool children attending Head Start. Child Dev. 76, 554-567. doi: 10.1111/j.1467-8624.2005.00863.x
6. Blair, C., and Razza, R. P. (2007). Relating effortful control, executive function, and false belief understanding to emerging math and literacy ability in kindergarten. Child Dev. 78, 647-663. doi: 10.1111/j.1467-8624.2007.01019.x
7. Blair, C., and Ursache, A. (2010). "A bidirectional model of executive functions and self-regulation," in Handbook of Self-Regulation: Research, Theory, and Applications 2nd Edn, eds K. D. Vohs and R. F. Baumeister, (New York, NY: Guilford), 300-320.
8. Bleichrodt, N., Resing, W. C. M., and Zaal, J. N. (1993). SCHOBL-R: Beoordeling van Schoolgedrag. Amsterdam: Harcourt Test Publishers.
9. Blom, E., Küntay, A. C., Messer, M., Verhagen, J., and Leseman, P. P. M. (in press). The benefits of being bilingual: working memory in bilingual Turkish-Dutch children. J. Exp. Child Psychol.
10. Briggs-Gowan, M. J., and Carter, A. S. (2001). BRIEF-Infant Toddler Social and Emotional Assessment (BITSEA) Manual, Version 1.0. New Haven, CT: Yale University.
11. Brock, L. L., Rimm-Kaufman, S. E., Nathanson, L., and Grimm, K. J. (2009). The contributions of 'hot' and 'cool' executive function to children's academic achievement, learning-related behaviors, and engagement in kindergarten. Early Child. Res. Q. 24, 337-349. doi: 10.1016/j.ecresq.2009.06.001
12. Byrne, B. M., and Stewart, S. M. (2006). Teacher's corner The MACS approach to testing for multigroup invariance of a second-order structure: a walk through the process. Struct. Equ. Model. 13, 287-321. doi: 10.1207/s15328007sem1302_7
13. Carlson, S. M. (2005). Developmentally sensitive measures of executive function in preschool children. Dev. Neuropsychol. 28, 595-616. doi: 10.1207/s15326942dn2802_3
14. Carlson, S. M., Mandell, D. J., and Williams, L. (2004). Executive function and theory of mind: stability and prediction from ages 2 to 3. Dev. Psychol. 40, 1105-1122. doi: 10.1037/0012-1649.40.6.1105
15. Carlson, S. M., and Meltzoff, A. N. (2008). Bilingual experience and executive functioning in young children. Dev. Sci. 11, 282-298. doi: 10.1111/j.1467-7687.2008.00675.x
16. Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct. Equ. Modeling 14, 464-504. doi: 10.1080/10705510701301834
17. Cheung, G. W., and Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Struct. Equ. Modeling 9, 233-255. doi: 10.1207/S15328007SEM0902_5
18. Clark, C. A., Pritchard, V. E., and Woodward, L. J. (2010). Preschool executive functioning abilities predict early mathematics achievement. Dev. Psychol. 46, 1176-1191. doi: 10.1037/a0019672
19. Davidson, M. C., Amso, D., Anderson, L. C., and Diamond, A. (2006). Development of cognitive control and executive functions from 4 to 13 years: evidence from manipulations of memory, inhibition, and task switching. Neuropsychologia 44, 2037-2078. doi: 10.1016/j.neuropsychologia.2006.02.006
20. Denham, S. A., Warren-Khot, H. K., Bassett, H. H., Wyatt, T., and Perna, A. (2012). Factor structure of self-regulation in preschoolers: testing models of a field-based assessment for predicting early school readiness. J. Exp. Child Psychol. 11, 386-404. doi: 10.1016/j.jecp.2011.10.002
21. Diamond, A., Barnett, W. S., Thomas, J., and Munro, S. (2007). Preschool program improves cognitive control. Science 318, 1387-1388. doi: 10.1126/science.1151148
22. Diamond, A., Cruttenden, L., and Neiderman, D. (1994). AB with multiple wells: I. Why are multiple wells sometimes easier than two wells? II. Memory or memory + inhibition? Dev. Psychol. 30, 192-205. doi: 10.1037/0012-1649.30.2.192
23. Diamond, A., Prevor, M. B., Callender, G., and Druin, D. P. (1997). Prefrontal cortex cognitive deficits in children treated early and continuously for PKU. Monogr. Soc. Res. Child Dev. 62, i-206. doi: 10.2307/1166208
24. Driessen, G., Mulder, L., Ledoux, G., Roeleveld, J., and Van Der Veen, I. (2009). Cohortonderzoek COOL5-18, Technisch rapport basisonderwijs, eerste meting 2007/08. Nijmegen: ITS/SCO-Kohnstamm Institute.
25. Dunn, M., and Dunn, L. M. (2005). Peabody Picture Vocabulary Test-III-NL. Amsterdam: Harcourt Test Publishers
26. Eisenberg, N., Valiente, C., Spinrad, T. L., Liew, J., Zhou, Q., Losoya, S. H., et al. (2009). Longitudinal relations of children's effortful control, impulsivity, and negative emotionality to their externalizing, internalizing, and co-occurring behavior problems. Dev. Psychol. 45, 988-1008. doi: 10.1037/a0016213
27. Espy, K. A., Sheffield, T. D., Wiebe, S. A., Clark, C. A., and Moehr, M. J. (2011). Executive control and dimensions of problem behaviors in preschool children. J. Child Psychol. Psychiatry 52, 33-46. doi: 10.1111/j.1469-7610.2010.02265.x
28. Evans, G. W., and English, K. (2002). The environment of poverty: multiple stressor exposure, psychophysiological stress, and socioemotional adjustment. Child Dev. 73, 1238-1248. doi: 10.1111/1467-8624.00469
29. Fitzpatrick, C., and Pagani, L. S. (2012). Toddler working memory skills predict kindergarten school readiness. Intelligence 40, 205-212. doi: 10.1016/j.intell.2011.11.007
30. Garon, N., Bryson, S. E., and Smith, I. M. (2008). Executive function in preschoolers: a review using an integrative framework. Psychol. Bull. 134, 31-60. doi: 10.1037/0033-2909.134.1.31
31. Garon, N., Smith, I. M., and Bryson, S. E. (2013). A novel executive function battery for preschoolers: Sensitivity to age differences. Child Neuropsychol. doi: 10.1080/09297049.2013.857650. [Epub ahead of print].
32. Gerhardstein, P., and Rovee-Collier, C. (2002). The development of visual search in infants and very young children. J. Exp. Child Psychol. 81, 194-215. doi: 10.1006/jecp.2001.2649
33. Gestsdottir, S., von Schudoletz, A., Wanless, S. B., Hubert, B., Guimard, P., Birgisdottir, F., et al. (2014). Early behavioral self-regulation, academic achievement, and gender: Longitudinal findings from France, Germany, and Iceland. Appl. Dev. Sci. 18, 90-109. doi: 10.1080/10888691.2014.894870
34. Hackman, D. A., Farah, M. J., and Meaney, M. J. (2010). Science and Society. Socioeconomic status and the brain: Mechanistic insights from human and animal research. Nat. Rev. Neurosci. 11, 651-659. doi: 10.1038/nrn2897
35. Heckman, J. (2006). Skill formation and the economics of investing in disadvantaged children. Science 312, 1900-1902. doi: 10.1126/science.1128898
36. Hu, L., and Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct. Equ. Modeling 6, 1-55. doi: 10.1080/10705519909540118
37. Hughes, C., and Ensor, R. (2005). Executive function and theory of mind in 2 year olds: a family affair? Dev. Neuropsychol. 28, 645-668. doi: 10.1207/s15326942dn2802_5
38. Hughes, C., and Ensor, R. (2007). Executive function and theory of mind: predictive relations from ages 2 to 4. Dev. Psychol. 43, 1447-1459. doi: 10.1037/0012-1649.43.6.1447
39. Huizinga, M., and Smidts, D. P. (2011). Age-related changes in executive function: a normative study with the Dutch version of the Behavior Rating Inventory of Executive Function (BRIEF). Child Neuropsychol. 17, 51-66. doi: 10.1080/09297049.2010.509715
40. Kim, S., Nordling, J. K., Yoon, J. E., Boldt, L. J., and Kochanska, G. (2013). Effortful control in "hot" and "cool" tasks differentially predicts childrens behavior problems and academic performance. J. Abnorm. Child Psychol. 41, 43-56. doi: 10.1007/s10802-012-9661-4
41. Kline, R. B. (2011). Principles and Practice of Structural Equation Modeling. New York, NY: Guilford Press.
42. Kochanska, G., and Knaack, A. (2003). Effortful control as a personality characteristic of young children: antecedents, correlates, and consequences. J. Pers. 71, 1087-1112. doi: 10.1111/1467-6494.7106008
43. Kochanska, G., Murray, K. T., and Harlan, E. T. (2000). Effortful control in early childhood: continuity and change, antecedents, and implications for social development. Dev. Psychol. 36, 220-232. doi: 10.1037/0012-1649.36.2.220
44. Lehto, J. E., Juujärvi, P., Kooistra, L., and Pulkkinen, L. (2003). Dimensions of executive function: evidence from children. Br. J. Dev. Psychol. 21, 59-80. doi: 10.1348/026151003321164627
45. Li-Grining, C. P. (2007). Effortful control among low-income preschoolers in three cities: stability, change, and individual differences. Dev. Psychol. 43, 208-221. doi: 10.1037/0012-1649.43.1.208
46. Mcclelland, M. M., Cameron, C. E., Connor, C. M., Farris, C. L., Jewkes, A. M., and Morrison, F. J. (2007). Links between behavioral regulation and preschoolers' literacy, vocabulary, and math skills. Dev. Psychol. 43, 947-959. doi: 10.1037/0012-1649.43.4.947
47. Meltzoff, A., Gopnik, A., and Repacholi, B. (1999). "Toddlers' understanding of intentions, desires and emotions: explorations of the dark ages," in Developing Theories of Intention: Social Understanding and Self-Control, eds P. Zelazo, J. Astington, and D. Olson (Mahwah, NJ: Lawrence Erlbaum Associates), 17-41.
48. Miller, M. R., Giesbrecht, G. F., Müller, U., McInerney, R. J., and Kerns, K. A. (2012). A latent variable approach to determining the structure of executive function in preschool children. J. Cogn. Dev. 13, 395-423. doi: 10.1080/15248372.2011.585478
49. Miller, S. E., and Marcovitch, S. (2011). Toddlers benefit from labeling on an executive function search task. J. Exp. Child Psychol. 108, 580-592. doi: 10.1016/j.jecp.2010.10.008
50. Millsap, R. E. (2011). Statistical Approaches to Measurement Invariance. New York, NY: Routledge.
51. Mischel, W., and Ebbesen, E. (1970). Attention in delay of gratification. J. Pers. Soc. Psychol. 16, 329-337. doi: 10.1037/h0029815
52. Miyake, A., and Friedman, N. P. (2012). The nature and organization of individual differences in executive functions: four general conclusions. Curr. Dir. Psychol. Sci. 21, 8-14. doi: 10.1177/0963721411429458
53. Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., and Wager, T. D. (2000). The unity and diversity of executive functions and their contributions to complex "Frontal Lobe" tasks: a latent variable analysis. Cogn. Psychol. 41, 49-100. doi: 10.1006/cogp.1999.0734
54. Muthén, L. K., and Muthén, B. O. (1998-2012). Mplus User's Guide, 7th Edn. Los Angeles, CA: Muthén and Muthén.
55. Muthén, L. K., and Muthén, B. O. (2013). Version 7.1. Mplus Language Addendum. Available online at: https://www.statmodel.com/download/Version7.1xLanguage.pdf
56. Neville, H. J., Stevens, C., Pakulak, E., Bell, T. A., Fanning, J., Klein, S., et al. (2013). Family-based training program improves brain function, cognition, and behavior in lower socioeconomic status preschoolers. Proc. Natl. Acad. Sci. U.S.A. 110, 12138-12143. doi: 10.1073/pnas.1304437110
57. Noble, K. G., Mccandliss, B. D., and Farah, M. J. (2007). Socioeconomic gradients predict individual differences in neurocognitive abilities. Dev. Sci. 10, 464-480. doi: 10.1111/j.1467-7687.2007.00600.x
58. Noble, K. G., Norman, M. F., and Farah, M. J. (2005). Neurocognitive correlates of socioeconomic status in kindergarten children. Dev. Sci. 8, 74-87. doi: 10.1111/j.1467-7687.2005.00394.x
59. Op Den Kamp, M., and Keuning, J. (2011). Wetenschappelijke Verantwoording Van de Toets Rekenen Voor Peuters. Arnhem: Cito.
60. Peake, P., Hebl, M., and Mischel, W. (2002). Strategic attention deployment for delay of gratification in working and waiting situations. Dev. Psychol. 38, 313-326. doi: 10.1037/0012-1649.38.2.313
61. Pelphrey, K. A., Reznick, J. S., Davis Goldman, B., Sasson, N., Morrow, J., Donahoe, A., et al. (2004). Development of visuospatial short-term memory in the second half of the 1st year. Dev. Psychol. 40, 836-851. doi: 10.1037/0012-1649.40.5.836
62. Ponitz, C. C., McClelland, M. M., Matthews, J. S., and Morrison, F. J. (2009). A structured observation of behavioral self-regulation and its contribution to kindergarten outcomes. Dev. Psychol. 45, 605-619. doi: 10.1037/a0015365
63. Poulin-Dubois, D., Blaye, A., Coutya, J., and Bialystok, E. (2011). The effects of bilingualism on toddlers' executive functioning. J. Exp. Child Psychol. 108, 567-579. doi: 10.1016/j.jecp.2010.10.009
64. Putnam, S. P., Gartstein, M. A., and Rothbart, M. K. (2006). Measurement of fine-grained aspects of toddler temperament: the early childhood behavior questionnaire. Infant Behav. Dev. 29, 386-401. doi: 10.1016/j.infbeh.2006.01.004
65. Raver, C. C., Jones, S. M., Li-Grining, C., Zhai, F., Bub, K., and Pressler, E. (2011). CSRP's Impacton low-income preschoolers' preacademic skills: self-regulation as a mediating mechanism. Child Dev. 82, 362-378. doi: 10.1111/j.1467-8624.2010.01561.x
66. Rose, S. A., Feldman, J. F., and Jankowski, J. J. (2009). A cognitive approach to the development of early language. Child Dev. 80, 134-150. doi: 10.1111/j.1467-8624.2008.01250.x
67. Rothbart, M. K., Ellis, L. K., Rosario Rueda, M., and Posner, M. I. (2003). Developing mechanisms of temperamental effortful control. J. Pers. 71, 1113-1144. doi: 10.1111/1467-6494.7106009
68. Scerif, G., Cornish, K., Wilding, J., Driver, J., and Karmiloff-Smith, A. (2004). Visual search in typically developing toddlers and toddlers with Fragile X or Williams syndrome. Dev. Sci. 7, 116-130. doi: 10.1111/j.1467-7687.2004.00327.x
69. Schmitt, N., and Kuljanin, G. (2008). Measurement invariance: review of practice and implications. Human Resour. Manag. Rev. 18, 210-222. doi: 10.1016/j.hrmr.2008.03.003
70. Schneider, W., Eschman, A., and Zuccolotto, A. (2002). E-Prime User's Guide. Pittsburgh, PA: Psychology Software Tools Inc.
71. Schreiber, J. B., Nora, A., Stage, F. K., Barlow, E. A., and King, J. (2006). Reporting structural equation modeling and confirmatory factor analysis results: a review. J. Educ. Res. 99, 323-338. doi: 10.3200/JOER.99.6.323-338
72. Shing, Y. L., Lindenberger, U., Diamond, A., Li, S.C., and Davidson, M. C. (2010). Memory maintenance and inhibitory control differentiate from early childhood to adolescence. Dev. Neuropsychol. 35, 679-697. doi: 10.1080/87565641.2010.508546
73. Sobeh, J., and Spijkers, W. (2013). Development of neuropsychological functions of attention in two cultures: a cross-cultural study of attentional performances of Syrian and German children of pre-school and school age. Eur. J. Dev. Psychol. 10, 318-336. doi: 10.1080/17405629.2012.674761
74. Usai, M. C., Viterbori, P., Traverso, L., and de Franchis, V. (2014). Latent structure of executive function in five- and six-year-old children: a longitudinal study. Eur. J. Dev. Psychol. 11, 447-462. doi: 10.1080/17405629.2013.840578
75. Van der Ven, S. H. G., Kroesbergen, E. H., Boom, J., and Leseman, P. P. M. (2012). The development of executive functions and early mathematics: a dynamic relationship. Br. J. Educ. Psychol. 82, 100-119. doi: 10.1111/j.2044-8279.2011.02035.x
76. Van der Ven, S. H. G., Kroesbergen, E. H., Boom, J., and Leseman, P. P. M. (2013). The structure of executive functions in children: A closer examination of inhibition, shifting, and updating. Br. J. Dev. Psyhol. 31, 70-87. doi: 10.1111/j.2044-835X.2012.02079.x
77. Veen, A., Veen, I., Heurter, A., Ledoux, G., Mulder, L., Paas, T., et al. (2012). Pre-COOL Cohortonderzoek. Technisch Rapport Tweejarigencohort, Eerste Meting 2010-2011. [Pre-COOL cohort study. Technical report two-year-olds cohort, first measurement 2010-2011]. Amsterdam: Kohnstamm Instituut.
78. Vicari, S., Caravale, B., Carlesimo, G. A., Casadei, A. M., and Allemand, F. (2004). Spatial working memory deficits in children at ages 3-4 who were low birth weight, preterm infants. Neuropsychology 18, 673-678. doi: 10.1037/0894-4105.18.4.673
79. Wanless, S. B., McClelland, M. M., Lan, X., Son, S. H., Cameron, C. E., Morrison, F. J., et al. (2013). Gender differences in behavioral regulation in four societies: the United States, Taiwan, South, and China. Early Child. Res. Q. 28, 621-633. doi: 10.1016/j.ecresq.2013.04.002
80. Wass, S. V., Scerif, G., and Johnson, M. H. (2012). Training attentional control and working memory - Is younger, better? Dev. Rev. 32, 360-387. doi: 10.1016/j.dr.2012.07.001
81. Welsh, M., and Peterson, E. (2014). Issues in the conceptualization and assessment of hot executive functions in childhood. J. Int. Neuropsychol. Soc. 20, 152-156. doi: 10.1017/S1355617713001379
82. Wiebe, S. A., Espy, K. A., and Charak, D. (2008). Using confirmatory factor analysis to understand executive control in preschool children: I. Latent structure. Dev. Psychol. 44, 575-587. doi: 10.1037/0012-1649.44.2.575
83. Wiebe, S. A., Sheffield, T., Nelson, J. M., Clark, C. A. C., Chevalier, N., and Espy, K. A. (2011). The structure of executive function in 3-year-olds. J. Exp. Child Psychol. 108, 436-452. doi: 10.1016/j.jecp.2010.08.008
84. Willoughby, M., Kupersmidt, J., Voegler-Lee, and Bryant, D. (2011). Contributions of hot and cool self-regulation to preschool disruptive behavior and academic achievement. Dev. Neuropsychol. 36, 162-180. doi: 10.1080/87565641.2010.549980
85. Willoughby, M. T., and Blair, C. B. (2011). Test-retest reliability of a new executive function test battery for use in early childhood. Child Neuropsychol. 17, 564-579. doi: 10.1080/09297049.2011.554390
86. Willoughby, M. T., Blair, C. B., Wirth, R. J., and Greenberg, M. (2010). The measurement of executive function at age 3 years: psychometric properties and criterion validity of a new battery of tasks. Psychol. Assess. 22, 306-317. doi: 10.1037/a0018708
87. Zelazo, P. D., and Reznick, J. S. (1991). Age-related asynchrony of knowledge and action. Child Dev. 62, 719-735. doi: 10.2307/1131173