Longitudinal applications of a behavioral screener of executive functioning: Assessing factorial invariance and exploring latent growth

Psychological Assessment

Volumn 25, Issue 4, 2013, Pages 1300-1313

  Garcia Barrera, Mauricio A ^a   Karr, Justin E ^a   Kamphaus, Randy W ^b  

^a UNIVERSITY OF VICTORIA   (Canada)

^b GEORGIA STATE UNIVERSITY   (United States)

Author keywords

Child development; Executive function; Latent growth modeling; Rating scale; Screening instrument

Indexed keywords

AGE DISTRIBUTION; ARTICLE; ATTENTION; ATTENTION CONTROL; BEHAVIOR CONTROL; BEHAVIORAL ASSESSMENT SYSTEM FOR CHILDREN; CHILD; CHILD BEHAVIOR; CHILD DEVELOPMENT; CHILDHOOD; EMOTIONALITY; EXECUTIVE FUNCTION; FACTORIAL ANALYSIS; FEMALE; HUMAN; LATENT GROWTH MODELING; LONGITUDINAL STUDY; MALE; PRESCHOOL CHILD; PROBLEM SOLVING; PSYCHOLOGIC ASSESSMENT; PSYCHOMETRY; RELIABILITY; SCHOOL CHILD; SEX DIFFERENCE; STATISTICAL ANALYSIS; MASS SCREENING; PERSONALITY TEST; PSYCHOLOGICAL MODEL; REPRODUCIBILITY; SOCIAL BEHAVIOR; STATISTICS AND NUMERICAL DATA; VALIDATION STUDY;

ATTENTION; CHILD; EXECUTIVE FUNCTION; FEMALE; HUMANS; LONGITUDINAL STUDIES; MALE; MASS SCREENING; MODELS, PSYCHOLOGICAL; PERSONALITY INVENTORY; PROBLEM SOLVING; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS; SOCIAL BEHAVIOR;

EID: 84890065904     PISSN: 10403590     EISSN: 1939134X     Source Type: Journal    
DOI: 10.1037/a0034046     Document Type: Article

References (66)

1. Aiken, L. S., & West, S. G. (1991). Multiple regression: Testing and interpreting interactions. Thousand Oaks, CA: Sage.
2. Baron, I. S. (2004). Neuropsychological evaluation of the child (pp. 140-141). New York, NY: Oxford University Press.
3. Best, J. R., Miller, P. H., & Jones, L. L. (2009). Executive functions after age 5: Changes and correlates. Developmental Review, 29, 180-200. doi:10.1016/j.dr.2009.05.002
4. Blakemore, S.-J., & Choudhury, S. (2006). Development of the adolescent brain: Implications for executive function and social cognition. Journal of Child Psychology and Psychiatry, 47, 296-312. doi:10.1111/j.1469-7610.2006.01611.x
5. Bontempo, D. E., Grouzet, F. E., & Hofer, S. M. (2012). Measurement issues in the analysis of within-person change. In J. T. Newsom, R. N. Jones, & S. M. Hofer (Eds.), Longitudinal data analysis: A practical guide for researchers in aging, health, and social sciences (pp. 97-142). New York, NY: Routledge/Taylor.
6. Bontempo, D. E., & Hofer, S. M. (2007). Assessing factorial invariance in cross-sectional and longitudinal studies. In A. D. Ong & M. M. van Dulmen (Eds.), Oxford handbook of methods in positive psychology (pp. 153-175). New York, NY: Oxford University Press.
7. Bryant, F. B., & Satorra, A. (2012). Principles and practice of scaled difference chi-square testing. Structural Equation Modeling, 19, 372-398. doi:10.1080/10705511.2012.687671
8. Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233-255. doi:10.1207/S15328007SEM0902_5
9. Davidson, M. C., Amso, D., Anderson, L. C., & Diamond, A. (2006). Development of cognitive control and executive functions from 4 to 13 years: Evidence from manipulations of memory, inhibition, and task switching. Neuropsychologia, 44, 2037-2078. doi:10.1016/j.neuropsychologia.2006.02.006
10. Diamond, A. (1988). Abilities and neural mechanisms underlying AB performance. Child Development, 59, 523-527. doi:10.2307/1130330
11. Diamond, A. (1996). Evidence for the importance of dopamine for prefrontal cortex functions early in life. Philosophical Transactions of the Royal Society, Series B: Biological Sciences, 351, 1483-1494. doi: 10.1098/rstb.1996.0134
12. Diamond, A. (2002). Normal development of prefrontal cortex from birth to young adulthood: Cognitive functions, anatomy, and biochemistry. In D. T. Stuss & R. T. Knight (Eds.), Principles of frontal lobe function (pp. 466-503). New York, NY: Oxford University Press. doi:10.1093/acprof:oso/9780195134971.003.0029
13. Eisenberg, N., & Spinrad, T. L. (2004). Emotion-related regulation: Sharpening the definition. Child Development, 75, 334-339. doi:10.1111/j.1467-8624.2004.00674.x
14. Espy, K. A., Kaufmann, P. M., Glisky, M. L., & McDiarmid, M. D. (2001). New procedures to assess executive functions in preschool children. Clinical Neuropsychologist, 15, 46-58. doi:10.1076/clin.15.1.46.1908
15. Espy, K. A., Sheffield, T. D., Wiebe, S., Clark, C. A. C., & Moehr, M. (2011). Executive control and dimensions of problem behaviors in preschool children. Journal of Child Psychology and Psychiatry, 52, 33-46. doi:10.1111/j.1469-7610.2010.02265.x
16. Ferrer, E., Balluerka, N., & Widaman, K. F. (2008). Factorial invariance and the specification of second-order latent growth models. Methodology, 4, 22-36. doi:10.1027/1614-2241.4.1.22
17. Finney, S. J., & DiStefano, C. (2006). Non-normal and categorical data in structural equation modeling. In G. R. Hancock & R. O. Mueller (Eds.), Structural equation modeling: A second course (pp. 269-314). Greenwich, CT: Information Age.
18. Flanagan, K. S., Bierman, K. L., & Kam, C. M. (2003). Identifying at-risk children at school entry: The usefulness of multibehavioral problem profiles. Journal of Clinical Child and Adolescent Psychology, 32, 396-407. doi:10.1207/S15374424JCCP3203_08
19. Frazer, J. (2012). The integrative neuropsychological theory of executiverelated abilities and component transactions (INTERACT): A novel validation study (Unpublished doctoral dissertation). University of Victoria, Victoria, British Columbia, Canada.
20. Fuster, J. M. (2002). Frontal lobe and cognitive development. Journal of Neurocytology, 31, 373-385. doi:10.1023/A:1024190429920
21. Garcia-Barrera, M. A., Kamphaus, R. W., & Bandalos, D. (2011). Theoretical and statistical derivation of a screener for the behavioral assessment of executive functions in children. Psychological Assessment, 23, 64-79. doi:10.1037/a0021097
22. Garon, N., Bryson, S. E., & Smith, I. M. (2008). Executive function in preschoolers: A review using an integrative framework. Psychological Bulletin, 134, 31-60. doi:10.1037/0033-2909.134.1.31
23. Giedd, J. N., Blumenthal, J., Jeffries, N. O., Castellanos, F. X., Liu, H., Zijdenbos, A.,. Rapoport, J. L. (1999). Brain development during childhood and adolescence: A longitudinal MRI study. Nature Neuroscience, 2, 861-863. doi:10.1038/13158
24. Gioia, G. A., Isquith, P. K., Guy, S. C., & Kenworthy, L. (2000). Behavior Rating Inventory of Executive Functions. Odessa, FL: Psychological Assessment Resources.
25. Gioia, G. A., Isquith, P. K., Retzlaff, P., & Espy, K. A. (2002). Confirmatory factor analysis of the Behavior Rating Inventory of Executive Function (BRIEF) in a clinical sample. Child Neuropsychology, 8, 249-257. doi:10.1076/chin.8.4.249.13513
26. Gogtay, N., Giedd, J. N., Lusk, L., Hayashi, K. M., Greenstein, D., Vaituzis, A. C.,. Thompson, P. M. (2004). Dynamic mapping of human cortical development during childhood through early adulthood. Proceedings of the National Academy of Sciences, USA, 101, 8174-8179. doi:10.1073/pnas.0402680101
27. Gur, R. C., Richard, J., Calkins, M. E., Chiavacci, R., Hansen, J. A., Bilker, W. B.,. Gur, R. E. (2012). Age group and sex differences in performance on a computerized neurocognitive battery in children age 8-21. Neuropsychology, 26, 251-265. doi:10.1037/a0026712
28. Hoyle, R. H., & Panter, A. T. (1995). Writing about structural equation models. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 158-176). Thousand Oaks, CA: Sage.
29. Hu, L., & Bentler, P. M. (1999). Cutoffcriteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55. doi:10.1080/10705519909540118
30. Hughes, C., & Ensor, R. (2011). Individual differences in growth in executive function across the transition to school predict externalizing and internalizing behaviors and children's self-perceived academic success at age 6. Journal of Experimental Child Psychology, 108, 663-676. doi:10.1016/j.jecp.2010.06.005
31. Hughes, C., Ensor, R., Wilson, A., & Graham, A. (2010). Tracking executive function across the transition to school: A latent variable approach. Developmental Neuropsychology, 35, 20-36. doi:10.1080/87565640903325691
32. Huizinga, M., Dolan, C. V., & van der Molen, M. W. (2006). Age-related change in executive function: Development trends and a latent variable analysis. Neuropsychologia, 44, 2017-2036. doi:10.1016/j.neuropsychologia.2006.01.010
33. Isquith, P. K., Gioia, G. A., & Espy, K. A. (2004). Executive function in preschool children: Examination through everyday behavior. Developmental Neuropsychology, 26, 403-422. doi:10.1207/s15326942dn2601_3
34. Jurado, M. B., & Rosselli, M. (2007). The elusive nature of executive functions: A review of our current understanding. Neuropsychology Review, 17, 213-233. doi:10.1007/s11065-007-9040-z
35. Kamphaus, R. W., Thorpe, J. S., Winsor, A., Kroncke, A. P., Dowdy, E. T., & VanDeventer, M. C. (2007). Development and predictive validity of a teacher screener for child behavioral and emotional problems at school. Educational and Psychological Measurement, 67, 342-356. doi: 10.1177/00131644070670021001
36. Kochanska, G., Barry, R. A., Aksan, N., & Boldt, L. J. (2008). A developmental model of maternal and child contributions to disruptive conduct: The first six years. Journal of Child Psychology and Psychiatry, 49, 1220-1227.
37. Kochanska, G., Coy, K. C., & Murray, K. T. (2001). The development of self-regulation in the first four years of life. Child Development, 72, 1091-1111. doi:10.1111/1467-8624.00336
38. Lehto, J. E., Juujärvi, P., Kooistra, L., & Pulkkinen, L. (2003). Dimensions of executive functioning: Evidence from children. British Journal of Developmental Psychology, 21, 59-80. doi:10.1348/026151003321164627
39. Lewis, M. D., & Todd, R. M. (2007). The self-regulating brain: Cortical- subcortical feedback and the development of intelligent action. Cognitive Development, 22, 406-430. doi:10.1016/j.cogdev.2007.08.004
40. Lezak, M. D. (1982). The problem of assessing executive functions. International Journal of Psychology, 17, 281-297. doi:10.1080/00207598208247445
41. Lezak, M. D., Howieson, D. B., Bigler, E. D., & Tranel, D. (2012). Neuropsychological assessment (5th ed.). New York, NY: Oxford University Press.
42. Lochman, J. E., and the Conduct Problems Prevention Research Group. (1995). Screening of child behavior problems for prevention programs at school entry. Journal of Consulting and Clinical Psychology, 63, 549-559. doi:10.1037/0022-006X.63.4.549
43. Meredith, W., & Horn, J. (2001). The role of factorial invariance in modeling growth and change. In L. M. Collins & A. G. Sayer (Eds.), New methods for the analysis of change (pp. 203-240). Washington, DC: American Psychological Association. doi:10.1037/10409-007
44. Miller, E. K., & Cohen, J. D. (2001). An integrative theory of prefrontal cortex function. Annual Review of Neuroscience, 24, 167-202. doi: 10.1146/annurev.neuro.24.1.167
45. Millsap, R. E., & Yun-Tein, J. (2004). Assessing factorial invariance in ordered-categorical measures. Multivariate Behavioral Research, 39, 479-515. doi:10.1207/S15327906MBR3903_4
46. Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000). The unity and diversity of executive functions and their contributions to complex "frontal lobe" tasks: A latent variable analysis. Cognitive Psychology, 41, 49-100. doi:10.1006/cogp.1999.0734
47. Muthén, B. O., & Asparouhov, T. (2002). Latent variable analysis with categorical outcomes: Multiple-group and growth modeling in Mplus (Mplus Web Note No. 4). Retrieved from http://www.statmodel.com/mplus/examples/webnote.html
48. Muthén, L. K., & Muthén, B. O. (2010). Mplus user's guide (6th ed.). Los Angeles, CA: Author.
49. Muthén, L., & Muthén, B. (2011). Mplus (Version 6.12) [Computer software]. Los Angeles, CA: Author.
50. Reynolds, C. R., & Kamphaus, R. W. (1992). Behavior Assessment System for Children (BASC). Circle Pines, MN: AGS.
51. Reynolds, C. R., & MacNeill Horton, A. (2008). Assessing executive functions: A life-span perspective. Psychology in the Schools, 45, 875-892. doi:10.1002/pits.20332
52. Romine, C. B., & Reynolds, C. R. (2005). A model of the development of frontal lobe functioning: Findings from a meta-analysis. Applied Neuropsychology, 12, 190-201. doi:10.1207/s15324826an1204_2
53. Sadeh, S. S., Burns, M. K., & Sullivan, A. L. (2012). Examining an executive function rating scale as a predictor of achievement in children at risk for behavior problems. School Psychology Quarterly, 27, 236-246. doi:10.1037/spq0000012
54. Satorra, A. (2000). Scaled and adjusted restricted tests in multi-sample analysis of moment structures. In R. D. H. Heijmans, D. S. G. Pollock, & A. Satorra (Eds.), Innovations in multivariate statistical analysis: A Festschrift for Heinz Neudecker (pp. 233-247). London, England: Kluwer Academic. doi:10.1007/978-1-4615-4603-0_17
55. Tanaka, J. S. (1987). "How big is big enough?": Sample size and goodness of fit in structural equation models with latent variables. Child Development, 58, 134-146. doi:10.2307/1130296
56. Testa, R., Bennett, P., & Ponsford, J. (2012). Factor analysis of nineteen executive function tests in a healthy adult population. Archives of Clinical Neuropsychology, 27, 213-224. doi:10.1093/arclin/acr112
57. Tsujimoto, S. (2008). The prefrontal cortex: Functional neural development during early childhood. Neuroscientist, 14, 345-358. doi:10.1177/1073858408316002
58. Welsh, M. C., Pennington, B. F., & Groisser, D. B. (1991). A normativedevelopmental study of executive function: A window on prefrontal function in children. Developmental Neuropsychology, 7, 131-149. doi: 10.1080/87565649109540483
59. Widaman, K. F., Ferrer, E., & Conger, R. D. (2010). Factorial invariance within longitudinal structural equation models: Measuring the same construct across time. Child Development Perspectives, 4, 10-18. doi: 10.1111/j.1750-8606.2009.00110.x
60. Wiebe, S. A., Espy, K. A., & Charak, D. (2008). Using confirmatory factor analysis to understand executive control in preschool children: I. Latent structure. Developmental Psychology, 44, 575-587. doi:10.1037/0012-1649.44.2.575
61. Wiebe, S. A., Sheffield, T., Nelson, J. M., Clark, C. A., Chevalier, N., & Espy, K. A. (2011). The structure of executive function in 3-year-olds. Journal of Experimental Child Psychology, 108, 436-452. doi:10.1016/j.jecp.2010.08.008
62. Willoughby, M. T., Wirth, R. J., Blair, C. B., & Family Life Project Investigators. (2012). Executive function in early childhood: Longitudinal measurement invariance and developmental change. Psychological Assessment, 24, 418-431. doi:10.1037/a0025779
63. Yu, C. Y. (2002). Evaluating cutoffcriteria of model fit indices for latent variable models with binary and continuous outcomes (Doctoral dissertation). University of California, Los Angeles.
64. Zelazo, P. D., & Cunningham, W. A. (2007). Executive function: Mechanisms underlying emotion regulation. In J. J. Gross (Ed.), Handbook of emotion regulation (pp. 135-158). New York, NY: Guilford Press.
65. Zelazo, P. D., & Müller, U. (2002). Executive functioning in typical and atypical children. In U. Goswami (Ed.), Blackwell handbook of childhood cognitive development (pp. 445-469). Oxford, England: Blackwell. doi:10.1002/9780470996652.ch20
66. Zelazo, P. D., Müller, U., Frye, D., & Marcovitch, S. (2003). The development of executive function in early childhood. Monographs of the Society for Research in Child Development, 68(3, Serial No. 274). doi:10.1111/j.0037-976X.2003.00261.x