New Findings on Impact Variation From the Head Start Impact Study: Informing the Scale-Up of Early Childhood Programs

AERA Open

Volumn 4, Issue 2, 2018, Pages

  Morris, Pamela A ^a   Connors, Maia ^b   Friedman Krauss, Allison ^c   McCoy, Dana Charles ^d   Weiland, Christina ^e   Feller, Avi ^f   Page, Lindsay ^g   Bloom, Howard ^h   Yoshikawa, Hirokazu ^a  

^a NEW YORK UNIVERSITY   (United States)

^b The Ounce of Prevention Fund   (United States)

^c Rutgers University   (United States)

^d HARVARD UNIVERSITY   (United States)

^e UNIVERSITY OF MICHIGAN   (United States)

^f UNIVERSITY OF CALIFORNIA   (United States)

^g UNIVERSITY OF PITTSBURGH   (United States)

^h MDRC   (United States)

Author keywords

early childhood; Head Start; impact variation

Indexed keywords

EID: 85062591820     PISSN: None     EISSN: 23328584     Source Type: Journal    
DOI: 10.1177/2332858418769287     Document Type: Article

References (79)

1. Arnett, J. (1989). Caregivers in day-care centers: Does training matter? Journal of Applied Developmental Psychology, 10, 541–552. doi:10.1016/0193-3973(89)90026-9
2. Barnett, W. S. (1995). Long-term effects of early childhood programs on cognitive and school outcomes. Future of Children, 5(3), 25–50.
3. Barnett, W. S. (2011). Effectiveness of early educational intervention. Science, 333, 975–978. doi:10.1126/science.1204534
4. Barnett, W. S., & Masse, L. N. (2007). Early childhood program design and economic returns: Comparative benefit-cost analyses of the Abecedarian program and policy implications. Economics of Education Review, 26, 113–125.
5. Belfield, C., Nores, M., Barnett, W. S., & Schweinhart, L. (2006). The High/Scope Perry Preschool Program: Cost-benefit analysis using data from the age 40. Journal of Human Resources, 16(1), 162–190. doi:10.3368/jhr.XLI.1.162
6. Bitler, M. P., Hoynes, H. W., & Domina, T. (2014). Experimental evidence on distributional effects of Head Start (NBER Working Paper No. w20434). Cambridge, MA: National Bureau of Economic Research.
7. Bloom, H. S., Hill, C. J., & Riccio, J. A. (2003). Linking program implementation and effectiveness: Lessons from a pooled sample of welfare-to-work experiments. Journal of Policy Analysis and Management, 22, 551–575.
8. Bloom, H. S., & Michalopoulos, C. (2013). When is the story in the subgroups? Prevention Science, 14(2), 179–188.
9. Bloom, H. S., Raudenbush, S. W., Weiss, M. J., & Porter, K. (2017). Using multisite experiments to study cross-site variation in treatment effects: A hybrid approach with fixed intercepts and a random treatment coefficient. Journal of Research on Educational Effectiveness, 10(4), 817–842.
10. Bloom, H. S., & Weiland, C. (2015). Quantifying variation in Head Start effects on young children’s cognitive and socio-emotional skills using data from the National Head Start Impact Study. New York, NY: MDRC.
11. Bronfenbrenner, U. (1979). The ecology of human development: Experiments by nature and design. Cambridge, MA: Harvard University Press.
12. Brooks-Gunn, J., Duncan, G., & Aber, J. L. (Eds.). (1997). Neighborhood poverty, Volume 1: Context and consequences for children. New York, NY: Russell Sage Foundation.
13. Burke, L. M., & Muhlhausen, D. B. (2013). Head Start impact evaluation report finally released (Issue Brief No. 3823). Washington, DC: Heritage Foundation.
14. Campbell, F. A., Pungello, E. P., Burchinal, M., Kainz, K., Pan, Y., Wasik, B., … Ramey, C. T. (2012). Adult outcomes as a function of an early childhood education program: An Abecedarian Project follow-up. Developmental Psychology, 48, 1033–1043. doi.org/10.1037/a0026644
15. Chertow, D. S. (1968). Project Head Start, the urban and rural challenge: Final report submitted to Office of Economic Opportunity (Doctoral dissertation). Syracuse University, Syracuse, NY.
16. Chor, E. (2016). Multigenerational Head Start participation: An unexpected marker of progress. Child Development. Advance online publication. doi:10.1111/cdev.12673
17. Clements, D. H., & Sarama, J. (2007). Effects of a preschool mathematics curriculum: Summative research on the Building Blocks project. Journal for Research in Mathematics Education, 38, 136–163.
18. Connors, M. C., & Friedman-Krauss, A. H. (2017). Varying states of Head Start: Impacts of a federal program across state policy contexts. Journal of Research on Educational Effectiveness. Advance online publication. doi:10.1080/19345747.2017.1320736
19. Connors, M. C., Friedman-Krauss, A. H., Jones, S. M., Morris, P. A., & Yudron, M. (2013, November). Refining early measures of early childhood classroom quality. Paper presented at the Association for Public Policy Analysis and Management Fall Research Conference, Washington, DC.
20. Cooper, B. R., & Lanza, S. T. (2014). Who benefits most from Head Start? Using latent class moderation to examine differential treatment effects. Child Development, 85, 2317–2338.
21. Currie, J., & Thomas, D. (1995). Does Head Start make a difference? American Economic Review, 85, 341–364.
22. Deming, D. (2009). Early childhood intervention and life-cycle skill development: Evidence from Head Start. American Economic Journal: Applied Economics, 1(3), 111–134.
23. Dodge, K. A., Bai, Y., Ladd, H. F., & Muschkin, C. G. (2016). Impact of North Carolina’s early childhood programs and policies on educational outcomes in elementary school. Child Development. Advance online publication. doi:10.1111/cdev.12645
24. Duncan, G. J., & Magnuson, K. (2013). Investing in preschool programs. Journal of Economic Perspectives, 27(2), 109–132. doi:10.1257/jep.27.2.109
25. Dunn, L. M., & Dunn, L. M. (1997). Peabody Picture and Vocabulary Test, Third Edition (PPVT). Circle Pines, MN: American Guidance Service.
26. Durlak, J. A., & Dupre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350. doi:10.1007/s10464-008-9165-0
27. Early, D. M., Iruka, I. U., Ritchie, S., Barbarin, O. A., Winn, D. M. C., Crawford, G. M., … Pianta, R. C. (2010). How do pre-kindergarteners spend their time? Gender, ethnicity, and income as predictors of experiences in pre-kindergarten classrooms. Early Childhood Research Quarterly, 25, 177–193.
28. Elango, S., García, J. L., Heckman, J. J., & Hojman, A. (2016). Early childhood education. Retrieved from https://heckman. uchicago.edu/sites/heckman2013.uchicago.edu/files/uploads/Papers/Moffitt-ECE-Paper_2016-08-29a_jld.pdf
29. ESRI. (2011). ArcGIS desktop: Release 10. Redlands, CA: Environmental Systems Research Institute
30. Feller, A., Grindal, T., Miratrix, L., & Page, L. C. (2016). Compared to what? Variation in the impacts of early childhood education by alternative care type. Annals of Applied Statistics, 10, 1245–1285.
31. Frangakis, C. E., & Rubin, D. B. (2002). Principal stratification in causal inference. Biometrics, 58, 21–29.
32. Friedman-Krauss, A. H., Connors, M. C., & Morris, P. A. (2017). Unpacking the treatment contrast in the Head Start Impact Study: To what extent does assignment to treatment affect quality of care? Journal of Research on Educational Effectiveness, 10, 68–95. doi:10.1080/19345747.2016.1147627
33. Garces, E., Thomas, D., & Currie, J. (2002). Longer-term effects of Head Start. American Economic Review, 92, 999–1012.
34. García, J. L., Heckman, J. J., Lead, D. E., & Prado, M. J. (2016). The life-cycle benefits of an influential early childhood program. Cambridge, MA: National Bureau of Economic Research.
35. Gelber, A., & Isen, A. (2013). Children’s schooling and parents’ behavior: Evidence from the Head Start Impact Study. Journal of Public Economics, 101, 25–38.
36. Gibbs, C., Ludwig, J., & Miller, D. L. (2011). Does Head Start do any lasting good? (NBER Working Paper No. 17452). Cambridge, MA: National Bureau of Economic Research.
37. Gormley, W. T., Phillips, D., & Gayer, T. (2008). Preschool programs can boost school readiness. Science, 320, 1723–1724.
38. Granger, R. C. (2010). Understanding and improving the effectiveness of after-school practice. American Journal of Community Psychology, 45(3–4), 441–446.
39. Harms, T., & Clifford, R. M. (1989). Family Day Care Rating Scale (FDCRS). New York, NY: Teachers College Press.
40. Harms, T., Clifford, R. M., & Cryer, D. (1998). Early Childhood Environment Rating Scale (Revised Edition). New York, NY: Teachers College Press.
41. Johnson, K. M., & Lichter, D. T. (2010). Growing diversity among America’s children and youth: Spatial and temporal dimensions. Population and Development Review, 36(1), 151–176.
42. Kline, P., & Walters, C. R. (2016). Evaluating public programs with close substitutes: The case of Head Start. The Quarterly Journal of Economics, 131, 1795–1848. doi:10.1093/qje/qjw027
43. Leventhal, T., & Brooks-Gunn, J. (2000). The neighborhoods they live in: The effects of neighborhood residence on child and adolescent outcomes. Psychological Bulletin, 126(2), 309.
44. Lipsey, M. W., Hofer, K. G., Dong, N., Farran, D. C., & Bilbrey, C. (2013). Evaluation of the Tennessee Voluntary Prekindergarten Program: End of pre-K results from the randomized control design. Nashville, TN: Peabody Research Institute.
45. Lombardi, J., Harding, J. F., Connors, M. C., & Friedman-Krauss, A. H. (2016). Prologue: Coming of age: A review of federal early childhood policy 2000–2015. In H. Dichter (Ed.), Rising to the challenge: Building effective systems for young children and families. Retrieved from http://www.buildinitiative.org/OurWork/StateandLocal/EarlyLearningChallenge.aspx
46. Ludwig, J., & Miller, D. L. (2007). Does Head Start improve children’s life chances? Evidence from a regression discontinuity design. Quarterly Journal of Economics, 122, 159–208. doi:10.1162/qjec.122.1.159
47. Ludwig, J., & Phillips, D. (2007). The benefits and costs of Head Start. Washington, DC: Society for Research on Child Development.
48. Ludwig, J., & Phillips, D. (2008). Long-term effects of Head Start on low-income children. Annals of the New York Academy of Sciences, 1136, 257–268.
49. McCoy, D. C., Connors, M. C., Morris, P. A., Yoshikawa, H., & Friedman-Krauss, A. H. (2015). Neighborhood economic disadvantage and children’s cognitive and social-emotional development: Exploring Head Start classroom quality as a mediating mechanism. Early Childhood Research Quarterly, 32, 150–159.
50. McCoy, D. C., Morris, P. A., Connors, M. C., Gomez, C. J., & Yoshikawa, H. (2016). Differential effectiveness of Head Start in urban and rural communities. Journal of Applied Developmental Psychology, 43, 29–42.
51. Miller, E. B., Farkas, G., Vandell, D. L., & Duncan, G. J. (2014). Do the effects of Head Start vary by parental preacademic stimulation? Child Development, 85(4), 1385–1400.
52. National Advisory Committee on Rural Health and Human Services. (2012). Challenges to Head Start and early childhood development programs in rural communities. Rockville, MD: Author.
53. Office of Head Start. (2015). Head Start Program facts fiscal year 2015. Retrieved from https://eclkc.ohs.acf.hhs.gov/hslc/data/factsheets/docs/head-start-fact-sheet-fy-2015.pdf
54. Page, L. C., Feller, A., Grindal, T., Miratrix, L., & Somers, M. A. (2015). Principal stratification: A tool for understanding variation in program effects across endogenous subgroups. American Journal of Evaluation, 36, 514–531.
55. Phillips, D. A., & Meloy, M. E. (2012). High-quality school-based pre-K can boost early learning for children with special needs. Exceptional Children, 78(4), 471–490.
56. Pianta, R. C., Barnett, W. S., Burchinal, M., & Thornburg, K. R. (2009). The effects of preschool education: What we know, how public policy is or is not aligned with the evidence base, and what we need to know. Psychological Science in the Public Interest, 10, 49–88. doi:10.1177/1529100610381908
57. Pianta, R., Howes, C., Burchinal, M., Bryant, D., Clifford, R., Early, D., & Barbarin, O. (2005). Features of pre-kindergarten programs, classrooms, and teachers: Do they predict observed classroom quality and child-teacher interactions? Applied Developmental Science, 9(3), 144–159.
58. Puma, M., Bell, S., Cook, R., Heid, C., Broene, P., Jenkins, F., … Downer, J. (2012). Third grade follow-up to the Head Start Impact Study: Final report. Washington, DC: Administration for Children and Families.
59. Puma, M., Bell, S., Cook, R., Heid, C., & Lopez, M. (2005). Head Start Impact Study: First year findings. Washington, DC: Administration for Children and Families.
60. Puma, M., Bell, S., Cook, R., Heid, C., Shapiro, G., Broene, P., … Spier, E. (2010a). Head Start Impact Study: Final report. Washington, DC: Administration for Children and Families.
61. Puma, M., Bell, S., Cook, R., Heid, C., Shapiro, G., Broene, P., … Spier, E. (2010b). Head Start Impact Study: Technical report. Washington, DC: Administration for Children and Families.
62. Raudenbush, S., & Bloom, H. S. (2015). Learning about and from variation in program impacts using multisite trials. New York, NY: MDRC.
63. Raudenbush, S. W., Reardon, S., & Nomi, T. (2012). Statistical analysis for multi-site trials using instrumental variables. Journal of Research and Educational Effectiveness, 5, 303–332.
64. Reynolds, A. J., Temple, J. A., Robertson, D. L., & Mann, E. A. (2002). Age 21 cost-benefit analysis of the Title I Chicago childparent centers. Educational Evaluation and Policy Analysis, 24(4), 267–303.
65. Rural Poverty Research Institute. (2008). Human service programs serving rural communities: Head Start. Corvallis, OR: Rural Poverty Research Institute
66. Schweinhart, L. J., Montie, J., Xiang, Z., Barnett, W. S., Belfield, C. R., & Nores, M. (2005). Lifetime effects: The High/Scope Perry Preschool study through age 40. Ypsilanti, MI: High/ Scope Educational Research Foundation.
67. Seligman, M. E. P. (1993). What you can change … and what you can’t. New York, NY: Ballantine Books.
68. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Belmont, CA: Wadsworth.
69. Shager, H. M., Schindler, H. S., Magnuson, K. A., Duncan, G. J., Yoshikawa, H., & Hart, C. M. D. (2013). Can research design explain variation in Head Start research results? A meta-analysis of cognitive and achievement outcomes. Educational Evaluation and Policy Analysis, 35(1), 76–95. doi:10.3102/0162373712462453
70. Thiel, H. (1969). A multinomial extension of linear logit model. International Economic Review, 10, 251–259.
71. Walters, C. R. (2015). Inputs in the production of early childhood human capital: Evidence from Head Start. American Economic Journal: Applied Economics, 7(4), 76–102.
72. Weiland, C. (2016). Impacts of the Boston prekindergarten program on the school readiness of young children with special needs. Developmental Psychology, 52, 1763–1776. doi:10.1037/dev0000168
73. Weiland, C., & Yoshikawa, H. (2013). Impacts of a prekindergarten program on children’s mathematics, language, literacy, executive function, and emotional skills. Child Development, 84(6), 2112–2130. doi:10.1111/cdev.12099
74. Whitehurst, G. J. (2013). New evidence raises doubts on Obama’s Preschool for All. Retrieved from https://www.brookings.edu/research/new-evidence-raises-doubts-on-obamas-preschool-for-all/
75. Woodcock, R. W., McGrew, K. S., & Mather, N. (2001). Woodcock-Johnson III Tests of Achievement. Itasca, IL: Riverside.
76. Yoshikawa, H., Weiland, C., Brooks-Gunn, J., Burchinal, M., Gormley, W., Ludwig, J., … Zaslow, M. J. (2013). Investing in our future: The evidence base on preschool education. Ann Arbor, MI: Society for Research in Child Development.
77. Zhai, F., Brooks-Gunn, J., & Waldfogel, J. (2014). Head Start’s impact is contingent on alternative type of care in comparison group. Developmental Psychology, 50, 2572–2586.
78. Zigler, E., & Muenchow, S. (1992). Head Start: The inside story of America’s most successful educational experiment. New York, NY: Basic Books.
79. Zigler, E., & Styfco, S. (2010). The hidden history of Head Start. New York, NY: Oxford University Press.