Can Research Design Explain Variation in Head Start Research Results? A Meta-Analysis of Cognitive and Achievement Outcomes

Educational Evaluation and Policy Analysis

Volumn 35, Issue 1, 2013, Pages 76-95

  Shager, Hilary M ^a   Schindler, Holly S ^b   Magnuson, Katherine A ^a   Duncan, Greg J ^c   Yoshikawa, Hirokazu ^d   Hart, Cassandra M D ^e  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

^b UNIVERSITY OF WASHINGTON   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d HARVARD UNIVERSITY   (United States)

^e UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Head Start; meta analysis; program evaluation

Indexed keywords

EID: 84874213905     PISSN: 01623737     EISSN: 19351062     Source Type: Journal    
DOI: 10.3102/0162373712462453     Document Type: Article

References (39)

1. Besharov D. J.,Higney C. A.Response to Barnett and Currie.Journal of Policy Analysis and Management. 2007;26 (3): 686-688.
2. Borenstein M.,Hedges L.,Higgins J.,Rothstein H.Englewood, NJ: Biostat; 2005:.
3. Camilli G.,Vargas S.,Ryan S.,Barnett W. S.Meta-analysis of the effects of early education interventions on cognitive and social development.Teachers College Record. 2010;112 (3): 579-620.
4. Christian K.,Morrison F. J.,Frazier J. A.,Massetti G.Specificity in the nature and timing of cognitive growth in kindergarten and first grade.Journal of Cognition and Development. 2000;1 (4): 429-448.
5. Cook, T. (2006). What works in publicly funded prekindergarten education? Presented at the Children's Achievement: What the Evidence Says about Teachers, Pre-K Programs and Economic Policies Policy Briefing, Washington, D.C.
6. Cook T. D.,Shadish W. R.,Wong V. C.Three conditions under which experiments and observational studies produce comparable causal estimates: New findings from within-study comparisons.Journal of Policy Analysis and Management. 2008;27 (4): 724-750.
7. Cook T. D.,Wong V. C.The warrant for universal pre-K: Can several thin reeds make a strong policy boat?.Social Policy Report. 2007;21 (3): 14-15.
8. Cooper, H., & Hedges, L. V. (2009). Research synthesis as a scientific process. In H. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), The handbook of research synthesis and meta-analysis (2nd ed., pp. 3-17). New York, NY: Russell Sage
9. Currie J.,Thomas D.Does Head Start make a difference?.American Economic Review. 1995;85:341-364.
10. de la Torre J.,Camilli G.,Vargas S.,Vernon R. F.Illustration of a multilevel model for meta-analysis.Measurement and Evaluation in Counseling and Development. 2007;40:169-180.
11. Gibbs C.,Ludwig J.,Miller D.Does Head Start do any lasting good?. Cambridge, MA: National Bureau of Economic Research; 2012:.
12. Gorey K. M.Early childhood education: A meta-analytic affirmation of the short- and long-term benefits of educational opportunity.School Psychology Quarterly. 2001;16 (1): 9-30.
13. Gormley W. T.,Phillips D.,Gayer T.Preschool programs can boost school readiness.Science. 2008;320:1723-1724.
14. Henry G. T.,Gordon C. S.,Rickman D. K.Early education policy alternatives: Comparing quality and outcomes of Head Start and state prekindergarten.Educational Evaluation and Policy Analysis. 2006;28:77-99.
15. Hoyt W. T.,Kerns M.-D.Magnitude and moderators of bias in observer ratings: A meta-analysis.Psychological Methods. 1999;4 (4): 403-424.
16. Jacob R. T.,Creps C. L.,Boulay B.Meta-analysis of research and evaluation studies in early childhood education. Cambridge, MA: Abt Associates; 2004:.
17. Layzer J. I.,Goodson B. D.,Bernstein L.,Price C.National evaluation of family support programs, volume A: The meta-analysis, final report. Cambridge, MA: Abt Associates; 2001:.
18. Lipsey M. W.,Wilson D. B.Practical meta-analysis. Thousand Oaks, CA: Sage; 2001:.
19. Ludwig J.,Phillips D.The benefits and costs of Head Start.Social Policy Report. 2007;21 (3): 3-18.
20. Magnuson K.,Shager H.Early education: Progress and promise for children from low-income families.Children and Youth Services Review. 2010;32 (9): 1186-1198.
21. McKey R. H.,Condelli L.,Ganson H.,Barrett B. J.,McConkey C.,Plantz M. C.The impact of Head Start on children, families and communities: Final report of the Head Start Evaluation, Synthesis and Utilization Project. Washington, DC: CSR; 1985:.
22. Moher D.,Pham B.,Jones A.,Cook D. J.,Jadad A. R.,Moher M.,Klassen T. P.Does quality of reports of randomized trials affect estimates of intervention efficacy reported in meta-analyses?.Lancet. 1998;352:609-613.
23. National Forum on Early Childhood Policy and Programs. (2010). Understanding the Head Start Impact Study. Retrieved from http://www.developingchild.harvard.edu/.
24. Nelson G.,Westhues A.,MacLeod J.A meta-analysis of longitudinal research on preschool prevention programs for children.Prevention and Treatment. 2003;6:1-34.
25. Rosenshine, B. (2010, March). Researcher-developed tests and standardized tests: A review of ten metaanalyses. Paper presented at the Society for Research on Educational Effectiveness conference, Washington, DC.
26. Rothstein, H. R., & Hopewell, S. (2009). Grey literature. In H. Cooper, L. V. Hedges, & J. C. Valentine(Eds.), The handbook of research synthesis and meta-analysis (2nd ed., pp. 103-125). New York, NY: Russell Sage.
27. Schulz K. F.,Chalmers I.,Hayes R. J.,Altman D. G.Empirical evidence of bias: Dimensions of methodological quality associated with estimates of treatment effects in controlled trials.Journal of the American Medical Association. 1995;273 (5): 408-412.
28. Schneider B.,Carnoy M.,Kilpatrick J.,Schmidt W. H.,Shavelson R. J.Estimating causal effects using experimental and observational designs. Washington, DC: American Educational Research Association; 2007:.
29. Shadish W. R.,Clark M. H.,Steiner P. M.Can nonrandomized experiments yield accurate answers? A randomized experiment comparing random and nonrandom assignments.Journal of the American Statistical Association. 2008;103:1334-1344.
30. Shadish W. R.,Galindo R.,Wong V. C.,Steiner P. M.,Cook T. D.A randomized experiment comparing random and cutoff-based assignment.Psychological Methods. 2011;16 (2): 179-191.
31. Sweet M. A.,Appelbaum M. I.Is home visiting an effective strategy? A meta-analytic review of home visiting programs for families with young children.Child Development. 2004;75 (5): 1435-1456.
32. Head Start impact study: First year findings. Washington, DC: Author; 2005:.
33. Head Start impact study: Final report. Washington, DC: Author; 2010:.
34. U.S. Department of Health and Human Services, Administration for Children and Families, Office of Head Start. (2010a). Head Start performance standards & other regulations. Retrieved from http://www.acf.hhs.gov/programs/ohs/legislation/index.html.
35. U.S. Department of Health and Human Services, Administration for Children and Families, Office of Head Start. (2010b). Head Start program fact sheet. Retrieved from http://www.acf.hhs.gov/programs/ohs/about/fy2010.html.
36. Westinghouse Learning Corporation. (1969). The impact of Head Start: An evaluation of the effects of Head Start on children's cognitive and affective development. In A report presented to the Office of Economic Opportunity (PB 184328). Washington, DC: Distributed by Clearinghouse for Federal Scientific and Technical Information, U.S. Department of Commerce, National Bureau of Standards, Institute for Applied Technology.
37. Wong V. C.,Cook T. D.,Barnett W. S.,Jung K.An effectiveness-based evaluation of five state pre-kindergarten programs.Journal of Policy Analysis and Management. 2008;27:122-154.
38. Zhai, F., Brooks-Gunn, J., & Waldfogel, J. (2010, March). Head Start and urban children's school readiness: A birth cohort study in 18 cities. Paper presented at the Society for Research on Educational Effectiveness conference, Washington, DC.
39. Project Head Start: A legacy of the war on poverty. Zigler E.Valentine J., ed. New York, NY: Free Press; 1979:.