Randomize groups, not individuals: A strategy for improving early childhood programs

Evaluation Review

Volumn 30, Issue 5, 2006, Pages 656-685

  St Pierre, Robert G ^a   Rossi, Peter H ^b  

^a STP Associates   (United States)

^b UNIVERSITY OF MASSACHUSETTS   (United States)

Author keywords

Child care quality; Group randomization; Study evaluation

Indexed keywords

ARTICLE; CHILD DEVELOPMENT; CLINICAL TRIAL; CONTROLLED CLINICAL TRIAL; DAY CARE; EARLY CHILDHOOD INTERVENTION; EDUCATIONAL STATUS; HEALTH CARE QUALITY; HUMAN; INFANT; METHODOLOGY; OUTCOME ASSESSMENT; POLICY; PRESCHOOL CHILD; RANDOMIZED CONTROLLED TRIAL; STANDARD; TIME; UNITED STATES;

CHILD DAY CARE CENTERS; CHILD DEVELOPMENT; CHILD, PRESCHOOL; EARLY INTERVENTION (EDUCATION); EDUCATIONAL STATUS; HUMANS; INFANT; OUTCOME ASSESSMENT (HEALTH CARE); PROGRAM EVALUATION; PUBLIC POLICY; QUALITY ASSURANCE, HEALTH CARE; RANDOMIZED CONTROLLED TRIALS; TIME FACTORS; UNITED STATES;

EID: 33748562844     PISSN: 0193841X     EISSN: 15523926     Source Type: Journal    
DOI: 10.1177/0193841X06291533     Document Type: Article

References (51)

1. Advisory Committee on Head Start Research and Evaluation. 1999. Evaluating Head Start: A recommended framework for studying the impact of the Head Start program. Washington, DC: U.S. Department of Health and Human Services, Administration on Children, Youth and Families, Head Start Bureau.
2. Barnett, W. S. 1995. Long-term effects of early childhood programs on cognitive and school outcomes. The Future of Children 5 (3). 25-50.
3. Berk, R. A. 2005. Randomized experiments as the bronze standard. Journal of Experimental Criminology 1: 417-433.
4. Bloom, H. S. 2004. Randomizing groups to evaluate place-based programs. In Learning more from social experiments: Evolving analytic approaches. New York: Russell Sage Foundation.
5. Boruch, R. F., and E. Foley. 2001. The honestly experimental society: Sites and other entities as the units of allocation and analysis in randomized trials. In Validity and social experimentation: Donald Campbell's legacy, vol. 1, ed. L. Bickman. 193-238. Beverly Hills, CA: Sage.
6. Boruch, R. F., H. May, H. Turner, and J. Lavenberg. 2003. Estimating the effects of interventions that are deployed in many places: Place randomized trials. Philadelphia: University of Pennsylvania, Graduate School of Education.
7. Bowman, B. T., M. S. Donovan, and M. S. Burns, eds. 2001. Eager to learn: Educating our preschoolers. Washington, DC: National Academy Press.
8. Coalition for Evidence-Based Policy. 2002. Bringing evidence-driven progress to education: A recommended strategy for the U.S. Department of Education. Washington, DC: The Council for Excellence in Government.
9. Cook, T. D., and M. R. Payne. 2002. Objecting to the objections to using random assignment in educational research. In Evidence matters: Randomized trials in education research, ed. F. Mosteller and R. Boruch, 150-178. Washington, DC: Brookings Institution.
10. Coyle, S. L., R. F. Boruch, and C. T. Turner, eds. 1989. Evaluating AIDS prevention programs. Washington, DC: National Academy of Sciences.
11. Faddis, B. J., and P. Ahrens-Gray. 2000. Evaluation of Head Start family child care demonstration: Final report. Report for the U.S. Department of Health and Human Services, Administration on Children, Youth and Families. Portland, OR: RMC Research Corporation.
12. Goodson, B. D., J. I. Layzer, R. G. St.Pierre, L. S. Bernstein, and M. Lopez. 2000. Effectiveness of a comprehensive five-year family support program on low-income children and their families: Findings from the Comprehensive Child Development Program. Early Childhood Research Quarterly 15 (1). 5-39.
13. Greenberg, D., and M. Shroder. 1997. The digest of social experiments. 2nd ed. Washington, DC: Urban Institute.
14. Gueron, J. M. 2002. The politics of random assignment: Implementing studies and affecting policy. In Evidence matters: Randomized trials in education research, ed. F. Mosteller and R. Boruch, 15-49. Washington, DC: Brookings Institution.
15. Hamilton, W. L., and P. H. Rossi. 2002. Effects of food assistance and nutrition programs on nutrition and health. Vol. 1, Research design. Report for the U.S. Department of Agriculture, Food and Nutrition Service. Cambridge, MA: Abt Associates.
16. High/Scope Educational Research Foundation, and Abt Associates. 1976. Home Start evaluation study. Final report: Findings and implications. Report for the U.S. Department of Health and Human Services, Administration on Children, Youth and Families. Ypsilanti, MI: High/Scope Educational Research Foundation.
17. Holmes, M., D. Holmes, D. Greenspan, and D. Tapper. 1973. The impact of the Head Start parent-child centers on children: Final report. Report for the U.S. Department of Health and Human Services, Administration on Children, Youth and Families. Washington, DC: Center for Community Research.
18. Huston, A. C., G. J. Duncan, R. Granger, J. Bos, V. McLoyd, R. Mistry, D. Crosby, C. Gibson, K. Magnuson, J. Romich, and A. Ventura. 2001. Work-based antipoverty programs for parents can enhance the school performance and social behavior of children. Child Development 72 (1). 318-336.
19. Karoly, L. A., P. W. Greenwood, S. S. Everingham, J. Hoube, M. R. Kilburn, C. P. Rydell, M. Sanders, and J. Chiesa. 1998. Investing in our children. Santa Monica, CA: RAND.
20. Love, J. M., E. E. Kisker, C. M. Ross, P. Z. Schochet, J. Brooks-Gunn, D. Paulsell, K. Boller, J. Constantine, C. Vogel, A. Fuligni, and C. Brady-Smith. 2002. Making a difference in the lives of infants and toddlers and their families: The impacts of Early Head Start. Executive summary. Report for the U.S. Department of Health and Human Services, Administration on Children, Youth and Families. Washington, DC: Mathematica Policy Research.
21. Meinert, C. L. 1986. Clinical trials: Design, conduct, and analysis. New York: Oxford University Press.
22. Murray, D. M. 1998. Design and analysis of group randomized experiments. New York: Oxford University Press.
23. Peterson, P. L., J. D. Hawkins, and R. F. Catalano. 1992. Evaluating comprehensive community drug risk reduction interventions. Evaluation Review 16 (6). 579-602.
24. Puma, M. J., N. Karweit, C. Price, A. Ricciuti, W. Thompson, and M. Vaden-Kiernan. 1997. Prospects: Final report on student outcomes. Report for the U.S. Department of Education, Planning and Evaluation Service. Bethesda, MD: Abt Associates.
25. Office of Management and Budget. 2002. Managing for results: Budget and performance integration: Program performance assessment. Washington, DC: Office of Management and Budget.
26. Quint, J. C., J. M. Bos, and D. Polit. 1997. New Chance: Final report on a comprehensive program for disadvantaged young mothers and their children. New York: Manpower Demonstration Research Corporation.
27. Ramey, S., C. Ramey, M. Phillips, R. Lanzi, C. Brezansek, C. Katholi, and S. Snyder. 2000. Head Start children's entry into public school: A report on the National Head Start/Public Early Childhood Transition Study. Report for the U.S. Department of Health and Human Services, Administration on Children, Youth and Families. Birmingham, AL: Civitan International Research Center.
28. Raudenbush, S. 1997. Statistical analysis and optimal design for cluster randomized trials. Psychological Methods 2 (2). 173-185.
29. Rossi, P. H. 1999. Evaluating community development programs: Problems and prospects. In Urban problems and community development, ed. R. Ferguson and W. Dickens. Washington, DC: Brookings Institution.
30. Schweinhart, L. J., H. V. Barnes, and D. P. Weikart. 1993. Significant benefits: The High/Scope Perry Preschool study through age 27. Monograph 10. Ypsilanti, MI: High/Scope Educational Research Foundation.
31. St.Pierre, R. G. 2001. Random assignment: Implementation in complex field settings. In International encyclopedia of the social and behavioral sciences. Vol. 19, Logic of inquiry and research design, ed. N. Smelser and P. Baltes (series eds.) and T. Cook and C. Ragin (vol. eds.), 12731-12734. Oxford, UK: Pergamon.
32. St.Pierre, R. G., and M. J. Puma. 2000. Toward the dream of the experimenting society. In Validity and social experimentation: Donald Campbell's legacy, ed. L. Bickman, 169-192. Beverly Hills, CA: Sage.
33. St.Pierre, R. G., A. Ricciuti, F. Tao, C. Creps, J. Swartz, and T. Rimdzius. 2003. Third national Even Start evaluation: Program impacts and implications for improvement. Report for the U.S. Department of Education, Planning and Evaluation Service. Cambridge, MA: Abt Associates.
34. Swartz, J. P., L. Bernstein, and M. Levin. 1998. Evaluation of the Head Start Family Service Center Demonstration projects. Vol. 1, Final report from the national evaluation. Report for the U.S. Department of Health and Human Services, Administration on Children, Youth and Families. Cambridge, MA: Abt Associates.
35. Travers, J., M. Nauta, and N. Irwin. 1982. The effects of a social program: Final report of the Child and Family Resource Program's infant-toddler component. Report for the U.S. Department of Health and Human Services, Administration on Children, Youth and Families. Cambridge, MA: Abt Associates.
36. U.S. Department of Education. n.d.-a. National Center for Education Evaluation and Regional Assistance. http://www.ed.gov/about/offices/list/ies/ ncee/index.html (accessed May 25, 2005).
37. U.S. Department of Education. n.d.-b. National Research and Development Centers - Applicant Information. http://www.ed.gov/programs/edresearch/ applicant.html (accessed May 25, 2005).
38. U.S. Department of Education. n.d.-c. Study plans of the National Center for Education Evaluation and Regional Assistance. http://www.ed.gov/rschstat/ eval/resources/studyplans.html (accessed May 25, 2005).
39. U.S. Department of Health and Human Services, Administration for Children and Families. 2005. Head Start impact study: First year findings. Washington, DC: U.S. Department of Health and Human Services, Administration for Children and Families.
40. U.S. Department of Health and Human Services (HHS), Administration for Children and Families, Child Care Bureau. N.d. Main research and data page. http://www.acf.hhs.gov/programs/ccb/research/ (accessed May 25, 2005).
41. U.S. Department of Health and Human Services (HHS), Administration for Children and Families, Office of Planning, Research, and Evaluation. n.d.-a. Early Head Start research. http://www.acf.hhs.gov/programs/opre/project/ tprojectIndex.jsp?topicId=4 (accessed May 25, 2005).
42. U.S. Department of Health and Human Services. n.d.-b. Head Start research. http://www.acf.hhs.gov/programs/opre/project/tprojectIndex.jsp? topicId=6 (accessed May 25, 2005).
43. U.S. General Accounting Office (GAO). 2000a. Early childhood programs: Characteristics affect the availability of school readiness information. GAO/HEHS-00-38. Washington, DC: GAO.
44. U.S. General Accounting Office. 2000b. Early education and care: Overlap indicates need to assess crosscutting programs. GAO/HEHS-00-78. Washington, DC: GAO.
45. U.S. General Accounting Office. 2002. Head Start and Even Start: Greater collaboration needed on adult literacy. GAO-02-348. Washington, DC: GAO.
46. Wasik, B. A., and N. L. Karweit. 1994. Off to a good start: Effects of birth to three interventions on early school success. In Preventing early school failure: Research, policy, and practice, ed. R. Slavin, N. L. Kar weit, and B. A. Wasik, 13-57. Boston, MA: Allyn & Bacon.
47. Weisberg, H. 1974. Short-term cognitive effects of Head Start programs: A report on the third year of planned variation, 1971-1972. Report for the U.S. Department of Health and Human Services, Administration on Children, Youth and Families. Cambridge, MA: Huron Institute.
48. West, J., K. Denton, and E. Germino-Hausken. 2000. America's kindergartners: Findings from the Early Childhood Longitudinal Study, kindergarten class of 1998-99, fall 1998. NCES 2000-070. Washington, DC: U.S. Department of Education, Institute of Education Sciences.
49. Whitehurst, G. J. 2003. The institute of education sciences: New wine, new bottles. Presentation at the annual meeting of the American Educational Research Association, Chicago.
50. William T. Grant Foundation. n.d. Capacity building for group-randomized studies. http://www.wtgrantfoundation.org/info-url_nocat4030/info-url_nocat.htm? attrib_id=9485 (accessed May 25, 2005).
51. Zill, N., G. Resnick, K. Kim, R. McKey, C. Clark, S. Pai-Samant, D. Connell, M. Vaden Kiernan, R. O'Brien, and M. D'Elio. 2001. Head Start FACES: Longitudinal findings on program performance, third progress report. Washington, DC: U.S. Department of Health and Human Services, Administration on Children, Youth and Families.