The prekindergarten age-cutoff regression-discontinuity design: Methodological issues and implications for application

Educational Evaluation and Policy Analysis

Volumn 37, Issue 3, 2015, Pages 296-313

  Lipsey, Mark W ^a   Weiland, Christina ^b   Yoshikawa, Hirokazu ^c   Wilson, Sandra Jo ^a   Hofer, Kerry G ^a  

^a VANDERBILT UNIVERSITY   (United States)

^b UNIVERSITY OF MICHIGAN   (United States)

^c NEW YORK UNIVERSITY   (United States)

Author keywords

Early childhood; Prekindergarten; Regression discontinuity; School readiness

Indexed keywords

EID: 84960353024     PISSN: 01623737     EISSN: 19351062     Source Type: Journal    
DOI: 10.3102/0162373714547266     Document Type: Article

References (59)

1. Angrist, J. D., & Pischke, J. S. (2009). Mostly harmless econometrics. Princeton, NJ: Princeton University Press.
2. Applied Survey Research. (2013, August). Evaluating Preschool for All effectiveness (Research brief). San Jose, CA: Author.
3. Barnett, W. S., Carolan, M. E., Fitzgerald, J., & Squires, J. H. (2012). The state of preschool 2012: State preschool yearbook. National Institute for Early Education Research, Rutgers University. Retrieved from http://nieer. org/sites/nieer/files/yearbook2012. pdf.
4. Bartik, T. J. (2013, June). Effects of the pre-k program of Kalamazoo County Ready 4s on kindergarten entry test scores: Estimates based on data from the fall of 2011 and the fall of 2012 (Upjohn Institute Working Paper 13-198). Kalamazoo, MI: W. E. Upjohn Institute for Employment Research.
5. Bartik, T. J., Gormley, W., & Adelstein, S. (2012). Earnings benefits of Tulsa's pre-k program for different income groups. Economics of Education Review, 31, 1143-1161.
6. Berlinski, S., Galiani, S., & McEwan, P. J. (2011). Preschool and maternal labor market outcomes: Evidence from a regression discontinuity design. Economic Development and Cultural Change, 59, 313-344.
7. Brigance, A. H. (2005). Preschool Screen II. North Billerica, MA: Curriculum Associates.
8. Britto, P. B. (2012). School readiness: A conceptual framework. New York, NY: United Nations Children's Fund.
9. Coburn, J. L. (2009). The effect of Tennessee's prekindergarten programs on young children's school readiness skills: A regression discontinuity design (Doctoral dissertation). Tennessee Technological University. Available from ProQuest Dissertations and Theses database. (UMI No. 3397432).
10. Cook, T. D., & Wong, V. C. (2008). Empirical tests of the validity of the regression discontinuity design. Annals of Economics and Statistics, 2008(91-92), 127-150.
11. Curriculum Associates. (n. d.). Early Childhood Screen II K & 1. North Billerica, MA: Author.
12. Dunn, L. M., & Dunn, L. M. (2007). Peabody Picture Vocabulary Test-Fourth Edition. Bloomington, MN: Pearson Assessments.
13. Fitzpatrick, M. D. (2010). Preschoolers enrolled and mothers at work? The effects of universal prekindergarten. Journal of Labor Economics, 28, 51-85.
14. Frede, E. (2005). Assessment in a continuous improvement cycle: New Jersey's Abbott Preschool Program. National Institute for Early Education Research, Rutgers University.
15. Frede, E., Jung, K., Barnett, W. S., Lamy, C. E., & Figueras, A. (2007). The Abbott Preschool Program Longitudinal Effects Study (APPLES) (Interim report). New Brunswick, NJ: National Institute for Early Education Research, Rutgers University.
16. Gennetian, L., Morris, P., Bos, J., & Bloom, H. (2005). Using instrumental variables analysis to learn more from social policy experiments. In H. Bloom (Ed.), Learning more from social experiments: Evolving analytic approaches (pp. 75-114). New York, NY: Russell Sage.
17. Gormley, W. T. (2008). The effects of Oklahoma's pre-k program on Hispanic students. Social Science Quarterly, 89, 916-936.
18. Gormley, W. T., Gayer, T., Phillips, D., & Dawson, B. (2005). The effects of universal pre-K on cognitive development. Developmental Psychology, 41, 872-884. doi: 10. 1037/0012-1649. 41. 6. 872.
19. Gormley, W. T., Phillips, D., Adelstein, S., & Shaw, C. (2010). Head Start's comparative advantage: Myth or reality? Policy Studies Journal, 38, 397-418.
20. Gormley, W. T., Phillips, D. A., & Gayer, T. (2008). Preschool programs can boost school readiness. Science, 320, 1723-1724. doi: 10. 1126/science. 1156019.
21. Grehan, A., Cavalluzzo, L., Gnuschke, J., Hanson, R., Oliver, S., & Vosters, K. (2011). Participation during the first four years of Tennessee's Voluntary Prekindergarten Program (Issues & Answers Report, REL 2011-No. 107). Washington, DC: U. S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, Regional Educational Laboratory Appalachia.
22. Henry, G., Gordon, C., Mashburn, A., & Ponder, B. (2001). Pre-K Longitudinal Study: Findings from the 1999-2000 school year. Atlanta: Applied Research Center, Georgia State University.
23. Hustedt, J. T., Barnett, W. S., & Jung, K. (2007). The effects of the New Mexico PreK Initiative on young children's school readiness. New Brunswick, NJ: National Institute for Early Education Research, Rutgers University.
24. Hustedt, J. T., Barnett, W. S., Jung, K., & Figueras-Daniel, A. (2008). Impacts of New Mexico PreK on children's school readiness at kindergarten entry: Results from the second year of a growing initiative. New Brunswick, NJ: National Institute for Early Education Research, Rutgers University.
25. Hustedt, J. T., Barnett, W. S., Jung, K., & Figueras-Daniel, A. (2009). Continued impacts of New Mexico PreK on children's readiness for kindergarten: Results from the third year of implementation. New Brunswick, NJ: National Institute for Early Education Research, Rutgers University.
26. Hustedt, J. T., Barnett, W. S., Jung, K., & Friedman, A. H. (2010). The New Mexico PreK evaluation: Impacts from the fourth year (2008-2009) of New Mexico's state-funded pre-k program. New Brunswick, NJ: National Institute for Early Education Research, Rutgers University.
27. Hustedt, J. T., Barnett, W. S., Jung, K., & Goetze, L. D. (2009). The New Mexico PreK evaluation: Results from the initial four years of a new state preschool initiative-Final report. New Brunswick, NJ: National Institute for Early Education Research, Rutgers University.
28. Hustedt, J. T., Barnett, W. S., Jung, K., & Thomas, J. (2007). The effects of the Arkansas Better Chance Program on young children's school readiness. New Brunswick, NJ: National Institute for Early Education Research, Rutgers University.
29. Imbens, G., & Kalyanaraman, K. (2009, February). Optimal bandwidth choice for the regression discontinuity estimator (National Bureau of Economic Research Working Paper #14726). Cambridge, MA: National Bureau of Economic Research.
30. Imbens, G. W., & Lemieux, T. (2008). Regression discontinuity designs: A guide to practice. Journal of Econometrics, 142, 615-635. doi: 10. 1016/j. jeconom. 2007. 05. 001.
31. Lamy, C., Barnett, W. S., & Jung, K. (2005a). The effects of the Michigan School Readiness Program on young children's abilities at kindergarten entry. New Brunswick, NJ: National Institute for Early Education Research, Rutgers University.
32. Lamy, C., Barnett, W. S., & Jung, K. (2005b). The effects of South Carolina's Early Childhood Programs on young children's school readiness. New Brunswick, NJ: National Institute for Early Education Research, Rutgers University.
33. Lamy, C., Barnett, W. S., & Jung, K. (2005c). The effects of West Virginia's Early Education Program on young children's school readiness. New Brunswick, NJ: National Institute for Early Education Research, Rutgers University.
34. Lee, D. S., & Lemieux, T. (2010). Regression discontinuity designs in economics. Journal of Economic Literature, 48, 281-355. doi: 10. 1257/jel. 48. 2. 281.
35. Lipsey, M. W., Farran, D. C., Bilbrey, C., Hofer, K. G., & Dong, N. (2011). Initial results of the evaluation of the Tennessee Voluntary Pre-K Program (Research Report). Nashville, TN: Peabody Research Institute, Vanderbilt University.
36. Lipsey, M. W., Hofer, K. G., Dong, N., Farran, D. C., & Bilbrey, C. (2013). Evaluation of the Tennessee Voluntary Prekindergarten Program: End of pre-k results from the randomized control design (Research Report). Nashville, TN: Peabody Research Institute, Vanderbilt University.
37. Ludwig, J., & Miller, D. L. (2007). Does Head Start improve children's life chances? Evidence from a regression discontinuity design. Quarterly Journal of Economics, 122, 159-208. doi: 10. 1162/qjec. 122. 1. 159.
38. Magnuson, K., Meyers, M., Ruhm, C., & Waldfogel, J. (2003). Inequality in preschool education and school readiness. New York, NY: School of Social Work, Columbia University.
39. Peisner-Feinberg, E. S., & Schaaf, J. M. (2011). Evaluation of the North Carolina More at Four Pre-Kindergarten Program: Summary of key findings. Chapel Hill: FPG Child Development Institute, The University of North Carolina at Chapel Hill.
40. Peisner-Feinberg, E. S., Schaaf, J. M., LaForett, D. R., Hildebrandt, L. M., & Sideris, J. (2014). Effects of Georgia's pre-k program on children's school readiness skills: Findings from the 2012-2013 evaluation study. Chapel Hill: FPG Child Development Institute, The University of North Carolina at Chapel Hill.
41. Pérez-Peña, R., & Rich, M. (2014, February 3). Preschool push moving ahead in many states. The New York Times. Retrieved from http://www. nytimes. com/2014/02/04/us/push-for-preschoolbecomes-a-bipartisan-cause-outside-washington. html.
42. Phillips, D., & Meloy, B. (2012). High-quality schoolbased pre-k can boost early learning for children with special needs. Exceptional Children, 78, 471-490.
43. Pianta, R. C., Cox, M. J., & Snow, K. L. (Eds.). (2007). School readiness and the transition to kindergarten in the era of accountability. Baltimore, MD: Brookes.
44. Puma, M., Bell, S., Cook, R., Heid, C., & Lopez, M. (2005). Head Start Impact Study: First year findings. Washington, DC: U. S. Department of Health and Human Services, Administration for Children and Families.
45. Samuels, C. A. (2014, January 13). Cities seize momentum on pre-k expansion. Education Week, 33(17), 1, 14.
46. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin.
47. Smith-Donald, R., Raver, C. C., Hayes, T., & Richardson, B. (2007). Preliminary construct and concurrent validity of the preschool self-regulation assessment (PSRA) for field-based research. Early Childhood Research Quarterly, 22, 173-187. doi: 10. 1016/j. ecresq. 2007. 01. 002.
48. Thistlethwaite, D. L., & Campbell, D. T. (1960). Regression-discontinuity analysis: An alternative to the ex post facto experiment. Journal of Education Psychology, 51, 309-317. doi: 10. 1037/h0044319.
49. Trochim, W. M. K. (1984). Research design for program evaluation: The regression-discontinuity approach. Beverly Hills, CA: SAGE.
50. U. S. Census. (2010). General mobility of family householders, by type of household, age of householder, and presence and age of own children under 18: 2009 to 2010. Retrieved from http://www. census. gov/hhes/migration/data/cps/cps2010. html.
51. Weiland, C., & Yoshikawa, H. (2013). Impacts of a prekindergarten program on children's mathematics, language, literacy, executive function, and emotional skills. Child Development, 84, 2112-2130.
52. White House. (2013, February 13). Fact sheet President Obama's plan for early education for all Americans. Washington, DC: Office of the Press Secretary. Retrieved from http://www. whitehouse. gov/the-press-office/2013/02/13/fact-sheet-president-obama-s-plan-early-educationall-americans.
53. Whitehurst, G., & Armor, D. J. (2013, July 24). Obama's preschool proposal is not based on sound research. The Brown Center Chalkboard. Available from http://www. brookings. edu.
54. Wilson, S. J. (2011, March). Program evaluation of an Early Reading First project using regression discontinuity. In M. W. Lipsey (Chair), The age cutoff regression-discontinuity design for preschool effects: Methodological quirks and implications for application. Symposium conducted at the spring meeting of the Society for Research in Educational Effectiveness, Washington, DC.
55. Wilson, S. J., Dickinson, D. K., & Rowe, D. W. (2013). Impact of an Early Reading First program on the language and literacy achievement of children from diverse language backgrounds. Early Childhood Research Quarterly, 28, 578-592. doi: 10. 1016/j. ecresq. 2013. 03. 006.
56. Wong, V. C., Cook, T. D., Barnett, W. S., & Jung, K. (2008). An effectiveness-based evaluation of Five State Pre-Kindergarten Programs. Journal of Policy Analysis and Management, 27, 122-154. doi: 10. 1002/pam. 20310.
57. Woodcock, R. W., McGrew, K. S., & Mather, N. (2001). Woodcock-Johnson Tests of Achievement. Itasca, IL: Riverside Publishing.
58. Workman, E., Griffith, M., & Atchison, B. (2014). State pre-k funding-2013-14 fiscal year. Denver, CO: Education Commission of the States. Retrieved from http://www. ecs. org/clearinghouse/01/10/28/11034. pdf.
59. Xiang, Z., & Schweinhart, L. (2002, January). Effects five years later: The Michigan School Readiness Program evaluation through age 10. Retrieved from http://www. highscope. org/file/Research/Effects%205%20Years%20Later. pdf.