Distributional Analysis in Educational Evaluation: A Case Study from the New York City Voucher Program

Journal of Research on Educational Effectiveness

Volumn 8, Issue 3, 2015, Pages 419-450

  Bitler, Marianne ^a   Domina, Thurston ^a   Penner, Emily ^a   Hoynes, Hilary ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

choice; distributional effects; experiments; quantile treatment effects; Voucher

Indexed keywords

EID: 84942982633     PISSN: 19345747     EISSN: 19345739     Source Type: Journal    
DOI: 10.1080/19345747.2014.921259     Document Type: Article

References (52)

1. A.Abdulkadiroğlu,, J.D.Angrist,, S.M.Dynarski,, T.J.Kane,, & P.A.Pathak, (2011). Accountability and flexibility in public schools: Evidence from Boston's charters and pilots. The Quarterly Journal of Economics, 126, 699–748.
2. J.Angrist,, E.Bettinger,, & M.Kremer, (2006). Long-term educational consequences of secondary school vouchers: Evidence from administrative records in Colombia. The American Economic Review, 96, 847–862.
3. J.D.Angrist,, S.M.Dynarski,, T.J.Kane,, P.A.Pathak,, & C.R.Walters, (2010). Inputs and impacts in charter schools: KIPP Lynn. The American Economic Review, 100, 239–243.
4. J.D.Angrist,, S.M.Dynarski,, T.J.Kane,, P.A.Pathak,, & C.R.Walters, (2012). Who benefits from KIPP? Journal of Policy Analysis and Management, 31, 837–860.
5. L.M.Argys,, D.I.Rees,, & D.J.Brewer, (1996). Detracking America's schools: Equity at zero cost? Journal of Policy Analysis and Management, 15, 623–645.
6. J.Barnard,, C.E.Frangakis,, J.L.Hill,, & D.B.Rubin, (2003). Principal stratification approach to broken randomized experiments: A case study of school choice vouchers in New York City. Journal of the American Statistical Association, 98, 299–310.
7. R.Chakrabarti, (2013). Vouchers, public school response, and the role of incentives: Evidence from Florida. Economic Inquiry, 51, 500–526.
8. M.M.Chingos,, & P.E.Peterson, (2012). The effects of school vouchers on college enrollment: Experimental evidence from New York City. Washington, DC: Brookings Institution.
9. J.E.Chubb,, & T.M.Moe, (1990). Politics, markets, and America's schools. Washington, DC: Brookings Institution Press.
10. J.S.Coleman,, & T.Hoffer, (1987). Public, Catholic, and private schools: The importance of community. New York, NY: Basic Books.
11. J.M.Cowen, (2008). School choice as a latent variable: Estimating the “complier average causal effect” of vouchers in Charlotte. Policy Studies Journal, 36, 301–315.
12. J.M.Cowen, (2012). Interpreting school choice effects: Do voucher experiments estimate the impact of attending private school? Journal of Research on Educational Effectiveness, 5, 384–400.
13. W.Dobbie,, R.G.Fryer,, & G.Fryer,, Jr. (2011). Are high-quality schools enough to increase achievement among the poor? Evidence from the Harlem Children's Zone. American Economic Journal: Applied Economics, 3, 158–187.
14. G.J.Duncan,, & D.L.Vandell, (2012, March). A conceptual approach to understanding treatment heterogeneity in human capital interventions. Paper presented at the Society for Research on Educational Effectiveness, Washington, DC.
15. D.Epple,, D.Figlio,, & R.Romano, (2004). Competition between private and public schools: Testing stratification and pricing predictions. Journal of Public Economics, 88, 1215–1245.
16. W.Evans,, & R.Schwab, (1995). Finishing high school and starting college: Do Catholic schools make a difference? Quarterly Journal of Economics, 110, 941–974.
17. M.Friedman,, & R.Friedman, (1980). Free to choose. New York, NY: Harcourt Brace Jovanovich.
18. A.M.Greeley, (1982). Catholic high schools and minority students. Livingston, NJ: Transaction Publishers.
19. J.P.Greene, (2001). Vouchers in Charlotte. Education Matters, 1, 55–60.
20. J.P.Greene,, W.G.Howell,, & P.E.Peterson, (1997). Lessons from the Cleveland scholarship program. Cambridge, MA: Education Policy and Governance, Harvard University.
21. J.P.Greene,, P.E.Peterson,, & J.Du, (1997). Effectiveness of school choice: The Milwaukee experiment. Cambridge, MA: Program in Education Policy and Governance and Center for American Political Studies, Harvard University.
22. J.Greene,, P.Peterson,, & J.Du, (1998). School choice in Milwaukee. Learning from School Choice, 1(2), 335–356.
23. J.P.Greene,, & M.A.Winters, (2003). When schools compete: The effects of vouchers on Florida public school achievement. New York, NY: Center for Civic Innovation, Manhattan Institute.
24. A.Hartocollis, (1997, November 26). School voucher experiment will be extended and expanded. The New York Times. Retrieved from http://www.nytimes.com/1997/11/26/nyregion/school-voucher-experiment-will-be-extended-and-expanded.html
25. J.Hastings,, T.Kane,, & D.Staiger, (2005). Parental preferences and school competition: Evidence from a public school choice program (Working Paper No. 11805). Washington, DC: National Bureau of Economic Research.
26. J.L.Hill,, D.B.Rubin,, & N.Thomas, (2000). The design of the New York School Choice Scholarships Program evaluation. In L.Bickman (Ed.), Research design: Donald Campbell's legacy (Vol., pp. 328–346). Thousand Oaks, CA: Sage.
27. T.Hoffer,, A.M.Greeley,, & J.S.Coleman, (1985). Achievement growth in public and Catholic schools. Sociology of Education, 58, 74–97.
28. G.Hong,, C.Corter,, Y.Hong,, & J.Pelletier, (2012). Differential effects of literacy instruction time and homogeneous ability grouping in Kindergarten classrooms: Who will benefit? Who will suffer? Educational Evaluation and Policy Analysis, 34, 69–88.
29. H.D.Hoover,, S.B.Dunbar,, & D.A.Frisbie, (2013). Iowa Tests of Basic Skills (ITBS_ Forms A, B, and C). Rolling Meadows, IL: Riverside. Retrieved from http://www.riversidepublishing.com/products/itbs/details.html
30. W.Howell,, & P.Peterson, (2000). School choice in Dayton, Ohio: An evaluation after 1 year. Paper prepared for the conference on charters, vouchers, and public education, Program on Education Policy and Governance, Kennedy School of Government, Harvard University, Cambridge, MA.
31. W.G.Howell,, P.J.Wolf,, D.E.Campbell,, & P.E.Peterson, (2002). School vouchers and academic performance: Results from three randomized field trials. Journal of Policy Analysis and Management, 21, 191–217.
32. C.M.Hoxby,, S.Murarka,, & J.Kang, (2009). How New York City's charter schools affect achievement (No. 2). Cambridge, MA: New York City Charter Schools Evaluation Project.
33. H.Jin,, J.Barnard,, & D.B.Rubin, (2010). A modified general location model for noncompliance with missing data: Revisiting the New York City School Choice Scholarship Program using principal stratification. Journal of Educational and Behavioral Statistics, 35, 154–173.
34. H.Jin,, & D.B.Rubin, (2009). Public schools versus private schools: Causal inference with partial compliance. Journal of Educational and Behavioral Statistics, 34, 24–45.
35. A.Krueger,, & P.Zhu, (2004a). Another look at the New York City school voucher experiment. American Behavioral Scientist, 47, 658–698.
36. A.Krueger,, & P.Zhu, (2004b). Inefficiency, subsample selection bias, and nonrobustness. American Behavioral Scientist, 47, 718–728.
37. H.Kupermintz, (2002). The effects of vouchers on school improvement: Another look at the Florida data. Los Angeles: Center for the Study of Evaluation, National Center for Research on Evaluation, Standards, and Student Testing, Graduate School of Education & Information Studies, University of California, Los Angeles.
38. H.F.Ladd,, & E.B.Fiske, (2003). Does competition improve teaching and learning? Evidence from New Zealand. Educational Evaluation and Policy Analysis, 25, 97–112.
39. B.Lara,, A.Mizala,, A.Repetto, (2011). The effectiveness of private voucher education: Evidence from structural school switchers. Educational Evaluation and Policy Analysis, 33, 119–137.
40. D.P.Mayer,, P.E.Peterson,, D.E.Myers,, C.C.Tuttle,, & W.G.Howell, (2002). School choice in New York City after three years: An evaluation of the school choice scholarship program. Washington, DC: Mathematica Policy Research, Inc.
41. P.J.McEwan,, & M.Carnoy, (2000). The effectiveness and efficiency of private schools in Chile's voucher system. Educational Evaluation and Policy Analysis, 22, 213–239.
42. S.L.Morgan, (2001). Counterfactuals, causal effect heterogeneity, and the Catholic school effect on learning. Sociology of Education, 74, 341–374.
43. D.A.Neal, (1997). The effects of Catholic secondary schooling on educational achievement. Journal of Labor Economics, 15, 98–123.
44. P.E.Peterson,, & W.G.Howell, (2004). Efficiency, bias, and classification schemes: A response to Alan B. Krueger and Pei Zhu. American Behavioral Scientist, 47, 699–717.
45. P.E.Peterson,, W.G.Howell,, & J.P.Greene, (1999). An evaluation of the Cleveland Voucher Program after two years. Cambridge, MA: Program on Education Policy and Governance, John F. Kennedy School of Government, Harvard University.
46. P.E.Peterson,, D.Myers,, & W.G.Howell, (1999). An evaluation of the Horizon Scholarship Program in the Edgewood Independent School District, San Antonio, Texas: The first year. Cambridge, MA: Program on Education Policy and Governance, John F. Kennedy School of Government, Harvard University.
47. C.E.Rouse, (1998). Private school vouchers and student achievement: An evaluation of the Milwaukee parental choice program. The Quarterly Journal of Economics, 113, 553–602.
48. J.Steinberg, (1997a, February 4). Giuliani sees tuition plan set for fall. The New York Times. Retrieved from. http://www.nytimes.com/1997/02/04/nyregion/giuliani-sees-tuition-plan-set-for-fall.html
49. J.Steinberg, (1997b, May 13). Students chosen for grants to attend private schools. The New York Times. Retrieved from. http://www.nytimes.com/1997/05/13/nyregion/students-chosen-for-grants-to-attend-private-schools.html
50. J.F.Witte, (1998). The Milwaukee voucher experiment. Educational Evaluation and Policy Analysis, 20, 229–251.
51. P.J.Wolf,, W.G.Howell,, & P.E.Peterson, (2000). School choice in Washington, DC: An evaluation after one year. Cambridge, MA: Program on Educational Policy and Governance, Harvard University.
52. P.J.Wolf,, B.Kisida,, B.Gutmann,, M.Puma,, N.Eissa,, & L.Rizzo, (2013). School vouchers and student outcomes: Experimental evidence from Washington, DC. Journal of Policy Analysis and Management, 32(2), 246270.