Principal stratification approach to broken randomized experiments: A case study of school choice vouchers in New York City

Journal of the American Statistical Association

Volumn 98, Issue 462, 2003, Pages 299-323

  Barnard, John ^a   Frangakis, Constantine E ^b   Hill, Jennifer L ^c   Rubin, Donald B ^d  

^a DeCODE Chemistry & Biostructures   (United States)

^b JOHNS HOPKINS UNIVERSITY   (United States)

^c Och Spine at New York Presbyterian Hospitals   (United States)

^d HARVARD UNIVERSITY   (United States)

Author keywords

Causal inference; Missing data; Noncompliance; Pattern mixture models; Principal stratification; Rubin causal model; School choice

Indexed keywords

EID: 0041743094     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1198/016214503000071     Document Type: Article

References (53)

1. Angrist, J. D., Imbens, G. W., and Rubin, D. B. (1996), "Identification of Causal Effects Using Instrumental Variables" (with discussion), Journal of the American Statistical Association, 91, 444-472.
2. Barnard, J., Du, J., Hill, J. L., and Rubin, D. B. (1998), "A Broader Template for Analyzing Broken Randomized Experiments," Sociological Methods and Research, 27, 285-317.
3. Barnard, J., Frangakis, C., Hill, J. L., and Rubin, D. B. (2002), "School Choice in NY City: A Bayesian Analysis of an Imperfect Randomized Experiment," in Case Studies in Bayesian Statistics, vol. V, eds. Gatsonis, C., Kass, R. E., Carlin, B., Cariiguiry, A., Gelman, A., Verdinelli, I., West, M. New York: Springer-Verlag, pp. 3-97.
4. Brandl, J. E. (1998), Money and Good Intentions Are Not Enough, or Why Liberal Democrats Think States Need Both Competition and Community, Washington, DC: Brookings Institute Press.
5. Carnegie Foundation for the Advancement of Teaching (1992), School Choice: A Special Report, San Francisco: Jossey-Bass.
6. Chubb, J. E., and Moe, T. M. (1990), Politics, Markets and America's Schools, Washington, DC: Brookings Institute Press.
7. Cobb, C. W. (1992), Responsive Schools, Renewed Communities, San Francisco: Institute for Contemporary Studies.
8. Coleman, J. S., Hoffer, T., and Kilgore, S. (1982), High School Achievement, New York: Basic Books.
9. Cookson, P. W. (1994), School Choice: The Struggle for the Soul of American Education, New Haven, CT: Yale University Press.
10. Coulson, A. J. (1999), Market Education: The Unknown History, Bowling Green, OH: Social Philosophy & Policy Center.
11. Cox, D. R. (1958), Planning of Experiments, New York: Wiley.
12. D'Agostino, Ralph B., J. and Rubin, D. B. (2000), "Estimating and Using Propensity Scores With Incomplete Data," Journal of the American Statistical Association, 95, 749-759.
13. Education, Week (1998), Quality Counts '98: The Urban Challenge; Public Education in the 50 States, Bethesda, MD: Editorial Projects in Education.
14. Frangakis, C. E., and Rubin, D. B. (1999), "Addressing Complications of Intention-to-Treat Analysis in the Combined Presence of All-or-None Treatment-Noncompliance and Subsequent Missing Outcomes," Biometrika, 86, 365-380.
15. _ (2001), "Addressing the Idiosyncrasy in Estimating Survival Curves Using Double-Sampling in the Presence of Self-Selected Right Censoring" (with discussion), Biometrics, 57, 333-353.
16. _ (2002), "Principal Stratification in Causal Inference," Biometrics, 58, 20-29.
17. Frangakis, C. E., Rubin, D. B., and Zhou, X. H. (2002a), "Clustered Encouragement Design With Individual Noncompliance: Bayesian Inference and Application to Advance Directive Forms" (with discussion), Biostatistics, 3, 147-164.
18. Frangakis, C. E., Brookmeyer, R. S., Varadhan, R., Mahboobeh, S., Vlahov, D., and Strathdee, S. A. (2002b), "Methodology for Evaluating a Partially Controlled Longitudinal Treatment Using Principal Stratification. With Application to a Needle Exchange Program," Technical Report NEP-06-02, Johns Hopkins University, Dept. of Biostatistics.
19. Fuller, B., and Elmore, R. F. (1996), Who Chooses? Who Loses? Culture, Institutions, and the Unequal Effects of School Choice, New York: Teachers College Press.
20. Gelfand, A. E., and Smith, A. F. M. (1990), "Sampling-Based Approaches to Calculating Marginal Densities," Journal of the American Statistical Association, 85, 398-409.
21. Gelman, A., Meng, X.-L., and Stern, H. (1996), "Posterior Predictive Assessment of Model Fitness via Realized Discrepancies (Disc: P760-807)," Statistica Sinica, 6, 733-760.
22. Gelman, A., and Rubin, D. B. (1992), "Inference from Iterative Simulation Using Multiple Sequences" (with discussion), Statistical Science, 7, 457-472.
23. Glynn, R. J., Laird, N. M., and Rubin, D. B. (1993), "Multiple Imputation in Mixture Models for Nonignorable Nonresponse With Follow-Ups," Journal of the American Statistical Association, 88, 984-993.
24. Goldberger, A. S., and Cain, G. G. (1982), "The Causal Analysis of Cognitive Outcomes in the Coleman. Hoffer, and Kilgore Report," Sociology of Education, 55, 103-122.
25. Haavelmo, T. (1943), "The Statistical Implications of a System of Simultaneous Equations," Econometrica, 11, 1-12.
26. Hastings, W. (1970), "Monte Carlo Sampling Methods Using Markov Chains and Their Applications," Biometrika, 57, 97-109.
27. Hill, J. L., Rubin, D. B., and Thomas, N. (2000), "The Design of the New York School Choice Scholarship Program Evaluation," in Donald Campbell's Legacy, ed. L. Bickman, Newbury Park, CA: Sage Publications.
28. Hirano, K., Imbens, G. W., Rubin, D. B., and Zhou, A. (2000), "Assessing the Effect of an Influenza Vaccine in an Encouragement Design," Biostatistics, 1, 69-88.
29. Holland, P. (1986), "Statistics and Causal Inference," Journal of the American Statistical Association, 81, 396, 945-970.
30. Imbens, G. W., and Angrist, J. D. (1994), "Identification and Estimation of Local Average Treatment Effects," Econometrica, 62, 467-476.
31. Imbens, G. W., and Rubin, D. B. (1997), "Bayesian Inference for Causal Effects in Randomized Experiments With Noncompliance," The Annals of Statistics, 25, 305-327.
32. Levin, H. M. (1998), "Educational Vouchers: Effectiveness, Choice, and Costs," Journal of Policy Analysis and Management, 17, 373-392.
33. Little, R. J. A. (1993), "Pattern-Mixture Models for Multivariate Incomplete Data," Journal of the American Statistical Association. 88, 125-134.
34. _ (1996), "Pattern-Mixture Models for Multivariate Incomplete Data With Covariates," Biometrics, 52, 98-111.
35. Little, R. J. A., and Rubin, D. B. (1987), Statistical Analysis With Missing Data, New York: Wiley.
36. Meng, X. L. (1996), "Posterior Predictive p Values," The Annals of Statistics, 22, 1142-1160.
37. Neal, D. (1997), "The Effects of Catholic Secondary Schooling on Educational Achievement,' Journal of Labor Economics, 15, 98-123.
38. Neyman, J. (1923), "On the Application of Probablity Theory to Agricultural Experiments Essay on Principles. Section 9," translated in Statistical Science, 5, 465-480.
39. Peterson, P. E., and Massel, B. C. (Eds.) (1998), Learning from School Choice, Washington, DC: Brookings Institute Press.
40. Peterson, P. E., Myers, D. E., Howell, W. G., and Mayer, D. P. (1999), "The Effects of School Choice in New York City," in Earning and Learning; How Schools Matter, eds. S. E. Mayer and P. E. Peterson, Washington, DC: Brookings Institute Press.
41. Robins, J. M., Greenland, S., and Hu, F.-C. (1999). "Estimation of the Causal Effect of a Time-Varying Exposure on the Marginal Mean of a Repeated Binary Outcome" (with discussion). Journal of the American Statistical Association, 94, 687-712.
42. Rosenbaum, P. R., and Rubin, D. B. (1983), "The Central Role of the Propensity Score in Observational Studies for Causal Effects," Biometrika, 70, 41-55.
43. Rubin, D. B. (1974), "Estimating Causal Effects of Treatments in Randomized and Non-Randomized Studies," Journal of Educational Psychology, 66, 688-701.
44. _ (1977), "Assignment to Treatment Groups on the Basis of a Covariate," Journal of Educational Statistics, 2, 1-26.
45. _ (1978a), "Bayesian Inference for Causal Effects: The Role of Randomization," The Annals of Statistics, 6, 34-58.
46. _ (1978b), "Multiple Imputations in Sample Surveys: A Phenomenological Bayesian Approach to Nonresponse (C/R: P29-34)," in Proceedings of the Survey Research Methods Section, American Statistical Association, pp. 20-28.
47. _ (1979), "Using Multivariate Matched Sampling and Regression Adjustment to Control Bias in Observational Studies," Journal of the American Statistical Association, 74, 318-328.
48. _ (1980). Comments on "Randomization Analysis of Experimental Data: The Fisher Randomization Test," Journal of the American Statistical Association. 75, 591-593.
49. _ (1984), "Bayesianly Justifiable and Relevant Frequency Calculations for the Applied Statistician," The Annals of Statistics, 12, 1151-1172.
50. _ (1990), "Comment: Neyman (1923) and Causal Inference in Experiments and Observational Studies," Statistical Science, 5, 472-480.
51. The Coronary Drug Project Research Group (1980), "Influence of Adherence to Treatment and Response of Cholesterol on Mortality in the Coronary Drug Project," New England Journal of Medicine, 303, 1038-1041.
52. Tinbergen, J. (1930), "Determination and Interpretation of Supply Curves: An Example," in The Foundations of Econometric Analysis, eds. D. Hendry and M. Morgan, Cambridge, U.K: Cambridge University Press.
53. Wilms, D. J. (1985), "Catholic School Effect on Academic Achievement: New Evidence From the High School and Beyond Follow-Up Study," Sociology of Education, 58, 98-114.