Matching for balance, pairing for heterogeneity in an observational study of the effectiveness of for-profit and not-for-profit high schools in Chile

Annals of Applied Statistics

Volumn 8, Issue 1, 2014, Pages 204-231

  Zubizarreta, José R ^a   Paredes, Ricardo D ^b   Rosenbaum, Paul R ^c  

^a Division of Decision Risk and Operations Department of Statistics Columbia University ^*  (United States)

^b PONTIFICIA UNIVERSIDAD CATÓLICA DE CHILE   (Chile)

^c UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

Design sensitivity; Integer programming; Testing twice

Indexed keywords

EID: 84898020864     PISSN: 19326157     EISSN: 19417330     Source Type: Journal    
DOI: 10.1214/13-AOAS713     Document Type: Article

References (52)

1. ANGRIST, J. D., PATHAK, P. A. and WALTERS, C. R. (2013). Explaining charter school effectiveness. Am. Econ. J. 5 1-27.
2. BAIOCCHI, M. (2011). Designing robust studies using propensity score and prognostic score matching. Chapter 3 in Methodologies for Observational Studies of Health Care Policy. Ph.D. thesis,s Dept. Statistics, The Wharton School, Univ. Pennsylvania, Philadelphia, PA.
3. BELLEI, C. (2009). Does lengthening the school day increase students academic achievement? Results from a natural experiment in Chile. Econ. Educ. Rev. 28 629-640.
4. BROWN, B. M. (1981). Symmetric quantile averages and related estimators. Biometrika 68 235-242. MR0614960.
5. CORNFIELD, J., HAENSZEL, W., HAMMOND, E., LILIENFELD, A., SHIMKIN, M. and WYNDER, E. (1959). Smoking and lung cancer. J. Natl. Cancer Inst. 22 173-203.
6. COX, D. R. (1958). Planning of Experiments. A Wiley Publication in Applied Statistics. Wiley, New York. MR0095561.
7. CRUMP, R. K., HOTZ, V. J., IMBENS, G. W. and MITNIK, O. A. (2009). Dealing with limited overlap in estimation of average treatment effects. Biometrika 96 187-199. MR2482144.
8. DEYO, R. A., CHERKIN, D. C. and CIOL, M. A. (1992). Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. J. Clin. Epidemiol. 45 613-619.
9. ELACQUA, G. (2009). The Impact of School Choice and Public Policy on Segregation: Evidence from Chile. Centro de Políticas Comparadas de Educación, Univ. Diego Portales, Santiago, Chile.
10. FISHER, R. A. (1935). The Design of Experiments. Oliver & Boyd, Edinburgh.
11. GASTWIRTH, J. L. (1992). Methods for assessing the sensitivity of statistical comparisons used in Title VII cases to omitted variables. Jurimetrics 33 19-34.
12. HANSEN, B. B. (2007). Optmatch: Flexible, optimal matching for observational studies. R News 7 18-24. (Package optmatch in R).
13. HANSEN, B. B. (2008). The prognostic analogue of the propensity score. Biometrika 95 481-488. MR2521594.
14. HILL, J. and SU, Y.-S. (2013). Assessing lack of common support in causal inference using Bayesian nonparametrics: Implications for evaluating the effect of breastfeeding on children's cognitive outcomes. Ann. Appl. Stat. 7 1386-1420. MR3127952.
15. HODGES, J. L. JR. and LEHMANN, E. L. (1963). Estimates of location based on rank tests. Ann. Math. Statist. 34 598-611. MR0152070.
16. HOSMAN, C. A., HANSEN, B. B. and HOLLAND, P. W. (2010). The sensitivity of linear regression coefficients' confidence limits to the omission of a confounder. Ann. Appl. Stat. 4 849-870. MR2758424.
17. IACUS, S. M., KING, G. and PORRO, G. (2009). Software for coarsened exact matching. J. Stat. Softw. 30 1-27.
18. KNAUS, W. A., DRAPER, E. A., Wagner, D. P. and Zimmerman, J. E. (1985). APACHE II: A severity of disease classification system. Crit. Care Med. 13 818-829.
19. LEHMANN, E. L. (1975). Nonparametrics. Holden-Day, San Francisco, CA.
20. LU, B., GREEVY, R., XU, X. and BECK, C. (2011). Optimal nonbipartite matching and its statistical applications. Amer. Statist. 65 21-30. (Package nbpmatching in R). MR2899649.
21. MARCUS, S. M. (1997). Using omitted variable bias to assess uncertainty in the estimation of an AIDS education treatment effect. J. Educ. Statist. 22 193-201.
22. MARITZ, J. S. (1979). A note on exact robust confidence intervals for location. Biometrika 66 163-166. MR0529161.
23. NEYMAN, J. (1923, 1990). On the application of probability theory to agricultural experiments. Statist. Sci. 5 463-480.
24. ROSENBAUM, P. R. (1987). Sensitivity analysis for certain permutation inferences in matched observational studies. Biometrika 74 13-26. MR0885915.
25. ROSENBAUM, P. R. (1993). Hodges-Lehmann point estimates of treatment effect in observational studies. J. Amer. Statist. Assoc. 88 1250-1253. MR1245357.
26. ROSENBAUM, P. R. (2002). Observational Studies, 2nd ed. Springer, New York. MR1899138.
27. ROSENBAUM, P. R. (2004). Design sensitivity in observational studies. Biometrika 91 153-164. MR2050466.
28. ROSENBAUM, P. R. (2005). Heterogeneity and causality: Unit heterogeneity and design sensitivity in observational studies. Amer. Statist. 59 147-152. MR2133562.
29. ROSENBAUM, P. R. (2007). Sensitivity analysis for m-estimates, tests, and confidence intervals in matched observational studies. Biometrics 63 456-464. (R package sensitivitymv). MR2370804.
30. ROSENBAUM, P. R. (2010a). Design of Observational Studies. Springer Series in Statistics. Springer, New York. MR2561612.
31. ROSENBAUM, P. R. (2010b). Design sensitivity and efficiency in observational studies. J. Amer. Statist. Assoc. 105 692-702. MR2724853.
32. ROSENBAUM, P. R. (2011). A new U-statistic with superior design sensitivity in matched observational studies. Biometrics 67 1017-1027. MR2829236.
33. ROSENBAUM, P. R. (2012a). Testing one hypothesis twice in observational studies. Biometrika 99 763-774. MR2999159.
34. ROSENBAUM, P. R. (2012b). Optimal matching of an optimally chosen subset in observational studies. J. Comput. Graph. Statist. 21 57-71. MR2913356.
35. ROSENBAUM, P. R. (2013). Impact of multiple matched controls on design sensitivity in observational studies. Biometrics 69 118-127. MR3058058.
36. ROSENBAUM, P. and RUBIN, D. (1983). Assessing sensitivity to an unobserved binary covariate in an observational study with binary outcome. J. Roy. Statist. Soc. Ser. B 45 212-218.
37. ROSENBAUM, P. R. and SILBER, J. H. (2009). Amplification of sensitivity analysis in matched observational studies. J. Amer. Statist. Assoc. 104 1398-1405. MR2750570.
38. RUBIN, D. B. (1974). Estimating causal effects of treatments in randomized and nonrandomized studies. J. Ed. Psych. 66 688-701.
39. RUBIN, D. B. (1979). Using multivariate matched sampling and regression adjustment to control bias in observational studies. J. Amer. Statist. Assoc. 74 318-328.
40. SMALL, D. S. (2007). Sensitivity analysis for instrumental variables regression with overidentifying restrictions. J. Amer. Statist. Assoc. 102 1049-1058. MR2411664.
41. STEPHENSON, W. R. (1981). A general class of one-sample nonparametric test statistics based on subsamples. J. Amer. Statist. Assoc. 76 960-966. MR0650912.
42. STUART, E. A. (2010).Matching methods for causal inference: A review and a look forward. Statist. Sci. 25 1-21. MR2741812.
43. TRASKIN, M. and SMALL, D. S. (2011). Defining the study population for an observational study to ensure suffient overlap: A tree approach. Statist. Biosci. 3 94-118.
44. WANG, L. and KRIEGER, A. M. (2006). Causal conclusions are most sensitive to unobserved binary covariates. Stat. Med. 25 2257-2271. MR2240099.
45. WELCH, B. L. (1937). On the z-test in randomized blocks. Biometrika 29 21-52.
46. WOLFE, D. A. (1974). A characterization of population weighted-symmetry and related results. J. Amer. Statist. Assoc. 69 819-822. MR0426239.
47. YANAGAWA, T. (1984). Case-control studies: Assessing the effect of a confounding factor. Biometrika 71 191-194. MR0738341.
48. YANG, D., SMALL, D. S., SILBER, J. H. and ROSENBAUM, P. R. (2012). Optimal matching with minimal deviation from fine balance in a study of obesity and surgical outcomes. Biometrics 68 628-636. (R package finebalance). MR2959630.
49. YU, B. B. and GASTWIRTH, J. L. (2005). Sensitivity analysis for trend tests: Application to the risk of radiation exposure. Biostatistics 6 201-209.
50. ZUBIZARRETA, J. R. (2012). Using mixed integer programming for matching in an observational study of kidney failure after surgery. J. Amer. Statist. Assoc. 107 1360-1371. (R software mipmatch at http://www-stat.wharton.upenn.edu/~josezubi/). MR3036400.
51. ZUBIZARRETA, J. R., PAREDES, R. D. and ROSENBAUM, P. R. (2014). Supplement to: "Matching for balance, pairing for heterogeneity in an observational study of the effectiveness of for-profit and not-for-profit high schools in Chile." DOI:10.1214/13-AOAS713SUPP.
52. ZUBIZARRETA, J. R., REINKE, C. E., KELZ, R. R., SILBER, J. H. and ROSENBAUM, P. R. (2011). Matching for several sparse nominal variables in a case-control study of readmission following surgery. Amer. Statist. 65 229-238. MR2867507