Matching estimators of causal effects: Prospects and pitfalls in theory and practice

Sociological Methods and Research

Volumn 35, Issue 1, 2006, Pages 3-60

  Morgan, Stephen L ^a,c   Harding, David J ^b  

^a Department of Obstetrics Gynecology   (United States)

^b UNIVERSITY OF MICHIGAN   (United States)

^c Cornell University ^*  (United States)

Author keywords

Causal effects; Matching methods; Matching techniques; Stratification

Indexed keywords

EID: 33745818364     PISSN: 00491241     EISSN: 15528294     Source Type: Journal    
DOI: 10.1177/0049124106289164     Document Type: Review

References (77)

1. Abadie, Alberto. 2002. "Bootstrap Tests for Distributional Treatment Effect in Instrumental Variable Models." Journal of the American Statistical Association 97: 284-292.
2. Abadie, Alberto, David Drukker, Jane L. Herr, and Guido W. Imbens. 2001. "Implementing Matching Estimators for Average Treatment Effects in Stata." The Stata Journal 1: 1-18.
3. Abadie, Alberto and Guido W. Imbens. 2004. "On the Failure of the Bootstrap for Matching Estimators." Working paper, John F. Kennedy School of Government, Harvard University.
4. Abadie, Alberto and Guido W. Imbens. 2006. "Large Sample Properties of Matching Estimators for Average Treatment Effects." Econometrica. 74: 235-267.
5. Althauser, Robert P. and Donald B. Rubin. 1970. "The Computerized Construction of a Matched Sample." American Journal of Sociology 76: 325-346.
6. Althauser, Robert P. and Donald B. Rubin. 1971. "Measurement Error and Regression to the Mean in Matched Samples." Social Forces 50: 206-214.
7. Angrist, Joshua D. and Alan B. Krueger. 1999. "Empirical Strategies in Labor Economics." Pp. 1277-1366 in Handbook of Labor Economics, vol. 3, edited by O. C. Ashenfelter and D. Card. Amsterdam: Elsevier.
8. Becker, Sascha O. and Andrea Ichino. 2002. "Estimation of Average Treatment Effects Based on Propensity Scores." The Stata Journal 2: 358-377.
9. Berk, Richard A. and Phyllis J. Newton. 1985. "Does Arrest Really Deter Wife Battery? An Effort to Replicate the Findings of the Minneapolis Spouse Abuse Experiment." American Sociological Review 50: 253-262.
10. Berk, Richard A., Phyllis J. Newton, and Sarah Fenstermaker Berk. 1986. "What a Difference a Day Makes: An Empirical Study of the Impact of Shelters for Battered Women." Journal of Marriage and Family 48: 481-490.
11. Cochran, William G. 1968. "The Effectiveness of Adjustment by Sub classification in Removing Bias in Observational Studies." Biometrics 24: 295-313.
12. Dehejia, Rajeev H. and Sadek Wahba. 1999. "Causal Effects in No experimental Studies: Reevaluating the Evaluation of Training Programs." Journal of the American Statistical Association 94: 1053-1062.
13. Dehejia, Rajeev H. and Sadek Wahba. 2002. "Propensity Score-Matching Methods for No experimental Causal Studies." Review of Economics and Statistics 84: 151-161.
14. Diamond, Alexis and Jasjeet S. Sekhon. 2005. "Genetic Matching for Estimating Causal Effects: A General Multivariate Matching Method for Achieving Balance in Observational Studies." Working paper, Travers Department of Political Science, UC Berkeley.
15. DiPrete, Thomas A. and Henriette Engelhardt. 2004. "Estimating Causal Effects With Matching Methods in the Presence and Absence of Bias Cancellation." Sociological Methods & Research 32: 501-528.
16. DiPrete, Thomas A. and Markus Gangl. 2004. "Assessing Bias in the Estimation of Causal Effects: Rosenbaum Bounds on Matching Estimators and Instrumental Variables Estimation With Imperfect Instruments." Sociological Methodology 34: 271-310.
17. Freedman, Ronald and Amos H. Hawley. 1949. "Unemployment and Migration in the Depression." Journal of the American Statistical Association 44: 260-272.
18. Greenwood, Ernest. 1945. Experimental Sociology: A Study in Method. New York: King's Crown Press.
19. Hahn, Jinyong. 1998. "On the Role of the Propensity Score in Efficient Semi parametric Estimation of Average Treatment Effects." Econometrica 66: 315-331.
20. Ham, J. C., X. Li, and P. B. Reagan. 2003. "Propensity Score Matching, a Distance-Based Measure of Migration, and the Wage Growth of Young Men." Working paper, Department of Sociology and Center for Human Resource Research, Ohio State University.
21. Hansen, Ben B. 2004a. "Full Matching in an Observational Study of Coaching for the SAT." Journal of the American Statistical Association 99: 609-618.
22. Hansen, Ben B. 2004b. "Optmatch, an Add-on Package for R." Department of Statistics, University of Michigan.
23. Harding, David J. 2003. "Counterfactual Models of Neighborhood Effects: The Effect of Neighborhood Poverty on Dropping Out and Teenage Pregnancy." American Journal of Sociology 109: 676-719.
24. Heckman, James J. 2000. "Causal Parameters and Policy Analysis in Economics: A Twentieth Century Retrospective." Quarterly Journal of Economics 115: 45-97.
25. Heckman, James J., Hidehiko Ichimura, Jeffery A. Smith, and Petra Todd. 1998. "Characterizing Selection Bias Using Experimental Data." Econometrica 66: 1017-1098.
26. Heckman, James J., Hidehiko Ichimura, and Petra Todd. 1997. "Matching as an Econometric Evaluation Estimator: Evidence From Evaluating a Job Training Programme." Review of Economic Studies 64: 605-654.
27. Heckman, James J., Hidehiko Ichimura, and Petra Todd. 1998. "Matching as an Econometric Evaluation Estimator." Review of Economic Studies 65: 261-294.
28. Heckman, James J., Robert J. LaLonde, and Jeffrey A. Smith. 1999. "The Economics and Econometrics of Active Labor Market Programs." Pp. 1865-2097 in Handbook of Labor Economics, vol. 3, edited by O. C. Ashenfelter and D. Card. Amsterdam: Elsevier.
29. Heckman, James J. and Edward Vytlacil. 1999. "Local Instrumental Variables and Latent Variable Models for Identifying and Bounding Treatment Effects." Proceedings of the National Academy of Sciences of the United States of America 96: 4730-4734.
30. Heckman, James J. and Edward Vytlacil. 2000. "The Relationship Between Treatment Parameters Within a Latent Variable Framework." Economics Letters 66: 33-39.
31. Heckman, James J. and Edward Vytlacil. 2004. "Structural Equations, Treatment Effects, and Econometric Policy Evaluation." Econometrica 73: 669-738.
32. Hirano, Keisuke and Guido W. Imbens. 2004. "The Propensity Score With Continuous Treatments." Pp. 73-84 in Applied Bayesian Modeling and Causal Inference From Incomplete Data Perspectives: An Essential Journey With Donald Rubin's Statistical Family, edited by A. Gelman and X.-L. Meng. New York: John Wiley.
33. Hirano, Keisuke, Guido W. Imbens, and Geert Ridder. 2003. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score." Econometrica 71: 1161-1189.
34. Ho, Daniel, Kosuke Imai, Gary King, and Elizabeth Stuart. 2004. "Matchit." http://gking.harvard.edu/matchit
35. Hoffer, Thomas, Andrew M. Greeley, and James S. Coleman. 1985. "Achievement Growth in Public and Catholic Schools." Sociology of Education 58: 74-97.
36. Holland, Paul W. 1986. "Statistics and Causal Inference." Journal of the American Statistical Association 81: 945-970.
37. Holland, Paul W. and Donald B. Rubin. 1983. "On Lord's Paradox." Pp. 3-25 in Principles of Modern Psychological Measurement: A Festschrift for Frederic M. Lord, edited by H. Wainer and S. Messick. Hillsdale, NJ: Lawrence Erlbaum.
38. Imai, Kosuke and David A. van Dyk. 2004. "Causal Inference With General Treatment Regimes: Generalizing the Propensity Score." Journal of the American Statistical Association 99: 854-866.
39. Imbens, Guido W. 2000. "The Role of the Propensity Score in Estimating Dose-Response Functions." Biometrika 87: 706-710.
40. Imbens, Guido W. 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review." Review of Economics and Statistics 86: 4-29.
41. Lechner, Michael. 2002a. "Some Practical Issues in the Evaluation of Heterogeneous Labour Market Programmes by Matching Methods." Journal of the Royal Statistical Society 165: 59-82.
42. Lechner, Michael. 2002b. "Program Heterogeneity and Propensity Score Matching: An Application to the Evaluation of Active Labor Market Policies." Review of Economics and Statistics 84: 205-220.
43. Leuven, Edwin and Barbara Sianesi. 2003. "Psmatch2: Stata Module to Perform Full Mahalanobis and Propensity Score Matching, Common Support Graphing, and Covariate Imbalance Testing." http://ideas.repec.org/c/boc/bocode/ s432001.html,versionx.x.x.
44. Lu, Bo, Elaine Zanutto, Robert Hornik, and Paul R. Rosenbaum. 2001. "Matching With Doses in an Observational Study of a Media Campaign Against Drug Abuse." Journal of the American Statistical Association 96: 1245-1245.
45. Manski, Charles F. 1995. Identification Problems in the Social Sciences. Cambridge, MA: Harvard University Press.
46. Morgan, Stephen L. 2001. "Counterfactuals, Causal Effect Heterogeneity, and the Catholic School Effect on Learning." Sociology of Education 74: 341-374.
47. Pearl, Judea. 2000. Causality: Models, Reasoning, and Inference. Cambridge, UK: Cambridge University Press.
48. Rosenbaum, Paul R. 1984. "The Consequences of Adjustment for a Concomitant Variable That Has Been Affected by the Treatment." Journal of the Royal Statistical Society, Series A 147: 656-666.
49. Rosenbaum, Paul R. 1987. "Model-Based Direct Adjustment." Journal of the American Statistical Association 82: 387-394.
50. Rosenbaum, Paul R. 1989. "Optimal Matching for Observational Studies." Journal of the American Statistical Association 84: 1024-1032.
51. Rosenbaum, Paul R. 1991. "Sensitivity Analysis for Matched Case Control Studies." Biometrics 47: 87-100.
52. Rosenbaum, Paul R. 1992. "Detecting Bias With Confidence in Observational Studies." Biometrika 79: 367-374.
53. Rosenbaum, Paul R. 2002. Observational Studies. New York: Springer.
54. Rosenbaum, Paul R. and Donald B. Rubin. 1983a. "The Central Role of the Propensity Score in Observational Studies for Causal Effects." Biometrika 70: 41-55.
55. Rosenbaum, Paul R. and Donald B. Rubin. 1983b. "Assessing Sensitivity to an Unobserved Covariate in an Observational Study With Binary Outcome." Journal of the Royal Statistical Society 45: 212-218.
56. Rosenbaum, Paul R. and Donald B. Rubin. 1984. "Reducing Bias in Observational Studies Using Sub classification on the Propensity Score." Journal of the American Statistical Association 79: 516-524.
57. Rosenbaum, Paul R. and Donald B. Rubin. 1985a. "Constructing a Control Group Using Multivariate Matched Sampling Methods." The American Statistician 39: 33-38.
58. Rosenbaum, Paul R. and Donald B. Rubin. 1985b. "The Bias Due to Incomplete Matching." Biometrics 41: 103-116.
59. Rubin, Donald B. 1973a. "Matching to Remove Bias in Observational Studies." Biometrics 29: 159-183.
60. Rubin, Donald B. 1973b. "The Use of Matched Sampling and Regression Adjustment to Remove Bias in Observational Studies." Biometrics 29: 185-203.
61. Rubin, Donald B. 1976a. "Multivariate Matching Methods That Are Equal Percent Bias Reducing, I: Some Examples." Biometrics 32: 109-120.
62. Rubin, Donald B. 1976b. "Multivariate Matching Methods That Are Equal Percent Bias Reducing, II: Maximums on Bias Reduction for Fixed Sample Sizes." Biometrics 32: 121-132.
63. Rubin, Donald B. 1977. "Assignment to Treatment Group on the Basis of a Covariate." Journal of Educational Statistics 2: 1-26.
64. Rubin, Donald B. 1978. "Bayesian Inference for Causal Effects: The Role of Randomization." The Annals of Statistics 6: 34-58.
65. Rubin, Donald B. 1979. "Using Multivariate Matched Sampling and Regression Adjustment to Control Bias in Observational Studies." Journal of the American Statistical Association 74: 318-328.
66. Rubin, Donald B. 1980. "Bias Reduction Using Mahalanobis-Metric Matching." Biometrics 36: 293-298.
67. Rubin, Donald B. and Neal Thomas. 1996. "Matching Using Estimated Propensity Scores: Relating Theory to Practice." Biometrics 52: 249-264.
68. Rubin, Donald B. and Neal Thomas. 2000. "Combining Propensity Score Matching With Additional Adjustments for Prognostic Covariates." Journal of the American Statistical Association 95: 573-585.
69. Rupert, David, M. P. Wand, and Raymond J. Carroll. 2003. Semi parametric Regression. Cambridge, UK: Cambridge University Press.
70. Sekhon, Jasjeet. 2005. "Matching." http://sekhon.polisci. berkeley.edu/
71. Smith, Herbert L. 1997. "Matching With Multiple Controls to Estimate Treatment Effects in Observational Studies." Sociological Methodology 27: 325-353.
72. Smith, Jeffery A. and Petra Todd. 2005. "Does Matching Overcome LaLonde's Critique of No experimental Estimators?" Journal of Econometrics 125: 305-353.
73. Sobel, Michael E. 1995. "Causal Inference in the Social and Behavioral Sciences." Pp. 1-38 in Handbook of Statistical Modeling for the Social and Behavioral Sciences, edited by G. Arminger, C. C. Clogg, and M. E. Sobel. New York: Plenum.
74. Tu, Wanzhu and Xiao-Hua Zhou. 2002. "A Bootstrap Confidence Interval Procedure for the Treatment Effect Using Propensity Score Sub classification." Health Services & Outcomes Research Methodology 3: 135-147.
75. van der Laan, Mark J. and James M. Robins. 2003. Unified Methods for Censored Longitudinal Data and Causality. New York: Springer.
76. Win ship, Christopher and Stephen L. Morgan. 1999. "The Estimation of Causal Effects From Observational Data." Annual Review of Sociology 25: 659-706.
77. Yinger, Milton J., Kiyoshi Ikeda, and Frank Laycock. 1967. "Treating Matching as a Variable in a Sociological Experiment." American Sociological Review 32: 801-812.