The performance of estimators based on the propensity score

Journal of Econometrics

Volumn 175, Issue 1, 2013, Pages 1-21

  Huber, Martin ^a   Lechner, Michael ^a   Wunsch, Conny ^a  

^a UNIVERSITY OF ST GALLEN   (Switzerland)

Author keywords

Empirical Monte Carlo study; Finite sample properties; Inverse probability tilting; Inverse probability weighting; Kernel matching; Propensity score matching; Selection on observables

Indexed keywords

EMPLOYMENT; SAMPLING;

FINITE SAMPLE PROPERTIES; INVERSE PROBABILITY TILTING; KERNEL MATCHING; MONTE CARLO STUDY; PROBABILITY WEIGHTING; PROPENSITY SCORE MATCHING; SELECTION ON OBSERVABLES;

ESTIMATION;

EID: 84876932344     PISSN: 03044076     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jeconom.2012.11.006     Document Type: Article

References (101)

1. A. Abadie Semiparametric difference-in-difference estimators Review of Economic Studies 72 2005 1 19
2. Abadie, A.; Imbens, G.W.; 2002. Simple and bias-corrected matching estimators for average treatment effects, NBER Technical Working Paper 283.
3. A. Abadie, and G.W. Imbens Large sample properties of matching estimators for average treatment effects Econometrica 74 2006 235 267
4. A. Abadie, and G.W. Imbens On the failure of the bootstrap for matching estimators Econometrica 76 2008 1537 1557
5. Abadie, A.; Imbens, G.W.; 2009. Matching on the estimated propensity score, NBER Working Paper 15301.
6. J.D. Angrist Estimating the labor market effects of voluntary military service using social security data on military applicants Econometrica 66 1998 249 288
7. J.D. Angrist, and J. Hahn When to control for covariates? panel-asymptotic results for estimates of treatment effects Review of Economics and Statistics 86 2004 58 72
8. J.D. Angrist, and S. Pischke Mostly Harmless Econometrics: An Empiricists' Companion 2009 Princeton University Press Princeton, NJ
9. B. Augurzky, and J. Kluve Assessing the performance of matching algorithms when selection into treatment is strong Journal of Applied Econometrics 22 2007 533 557
10. H. Bang, and J.M. Robins Doubly robust estimation in missing data and causal inference models Biometrics 61 2005 962 972
11. S. Behncke, M. Frölich, and M. Lechner Unemployed and their case workers: should they be friends or foes? The Journal of the Royal Statistical Society - Series A 173 2010 67 92
12. S. Behncke, M. Frölich, and M. Lechner A caseworker like me - does the similarity between unemployed and caseworker increase job placements? The Economic Journal 2010 1430 1459
13. M. Bertrand, E. Duflo, and S. Mullainathan How much should we trust differences-in-differences estimates Quarterly Journal of Economics 2004 249 275
14. R. Blundell, and M. Costa Dias Alternative approaches to evaluation in empirical microeconomics Journal of Human Resources 44 2009 565 640
15. R. Blundell, C. Meghir, M. Costa Dias, and J. van Reenen Evaluating the employment impact of a mandatory job search program Journal of the European Economic Association 2 2004 569 606
16. Busso, M.; DiNardo, J.; McCrary, J.; 2009. Finite sample properties of semiparametric estimators of average treatment effects, The Journal of Business and Economic Statistics (forthcoming).
17. Busso, M.; DiNardo, J.; McCrary, J.; 2009. New evidence on the finite sample properties of propensity score matching and reweighting estimators, IZA discussion paper, 3998.
18. M. Caliendo, R. Hujer, and S. Thomsen Sectoral heterogeneity in the employment effects of job creation schemes in Germany Journal of Economics and Statistics 226 2 2006 139 179
19. M. Caliendo, R. Hujer, and S. Thomsen The employment effects of job creation schemes in Germany-a microeconometric evaluation D. Millimet, J. Smith, E. Vytlacil, Advances in Econometrics, Volume 21: Estimating and Evaluating Treatment Effects in Econometrics 2008 383 430
20. M. Caliendo, R. Hujer, and S. Thomsen Identifying effect heterogeneity to improve the efficiency of job creation schemes in Germany Applied Economics 40 2008 1101 1122
21. D. Card, J. Kluve, and A. Weber Active labour market policy evaluations: a meta-analysis Economic Journal 120 2010 F452 F477
22. X. Chen Large sample sieve estimation of semi-nonparametric models Handbook of Econometrics vol. 6B 2007 Elsevier B.V 5549 5632 (Chapter 76)
23. Chen, X.; Hong, H.; Tarozzi, A.; 2008. Semiparametric efficiency in gmm models of nonclassical measurement errors, missing data and treatment effects, Cowles Foundation Discussion Paper No. 1644; shorter version published as Semiparametric Efficiency in GMM Models with Auxiliary Data, The Annals of Statistics, 36, 808-843.
24. R.K. Crump, V.J. Hotz, G.W. Imbens, and O.A. Mitnik Dealing with limited overlap in estimation of average treatment effects Biometrika 96 2009 187 199
25. R.H. Dehejia Practical propensity score estimation: a reply to Smith and Todd Journal of Econometrics 125 2005 355 364
26. R.H. Dehejia, and S. Wahba Causal effects in non-experimental studies: reevaluating the evaluation of training programmes SAT Journal of the American Statistical Association 94 1999 1053 1062
27. R.H. Dehejia, and S. Wahba Propensity score-matching methods for nonexperimental causal studies Review of Economics and Statistics 84 2002 151 161
28. A. Diamond, and J.S. Sekhon Genetic matching for estimating causal effects: a general multivariate matching method for achieving balance in observational studies Mimeo 2008
29. J. DiNardo, N.M. Fortin, and T. Lemieux Labor market institutions and the distribution of wages, 1973-1992: a semiparametric approach Econometrica 64 1996 1001 1044
30. C. Drake Effects of misspecification of the propensity score on estimators of treatment effect Biometrics 49 1993 1231 1236
31. J. Fan Design-adaptive nonparametric regression SAT Journal of the American Statistical Association 87 1992 998 1004
32. C.A. Flores, and O.A. Mitnik Evaluating nonexperimental estimators for multiple treatments: evidence from experimental data Mimeo 2009
33. M. Frölich Finite-sample properties of propensity-score matching and weighting estimators Review of Economics and Statistics 86 2004 77 90
34. M. Frölich Matching estimators and optimal bandwidth choice Statistics and Computing 15 2005 197 215
35. M. Frölich Nonparametric IV estimation of local average treatment effects with covariates Journal of Econometrics 139 2007 35 75
36. M. Frölich Nonparametric regression for binary dependent variables Econometrics Journal 9 2007 511 540
37. J. Galdo, J. Smith, and D. Black Bandwidth selection and the estimation of treatment effects with unbalanced data Annales d'Économie et de Statistique 91-92 2008 189 216
38. M. Gerfin, and M. Lechner Microeconometric evaluation of the active labour market policy in Switzerland The Economic Journal 112 2002 854 893
39. A.N. Glynn, and K.M. Quinn An introduction to the augmented inverse propensity weighted estimator Political Analysis 18 2010 36 56 10.1093/pan/mpp036
40. Graham, B.S.; Pinto, C.; Egel, D.; 2011. Efficient Estimation of Data Combination Models by the Method of Auxiliary-to-Study Tilting (AST), NBER Working Paper No. 16928.
41. B.S. Graham, C. Pinto, and D. Egel Inverse probability tilting for moment condition models with missing data Review of Economic Studies 79 3 2012 1053 1079
42. J. Hahn On the role of the propensity score in efficient semiparametric estimation of average treatment effects Econometrica 66 1998 315 331
43. L.P. Hansen Large sample properties of generalized methods of moments estimators Econometrica 50 1982 1029 1055
44. B. Hansen Full matching in an observational study of coaching for the sat SAT Journal of the American Statistical Association 99 467 2004 609 618
45. P. Hall, J. Racine, and Q. Li Cross-validation and the estimation of conditional probability densities SAT Journal of the American Statistical Association 99 2004 1015 1026
46. J.J. Heckman The common structure of statistical models of truncation, sample selection and limited dependent variables and a simple estimator for such models Annals of Economic and Social Measurement 5 1976 475 492
47. J.J. Heckman, H. Ichimura, and P. Todd Matching as an econometric evaluation estimator Review of Economic Studies 65 1998 261 294
48. J.J. Heckman, H. Ichimura, J. Smith, and P. Todd Characterizing selection bias using experimental data Econometrica 66 1998 1017 1098
49. Heckman, J.J.; LaLonde, R.; Smith, J.A.; 1999. The economics and econometrics of active labor market programs, in: O. Ashenfelter, D. Card (Eds.), Handbook of Labour Economics, vol. 3, Amsterdam, North-Holland, pp. 1865-2097.
50. Hill, J.B.; Renault, E.; 2010. generalized method of moments with tail trimming, mimeo, Dept. of Economics, University of North Carolina - Chapel Hill.
51. K. Hirano, and G.W. Imbens Estimation of causal effects using propensity score weighting: an application of data on right ear catheterization Health Services and Outcomes Research Methodology 2 2001 259 278
52. K. Hirano, G.W. Imbens, and G. Ridder Efficient estimation of average treatment effects using the estimated propensity score Econometrica 2003 2003 1161 1189
53. D. Ho, K. Imai, G. King, and E. Stuart Matching as nonparametric preprocessing for reducing model dependence in parametric causal inference Political Analysis 15 2007 199 236
54. D. Horvitz, and D. Thompson A generalization of sampling without replacement from a finite population SAT Journal of the American Statistical Association 47 1952 663 685
55. P.J. Huber, and E.M. Ronchetti Robust Statistics second ed. 2009 Wiley Hoboken
56. M. Huber Testing for covariate balance using quantile regression and resampling methods Journal of Applied Statistics 38 2011 2881 2899
57. M. Huber, M. Lechner, and C. Wunsch Does leaving welfare improve health? evidence for Germany Health Economics 20 2011 484 504
58. R. Hujer, and S. Thomsen How do employment effects of job creation schemes differ with respect to the foregoing unemployment duration? Labour Economics 17 2010 38 51
59. R. Hujer, M. Caliendo, and S. Thomsen New evidence on the effects of job creation schemes in Germany - a matching approach with threefold heterogeneity Research in Economics 58 2004 257 302
60. R. Hujer, S. Thomsen, and C. Zeiss The effects of vocational training programmes on the duration of unemployment in eastern Germany AStA Advances in Statistical Analysis 90 2 2006 299 322
61. G.W. Imbens Nonparametric estimation of average treatment effects under exogeneity: a review Review of Economics and Statistics 86 2004 4 29
62. G.W. Imbens, and J.M. Wooldridge Recent developments in the econometrics of program evaluation Journal of Economic Literature 47 2009 5 86
63. Imbens, G.W.; Newey, W.; Ridder, G.; 2006. Mean-squared-error calculations for average treatment effects, IRP discussion paper.
64. Jacob, B.A.; Ludwig, J.; Smith, J.; 2009, Estimating neighborhood effects on low-income youth, mimeo.
65. Kahn, S.; Tamer, E.; 2009. irregular identification, support conditions, and inverse weight estimation, mimeo.
66. J.D. Kang, and J.L. Schafer Demystifying double robustness: a comparison of alternative strategies for estimating a population mean from incomplete data Statistical Science 22 2007 523 539
67. King, Gary, Nielsen, R.; Coberley, C.; Pope, J.E.; Wells, Aaron, 2011. Comparative effectiveness of matching methods for causal inference, mimeo, Harvard University.
68. A. Khwaja, G.P.M. Salm, and J.G. Trogdon A comparison of treatment effects estimators using a structural model of AMI treatment choices and severity of illness information from hospital charts Journal of Applied Econometrics 2010 10.1002/Jae.1181 published online
69. Patrick Kline Oaxaca-Blinder as a reweighting estimator American Economic Review: Papers & Proceedings 101 3 2011 532 537
70. R. LaLonde Evaluating the econometric evaluations of training programs with experimental data American Economic Review 76 1986 604 620
71. M. Lechner Earnings and employment effects of continuous off-the-job training in east Germany after unification Journal of Business & Economic Statistics 17 1999 74 90
72. M. Lechner An evaluation of public sector sponsored continuous vocational training programs in east Germany The Journal of Human Resources 35 2000 347 375
73. M. Lechner A note on the common support problem in applied evaluation studies Annales d'Économie et de Statistique 91-92 2008 217 234
74. M. Lechner Long-run labour market and health effects of individual sports activities The Journal of Health Economics 28 2009 839 854
75. Lechner, M.; 2010. The estimation of causal effects by difference-in-difference methods, Discussion paper, Economics Department, University of St. Gallen.
76. M. Lechner, and C. Wunsch Active labour market policy in east Germany: waiting for the economy to take off Economics of Transition 17 2009 661 702
77. M. Lechner, and C. Wunsch Are training programs more effective when unemployment is high? Journal of Labor Economics 27 2009 653 692
78. M. Lechner, R. Miquel, and C. Wunsch Long-run effects of public sector sponsored training in west Germany Journal of the European Economic Association 9 2011 742 784
79. Lee, S.; Whang, Y.-J.; 2009. Nonparametric tests of conditional treatment effects, Cowles Foundation Discussion Paper 1740.
80. J. Lunceford, and M. Davidian Stratification and weighting via the propensity score in estimation of causal treatment effects Statistics in Medicine 23 2004 2937 2960
81. D.L. Millimet, and R. Tchernis On the specification of propensity scores, with applications to the analysis of trade policies Journal of Business & Economic Statistics 27 2009 297 315
82. W.K. Newey A method of moments interpretation of sequential estimators Economics Letters 14 1984 201 206
83. M. Plesca, and J. Smith Evaluating multi-treatment programs: theory and evidence from the U.S. job training partnership act Empirical Economics 32 2007 491 528
84. J.M. Robins, A. Rotnitzky, and L.P. Zhao Estimation of regression coefficients when some regressors are not always observed SAT Journal of the American Statistical Association 89 1994 846 866
85. J.M. Robins, and A. Rotnitzky Semiparametric efficiency in multivariate regression models with missing data SAT Journal of the American Statistical Association 90 1995 122 129
86. J.M. Robins, S.D. Mark, and W.K. Newey Estimating exposure effects by modelling the expectation of exposure conditional on confounders Biometrics 48 1992 479 495
87. P.R. Rosenbaum, and D.B. Rubin The central role of the propensity score in observational studies for causal effects Biometrika 70 1983 41 55
88. P.R. Rosenbaum, and D.B. Rubin Constructing a control group using multivariate matched sampling methods that incorporate the propensity score The American Statistician 39 1985 33 38
89. D.B. Rubin Estimating causal effects of treatments in randomized and nonrandomized studies Journal of Educational Psychology 66 1974 688 701
90. D.B. Rubin Using multivariate matched sampling and regression adjustment to control bias in observational studies SAT Journal of the American Statistical Association 74 1979 318 328
91. D.O. Scharfstein, A. Rotnitzky, and J.M. Robins Adjusting for nonignorable drop-out using semiparametric nonresponse models SAT Journal of the American Statistical Association 94 1999 1096 1120
92. B. Seifert, and T. Gasser Finite-sample variance of local polynomials: analysis and solutions SAT Journal of the American Statistical Association 91 1996 267 275
93. B. Seifert, and T. Gasser Data adaptive ridging in local polynomial regression Journal of Computational and Graphical Statistics 9 2000 338 360
94. B.W. Silverman Density Estimation for Statistics and Data Analysis 1986 Chapman and Hall London
95. J. Smith, and P. Todd Does matching overcome lalonde's critique of nonexperimental estimators? Journal of Econometrics 125 2005 305 353
96. S.M. Stigler Do robust estimators work with real data Annals of Statistics 5 1977 1055 1098
97. J.M. Wooldridge Inverse probability weighted estimation for general missing data problems Journal of Econometrics 141 2007 1281 1301
98. C. Wunsch, and M. Lechner What did all the money do? on the general ineffectiveness of recent west German labour market programmes Kyklos 61 2008 134 174
99. Z. Zhao Using matching to estimate treatment effects: data requirements, matching metric and a monte carlo study The Review of Economics and Statistics 86 2004 91 107
100. Zhao, Z.; 2006. Matching estimators and the data from the national supported work demonstration again, IZA Discussion Paper No. 2375.
101. Z. Zhao Sensitivity of propensity score methods to the specifications Economics Letters 98 2008 309 319