Characterizing selection bias using experimental data

Econometrica

Volumn 66, Issue 5, 1998, Pages 1017-1098

  Heckman, James ^a   Ichimura, Hidehiko ^a   Smith, Jeffrey ^a   Todd, Petra ^a  

^a NONE

Author keywords

Program evaluation; Selection bias; Semiparametric estimation; Training programs

Indexed keywords

EID: 0346856929     PISSN: 00129682     EISSN: None     Source Type: Journal    
DOI: 10.2307/2999630     Document Type: Article

References (71)

1. AHN, H., AND J. POWELL (1993): "Semiparametric Estimation of Censored Selection Models with a Nonparametric Selection Mechanism," Journal of Econometrics, 58, 3-29.
2. AÏT-SAHALIA, Y., P. BICKEL, AND T. STOKER (1994): "Goodness-Of-Fit Tests for Regression Using Kernel Methods," Mimeo, University of Chicago.
3. AMEMIYA, T. (1985): Advanced Econometrics. Cambridge: Harvard University Press.
4. ASHENFELTER, O. (1978): "Estimating the Effect of Training Programs on Earnings," Review of Economics and Statistics, 60, 47-57.
5. ASHENFELTER, O., AND D. CARD (1985): "Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs," Review of Economics and Statistics, 67, 648-660.
6. BARNOW, B., G. CAIN, AND A. GOLDBERGER (1980): "Issues in the Analysis of Selectivity Bias," in Evaluation Studies Review Annual, Volume 5, ed. by E. Stromsdorfer and G. Farkas. San Francisco: Sage, pp. 290-317.
7. BLOOM, H., L. ORR, G. CAVE, S. BELL, AND F. DOOLITTLE (1993): The National JTPA Study: Title IIA Impacts on Earnings and Employment at 18 Months. Bethesda, MD: Abt Associates.
8. BREIMAN, L., J. H. FRIEDMAN, R. OLSHEN, AND C. J. STONE (1984): Classification and Regression Trees. Belmont, CA: Wadsworth International Group.
9. BURTLESS, G. (1995): "The Case for Randomized Field Trials in Economic and Policy Research," Journal of Economic Perspectives, 9, 63-84.
10. CHAMBERS, J., AND T. HASTIE (1993): Statistical Models in S. Pacific Grove, CA: Wadsworth and Brooks.
11. COCHRANE, W., AND D. RUBIN (1973): "Controlling Bias in Observational Studies," Sankyha, 35, 417-446.
12. COSSLETT, S. (1991): "Semiparametric Estimation of a Regression Model with Sample Selectivity," in Nonparametric and Semiparametric Methods in Econometrics and Statistics, ed. by W. Barnett, J. Powell, and G. Tauchen. Cambridge: Cambridge University Press, pp. 175-198.
13. DAWID, A. P. (1979): "Conditional Independence in Statistical Theory," Journal of the Royal Statistical Society, Series B, 41, 1-31.
14. DEVINE, T., AND J. HECKMAN (1996): "The Structure and Consequences of Eligibility Rules for a Social Program: A Study of the Job Training Partnership Act (JTPA)," Research in Labor Economics, Volume 15, ed. by S. Polachek. Greenwich, CT: JAI Press, pp. 111-170.
15. FAN, J. (1992): "Design-adaptive Nonparametric Regression," Journal of the American Statistical Association, 87, 998-1004.
16. _ (1993): "Local Linear Regression Smoothers and Their Minimax Efficiencies," The Annals of Statistics, 21, 196-216.
17. FAN, Y., AND Q. LI (1996): "Consistent Model Specification Tests: Omitted Variable Bias and Semiparametric Functional Forms," Econometrica, 64, 865-890.
18. FECHNER, G. T. (1860): Elemente der Psychophysik. Leipzig: Breitkopf and Härtel.
19. FISHER, R. A. (1935): Design of Experiments. New York: Hafner.
20. HAAVELMO, T. (1944): "The Probability Approach in Econometrics," Econometrica, 12, 1-145.
21. HASTIE, T., AND R. TIBSHIRANI (1990): Generalized Additive Models. London: Chapman and Hall.
22. HECKMAN, J. (1979): "Sample Selection Bias as a Specification Error," Econometrica, 46, 931-961.
23. _ (1980): "Addendum To Sample Selection Bias as a Specification Error," in Evaluation Studies Review Annual, Volume 5, ed. by E. Stromsdorfer and G. Farkas. San Francisco: Sage, pp. 970-995.
24. _ (1990a): "Varieties of Selection Bias," American Economic Review, 80, 313-318.
25. _ (1990b): "Alternative Approaches to the Evaluation of Social Programs," Barcelona Lecture, World Congress of the Econometric Society.
26. _ (1992): "Randomization and Social Policy Evaluation," in Evaluating Welfare and Training Programs, ed. by C. F. Manski and I. Garfinkel. Cambridge, MA: Harvard University Press, pp. 201-230.
27. _ (1996): "Randomization as an Instrumental Variable," Review of Economics and Statistics, 73, 336-340.
28. _ (1997): "Instrumental Variables: A Study of Implicit Behavioral Assumptions in One Widely-Used Estimator," Journal of Human Resources, 32, 442-462.
29. HECKMAN, J., N. HOHMANN, M. KHOO, AND J. SMITH (1997): "Substitution and Dropout Bias in Social Experiments: A Study of an Influential Social Experiment," Mimeo, University of Chicago.
30. HECKMAN, J., AND V. J. HOTZ (1989): "Choosing Among Alternative Nonexperimental Methods for Estimating the Impact of Social Programs: The Case of Manpower Training," Journal of the American Statistical Association, 84, 862-874.
31. HECKMAN, J., H. ICHIMURA, AND P. TODD (1996; first draft 1994): "Making the Asymptotic Theory of Semiparametric Estimation Empirically Relevant," Mimeo, University of Chicago.
32. _ (1997; first draft 1993): "Matching As An Econometric Estimator: Evidence from Evaluating a Job Training Programme," Review of Economic Studies, 64, 605-654.
33. _ (1998, first draft 1993): "Matching As An Econometric Evaluation Estimator," Review of Economic Studies, 65, 261-294.
34. HECKMAN, J., M. KHOO, R. ROSELIUS, AND J. SMITH (1996): "The Empirical Importance of Randomization Bias in Social Experiments: Evidence from the National JTPA Study," Mimeo, University of Chicago.
35. HECKMAN, J., R. LALONDE, AND J. SMITH (1999): " The Economics and Econometrics of Active Labor Market Programs," in Handbook of Labor Economics, Volume III, ed. by O. Ashenfelter and D. Card. Amsterdam: North Holland.
36. HECKMAN, J., L. LOCHNER, AND C. TABER (1997): "Formulating and Estimating Dynamic General Equilibrium Models to Evaluate Policies Designed to Promote Skill Formation," Marschak Lecture, Hong Kong Meetings of the Econometric Society, July 25, 1997.
37. _ (1998): "General Equilibrium Treatment Effects: A Study of Tuition Policy," American Economic Review, 88, 381-386.
38. HECKMAN, J., AND R. ROBB, JR. (1985): "Alternative Methods for Evaluating the Impact of Interventions," in Longitudinal Analysis of Labor Market Data, ed. by J. Heckman and B. Singer. New York: Cambridge University Press, pp. 156-245.
39. _ (1986): "Alternative Methods for Solving the Problem of Selection Bias in Evaluating the Impact of Treatments on Outcomes," in Drawing Inferences from Self-Selected Samples, ed. by H. Wainer. New York: Springer-Verlag, pp. 63-107.
40. HECKMAN, J., AND P. SIEGELMAN (1993): "The Urban Institute Audit Studies: Their Methods and Findings," in Clear and Convincing Evidence: Measurement of Discrimination in America, ed. by M. Fix and R. Struyk. Washington, DC: Urban Institute Press, pp. 260-311.
41. HECKMAN, J., AND J. SMITH (1993): "Assessing the Case for Randomized Evaluation of Social Programs," in Measuring Labour Market Measures: Evaluating the Effects of Active Labour Market Policies, ed. by K. Jensen and P. K. Madsen. Copenhagen: Ministry of Labour, pp. 35-96.
42. _ (1995a): "Assessing the Case for Randomized Social Experiments," Journal of Economic Perspectives, 9, 85-110.
43. _ (1995b): "Ashenfelter's Dip and the Determinants of Participation in a Social Program: Implications for Simple Program Evaluation Strategies," mimeo, University of Chicago.
44. _ (1996)' "Experimental and Non-Experimental Evaluations," in International Handbook of Labour Market Policy and Evaluation, ed. by G. Schmid, J. O'Reilly, and K. Schömann. London: Edward Elgar, pp. 37-88.
45. _ (1998): "Evaluating the Welfare State," in Econometrics and Economic Theory in the 20th Century: The Ragnar Frisch Centennial, ed. by S. Strom. Cambridge: Cambridge University Press for Econometric Society Monograph Series.
46. HECKMAN, J., J. SMITH, AND N. CLEMENTS (1997; first draft 1993): "Making the Most Out of Program Evaluations and Social Experiments: Accounting for Heterogeneity in Program Impacts," Review of Economic Studies, 64, 421-471.
47. HECKMAN, J., J. SMITH, AND C. TABER (1996): "What Do Bureaucrats Do? The Effects of Performance Standards and Bureaucratic Preferences on Acceptance into the JTPA Program, in Reinventing Government and the Problem of Bureaucracy. Advances in the Study of Entrepreneurship, Innovation and Economic Growth, Volume 6, ed. by G. Libecap. Greenwich, CT: JAI Press, pp. 110-130.
48. _ (1998): "Accounting for Dropouts in Evaluations of Social Programs," Review of Economics and Statistics, forthcoming.
49. HECKMAN, J., AND P. TODD (1994): "Interpreting Standard Measures of Selection Bias," Mimeo, University of Chicago, Department of Economics.
50. LALONDE, R. (1986): "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, 76, 604-620.
51. LANCASTER, K. (1971): Consumer Demand: A New Approach. New York and London: Columbia University Press.
52. LEWIS, H. G. (1963): Unionism and Relative Wages. Chicago: University of Chicago Press.
53. MALINVAUD, E. B. (1970): Statistical Methods of Econometrics. Amsterdam: North-Holland.
54. MARSCHAK, J. (1953): "Economic Measurements for Policy and Prediction," in Studies in Econometric Method, ed. by W. Hood and T. J. Koopmans. New York: Wiley, pp. 1-26.
55. MOFFITT, R. (1992): "Evaluation Methods for Program Entry Effects," in Evaluating Welfare and Training Programs, ed. by C. Manski and I. Garfinkel. Cambridge: Harvard University Press, pp. 231-252.
56. ORR, L., H. BLOOM, S. BELL, W. LIN, G. CAVE, AND F. DOOLITTLE (1995): The National JTPA Study: Impacts, Benefits and Costs of Title II-A. Bethesda, MD: Abt Associates.
57. QUANDT, R. (1972): "A New Approach to Estimating Switching Regressions," Journal of the American Statistical Association, 67, 306-310.
58. RAO, C. R. (1965): "On Discrete Distributions Arising Out of Methods of Ascertainment," in Classical and Contagious Discrete Distributions, ed. by G. P. Patil. Calcutta: Statistical Publication Society, pp. 320-333.
59. _ (1986): "Weighted Distributions," in A Celebration of Statistics, ed. by S. Feinberg. Berlin: Springer-Verlag, pp. 543-569.
60. ROBINSON, P. (1988): "Root-N-Consistent Semiparametric Regression," Econometrica, 56, 931-954.
61. ROSENBAUM, P., AND D. RUBIN (1983): "The Central Role of the Propensity Score in Observational Studies for Causal Effects," Biometrika, 70, 41-55.
62. ROSELIUS, R. (1996): "New Life for Non-Experimental Methods: Three Essays that Re-examine the Evaluation of Social Programs," Ph.D. Thesis, University of Chicago.
63. ROY, A. D. (1951): "Some Thoughts on the Distribution of Earnings," Oxford Economic Papers, 3, 135-146.
64. SILVERMAN, R. (1986): Density Estimation. London: Chapman and Hall.
65. SMITH, J. (1994): "Sampling Frame for the Eligible Non-Participant Sample," Mimeo, University of Chicago.
66. _ (1995): "A Comparison of the Earnings Patterns of Two Samples of JTPA Eligibles," Mimeo, University of Western Ontario.
67. TODD, P. (1995): "Semiparametric Least Squares Estimation of Binary Choice Models with Choice Based Samples Using Local Linear Regression," Mimeo, University of Chicago.
68. TORP, H., O. RAAUM, E. HERNAES, AND H. GOLDSTEIN (1993): "The First Norwegian Experiment," in Measuring Labour Market Measures: Evaluating the Effects of Active Labour Market Policies, ed. by K. Jensen and P. K. Madsen. Copenhagen: Ministry of Labour, pp. 97-140.
69. WAHBA, G. (1984): "Partial Spline Models for the Semiparametric Estimation of Functions of Several Variables," in Statistical Analysis of Time Series. Tokyo: Institute of Mathematical Statistics, pp. 37-95.
70. WHITE, H. (1980): "Using Least Squares to Approximate Unknown Regression Functions," International Economic Review, 21, 149-170.
71. YATCHEW, A. (1997): "An Elementary Estimator for the Partial Linear Model," Mimeo, Department of Economics, University of Toronto.