Using performance standards to evaluate social programs with incomplete outcome data: General issues and application to a higher education block grant program

Evaluation Review

Volumn 26, Issue 4, 2002, Pages 355-381

  Manski, Charles F ^a   Newman, John ^b   Pepper, John V ^c  

^a NORTHWESTERN UNIVERSITY   (United States)

^b WORLD BANK   (United States)

^c UNIVERSITY OF VIRGINIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; EDUCATION; EVALUATION; FINANCIAL MANAGEMENT; HEALTH CARE QUALITY; HUMAN; INFORMATION PROCESSING; SOCIAL WORK; STANDARD; TREATMENT OUTCOME; UNITED STATES;

DATA COLLECTION; FINANCING, GOVERNMENT; HUMANS; OUTCOME AND PROCESS ASSESSMENT (HEALTH CARE); PROGRAM EVALUATION; QUALITY INDICATORS, HEALTH CARE; SOCIAL WORK; TRAINING SUPPORT; UNITED STATES;

EID: 0036675771     PISSN: 0193841X     EISSN: None     Source Type: Journal    
DOI: 10.1177/0193841X02026004001     Document Type: Article

References (35)

1. Balke, A., and J. Pearl. 1997. Bounds on treatment effects from studies with imperfect compliance. Journal of the American Statistical Association 92:1171-77.
2. Berger, J. 1985. Statistical decision theory and Bayesian analysis. New York: Springer-Verlag.
3. Björklund, A., and R. Moffitt. 1987. Estimation of wage gains and welfare gains in self-selection models. Review of Economics and Statistics 69:42-49.
4. Cave, M., and S. Hanney. 1992. Performance indicators. In The encyclopedia of higher education, vol. 2, edited by B. Clark and G. Neave, 1411-23. Oxford: Pergamon.
5. Cornfield, J., W. Haenszel, E. Hammond, A. Lilienfeld, M. Shimken, and E. Wynder. 1959. Smoking and lung cancer: Recent evidence and a discussion of some questions. Journal of the National Cancer Institute 22:173-203.
6. Friedlander, D., D. H. Greenberg, and P. K. Robins. 1997. Evaluating government training programs for the economically disadvantaged. Journal of Economic Literature 25 (4): 1809-55.
7. Heckman, J., and B. Honore. 1990. The empirical content of the Roy Model. Econometrica 58:1121-49.
8. Heckman, J., and J. Hotz. 1989. Choosing among alternative nonexperimental methods for estimating the impact of social programs: The case of manpower training. Journal of the American Statistical Association 84:862-74.
9. Heckman, J., and R. Robb. 1985. Alternative methods for evaluating the impact of interventions. In Longitudinal analysis of labor market data, edited by J. Heckman and B. Singer. Cambridge, UK: Cambridge University Press.
10. Heckman, J., J. Smith, and N. Clements. 1997. Making the most out of programme evaluations and social experiments: Accounting for heterogeneity in programme impacts. Review of Economic Studies 64:487-536.
11. Hotz, V. J., C. Mullins, and S. Sanders. 1997. Bounding causal effects using data from contaminated natural experiment: Analyzing the effects of teenage childbearing. Review of Economic Studies 64:575-604.
12. Keynes, J. 1921. A treatise on probability. London: Macmillan.
13. Knight, F. 1921. Risk, uncertainty and profit. Boston: Houghton-Mifflin.
14. Lazear, E. P. 1995. Personnel economics. Cambridge, MA: MIT Press.
15. Maddala, G. S. 1983. Limited-dependent and qualitative variables in econometrics. Cambridge, UK: Cambridge University Press.
16. Manski, C. 1988. Analog estimation methods in econometrics. London: Chapman & Hall.
17. _. 1989. Anatomy of the selection problem. Journal of Human Resources 24:343-60.
18. _. 1990. Nonparametric bounds on treatment effects. American Economic Review Papers and Proceedings 80:319-23.
19. _. 1994. The selection problem. In Advances in econometrics, edited by C. Sims. Cambridge, UK: Cambridge University Press.
20. _. 1995. Identification problems in the social sciences. Cambridge, MA: Harvard University Press.
21. _. 1997a. The mixing problem in program evaluation. Review of Economic Studies 64: 537-53.
22. _. 1997b. Monotone treatment response. Econometrica 65:1311-34.
23. _. 2000. Identification problems and decisions under ambiguity: Empirical analysis of treatment response and normative analysis of treatment choice. Journal of Econometrics 95:415-42.
24. Manski, C., and D. Nagin. 1998. Bounding disagreements about treatment effects: A case study of sentencing and recidivism. Sociological Methodology 28:99-137.
25. Manski, C., and J. Pepper. 2000. Monotone instrumental variables with an application to the returns to schooling. Econometrica 68:997-1010.
26. Pepper, J. 2000. The intergenerational transmission of welfare receipt: A nonparametric bounds analysis. Review of Economics and Statistics 82 (3): 472-88.
27. _. Forthcoming. Using experiments to evaluate performance standards: What do welfare-to-work demonstrations reveal to welfare reformers? Journal of Human Resources.
28. Robins. J. 1989. The analysis of randomized and non-randomized AIDS treatment trials using a new approach to causal inference in longitudinal studies. In Health service research methodology: A focus on AIDS, edited by L. Sechrest, H. Freeman, and A. Mulley, 113-59. Washington, DC: U.S. Public Health Service, National Center for Health Services Research.
29. Robins, J., and S. Greenland. 1996. Comment on Angrist, Imbens, and Rubin's "Identification of causal effects using instrumental variables." Journal of the American Statistical Association 91:456-58.
30. Rosenbaum. P. R. 1995. Observational studies (Springer Series in Statistics). New York: Springer-Verlag.
31. Rosenbaum, P. R., and D. B. Rubin. 1983. Assessing the sensitivity to an unobserved binary covariate in an observational study with a binary outcome. Journal of the Royal Statistical Society, Series B, 45:212-18.
32. Spencer, B. 1985. Optimal data quality, Journal of the American Statistical Association 80:564-73.
33. Spencer, B., and L. Moses 1990. Needed data expenditure for an ambiguous decision problem. Journal of the American Statistical Association 85:1099-104.
34. Wald, A. 1950. Statistical decision functions. New York: Wiley.
35. Walley, P. 1991. Statistical reasoning with imprecise probabilities. London: Chapman & Hall.