Extending the reach of randomized social experiments: New directions in evaluations of American welfare-to-work and employment initiatives

Journal of the Royal Statistical Society. Series A: Statistics in Society

Volumn 165, Issue 1, 2002, Pages 13-30

  Riccio, James A ^a   Bloom, Howard S ^a  

^a Manpower Demonstration Res Corp   (United States)

Author keywords

Evaluation research; Non experimental methods; Randomized experiments

Indexed keywords

EID: 0036425108     PISSN: 09641998     EISSN: None     Source Type: Journal    
DOI: 10.1111/1467-985X.0asp4     Document Type: Article

References (44)

1. Angrist, J.D., Imbens, G.W. and Rubin, D.B. (1996) Identification of causal effects using instrumental variables. J. Am. Statist. Ass., 91, 444-472.
2. Betsey, C, Hollister, R. and Papageorgiou, M. (1985) Youth Employment and Training Programs: the YEDPA Years. Washington DC: National Academy Press.
3. Bloom, H.S. (1984) Accounting for no-shows in experimental evaluation designs. Evaln Rev., 8, 225-246.
4. _(1996) Building a Convincing Test of a Public Housing Employment Program: Planning for the Jobs-Plus Demonstration. New York: Manpower Demonstration Research Corporation.
5. _(2001) Measuring the Impacts of Whole School Reforms: Methodological Lessons from an Evaluation of Accelerated Schools. New York: Manpower Demonstration Research Corporation.
6. Bloom, H.S., Bos, J.M. and Lee, S.W. (1999) Using cluster random assignment to measure program impacts: statistical implications for the evaluation of education programs. Evaln Rev., 23, 445-469.
7. Bloom, H.S., Hill, C.J. and Riccio, J.A. (2001) Modeling the Performance of Welfare-to-work Programs: the Effects of Program Management and Services, Economic Environment, and Client Characteristics. New York: Manpower Demonstration Research Corporation.
8. Boruch, R.F. (1997) Randomized Experiments for Planning and Evaluation: a Practical Guide, vol. 44. Thousand Oaks: Sage.
9. Boruch, R.F. and Foley, E. (1999) The honestly experimental society: sites and other entities as the units of allocation and analysis in randomized experiments. Report. Center for Research and Evaluation in Social Policy, University of Pennsylvania, Philadelphia.
10. Bos, J.M. and Granger, R.C. (1999) Estimating Effects of Day Care Use on Child Outcomes: Evidence from the New Chance Demonstration. New York: Manpower Demonstration Research Corporation.
11. Boudett, K.P. and Friedlander, D. (1997) Does mandatory basic education improve achievement test scores of AFDC recipients: a reanalysis of data from California's GAIN Program. Evaln Rev., 21, 568-588.
12. Bound, J., Jaeger, D. and Baker, E. (1995) Problems with instrumental variables estimation when the correlation between the instruments and the endogenous explanatory variable is weak. J. Am. Statist. Ass., 90, 443-450.
13. Brock, T. and Harknett, K. (1998) A comparison of two welfare-to-work case management models. Socl Serv. Rev., 74, 494-520.
14. Bryk, A. and Raudenbush, S. (1992) Hierarchical Linear Models: Applications and Data Analysis Methods. Newbury Park: Sage.
15. Campbell, D.T. and Stanley J.C. (1996) Experimental Designs for Research. Chicago: Rand McNally.
16. Card, D. (1995) Using geographic variation in college proximity to estimate the return to schooling. In Aspects of Labour Market Behavior: Essays in Honour of John Vanderkamp (eds L.N. Christofides, E.I. Grant and R. Swidinsky). Toronto: University of Toronto Press.
17. Chen, H. and Rossi, P.H. (1983) Evaluating with sense: the theory-driven approach. Evaln Rev., 7, 283-302.
18. Cook,T.D. and Campbell,D.T. (1979) Quasi-experimental Design and Analysis Issues for Field Settings. Chicago: Rand McNally.
19. Freedman,S., Friedlander,D., Lin,W. and Schweder,A. (1996) The GAIN evaluation: five-year impacts on employment, earnings, and AFDC receipt. Report. Manpower Demonstration Research Corporation, New York.
20. Friedlander,D. and Burtless,G. (1995) Five Years After: the Long-term Effects of Welfare-to-work Programs. New York: Russell Sage Foundation.
21. Friedlander,D., Greenberg,D. and Robins,P.K. (1997) Evaluating government training programs for the economically disadvantaged.J. Econ. Lit., 35, 1809-1855.
22. Fulbright-Anderson,K., Kubisch,A.C. and Connell,J.P. (1998) New Approaches to Evaluating Community Initiatives, vol. 2, Theory, Measurement and Analysis. Washington DC: Aspen Institute.
23. Greenberg,D. and Shroder,M. (1997) Digest of Social Experiments, 2nd edn. Washington DC: Urban Institute Press.
24. Greene,W.H. (1997) Instrumental variables estimation. In Econometric Analysis, 3rd edn, pp. 288-297. Upper Saddle River: Prentice Hall.
25. Gueron,J.M. (1999) The Politics of Random Assignment: Implementing Studies and Impacting Policy. New York: Manpower Demonstration Research Corporation.
26. Gueron,J.M. and Pauly,E. (1991) From Welfare to Work. New York: Russell Sage Foundation.
27. Hamilton,G., Brock,T., Farrell,M., Friedlander,D. and Harknett,K. (1997) National Evaluation of Welfare-to-work Strategies: Evaluating Two Welfare-to-work Program Approaches: Two-year Findings on the Labor Force Attachment and Human Capital Development Programs in Three Sites. Washington DC: US Department of Health and Human Services and US Department of Education.
28. Hollister, R.G. and Hill, J. (1995) Problems in the evaluation of community-wide initiatives. In New Approaches to Evaluating Community Initiatives: Concepts, Methods, and Contexts (eds J.P. Connell, A.C. Kubisch, L.B. Schorr and C.H. Weiss). Washington DC: Aspen Institute.
29. Kemple, J., Friedlander, D. and Fellerath, V. (1995) Florida's Project Independence: Benefits, Costs, and Two-year Impacts of Florida's JOBS Program. New York: Manpower Demonstration Research Corporation.
30. Kornfeld, R. and Bloom, H.S. (1999) Measuring program impacts on earnings and employment: do unemployment insurance wage reports from employers agree with surveys of individuals?J. Lab. Econ., 17, 168-197.
31. Ludwig, J., Duncan, G.J. and Hirschfield, P. (1998) Urban Poverty and Juvenile Crime: Evidence from a Housing Mobility Experiment. Washington DC: Georgetown Public Policy Institute.
32. Miller, C., Knox, V., Gennetian, L.A., DoDoo, M., Hunter, J. and Redcross, C. (2000) Reforming Welfare and Rewarding Work: Final Report on the Minnesota Family Investment Program, vol. 1, Effects on Adults. New York: Manpower Demonstration Research Corporation.
33. Morris, P.A. and Gennetian, L.A. (1999) Identifying causal effects of poverty on children's development: integrating an instrumental variables analytic method with an experimental design. Report. Manpower Demonstration Research Corporation, New York.
34. Murray, D.M., Hannan, P.J., Jacobs, D.R., McGovern, P.J., Schmid, L., Baker, W.L. and Gray, C. (1994) Assessing intervention effects in the Minnesota Heart Health Program. Am. J. Epidem., 139, 91-103.
35. Plewis, I. (2002) Modelling impact heterogeneity. J. R. Statist. Soc. A, 165, 31-38.
36. Raudenbush, S.W. (1997) Statistical analysis and optimal design in cluster randomized trials. Psychol. Meth., 2, 173-185.
37. Riccio, J.A. (1999) Mobilizing Public Housing Communities for Work: Origins and Early Accomplishments of the Jobs-Plus Demonstration. New York: Manpower Demonstration Research Corporation.
38. Riccio, J.A., Bloom, H.S. and Hill, C.J. (2000) Management, organizational characteristics, and performance: the case of welfare-to-work programs. In Governance and Performance: Models, Methods, and Results (eds L.E. Lynn, Jr, and C. Heinrich). Georgetown: Georgetown University Press.
39. Riccio, J.A., Friedlander, D. and Freedman, S. (1994) GAIN: Benefits, Costs, and Three-year Impacts of a Welfare-to-work Program. New York: Manpower Demonstration Research Corporation.
40. Riccio, J.A. and Hasenfeld, Y. (1996) Enforcing a participation mandate in a welfare-to-work program. Socl Serv. Rev., 70, 516-542.
41. Riccio, J.A. and Orenstein, A. (1996) Understanding best practices for operating welfare-to-work programs. Evaln Rev., 20, 3-28.
42. Rossi, P.H. (1999) Evaluating community development programs: problems and prospects. In Urban Problems Community Development (eds R.F. Ferguson and W.T. Dickens). Washington DC: Brookings Institution Press.
43. Shadish, W.R., Cook, T.D and Campbell, D.T. (2001) Experimental and Quasi-experimental Designs for Generalized Causal Inference. Boston: Houghton-Mifflin.
44. Weiss, C.H. (1995) Nothing as practical as good theory: exploring theory-based evaluation for comprehensive community initiatives for children and families. In New Approaches to Evaluating Community Initiatives: Concepts, Methods, and Contexts (eds J. Connell, A.C. Kubisch, L.B. Schorr and C.H. Weiss). Washington DC: Aspen Institute.