Mechanism experiments and policy evaluations

Journal of Economic Perspectives

Volumn 25, Issue 3, 2011, Pages 17-38

  Ludwig, Jens ^a   Kling, Jeffrey R ^b   Mullainathan, Sendhil ^c  

^a UNIVERSITY OF CHICAGO   (United States)

^b Macroeconomic Analysis Division   (United States)

^c HARVARD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 80051919323     PISSN: None     EISSN: 08953309     Source Type: Journal    
DOI: 10.1257/jep.25.3.17     Document Type: Conference Paper

References (72)

1. Allcott, Hunt, and Sendhil Mullainathan. 2011. "External Validity and Partner Selection Bias." Unpublished paper, Harvard University Department of Economics.
2. Angrist, Joshua D. 1990. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records." American Economic Review, 80(3): 313-35.
3. Angrist, Joshua D., and Jorn-Steffen Pischke. 2009. Mostly Harmless Econometrics. Princeton, NJ: Princeton University Press.
4. Angrist, Joshua D., and Jorn-Steffen Pischke. 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design is Taking the Con out of Econometrics." Journal of Economic Perspectives, 24(2): 3-30.
5. Banerjee, Abhijit V., and Esther Dufl o. 2009. "The Experimental Approach to Development Economics." Annual Review of Economics, vol. 1, pp. 151-78.
6. Becker, Gary S., and Kevin M. Murphy. 2003. Social Economics: Market Behavior in a Social Environment. Belknap Press of Harvard University Press.
7. Black, Jennifer L., and James Macinko. 2010. "The Changing Distribution and Determinants of Obesity in the Neighborhoods of New York City, 2003-2007." American Journal of Epidemiology, 171(7): 765-75.
8. Bloom, Howard S., James A. Riccio, and Nandita Verma. 2005. Promoting Work in Public Housing: The Effectiveness of Jobs-Plus. New York: MDRC.
9. Bloom, Howard S., Saskia Levy Thompson, and Rebecca Unterman. 2010. Transforming the High School Experience: How New York City's Small Schools Are Boosting Student Achievement and Graduation Rates. New York: MDRC.
10. Buka, Stephen L., Theresa L. Stichick, Isolde Birdthistle, and Felton J. Earls. 2001. "Youth Exposure to Violence: Prevalence, Risks, and Consequences." American Journal of Orthopsychiatry, 71(3): 298-310. (Pubitemid 32720408)
11. Clampet-Lundquist, Susan, Kathryn Edin, Jeffrey R. Kling, and Greg J. Duncan. 2011. "Moving At-Risk Youth Out of High-Risk Neighborhoods: Why Girls Fare Better Than Boys." American Journal of Sociology, 116(4): 1154-89.
12. Cohen, Jacqueline, and Jens Ludwig. 2003. "Policing Crime Guns." In Evaluating Gun Policy, ed. Jens Ludwig and Philip J. Cook, 217-50.
13. Washington, DC: Brookings Institution Press. Cole, Stephen R., and Elizabeth A. Stuart. 2010. "Generalizing Evidence from Randomized Clinical Trials to Target Populations: The ACTG 320 Trial." American Journal of Epidemiology, 172(1): 107-115.
14. Cook, Philip J., and Jens Ludwig. 2000. Gun Violence: The Real Costs. New York: Oxford University Press.
15. Cook, Thomas D., and Donald T. Campbell. 1979. Quasi-Experimentation: Design and Analysis Issues for Field Settings. Wadsworth.
16. Cutler, David M., Edward L. Glaeser, and Jesse M. Shapiro. 2003. "Why Have Americans Become More Obese?" Journal of Economic Perspectives, 17(3): 93-118. (Pubitemid 38883447)
17. Deaton, Angus. 2010. "Instruments, Randomization, and Learning about Development." Journal of Economic Literature, 48(2): 424-455.
18. DiNardo, John, and David S. Lee. 2010. "Program Evaluation and Research Designs." NBER Working Paper 16016.
19. Dufl o, Esther, and Emmanuel Saez. 2003. "The Role of Information and Social Interactions in Retirement Plan Decisions: Evidence from a Randomized Experiment." Quarterly Journal of Economics, 118(3): 815-842. (Pubitemid 37052876)
20. Feynman, Richard. 1964. "The Great Conservation Principles." A video in the Messenger Lecture Series. Quotation starts at 38:48. Available at: http://research.microsoft.com/apps/tools/tuva/index.html#data= 4|84edf183-7993-4b5b-9050-7ea34f236045.
21. Fortson, Jane G., and Lisa Sanbonmatsu. 2010. "Child Health and Neighborhood Conditions: Results from a Randomized Housing Voucher Experiment." Journal of Human Resources, 45(4): 840-864.
22. Golomb, Beatrice A., Michael H. Criqui, Halbert White, and Joel E. Dimsdale. 2004. "Conceptual Foundations of the UCSD Statin Study: A Randomized Controlled Trial Assessing the Impact of Statins on Cognition, Behavior, and Biochemistry." Archives of Internal Medicine, 164(2): 153-162. (Pubitemid 38140401)
23. Golomb, Beatrice A., Joel E. Dimsdale, Halbert L. White, Janis B. Ritchie, and Michael H. Criqui. 2008. "Reduction in Blood Pressure with Statins." Archives of Internal Medicine, 168(7): 721-727.
24. Gotto, Antonio M. 2003. "Safety and Statin Therapy: Reconsidering the Risks and Benefi ts." Archives of Internal Medicine, 163(6): 657-659.
25. Greenberg, David, and Mark Shroder. 2004. The Digest of Social Experiments, 3rd ed. Washington, DC: Urban Institute Press.
26. Gutelius, Margaret F., Arthur D. Kirsh, Sally MacDonald, Marion R. Brooks, and Toby McErlean. 1977. "Controlled Study of Child Health Supervision: Behavioral Results." Pediatrics, 60(3): 294-304. (Pubitemid 8183088)
27. Harris, Jeffrey E. 1985. "Macro-Experiments versus Micro-Experiments for Health Policy." In Social Experimentation, ed. Jerry Hausman and David Wise, 145-85. Chicago: University of Chicago Press.
28. Harris, Gardiner. 2011. "Federal Research Center Will Help to Develop Vaccines." New York Times. January 23, p. A1. Also at: http://www.nytimes.com/2011/01/23/health/policy/23drug.html.
29. Harrison, Glenn W., and John A. List. 2004. "Field Experiments." Journal of Economic Literature, 42(4): 1009-1055. (Pubitemid 40406044)
30. Hausman, Jerry A., and David A. Wise. 1985. Social Experimentation. Chicago: University of Chicago Press.
31. Heckman, James J. 1992. "Randomization and Social Policy Evaluation." In Evaluating Welfare and Training Programs, ed., Charles Manski and Irwin Garfi nkel, 201-230. Cambridge, MA: Harvard University Press.
32. Heckman, James J. 2010. "Building Bridges between Structural and Program Evaluation Approaches to Evaluating Policy." Journal of Economic Literature, 48(2): 356-98.
33. Hotz, V. Joseph, Guido W. Imbens, and Julie H. Mortimer. 2005. "Predicting the Efficacy of Future Training Programs Using Past Experiences at Other Locations." Journal of Econometrics, 125(1-2): 241-70.
34. Imbens, Guido S. 2010. "Better LATE than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)." Journal of Economic Literature, 48(2): 399-423.
35. Jacob, Brian A., and Jens Ludwig. Forthcoming. "The Effects of Housing Assistance on Labor Supply: Evidence from a Voucher Lottery." American Economic Review.
36. Jepsen, Christopher, and Steven Rivkin. 2009. "Class Size Reduction and Student Achievement: The Potential Tradeoff between Teacher Quality and Class Size." Journal of Human Resources, 44(1): 223-50.
37. Kabat-Zinn, J., A. O. Massion, J. Kristeller, L. G. Peterson, K. E. Fletcher, L. Pbert, W. R. Lenderking, and S. F. Santorelli. 1992. "Effectiveness of a Meditation-based Stress Reduction Program in the Treatment of Anxiety Disorders." American Journal of Psychiatry, 149(7): 936-43.
38. Keizer, Kees, Siegwart Lindenberg, and Linda Steg. 2008 "The Spreading of Disorder." Science, 322(5908): 1681-85.
39. Kelling, George L., and James Q. Wilson. 1982. "Broken Windows." The Atlantic Monthly, March. http://www.theatlantic.com/magazine/ archive/1982/03/broken-windows/4465/.
40. Kling, Jeffrey R. 2006. "Incarceration Length, Employment and Earnings." American Economic Review, 96(3): 863-76.
41. Kling, Jeffrey R. 2007. "Methodological Frontiers of Public Finance Field Experiments." National Tax Journal, 60(1): 109-127.
42. Kling, Jeffrey R., Jeffrey B. Liebman, and Lawrence F. Katz. 2005. "Bullets Don't Got No Name: Consequences of Fear in the Ghetto." In Discovering Successful Pathways in Children's Development: New Methods in the Study of Childhood and Family Life, ed. Thomas S. Weisner, 243-81. Chicago: University of Chicago Press.
43. Kling, Jeffrey R., Jeffrey B. Liebman, and Lawrence F. Katz. 2007. "Experimental Analysis of Neighborhood Effects." Econometrica, 75(1): 83-119.
44. Kling, Jeffrey R., Jens Ludwig, and Lawrence F. Katz. 2005. "Neighborhood Effects on Crime for Female and Male Youth: Evidence from a Randomized Housing Voucher Experiment." Quarterly Journal of Economics, 120(1): 87-130. (Pubitemid 40405994)
45. Krueger, Alan B. 1999. "Experimental Estimates of Education Production Functions." Quarterly Journal of Economics, 114(2): 497-532.
46. Lazear, Edward. 2001. "Educational Production." Quarterly Journal of Economics, 116(3): 777-803. (Pubitemid 33583975)
47. Leaf, Clifton. 2007. "Why We're Losing the War on Cancer (And How to Win It)." CNN Health, January 9. http://articles.cnn.com/2007-01-09/ health/fortune.leaf.waroncancer-1-gamma-rays-testicular-cancer-national-cancer- act?-s=PM:HEALTH.
48. Lipsey, Mark W., Nana A. Landenberger, and Sandra J. Wilson. 2007. Effects of Cognitive-Behavioral Programs for Criminal Offenders. Campbell Systematic Reviews.
49. Ludwig, Jens, Jeffrey Liebman, Jeffrey Kling, Greg J. Duncan, Lawrence F. Katz, Ronald C. Kessler, and Lisa Sanbonmatsu. 2008. "What Can We Learn about Neighborhood Effects from the Moving to Opportunity Experiment?" American Journal of Sociology, 114(1): 144-88.
50. Malani, Anup. 2006. "Identifying Placebo Effects with Data from Clinical Trials." Journal of Political Economy, 114(2): 236-56.
51. Manski, Charles F. 2000. "Economic Analysis of Social Interaction." Journal of Economic Perspectives, 14(3): 115-36.
52. Mencken, H. L. 1948 [1998]. "Stare Decisis." The New Yorker. Reprinted and abridged in the Wall Street Journal, December 24, 1998, as "A Bum's Christmas." http://www.io.com/gibbonsb/mencken/bumsxmas.html.
53. Meyer, Bruce D. 1995. "Natural and Quasi- Experiments in Economics." Journal of Business and Economic Statistics, 13(2): 151-61.
54. National Association of Community Health Centers. 2010. "Expanding Health Centers under Health Care Reform: Doubling Patient Capacity and Bringing Down Costs." June. http://www.nachc.com/client/HCR-New-Patients-Final.pdf (on the National Association of Community Health Centers website under "Research $ Data" and "Highlights")
55. Newhouse, Joseph P., and the Insurance Experiment Group. 1993. Free for All? Lessons from the RAND Health Insurance Experiment. Cambridge, MA: Harvard University Press.
56. Oreopoulos, Philip, and Kjell G. Salvanes. 2011. "Priceless: The Nonpecuniary Benefi ts of Schooling." Journal of Economic Perspectives, 25(1): 159-184.
57. Ross, Susan D., I. Elaine Allen, Janet E. Connelly, Bonnie M. Korenblat, M. Eugene Smith, Daren Bishop, and Don Lou. 1999. "Clinical Outcomes in Statin Treatment Trials: A Meta-analysis." Archives of Internal Medicine, 159(15): 1793-1802. (Pubitemid 29379144)
58. Rossi, Peter H. 1987. "The Iron Law of Evaluation and Other Metallic Rules." Research in Social Problems and Public Policy, vol. 4, pp. 3-20.
59. Sanbonmatsu, Lisa, Jeffrey R. Kling, Greg J. Duncan, and Jeanne Brooks-Gunn. 2006. "Neighborhoods and Academic Achievement: Results from the Moving to Opportunity Experiment." Journal of Human Resources, 41(4): 649-91. (Pubitemid 46128498)
60. Schanzenbach, Diane Whitmore. 2007. "What Have Researchers Learned from Project STAR?" Brookings Papers on Education Policy.
61. Sen, Bisakha, Stephen Mennemeyer, and Lisa C. Gary. 2009. "The Relationship between Neighborhood Quality and Obesity among Children." NBER Working Paper 14985.
62. Stuart, Elizabeth A., Stephan R. Cole, Catherine P. Bradshaw, and Philip J. Leaf. 2011. "The Use of Propensity Scores to Assess the Generalizability of Results from Randomized Trials. The Journal of the Royal Statistical Society, Series A, 174(2): 369-386.
63. Thavendiranathan, Paaladinesh, Akshay Bagai, M. Alan Brookhart, and Niteesh K. Choudhry. 2006. "Primary Prevention of Cardiovascular Diseases with Statin Therapy." Archives of Internal Medicine, 166(22): 2307-13.
64. Todd, Petra E., and Kenneth I. Wolpin. 2008. "Ex ante Evaluation of Social Programs." http://athena.sas.upenn.edu/~petra/papers/exantepaper. pdf. (Forthcoming in Annals of Economics and Statistics.)
65. U.S. Census Bureau. 2011. Statistical Abstract of the United States. Available at: http://www.census.gov/compendia/statab/.
66. U.S. Department of Education. 2010. "Fiscal Year 2011 Budget Summary-February 1, 2010." Section III. F. Institute of Education Sciences. http://www2.ed.gov/about/overview/budget/budget11/summary/edlite-section3f. html.
67. Wehunt, Jennifer. 2009. "The Food Desert." Chicago Magazine, July. http://www.chicagomag.com/Chicago-Magazine/July-2009/The-Food-Desert/
68. Wilson, William J. 1987. The Truly Disadvantaged: The Inner City, the Underclass, and Public Policy. Chicago: University of Chicago Press.
69. Wilson, William J. 1997. When Work Disappears: The World of the New Urban Poor. Vintage.
70. Wilt, Timothy J., Hanna E. Bloomfield, Roderick MacDonald, David Nelson, Indulis Rutks, Michael Ho, Gregory Larson, Anthony McCall, Sandra Pineros, and Anne Sales. 2004. "Effectiveness of Statin Therapy in Adults with Coronary Heart Disease." Archives of Internal Medicine, 164(13): 1427-36. (Pubitemid 38937854)
71. Wolpin, Kenneth I. 2007. "Ex Ante Policy Evaluation, Structural Estimation, and Model Selection." American Economic Review, 97(2): 48-52.
72. Zhang, Lei, Shuning Zhang, Hong Jiang, Aijun Sun, Yunkai Wang, Yunzeng Zou, Junbo Ge, and Haozhu Chen. 2010. "Effects of Statin Therapy on Infl ammatory Markers in Chronic Health Failure: A Meta-Analysis of Randomized Controlled Trials." Archives of Medical Research, 41(6): 464-71.