Site selection bias in program evaluation

Quarterly Journal of Economics

Volumn 130, Issue 3, 2015, Pages 1117-1165

  Allcott, Hunt ^a  

^a NEW YORK UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ENERGY CONSERVATION; ENERGY EFFICIENCY; HOUSEHOLD ENERGY; SITE SELECTION;

UNITED STATES;

EID: 84939491193     PISSN: 00335533     EISSN: 15314650     Source Type: Journal    
DOI: 10.1093/qje/qjv015     Document Type: Article

References (50)

1. Allcott, Hunt, ''Social Norms and Energy Conservation,'' Journal of Public Economics, 95 (2011), 1082-1095.
2. Allcott, Hunt, and Todd Rogers, ''The Short-Run and Long-Run Effects of Behavioral Interventions: Experimental Evidence from Energy Conservation,'' American Economic Review, 104 (2014), 3003-3037.
3. Altonji, Joseph, Todd Elder, and Christopher Taber, ''Selection on Observed and Unobserved Variables: Assessing the Effectiveness of Catholic Schools,'' Journal of Political Economy, 113 (2005), 151-184.
4. Angrist, Joshua, and Guido Imbens, ''Identification and Estimation of Local Average Treatment Effects,'' Econometrica, 62 (1994), 467-475.
5. Angrist, Joshua, and Jorn-Steffen Pischke, ''The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics,'' Journal of Economic Perspectives, 24 (2010), 3-30.
6. Ayres, Ian, Sophie Raseman, and Alice Shih, ''Evidence from Two Large Field Experiments that Peer Comparison Feedback Can Reduce Residential Energy Usage,'' Journal of Law, Economics, and Organization, 29 (2013), 992-1022.
7. Banerjee, Abhijit, Dean Karlan, and Jonathan Zinman, ''Six Randomized Evaluations of Microcredit: Introduction and Further Steps,'' American Economic Journal: Applied Economics, 7 (2015), 1-21.
8. Bold, Tessa, Mwangi Kimenyi, Germano Mwabu, Alice Ng'ang'a, and Justin Sandefur, ''Scaling Up What Works: Experimental Evidence on External Validity in Kenyan Education,'' Mimeo, Goethe University Frankfurt, 2013.
9. Chandra, Amitabh, and Douglas Staiger, ''Productivity Spillovers in Health Care: Evidence from the Treatment of Heart Attacks,'' Journal of Political Economy, 115 (2007), 103-140.
10. Costa, Dora, and Matthew Kahn, ''Energy Conservation 'Nudges' and Environmentalist Ideology: Evidence from a Randomized Residential Electricity Field Experiment,'' Journal of the European Economic Association, 11 (2013), 680-702.
11. Crepon, Bruno, Esther Duflo, Marc Gurgand, Roland Rathelot, and Philippe Zamora, ''Do Labor Market Policies Have Displacement Effects? Evidence from a Clustered Randomized Experiment,'' Quarterly Journal of Economics, 128 (2013), 531-580.
12. Crump, Richard, Joseph Hotz, Guido Imbens, and Oscar Mitnik, ''Nonparametric Tests for Treatment Effect Heterogeneity,'' Review of Economics and Statistics, 90 (2008), 389-405.
13. Dehejia, Rajeev, ''Was There a Riverside Miracle? A Hierarchical Framework for Evaluating Programs with Grouped Data,'' Journal of Business and Economic Statistics, 21 (2003), 1-11.
14. Dehejia, Rajeev, and Sadek Wahba, ''Causal Effects in Non-Experimental Studies: Re-Evaluating the Evaluation of Training Programs,'' Journal of the American Statistical Association, 94 (1999), 1053-1062.
15. Dinardo, John, Justin McCrary, and Lisa Sanbonmatsu, ''Constructive Proposals to Dealing with Attrition: An Empirical Example,'' Mimeo, University of California at Berkeley, 2006.
16. Donabedian, Avedis, ''The Quality of Care: How Can It Be Assessed?,'' Journal of the American Medical Association, 260 (1988), 1743-1748.
17. EIA (U.S. Energy Information Administration), ''Form EIA-861 Data Files,'' 2013, available at http://www.eia.gov/electricity/data/eia861/.
18. ENERNOC, ''New Jersey Energy Efficiency Market Potential Assessment,'' Technical Report, 2012, available at http://www.njcleanenergy.com/files/file/Library/NJ_Potential_Final_Report-Vol_1-Exec-Summary_2012-10-17.pdf.
19. Field, Erica, and Rohini Pande, ''Repayment Frequency and Default in Microfinance: Evidence from India,'' Journal of European Economic Association Papers and Proceedings, 6 (2008), 501-509.
20. Field, Erica, Rohini Pande, John Papp, and Natalia Rigol, ''Does the Classic Microfinance Model Discourage Entrepreneurship among the Poor? Experimental Evidence from India,'' American Economic Review, 103 (2013), 2196-2226.
21. Gine, Xavier, and Dean Karlan, ''Group versus Individual Liability: Short and Long Term Evidence from Philippine Microcredit Lending Groups,'' Journal of Development Economics, 107 (2014), 65-83.
22. Harrison, Glenn, and John List, ''Field Experiments,'' Journal of Economic Literature, 42 (2004), 1009-1055.
23. Heck, Stefan, and Humayun Tai, ''Sizing the Potential of Behavioral Energy-Efficiency Initiatives in the U.S. Residential Market,'' Technical Report, McKinsey & Company, 2013.
24. Heckman, James, ''Randomization and Social Policy Evaluation,'' in Evaluating Welfare and Training Programs, Charles Manski, and Irwin Garfinkel, eds. (Cambridge, MA: Harvard University Press, 1992).
25. Heckman, James, Hidehiko Ichimura, Jeffrey Smith, and Petra Todd, ''Characterizing Selection Bias Using Experimental Data,'' Econometrica, 66 (1998), 1017-1098.
26. Heckman, James, and Jeffrey Smith, ''The Sensitivity of Experimental Impact Estimates: Evidence from the National JTPA Study,'' NBER Working Paper 6105, 1997.
27. Heckman, James, Sergio Urzua, and Edward Vytlacil, ''Understanding Instrumental Variables in Models with Essential Heterogeneity,'' Review of Economics and Statistics, 88 (2006), 389-432.
28. Heckman, James, and Edward Vytlacil, ''Policy-Relevant Treatment Effects,'' American Economic Review, 91 (2001), 107-111.
29. Heckman, James, and Edward Vytlacil, ''Structural Equations, Treatment Effects, and Econometric Policy Evaluation,'' Econometrica, 73 (2005), 669-738.
30. Hellerstein, Judith, and Guido Imbens, ''Imposing Moment Restrictions from Auxiliary Data by Weighting,'' Review of Economics and Statistics, 81 (1999), 1-14.
31. Hotz, Joseph, ''Designing Experimental Evaluations of Social Programs: The Case of the U.S. National JTPA Study,'' University of Chicago Harris School of Public Policy Working Paper 9203, 1992.
32. Hotz, Joseph, Guido Imbens, and Jacob Klerman, ''Evaluating the Differential Effects of Alternative Welfare-to-Work Training Components: A Reanalysis of the California GAIN Program,'' Journal of Labor Economics, 24 (2006), 521-566.
33. Hotz, Joseph, Guido Imbens, and Julie Mortimer, ''Predicting the Efficacy of Future Training Programs Using Past Experiences at Other Locations,'' Journal of Econometrics, 125 (2005), 241-270.
34. Imbens, Guido, and Donald Rubin, Causal Inference in Statistics and the Social Sciences (Cambridge: Cambridge University Press, 2014).
35. JD Power, ''Electric Utility Residential Customer Satisfaction Study,'' Technical Report, 2014, available at http://www.jdpower.com/press-releases/2014-electric-utility-residential-customer-satisfaction-study.
36. Jones, Michael, ''Indicator and Stratification Methods for Missing Explanatory Variables in Multiple Linear Regression,'' Journal of the American Statistical Association, 91 (1996), 222-230.
37. Keim, Brandon, ''The Hot New Frontier of Energy Research Is Human Behavior,'' Wired, June 9, 2014, available at http://www.wired.com/2014/06/energy-andhuman-behavior/.
38. Kling, Jeffrey, Jeffrey Liebman, and Lawrence Katz, ''Experimental Analysis of Neighborhood Effects,'' Econometrica, 1 (2007), 83-119.
39. LaLonde, Robert, ''Evaluating the Econometric Evaluations of Training Programs with Experimental Data,'' American Economic Review, 76 (1986), 604-620.
40. Leip, David, ''Dave Leip's Atlas of U.S. Presidential Elections,'' 2013, available at http://uselectionatlas.org/.
41. Manning, Willard, Joseph Newhouse, Naihua Duan, Emmett Keeler, Bernadette Benjamin, Arleen Leibowitz, Susan Marquis, and Jack Zwanziger Health Insurance and the Demand for Medical Care (Santa Monica: RAND, 1988).
42. Nolan, Jessica, Wesley Schultz, Robert Cialdini, Noah Goldstein, and Vladas Griskevicius, ''Normative Influence Is Underdetected,'' Personality and Social Psychology Bulletin, 34 (2008), 913-923.
43. Pew Center, ''Energy Efficiency Standards and Targets,'' available at http://www. c2es.org/us-states-regions/policy-maps/energy-efficiency-standards (accessed May 2011).
44. Pritchett, Lant, ''It Pays to Be Ignorant: A Simple Political Economy of Rigorous Program Evaluation,'' Mimeo, Kennedy School of Government, 2002.
45. Quackenbush, John, ''Readying Michigan to Make Good Energy Decisions: Energy Efficiency,'' Technical Report, Michigan Public Service Commission, 2013.
46. Rubin, Donald, ''Estimating Causal Effects of Treatments in Randomized and Non-Randomized Studies,'' Journal of Educational Psychology, 66 (1974), 688-701.
47. Rubin, Donald, Multiple Imputation for Nonresponse in Surveys (New York: Wiley, 1987).
48. Schultz, Wesley, Jessica Nolan, Robert Cialdini, Noah Goldstein, and Vladas Griskevicius, ''The Constructive, Destructive, and Reconstructive Power of Social Norms,'' Psychological Science, 18 (2007), 429-434.
49. Smith, Jeffrey, and Petra Todd, ''Does Matching Address LaLonde's Critique of Nonexperimental Estimators?,'' Journal of Econometrics, 125 (2004), 305-353.
50. Wennberg, David, F.L. Lucas, John Birkmeyer, Carl Bredenberg, and Elliott Fisher, ''Variation in Carotid Endarterectomy Mortality in the Medicare Population,'' Journal of the American Medical Association, 279 (1998), 1278-1281.