Advances in measuring the environmental and social impacts of environmental programs

Annual Review of Environment and Resources

Volumn 39, Issue , 2014, Pages 495-517

  Ferraro, Paul J ^a   Hanauer, Merlin M ^b  

^a GEORGIA STATE UNIVERSITY   (United States)

^b SONOMA STATE UNIVERSITY   (United States)

Author keywords

Bias; Causal; Heterogeneity; Impact evaluation; Mechanisms; Selection

Indexed keywords

ECONOMIC AND SOCIAL EFFECTS; MECHANISMS;

BIAS; CAUSAL; HETEROGENEITY; IMPACT EVALUATION; SELECTION;

ENVIRONMENTAL IMPACT;

EID: 84908028003     PISSN: 15435938     EISSN: None     Source Type: Book Series    
DOI: 10.1146/annurev-environ-101813-013230     Document Type: Review

References (81)

1. Pearl J. 2009. Causality: Models, Reasoning, and Inference. Cambridge, UK: Cambridge Univ. Press
2. Rosenbaum PR. 2002. Design of Observational Studies. New York: Springer
3. Rubin DB. 2007. The design versus the analysis of observational studies for causal effects: parallels with the design of randomized trials. Stat. Med. 26(1):20-36
4. Angrist JD, Pischke JS. 2009. Mostly Harmless Econometrics: An Empiricist's Companion. Princeton, NJ: Princeton Univ. Press
5. Morgan SL, Winship C. 2007. Counterfactuals and Causal Inference: Methods and Principles for Social Research. Cambridge, UK: Cambridge Univ. Press
6. Ferraro PJ. 2009. Counterfactual thinking and impact evaluation in environmental policy. New Dir. Eval. 122:75-84
7. Heckman JJ, Vytlacil E. 2005. Structural equations, treatment effects, and econometric policy evaluation. Econometrica 73(3):669-738
8. Millenn. Ecosyst. Assess. 2005. Ecosystems and Human Well-Being: A Framework for Assessment. Washington, DC: Island
9. Joppa LN, Pfaff A. 2009. High and far: biases in the location of protected areas. PLOS ONE 4(12):e8 2739
10. Pressey RL, Bottrill MC. 2008. Opportunism, threats, and the evolution of systematic conservation planning. Conserv. Biol. 22(5):1340-45
11. Aronow PM, Samii C. 2013. Estimating average causal effects under interference between units. arXiv:1305.6156
12. Andam KS, Ferraro PJ, Pfaff A, Sanchez-Azofeifa GA, Robalino JA. 2008. Measuring the effectiveness of protected area networks in reducing deforestation. Proc. Natl. Acad. Sci. USA 105(42):16089-89
13. Gaveau DLA, Epting J, Lyne O, Linkie M, Kumara I, et al. 2009. Evaluating whether protected areas reduce tropical deforestation in Sumatra. J. Biogeogr. 36(11):2165-75
14. Alix-Garcia JM, Shapiro EN, Sims KRE. 2012. Forest conservation and slippage: evidence from Mexico's national payments for ecosystem services program. Land Econ. 88(4):613-38
15. Ferraro PJ. 2012. Experimental project designs in the Global Environment Facility: designing projects to create evidence and catalyze investments to secure global environmental benefits. STAP Advis. Doc., Glob. Environ. Facil., Washington, DC
16. Ferraro PJ, Miranda JJ, Price MK. 2011. The persistence of treatment effects with norm-based policy instruments: evidence from a randomized environmental policy experiment. Am. Econ. Rev. Pap. Proc. 101(3):318-22
17. Allcott H. 2011. Social norms and energy conservation. J. Public Econ. 95(9):1082-95
18. Allcott H. 2011. Rethinking real-time electricity pricing. Resour. Energy Econ. 33(4):820-42
19. Wolak FA. 2011. Do residential customers respond to hourly prices? Evidence from a dynamic pricing experiment. Am. Econ. Rev. 101(3):83-87
20. Jessoe K, Rapson D. 2014. Knowledge is (less) power: experimental evidence from residential energy use. Am. Econ. Rev. 104(4):1417-38
21. Ferraro PJ, Price MK. 2013. Using nonpecuniary strategies to influence behavior: evidence from a largescale field experiment. Rev. Econ. Stat. 95(1):64-73
22. Duo E, Greenstone M, Pande R, Ryan R. 2013. Truth-telling by third-party auditors and the response of polluting firms: experimental evidence from India. Q. J. Econ. 28(4):1499-545
23. Bennear L, Tarozzi A, Pfaff A, Balasubramanya S, Ahmed M, van Geen A. 2013. Impact of a randomized controlled trial in arsenic risk communication on household water-source choices in Bangladesh. J. Environ. Econ. Man. 65(2):225-40
24. Fowlie M, Greenstone M, Wolfram C. 2014. Reducing energy consumption and greenhouse gas emissions through energy efficient retrofits: evidence from low-income households. Rep., Poverty Action Lab, Cambridge, MA. http://www.povertyactionlab.org/evaluation/reducing-energy-consumption-and-greenhouse-gas-emissions-through-energy-efficient-retrofi
25. Imbens GW. 2010. Better late than nothing: some comments on Deaton 2009 and Heckman and Urzua 2009. J. Econ. Lit. 48:399-423
26. Gerber AS, Green DP. 2012. Field Experiments: Design, Analysis, and Interpretation. New York: WW Norton
27. Ludwig J, Kling JR, Mullainathan S. 2011. Mechanism experiments and policy evaluations. J. Econ. Perspect. 25(3):17-38
28. Heckman J, Ichimura H, Todd P. 1997. Matching as an econometric evaluation estimator: evidence from evaluating a job training program. Rev. Econ. Stud. 64(4):605-54
29. Heckman J, Ichimura H, Todd P. 1998. Matching as an econometric evaluation estimator. Rev. Econ. Stud. 65(2):261-94
30. Smith J, Todd P. 2005. Does matching overcome Lalonde's critique of nonexperimental estimators? J. Econom. 125:305-53
31. Cook T, Shadish W, Wong V. 2008. Three conditions under which observational studies produce the same results as experiments. J. Policy Anal. Manag. 274:724-50
32. Ferraro PJ, Miranda JJ. 2014. The performance of non-experimental designs in the evaluation of environmental programs: a design-replication study using a large-scale randomized experiment as a benchmark. J. Econ. Behav. Organ. In press
33. Stuart EA. 2010. Matching methods for causal inference: a review and a look forward. Stat. Sci. 25(1):1
34. Imbens GW, Wooldridge JM. 2009. Recent developments in the econometrics of program evaluation. J. Econ. Lit. 47(1):5-86
35. Diamond A, Sekhon JS. 2013. Genetic matching for estimating causal effects: a general multivariate matching method for achieving balance in observational studies. Rev. Econ. Stat. 95(3):932-45
36. Hainmueller J. 2012. Entropy balancing for causal effects: a multivariate reweighting method to produce balanced samples in observational studies. Polit. Anal. 20(1):25-46
37. Andam KS, Ferraro PJ, Sims KRE, Healy A, Holland MB. 2010. Protected areas reduced poverty in Costa Rica and Thailand. Proc. Natl. Acad. Sci. USA 107(22):9996-10001
38. Lee WS. 2013. Propensity score matching and variations on the balancing test. Empir. Econ. 44(1):47-80
39. List JA, Millimet DL, Fredriksson PG, McHone WW. 2003. Effects of environmental regulations on manufacturing plant births: evidence from a propensity score matching estimator. Rev. Econ. Stat. 85(4):944-52
40. Greenstone M. 2004. Did the clean air act cause the remarkable decline in sulfur dioxide concentrations? J. Environ. Econ. Manag. 47(3):585-611
41. Blackman A, Rivera J. 2010. The evidence base for environmental and socioeconomic impacts of sustainable certification.RFF Discuss. Pap., Resour. Futur., Washington, DC. http://www.rff.org/RFF/Documents/EfD-DP-10-10.pdf
42. Mezzatesta M, Newburn DA, Woodward RT. 2013. Additionality and the adoption of farm conservation practices. Land Econ. 89(4):722-42
43. Blackman A, Naranjo A. 2012. Does eco-certification have environmental benefits? Organic coffee in Costa Rica. Ecol. Econ. 83:58-66
44. Weber JG, Sills EO, Bauch S, Pattanayak SK. 2011. Do ICDPs work? An empirical evaluation of forest-based microenterprises in the Brazilian Amazon. Land Econ. 87(4):661-81
45. Arriagada RA, Ferraro PJ, Sills EO, Pattanayak SK, Cordero-Sancho S. 2012. Do payments for environmental services affect forest cover? A farm-level evaluation from Costa Rica. Land Econ. 88(2):382-99
46. Joppa L, Pfaff A. 2012. Reassessing the forest impacts of protection: the challenge of nonrandom location and a corrective measure. Ann. N. Y. Acad. Sci. 1185:135-39
47. Honey-Roses J, Baylis K, Ramírez MI. 2011. A spatially explicit estimate of avoided forest loss. Conserv. Biol. 25(5):1032-43
48. Gaveau DLA, Curran LM, Paoli GD, Carlson KM, Wells P, et al. 2012. Examining protected area effectiveness in Sumatra: importance of regulations governing unprotected lands. Conserv. Lett. 5(2):142-48
49. Andam KS, Ferraro PJ, Hanauer MM. 2013. The effects of protected area systems on ecosystem restoration: a quasi-experimental design to estimate the impact of Costa Rica's protected area system on forest regrowth. Conserv. Lett. 6(5):317-23
50. Ferraro PJ, Hanauer MM, Miteva DA, Canavire-Bacarezza G, Pattanayak SK, Sims KRE. 2013. More strictly protected areas are not necessarily more protective: evidence from Bolivia, Costa Rica, Indonesia, and Thailand. Environ. Res. Lett. 8:025011
51. Nolte C, Agrawal A. 2013. Linking management effectiveness indicators to observed effects of protected areas on fire occurrence in the Amazon rainforest. Conserv. Biol. 27(1):155-65
52. Ho DE, Imai K, King G, Stuart EA. 2007. Matching as nonparametric preprocessing for reducing model dependence in parametric causal inference. Polit. Anal. 15:199-236
53. Abadie A, Imbens GW. 2006. Large sample properties of matching estimators for average treatment effects. Econometrica 74(1):235-67
54. Bennear LS, Olmstead SM. 2008. The impacts of the right to know: information disclosure and the violation of drinking water standards. J. Environ. Econ. Manag. 56(2):117-30
55. Sims KRE, Schuetz J. 2009. Local regulation and land-use change: the effects of wetlands bylaws in Massachusetts. Reg. Sci. Urban Econ. 39(4):409-21
56. Burgess R, Hansen M, Olken BA, Potapov P, Sieber S. 2012. The political economy of deforestation in the tropics. Q. J. Econ. 127(4):1707-54
57. Davis L, Fuchs A, Gertler P. 2014. Cash for coolers: evaluating a large-scale appliance replacement program in Mexico. Am. Econ. J. Econ. Policy. In press
58. Abadie A, Diamond A, Hainmueller J. 2010. Synthetic control methods for comparative case studies: estimating the effect of California's tobacco control program. J. Am. Stat. Assoc. 105(490):493-505
59. Sims KRE. 2010. Conservation and development: evidence from Thai protected areas. J. Environ. Econ. Manag. 60(2):94-114
60. Chay K, Dobkin C, Greenstone M. 2003. The Clean Air Act of 1970 and adultmortality. J. Risk Uncertain. 27(3):279-300
61. Busch J, Cullen R. 2009. Effectiveness and cost-effectiveness of yellow-eyed penguin recovery. Ecol. Econ. 68(3):762-76
62. Millimet DL. 2011. The Elephant in the Corner: A Cautionary Tale About Measurement Error in Treatment Effects Models, Vol. 27. Bingley, UK: Emerald Group
63. Chay K, Greenstone M. 2005. Does air quality matter? Evidence from the housing market. J. Polit. Econ. 113(2):376-424
64. Cutter WB, Neidell M. 2009. Voluntary information programs and environmental regulation: evidence from spare the air. J. Environ. Econ. Manag. 58(3):253-65
65. Alix-Garcia J, McIntosh C, Sims KRE, Welch JR. 2013. The ecological footprint of poverty alleviation: evidence from Mexico's Oportunidades program. Rev. Econ. Stat. 95(2):417-35
66. Liscow ZD. 2013. Do property rights promote investment but cause deforestation? Quasi-experimental evidence from Nicaragua. J. Environ. Econ. Manag. 65(2):241-61
67. Deaton A. 2010. Instruments, randomization and learning about development. J. Econ. Lit. 48:424-55
68. Altonji J, Elder TE, Taber CR. 2005. Selection on observed and unobserved variables: assessing the effectiveness of Catholic school. J. Polit. Econ. 105:151-84
69. Ichino A, Mealli F, Nannicini T. 2008. From temporary help jobs to permanent employment: What can we learn from matching estimators and their sensitivity? J. Appl. Econom. 23(3):305-27
70. Manski CF. 2011. Policy analysis with incredible certitude. Econ. J. 121(554):F261-89
71. Canavire-Bacarezza G, Hanauer MM. 2013. Estimating the impacts of Bolivia's protected areas on poverty. World Dev. 41:265-85
72. Ferraro PJ, McIntosh C, Ospina M. 2007. The effectiveness of the US Endangered Species Act: an econometric analysis using matching methods. J. Environ. Econ. Manag. 54(3):245-61
73. Butler JS, Moser C. 2007. Cloud cover and satellite images of deforestation. Land Econ. 83(2):166-73
74. Ferraro PJ, Hanauer MM. 2011. Protecting ecosystems and alleviating poverty with parks and reserves: 'win-win' or tradeoffs? Environ. Resour. Econ. 48(2):269-86
75. Ferraro PJ, Hanauer MM, Sims KRE. 2011. Conditions associated with protected area success in conservation and poverty reduction. Proc. Natl. Acad. Sci. USA 108(34):13913-18
76. Pfaff A, Robalino J, Sanchez-Azofeifa GA, Andam KS, Ferraro PJ. 2009. Park location affects forest protection: land characteristics cause differences in park impacts across Costa Rica. B.E. J. Econ. Anal. Policy 9(2):5
77. Ferraro PJ, Miranda JJ. 2013. Heterogeneous treatment effects and causal mechanisms in non-pecuniary, information-based environmental policies: evidence from a large-scale field experiment. Res. Energy Econ. 35:356-79
78. Sun X, Briel M, Busse JW, You JJ, Akl EA, et al. 2012. Credibility of claims of subgroup effects in randomised controlled trials: systematic review. BMJ 344:e1553
79. Crump RK, Hotz VJ, Imbens GW, Mitnik OA. 2008. Nonparametric tests for treatment effect heterogeneity. Rev. Econ. Stat. 90(3):389-405
80. Ferraro PJ, Hanauer MM. 2014. Quantifying causal mechanisms to determine how protected areas affect poverty through changes in ecosystem services and infrastructure. Proc.Natl. Acad. Sci. USA 111(11):4332-37
81. Pullin AS, Knight T. 2013. Time to build capacity for evidence synthesis in environmental management. Environ. Evid. 2(1):21