Ecosystem services indicators: Improving the linkage between biophysical and economic analyses

International Review of Environmental and Resource Economics

Volumn 8, Issue 3-4, 2016, Pages 359-443

  Boyd, James ^a   Ringold, Paul ^b   Krupnick, Alan ^a   Johnston, Robert J ^c   Weber, Matthew A ^b   Hall, Kim ^b,d  

^a RESOURCES FOR THE FUTURE   (United States)

^b U S ENVIRONMENTAL PROTECTION AGENCY   (United States)

^c CLARK UNIVERSITY   (United States)

^d OREGON STATE UNIVERSITY   (United States)

Author keywords

Ecological indicators; Ecosystem services; Nonmarket valuation

Indexed keywords

EID: 84973547173     PISSN: 19321465     EISSN: 19321473     Source Type: Journal    
DOI: 10.1561/101.00000073     Document Type: Review

References (190)

1. Adamowicz, W., P. Boxall, M. Williams, and J. Louviere. 1998. "Stated Preference Approaches for Measuring Passive Use Values: Choice Experiments and Contingent Valuation". American Journal of Agricultural Economics. 80: 64-75.
2. Adamowicz, W., J. Swait, P. Boxall, J. Louviere, and M. Williams. 1997. "Perceptions Versus Objective Measures of Environmental Quality in Combined Revealed and Stated Preference Models of Environmental Valuation". Journal of Environmental Economics and Management. 32: 65-84.
3. Arrow, K., R. Solow, P. R. Portney, E. E. Leamer, R. Radner, and H. Schuman. 1993. "Report of the NOAA Panel on Contingent Valuation". Federal Register. 58: 4601-4614.
4. Banzhaf, H. S., D. Burtraw, D. Evans, and A. Krupnick. 2006. "Valuation of Natural Resource Improvements in the Adirondacks". Land Economics. 82: 445-464.
5. Barbier, E. B., S. Baumgartner, K. Chopra, C. Costello, A. Duraiappah, R. Hassan, A. P. Kinzig, M. Lehman, U. Pascual, S. Polasky, and C. Perrings. 2009. "The Valuation of Ecosystem Services". In: Biodiversity, Ecosystem Functioning, & Human Wellbeing. Ed. by S. Naeem, D. E. Bunker, A. Hector, M. Loreau, and C. Perrings. Oxford, UK: Oxford University Press.
6. Bastian, C. T., D. M. McLeod, M. J. Germino, W. A. Reiners, and B. J. Blasko. 2002. "Environmental Amenities and Agricultural Land Values: A Hedonic Model Using Geographic Information Systems Data". Ecological Economics. 40: 337-349.
7. Bateman, I. J., R. Brouwer, S. Ferrini, M. Schaafsma, D. N. Barton, A. Dubgaard B. Hasler, S. Hime, I. Liekens, and S. Navrud. 2011b. "Making Benefit Transfers Work: Deriving and Testing Principles for Value Transfers for Similar and Dissimilar Sites Using A Case Study of the Non-Market Benefits of Water Quality Improvements Across Europe". Environmental and Resource Economics. 50: 365-387.
8. Bateman, I. J., R. T. Carson, B. Day, M. Hanemann, N. Hanley, T. Hett, M. Jones-Lee, G. Loomes, S. Mourato, and E. Özdemiroglu. 2002. Economic Valuation with Stated Preference Techniques: A Manual. Northampton, MA: Edward Elgar.
9. Bateman, I. J., B. H. Day, S. Georgiou, and I. Lake. 2006. "The Aggregation of Environmental Benefit Values: Welfare Measures, Distance Decay and Total WTP". Ecological Economics. 60: 450-460.
10. Bateman, I. J., A. Munro, and G. L. Poe. 2008. "Decoy Effects in Choice Experiments and Contingent Valuation: Asymmetric Dominance". Land Economics. 84: 115-127.
11. Bateman, I., P. Cooper, S. Georgiou, S. Navrud, G. Poe, R. Ready, P. Riera, M. Ryan, and C. Vossler. 2005. "Economic Valuation of Policies for Managing Acidity in Remote Mountain Lakes: Examining Validity through Scope Sensitivity Testing". Aquatic Sciences-Research across Boundaries. 67: 274-291.
12. Bateman, I., G. Mace, C. Fezzi, G. Atkinson, and K. Turner. 2011a. "Economic Analysis for Ecosystem Service Assessments". Environmental and Resource Economics. 48: 177-218.
13. Bennett, J. and V. Adamowicz. 2001. "Some Fundamentals of Environmental Choice Modelling". In: The Choice Modelling Approach to Environmental Valuation. Ed. by J. Bennett and R. Blamey. Cheltenham UK: Edward Elgar.
14. Bernard, H. R. 2011. Research Methods in Anthropology: Qualitative and Quantitative Approaches. Rowman Altamira, Lanham, MD.
15. Bin, O., C. E. Landry, C. L. Ellis, and H. Vogelsong. 2005. "Some Consumer Surplus Estimates for North Carolina Beaches". Marine Resource Economics. 20: 145.
16. Bishop, R. C. 2003. "Where to From Here?" In: A Primer on Nonmarket Valuation. Ed. by P. A. Champ, J. Boyle, and T. C. Brown. Netherlands: Kluwer, Dordrecht.
17. Blamey, R. K., J. W. Bennett, J. J. Louviere, M. D. Morrison, and J. C. Rolfe. 2002. "Attribute Causality in Environmental Choice Modelling". Environmental and Resource Economics. 23: 167-186.
18. Bockstael, N. E. and K. E. McConnell. 2010. Environmental and Resource Valuation with Revealed Preferences: A Theoretical Guide to Empirical Models. Netherlands: Springer, Dordrecht.
19. Bockstael, N. E., K. E. McConnell, and I. E. Strand. 1989. "Measuring the Benefits of Improvements in Water Quality: The Chesapeake Bay". Marine Resource Economics. 6: 1-18.
20. Bockstael, N. E. and I. E. Strand. 1987. "The Effect of Common Sources of Regression Error on Benefit Estimates". Land Economics. 63: 11-20.
21. Bockstael, N., R. Costanza, I. Strand, W. Boynton, K. Bell, and L. Wainger. 1995. "Ecological Economic Modeling and Valuation of Ecosystems". Ecological Economics. 14: 143-159.
22. Boyd, J. 2007. "Nonmarket Benefits of Nature: What Should be Counted in Green GDP?" Ecological Economics. 61: 716-723.
23. Boyd, J. W. and A. J. Krupnick. 2013. "Using Ecological Production Theory to Define and Select Environmental Commodities for Nonmarket Valuation". Agricultural and Resource Economics Review. 42: 1-32.
24. Boyd, J. W., P. L. Ringold, A. J. Krupnick, R. J. Johnston, M. Weber, and K. Hall. 2015. "Ecosystem Services Indicators: Improving the Linkage between Biophysical and Economic Analyses". Resources for the Future Discussion Paper 15-40, Resources for the Future, Washington DC.
25. Boyd, J. and S. Banzhaf. 2007. "What are Ecosystem Services? The Need for Standardized Environmental Accounting Units". Ecological Economics. 63: 616-626.
26. Brouwer, R. 2006. "Do Stated Preference Methods Stand The Test of Time? A Test of the Stability of Contingent Values and Models for Health Risks When Facing an Extreme Event". Ecological Economics. 60: 399-406.
27. Brouwer, R., I. H. Langford, I. Bateman, and K. Turner. 1999. "A Meta-analysis of Wetland Contingent Valuation Studies". Regional Environmental Change. 1(1): 47-57.
28. Brouwer, R., J. Martin-Ortega, and J. Berbel. 2010. "Spatial Preference Heterogeneity: A Choice Experiment". Land Economics. 86: 552-568.
29. Brown, N. R. and R. S. Siegler. 1993. "Metrics and Mappings: A Framework for Understanding Real-World Quantitative Estimation". Psychological Review. 100: 511.
30. Brown, T. C., J. C. Bergstrom, and J. Loomis. 2007. "Defining, Valuing, and Providing Ecosystem Goods and Services". Natural Resources Journal. 47: 329-376.
31. Burgan, B. and V. Engle. 2006. "National Estuary Program Coastal Condition Report US Environmental Protection Agency 842. B-06/001".
32. Cai, B., T. A. Cameron, and G. R. Gerdes. 2011. "Distal Order Effects in Stated Preference Surveys". Ecological Economics. 70(6): 1101-1108.
33. Cairns, J., P. McCormick, and B. Niederlehner. 1993. "A Proposed Framework for Developing Indicators of Ecosystem Health". Hydrobiologia. 263: 1-44.
34. Cameron, T. A. and J. Englin. 1997. "Respondent Experience and Contingent Valuation of Environmental Goods". Journal of Environmental Economics and Management. 33: 296-313.
35. Campbell, D., W. G. Hutchinson, and R. Scarpa. 2009. "Using Choice Experiments to Explore The Spatial Distribution of Willingness to Pay for Rural Landscape Improvements". Environment and Planning A. 41: 97-111.
36. Carson, R. T. 2012. "Contingent Valuation: A Practical Alternative When Prices Aren't Available". Journal of Economic Perspectives. 26: 27-42.
37. Carson, R. T., N. E. Flores, and R. C. Mitchell. 1999. "The Theory and Measurement of Passive-use Value". In: Valuing Environmental Preferences: Theory and Practice of the Contingent Valuation Method in the US, EU, and Developing Countries. Ed. by I. J. Bateman and K. G. Willis. Oxford, UK: Oxford University Press. 97-130.
38. Carson, R. T. and R. C. Mitchell. 1995. "Sequencing and Nesting in Contingent Valuation Surveys". Journal of Environmental Economics and Management. 28: 155-173.
39. Champ, P. A., K. J. Boyle, T. C. Brown, and I. J. Bateman, eds. 2003. A Primer on Nonmarket Valuation. Dordrecht, Netherlands: Kluwer Academic Publishers.
40. Chang, H., P. Thiers, N. R. Netusil, J. A. Yeakley, G. Rollwagen-Bollens, S. M. Bollens, and S. Singh. 2014. "Relationships between Environmental Governance and Water Quality in A Growing Metropolitan Area of the Pacific Northwest, USA". Hydrology and Earth System Sciences. 18: 1383-1395.
41. Cho, S.-H., N. C. Poudyal, and R. K. Roberts. 2008. "Spatial Analysis of the Amenity Value of Green Open Space". Ecological Economics. 66: 403-416.
42. Christie, M., N. Hanley, J. Warren, K. Murphy, R. Wright, and T. Hyde. 2006. "Valuing the Diversity of Biodiversity". Ecological Economics. 58: 304-317.
43. Council on Environmental Quality. 1997. The 1997 Report of the Council on Environmental Quality. Washington, DC.
44. Creswell, J. W. 2013. Qualitative Inquiry and Research Design: Choosing among Five Approaches. 2nd ed. Thousand Oaks, CA: Sage Publications.
45. Creswell, J. W. 2014. Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. 4th edn. Los Angeles, CA: Sage.
46. Czajkowski, M., N. Hanley, and J. LaRiviere. 2015. "The Effects of Experience on Preferences: Theory and Empirics for Environmental Public Goods". American Journal of Agricultural Economics. 97: 333-351.
47. Dale, V. H. and S. C. Beyeler. 2001. "Challenges in the Development and use of Ecological Indicators". Ecological Indicators. 1: 3-10.
48. Daw, T., K. Brown, S. Rosendo, and R. Pomeroy. 2011. "Applying the Ecosystem Services Concept to Poverty Alleviation: The Need to Disaggregate Human Well-being". Environmental Conservation. 38: 370-379.
49. Dernburg, T. and D. McDougall. 1972. "Macroeconomics: The Measurement". Analysis, and Control of Aggregate Economic Activity. New York: Mc-Graw Hill.
50. Desvousges, W. H. and V. K. Smith. 1988. "Focus Groups and Risk Communication: The "Science" of Listening to Data". Risk Analysis. 8: 479-484.
51. Dietzenbacher, E. and M. L. Lahr, eds. 2004. Wassilly Leontief and Input-Output Economics. Cambridge University Press.
52. Duke, J. M. and R. Aull-Hyde. 2002. "Identifying Public Preferences for Land Preservation Using the Analytic Hierarchy Process". Ecological Economics. 42: 131-145.
53. Egan, K. J., J. A. Herriges, C. L. Kling, and J. A. Downing. 2009. "Valuing Water Quality as A Function of Water Quality Measures". American Journal of Agricultural Economics. 91: 106-123.
54. European Environment Agency. 2012. "European waters - Assessment of Status and Pressures". EEA Report No 8/2012.
55. Farber, S. C., R. Costanza, and M. A. Wilson. 2002. "Economic and Ecological Concepts for Valuing Ecosystem Services". Ecological Economics. 41: 375-392.
56. Federal Register. 2013. "EPA-HQ-OA-2012-0033. 78 FR 9045".
57. Fern, E. F. 2001. Advanced Focus Group Research. CA: Sage, Thousand Oaks.
58. Finn, A. and J. J. Louviere. 1992. "Determining the Appropriate Response to Evidence of Public Concern: The Case of Food Safety". Journal of Public Policy and Marketing. 11(2): 12-25.
59. Fisher, B., K. Turner, M. Zylstra, R. Brouwer, R. D. Groot, S. Farber, P. Ferraro, R. Green, D. Hadley, J. Harlow, P. Jefferiss, C. Kirkby, P. Morling, S. Mowatt, R. Naidoo, J. Paavola, B. Strassburg, D. Yu, and A. Balmford. 2008. "Ecosystem Services and Economic Theory: Integration for Policy-Relevant Research". Ecological Applications. 18: 2050-2067.
60. Fisher, B. and R. K. Turner. 2008. "Ecosystem Services: Classification for Valuation". Biological Conservation. 141: 1167-1169.
61. Fisher, W., L. Jackson, G. Suter, and P. Bertram. 2001. "Indicators for Human and Ecological Risk Assessment: US Environmental Protection Agency perspective". Human and Ecological Risk Assessment. 7: 961-970.
62. Flynn, T. N., J. J. Louviere, T. J. Peters, and J. Coast. 2007. "Best- Worst Scaling: What it Can Do for Health Care Research and How to Do It". Journal of Health Economics. 26(1): 171-189.
63. Frank, S., C. Fürst, L. Koschke, A. Witt, and F. Makeschin. 2013. "Assessment of Landscape Aesthetics - Validation of A Landscape Metrics-Based Assessment by Visual Estimation of the Scenic Beauty". Ecological Indicators. 32: 222-231.
64. Freeman III, A. M. 1995. "The Benefits of Water Quality Improvements for Marine Recreation: A Review of the Empirical Evidence". Marine Resource Economics. 10: 385-406.
65. Freeman, A. M., J. A. Herriges, and C. L. Kling. 2014. The Measurement of Environmental and Resource Values: Theory and Methods. 3rd edn. Ed. by Taylor and Francis. UK: Abingdon, Oxon.
66. Geoghegan, J., L. A. Wainger, and N. E. Bockstael. 1997. "Spatial Landscape Indices in A Hedonic Framework: An Ecological Economics Analysis Using GIS". Ecological Economics. 23: 251-264.
67. Giraud, K. L., J. B. Loomis, and R. L. Johnson. 1999. "Internal and External Scope in Willingness-To-Pay Estimates for Threatened and Endangered Wildlife". Journal of Environmental Management. 56: 221-229.
68. Golusin, M. and O. Munitlak Ivanovic. 2009. "Definition, Characteristics and State of the Indicators of Sustainable Development in Countries Of Southeastern Europe". Agriculture, Ecosystems & Environment. 130: 67-74.
69. Hanemann, W. M. 1994. "Valuing the Environment Through Contingent Valuation". Journal of Economic Perspectives. 8: 19-43.
70. Hanemann, W. M. 2006. "The Economic Conception of Water". In: Water Crisis: Myth or Reality? Marcelino Botin Water Forum 2004. Ed. by P. P. Rogers, M. R. Llamas, and L. Martínez-Cortina. London: Taylor and Francis.
71. Hanley, N. and E. B. Barbier. 2009. Pricing Nature: Cost-Benefit Analysis and Environmental Policy. Cheltenham, UK: Edward Elgar.
72. Hanley, N., D. Bell, and B. Alvarez-Farizo. 2003a. "Valuing the Benefits of Coastal Water Quality Improvements Using Contingent and Real Behaviour". Environmental & Resource Economics. 24(3): 273-285.
73. Hanley, N. and A. Munro. 1992. "The Effects of Information in Contingent Markets for Environmental Goods: A Survey and Some New Evidence". Queen's Economics Department Working Paper No. 848. Kingston, Ontario, Canada.
74. Hanley, N., F. Schläpfer, and J. Spurgeon. 2003b. "Aggregating the Benefits of Environmental Improvements: Distance-Decay Functions for Use and Non-use Values". Journal of Environmental Management. 68: 297-304.
75. Heberlein, T. A., M. A. Wilson, R. C. Bishop, and N. C. Schaeffer. 2005. "Rethinking the Scope Test as a Criterion for Validity in Contingent Valuation". Journal of Environmental Economics and Management. 50: 1-22.
76. Hein, L., K. van Koppen, R. S. de Groot, and E. C. van Ierland. 2006. "Spatial Scales, Stakeholders and the Valuation of Ecosystem Services". Ecological Economics. 57: 209-228.
77. Hoehn, J. P., F. Lupi, and M. D. Kaplowitz. 2003. "Untying a Lancastrian Bundle: Valuing Ecosystems and Ecosystem Services for Wetland Mitigation". Journal of Environmental Management. 68: 263-272.
78. Hovardas, T. and K. Korfiatis. 2011. "Towards A Critical Re-appraisal of Ecology Education: Scheduling and Educational Intervention to Revisit the "Balance of Nature" Metaphor". Science and Education. 20: 1039-1053.
79. Hughes, R. M. and D. V. Peck. 2008. "Acquiring Data for Large Aquatic Resource Surveys: The Art of Compromise Among Science, Logistics, and Reality". Journal of the North American Benthological Society. 27: 837-859.
80. Hutchinson, W. G., S. M. Chilton, and J. Davis. 1995. "Measuring Nonuse Value of Environmental Goods using the Contingent Valuation Method: Problems of Information and Cognition and the Application of Cognitive Questionnaire Design Methods". Journal of Agricultural Economics. 46: 97-112.
81. Irwin, E. G. 2002. "The Effects of Open Space on Residential Property Values". Land Economics. 78: 465-480.
82. "Evaluation Guidelines for Ecological Indicators. EPA/620/R-99/005". 2000. In: US Environmental Protection Agency, Office of Research and Development. Ed. by L. E. Jackson, J. C. Kurtz, and W. S. Fisher. NC: Research Triangle Park.
83. Jacobsen, J. B., J. H. Boiesen, B. J. Thorsen, and N. Strange. 2008. "What's in a Name? The Use of Quantitative Measures Versus "Iconised" Species When Valuing Biodiversity". Environmental and Resource Economics. 39: 247-263.
84. Jakus, P. M. and W. D. Shaw. 2003. "Perceived Hazard and Product Choice: An Application to Recreational Site Choice". Journal of Risk and Uncertainty. 26: 77-92.
85. John Heinz III Center for Science, Economics, and the Environment, H. 2008. "The State of the Nation's Ecosystems 2008: Measuring the Land, Waters, and Living Resources of the United States". Washington, DC.
86. Johnston, R. J. 2002a. "Combining Economic and Ecological Indicators to Prioritize Salt Marsh Restoration Actions". American Journal of Agricultural Economics. 84: 1362-1370.
87. Johnston, R. J., E. Y. Besedin, E. Helm, and R. Stapler. 2013a. "Overlaps and Causality in Aquatic Ecosystem Impacts of Energy Facilities: Evaluating Benefits of Cooling Water Intake Regulations Under Section 316b of The Clean Water Act". Association of Environmental and Resource Economists Third Annual Summer Conference, Banff, Alberta, Canada.
88. Johnston, R. J., E. Y. Besedin, R. Iovanna, C. J. Miller, R. F. Wardwell, and M. H. Ranson. 2005a. "Systematic Variation in Willingness to Pay for Aquatic Resource Improvements and Implications for Benefit Transfer: A Meta-Analysis". Canadian Journal of Agricultural Economics. 53: 221-248.
89. Johnston, R. J., E. Y. Besedin, and R. F. Wardwell. 2003a. "Modeling Relationships Between Use and Nonuse Values for Surface Water Quality: A Meta-analysis". Water Resources Research. 39: 1363.
90. Johnston, R. J. and J. M. Duke. 2009. "Willingness to Pay for Land Preservation Across States and Jurisdictional Scale: Implications for Benefit Transfer". Land Economics. 85: 217-237.
91. Johnston, R. J., D. Jarvis, K. Wallmo, and D. Lew. 2015a. "Multi- Scale Spatial Pattern in Nonuse Willingness to Pay: Applications to Threatened and Endangered Marine Species". Land Economics. 91(4): 739-761.
92. Johnston, R. J., J. J. Opaluch, M. J. Mazzotta, and G. Magnusson. 2005b. "Who are Resource Nonusers and What Can They Tell Us About Nonuse Values? Decomposing User and Nonuser Willingness to Pay for Coastal Wetland Restoration". Water Resources Research. 41(7): W07017.
93. Johnston, R. J. and M. Ramachandran. 2014. "Modeling Spatial Patchiness and Hot Spots in Stated Preference Willingness to Pay". Environmental and Resource Economics. 59: 363-387.
94. Johnston, R. J., M. H. Ranson, E. Y. Besedin, and E. C. Helm. 2006. "What Determines Willingness to Pay Per Fish? A Meta-Analysis of Recreational Fishing Values". Marine Resource Economics. 21: 1-32.
95. Johnston, R. J., J. Rolfe, R. S. Rosenberger, and R. Brouwer. 2015b. "Introduction to Benefit Transfer Methods". In: Benefit Transfer of Environmental and Resource Values: A Guide for Researchers and Practitioners. Ed. by R. J. Johnston, J. Rolfe, R. S. Rosenberger, and R. Brouwer. Dordrecht, the Netherlands: Springer.
96. Johnston, R. J. and R. S. Rosenberger. 2010. "Methods, Trends and Controversies in Contemporary Benefit Transfer". Journal of Economic Surveys. 24: 479-510.
97. Johnston, R. J. and M. Russell. 2011. "An operational Structure for Clarity in Ecosystem Service Values". Ecological Economics. 70: 2243-2249.
98. Johnston, R. J., E. T. Schultz, K. Segerson, E. Y. Besedin, and M. Ramachandran. 2012. "Enhancing the Content Validity of Stated Preference Valuation: The Structure and Function of Ecological Indicators". Land Economics. 88: 102-120.
99. Johnston, R. J., E. T. Schultz, K. Segerson, E. Y. Besedin, and M. Ramachandran. 2013b. "Stated Preferences for Intermediate Versus Final Ecosystem Services: Disentangling Willingness to Pay for Omitted Outcomes". Agricultural and Resource Economics Review. 42: 98-118.
100. Johnston, R. J., E. T. Schultz, K. Segerson, E. Y. Besedin, and M. Ramachandran. 2014. "Guidelines for Stated Preference Commodities: Implications of Biophysical Production and Utility Theory". Fifth World Congress of Environmental and Resource Economists, Istanbul, Turkey, June 28-July 2.
101. Johnston, R. J., K. Segerson, E. T. Schultz, E. Y. Besedin, and M. Ramachandran. 2011. "Indices of Biotic Integrity in Stated Preference Valuation of Aquatic Ecosystem Services". Ecological Economics. 70: 1946-1956.
102. Johnston, R. J., S. K. Swallow, and D. M. Bauer. 2002b. "Spatial Factors and Stated Preference Values for Public Goods: Considerations for Rural Land Use". Land Economics. 78: 481-500.
103. Johnston, R. J., S. K. Swallow, T. J. Tyrrell, and D. M. Bauer. 2003b. "Rural Amenity Values and Length of Residency". American Journal of Agricultural Economics. 85: 1009-1024.
104. Johnston, R. J., T. F. Weaver, L. A. Smith, and S. K. Swallow. 1995. "Contingent Valuation Focus Groups: Insights From Ethnographic Interview Techniques". Agricultural and Resource Economics Review. 24: 56-69.
105. Jordan, T., D. Weller, and D. Correll. 2003. "Sources of Nutrient Inputs to the Patuxent River Estuary". Estuaries. 26: 226-243.
106. Jorgensen, S. L., S. B. Olsen, J. Ladenburg, L. Martinsen, S. R. Svenningsen, and B. Hasler. 2013. "Spatially Induced Disparities in Users' and Non-users' WTP for Water Quality Improvements: Testing the Effect of Multiple Substitutes and Distance Decay". Ecological Economics. 92: 58-66.
107. Kaplowitz, M. D., F. Lupi, and J. P. Hoehn. 2004. "Multiple Methods for Developing and Evaluating A Stated - Choice Questionnaire to Value Wetlands". In: Methods for Testing and Evaluating Survey Questionnaires. Ed. by S. Presser, J. M. Rothget, M. P. Coputer, J. T. Lesser, E. Martin, J. Martin, and E. Singer. New York, NY: John Wiley and Sons.
108. Karr, J. R. 1981. "Assessment of Biotic Integrity Using Fish Communities". Fisheries. 6: 21-27.
109. Karr, J. R. 1991. "Biological Integrity: A Long-neglected Aspect of Water Resource Management". Ecological Applications. 1: 66-84.
110. Kim, S.-I. and T. C. Haab. 2009. "Temporal Insensitivity of Willingness to Pay and Implied Discount Rates". Resource and Energy Economics. 31: 89-102.
111. Kling, C. L., D. J. Phaneuf, and J. Zhao. 2012. "From Exxon to BP: Has Some Number Become Better Than No Number?" Journal of Economic Perspectives. 26: 3-26.
112. Kontogianni, A., G. W. Luck, and M. Skourtos. 2010. "Valuing Ecosystem Services on the Basis of Service-providing Units: A Potential Approach to Address the "Endpoint Problem" and Improve Stated Preference Methods". Ecological Economics. 69: 1479-1487.
113. Kovacs, K. F. and D. M. Larson. 2008. "Identifying Individual Discount Rates and Valuing Public Open Space With Stated-Preference Models". Land Economics. 84: 209-224.
114. Krippendorff, K. 2013. Content Analysis: An Introduction to Its Methodology. 3rd edn. Thousand Oaks, CA: Sage Publications.
115. Ladle, R. J. and L. Gillson. 2009. "The (im)Balance of Nature: A Public Perception Time-Lag?" Public Understanding of Science. 18: 229-242.
116. Lew, D. K. and K. Wallmo. 2011. "External Tests of Scope and Embedding in Stated Preference Choice Experiments: An Application to Endangered Species Valuation". Environmental and Resource Economics. 48: 1-23.
117. Liebe, U., J. Meyerhoff, and V. Hartje. 2012. "Test-retest Reliability of Choice Experiments in Environmental Valuation". Environmental and Resource Economics. 53: 389-407.
118. List, J. A. and C. A. Gallet. 2001. "What Experimental Protocol Influence Disparities Between Actual and Hypothetical Stated Values?" Environmental and Resource Economics. 20: 241-254.
119. Loomis, J. B. 2000. "Vertically Summing Public Good Demand Curves: An Empirical Comparison of Economic Versus Political Jurisdictions". Land Economics: 312-321.
120. Loomis, J. B. 2011. "Incorporating Distributional Issues Into Benefit Cost Analysis: Why, How, and Two Empirical Examples Using Non- Market Valuation". Journal of Benefit-Cost Analysis. 2(1): 1-24.
121. Loomis, J. B. and R. S. Rosenberger. 2006. "Reducing Barriers in Future Benefit Transfers: Needed Improvements in Primary Study Design and Reporting". Ecological Economics. 60: 343-350.
122. Louviere, J. J., D. A. Hensher, and J. D. Swait. 2000. Stated Choice Methods: Analysis and Applications. Cambridge, UK: Cambridge University Press.
123. Luisetti, T., I. J. Bateman, and R. K. Turner. 2011. "Testing the Fundamental Assumption of Choice Experiments: Are Values Absolute or Relative?" Land Economics. 87: 284-296.
124. Mahan, B. L., S. Polasky, and R. M. Adams. 2000. "Valuing Urban Wetlands: A Property Price Approach". Land Economics. 76: 100-113.
125. Martin-Ortega, J. and J. Berbel. 2010. "Using Multi-criteria Analysis to Explore Non-Market Monetary Values of Water Quality Changes in the Context of the Water Framework Directive". Science of the Total Environment. 408: 3990-3997.
126. Massey, D. M. and G. Parsons. 2002. A Random Utility Model of Beach Recreation. Ed. by N. Hanley, D. Shaw, and R. Wright. Cheltenham, UK: Elgar: The New Economics of Outdoor Recreation. 237-263.
127. McClelland, G. H. and W. D. Schulze. 1992. Methods for Measuring Non-use Values: A Contingent Valuation Study of Groundwater Cleanup. US Environmental Protrection Agency, Office of Policy, Planning and Evaluation.
128. McClelland, N. I. 1974. Water Quality Index Application in the Kansas River Basin. Kansas City, MO: US Environmental Protection Agency- Region VII.
129. McConnell, K. E. and W.-C. Tseng. 1999. "Some Preliminary Evidence on Sampling of Alternatives With the Random Parameters Logit". Marine Resource Economics. 14: 317-332.
130. Meyer, A. 2013. "Intertemporal Valuation of River Restoration". Environmental and Resource Economics. 54: 41-61.
131. Miles, M. B., M. A. Huberman, and J. Saldaña. 2014. Qualitative Data Analysis: A Methods Sourcebook. 3rd edn. Thousand Oaks, CA: Sage Publications.
132. Milon, J. W. and D. Scrogin. 2006. "Latent Preferences and Valuation of Wetland Ecosystem Restoration". Ecological Economics. 56: 162-175.
133. Mitchell, R. C. and R. T. Carson. 1989. Using Surveys to Value Public Goods: The Contingent Valuation Method. Washington, DC: Resources for the Future.
134. Moeltner, K. and R. S. Rosenberger. 2008. "Predicting Resource Policy Outcomes Via Meta-Regression: Data Space, Model Space, and the Quest for "Optimal Scope"". B E Journal of Economic Analysis and Policy. 8: 31-31.
135. Morgan, D. L. and R. A. Krueger. 1998. The Focus Group Kit. 6 vols. Thousand Oaks, CA: Sage Publications.
136. Morrison, M., J. Bennett, R. Blamey, and J. Louviere. 2002. "Choice Modeling and Tests of Benefit Transfer". American Journal of Agricultural Economics. 84: 161-170.
137. Mueller, J. M. and J. B. Loomis. 2008. "Spatial Dependence in Hedonic Property Models: Do Different Corrections for Spatial Dependence Result in Economically Significant Differences in Estimated Implicit Prices?" Journal of Agricultural and Resource Economics. 33: 212-231.
138. Murray, C., B. Sohngen, and L. Pendleton. 2001. "Valuing Water Quality Advisories and Beach Amenities in the Great Lakes". Water Resources Research. 37: 2583-2590.
139. Netusil, N., M. Kincaid, and H. Chang. 2014. "Valuing Water Quality in Urban Watersheds: A Comparative Analysis of Johnson Creek Oregon and Burnt Bridge Creek, Washington". Water Resources Research. 50: 4254-4268.
140. Niemeijer, D. and R. S. de Groot. 2008. "A Conceptual Framework for Selecting Environmental Indicator Sets". Ecological Indicators. 8: 14-25.
141. Niemi, G. J. and M. E. McDonald. 2004. "Application of Ecological Indicators". Annual Review of Ecology, Evolution, and Systematics. 35: 89-111.
142. Opaluch, J. J., S. K. Swallow, T. Weaver, C. W. Wessells, and D. Wichelns. 1993. "Evaluating Impacts From Noxious Facilities: Including Public Preferences in Current Siting Mechanisms". Journal of Environmental Economics and Management. 24: 41-59.
143. Parsons, G. R., D. M. Massey, and T. Tomasi. 1999. "Familiar and Favorite Sites in a Random Utility Model of Beach Recreation". Marine Resource Economics. 14: 299-315.
144. Paterson, R. W. and K. J. Boyle. 2002. "Out of Sight, Out of Mind? Using Gis to Incorporate Visibility in Hedonic Property Value Models". Land Economics. 78: 417-425.
145. Patton, M. Q. 2002. Qualitative Research and Evaluation Methods. 3rd edn. Thousand Oaks, CA: Sage Publications.
146. Poor, P. J., K. J. Boyle, L. O. Taylor, and R. Bouchard. 2001. "Objective Versus Subjective Measures of Water Clarity in Hedonic Property Value Models". Land Economics. 77: 482-493.
147. Powe, N. A. 2007. Redesigning Environmental Valuation: Mixing Methods within Stated Preference Techniques. Cheltenham, UK: Edward Elgar.
148. Reynolds and Rochon. 1991. "Means-End Based Advertising Research: Copy Testing is Not Strategy Assessment". Journal of Business Research. 22(2): 131-142.
149. Ringold, P. L., J. W. Boyd, D. H. Landers, and M. A. Weber. 2009. Report from the Workshop on Indicators of Final Ecosystem Services for Streams. Corvallis, OR: US Environmental Protection Agency.
150. Ringold, P. L., J. W. Boyd, A. Nahlik, and D. Bernard. 2011. Report From the Workshop on Indicators of Rinal Ecosystem Services for Wetlands and Estuaries. Corvallis, OR: US Environmental Protection Agency.
151. Ringold, P. L., J. W. Boyd, M. Weber, A. T. Herlihy, and K. Winters. in review. "Barriers in the Capacity to Describe Stream Ecosystem Features That Matter to People".
152. Ringold, P. L., J. Boyd, A. Krupnick, M. Weber, K. Hall, M. Papenfus, M. Barber, and R. J. Johnston. 2014. Research Questions to Identify Ecological Indicators Most Useful For Linking Ecosystems and Human Well-Being. Washington, DC: ACES 2014.
153. Ringold, P. L., J. Boyd, D. Landers, and M. Weber. 2013. "What Data Should We Collect? A Framework for Identifying Indicators of Ecosystem Contributions to Human Well-Being". Frontiers in Ecology and the Environment. 11: 98-105.
154. Ringold, P. L., M. Weber, and J. Boyd. 2012a. The Gap between What We Measure and What We Want to Know about Ecosystem Services in Streams and Their Linkages to Human Values. Portland, OR: Ecological Society of America 2012 Annual Meeting.
155. Ringold, P. L., M. Weber, J. Boyd, D. Landers, and A. Nahlik. 2012b. The Gap between What We Measure and What We Want to Know about Ecosystem Services in Streams and their Linkages to Human Values. Fort Lauderdale, FL: ACES and Ecosystem Markets 2012.
156. Rosenberger, R. S. and R. J. Johnston. 2009. "Selection Effects in Meta- Analysis and Benefit Transfer: Avoiding Unintended Consequences". Land Economics. 85: 410-428.
157. Rosenberger, R. S. and T. D. Stanley. 2006. "Measurement, Generalization, and Publication: Sources of Error in Benefit Transfers and Their Management". Ecological Economics. 60: 372-378.
158. Rubin, H. J. and I. S. Rubin. 2005. Qualitative Interviewing. 2nd. Thousand Oaks, CA: Sage Publications.
159. Rungie, C., R. Scarpa, and M. Thiene. 2014. "The Influence of Individuals in Forming Collective Household Preferences For Water Quality". Journal of Environmental Economics and Management. 68: 161-174.
160. Schaafsma, M., R. Brouwer, and J. Rose. 2012. "Directional Heterogeneity in WTP Models For Environmental Valuation". Ecological Economics. 79: 21-31.
161. Schiller, A., C. Hunsaker, M. A. Kane, A. K. Wolfe, V. H. Dale, G. W. Suter II, C. S. Russell, G. Pion, M. H. Jensen, and V. C. Konar. 2001. "Communicating Ecological Indicators to Decision Makers and the Public". Ecology and Society. 5: 19.
162. Schkade, D. A. and J. W. Payne. 1994. "How People Respond to Contingent Valuation Questions: A Verbal Protocol Analysis of Willingness to Pay for an Environmental Regulation". Journal of Environmental Economics and Management. 26: 88-109.
163. Schultz, E. T., R. J. Johnston, K. Segerson, and E. Y. Besedin. 2012. "Integrating Ecology and Economics for Restoration: Using Ecological Indicators in Valuation of Ecosystem Services". Restoration Ecology. 20: 304-310.
164. Shields, C. A., L. E. Band, N. Law, P. M. Groffman, S. S. Kaushal, K. Savvas, G. T. Fisher, and K. T. Belt. 2008. "Streamflow Distribution Of Non-Point Source Nitrogen Export from Urban-Rural Catchments in the Chesapeake Bay Watershed". Water Resources Research. 44: W09416.
165. Simpson, R. D. 1998. "Economic Analysis and Ecosystems: Some Concepts and Issues". Ecological Applications. 8: 342-349.
166. Smith, V. K., C. Poulos, and H. Kim. 2002. "Treating Open Space as an Urban Amenity". Resource and Energy Economics. 24: 107-129.
167. Stephenson, W. 1993. "Introduction to Q-methodology". Operant Subjectivity. 17(1): 1-13.
168. Stoddard, J. L., D. P. Larsen, C. P. Hawkins, R. K. Johnsonm, and R. H. Norris. 2006. "Setting Expectations for the Ecological Condition of Streams: The Concept of Reference Condition". Ecological Applications. 16: 1267-1276.
169. Stoddard, J. L., D. V. Peck, A. R. Olsen, D. P. Larsen, J. Van Sickle, C. P. Hawkins, R. M. Hughes, T. R. Whittier, G. Lomnicky, A. T. Herlihy, P. R. Kaufmann, S. A. Peterson, P. L. Ringold, S. G. Paulsen, and R. Blair. 2005. Environmental Monitoring and Assessment Program (EMAP): Western Streams and Rivers Statistical Summary. Washington, DC: US Environmental Protection Agency, Office of Research and Development.
170. Suter II, G. W. 1993. "A Critique of Ecosystem Health Concepts and Indexes". Environmental Toxicology and Chemistry. 12: 1533-1539.
171. Suter II, G. W. 2001. "Applicability of Indicator Monitoring to Ecological Risk Assessment". Ecological Indicators. 1: 101-112.
172. Swallow, S. K. 1996. "Economic Issues in Ecosystem Management: An Introduction and Overview". Agricultural and Resource Economics Review. 25: 83-100.
173. US Environmental Protection Agency. 2002. "Estimation of National Economic Benefits Using the National Water Pollution Control Assessment Model to Evaluate Regulatory Options for Concentrated Animal Feeding Operations. EPA-821-R-03-009". Washington, DC.
174. US Environmental Protection Agency. 2008. "EPA's 2008 Report on the Environment". Washington, DC.
175. US Environmental Protection Agency Office of Water 2010 National Rivers and Streams Assessment
176. US EPA Science Advisory Board 2009 Valuing the Protection of Ecological Systems and Services: A Report of the EPA Science Advisory Board. EPA-SAB-09-012
177. Van Houtven, G., C. Mansfield, D. J. Phaneuf, R. von Haefen, B. Milstead, M. A. Kenney, and K. H. Reckhow. 2014. "Combining Expert Elicitation and Stated Preference Methods to Value Ecosystem Services from Improved Lake Water Quality". Ecological Economics. 99: 40-52.
178. Van Houtven, G., J. Powers, and S. K. Pattanayak. 2007. "ValuingWater Quality Improvements in the United States Using Meta-Analysis: Is the Glass Half-Full or Half-Empty For National Policy Analysis?" Resource and Energy Economics. 29: 206-228.
179. Vatn, A. and D. W. Bromley. 1994. "Choices Without Prices Without Apologies". Journal of Environmental Economics and Management. 26(2): 129-148.
180. Vaughan, W. J. 1986. "The RFF water quality ladder". In: The Use of Contingent Valuation Data for Benefit/Cost Analysis in Water Pollution Control: Final Report to the Environmental Protection Agency. Ed. by R. C. Mitchell and R. T. Carson. Washington, DC: Resources for the Future.
181. Viscusi, W., J. Huber, and J. Bell. 2008. "The Economic Value of Water Quality". Environmental and Resource Economics. 41: 169-187.
182. Wallace, K. J. 2007. "Classification of Ecosystem Services: Problems and Solutions". Biological Conservation. 139: 235-246.
183. Weber, M. A., S. Caplan, and P. L. Ringold. 2014. "Content Analysis to Document Publicly Valued Ecosystem Services of Rivers and Streams [conference poster]". December. A Community on Ecosystem Services, Washington, DC. Available from: http://www.conference.ifas.ufl.edu/aces/posters.html.
184. Weber, M. A. and P. L. Ringold. 2012. "Ecosystems and People: Qualitative Insights". Environment, Health, and Society Bulletin 3(Spring): 2-8. Available from: http : //www. epa. gov/ ncer / ehs / bulletin /ehsspring2012/ehs-bulletin-spring2012.pdf.
185. Weber, M. A. and P. L. Ringold. 2014. "Public Input on Stream Monitoring from Residents of the Willamette Valley, Oregon [conference poster]". December. A Community on Ecosystem Services, Washington, DC. Available form: http://www.conference.ifas.ufl.edu/aces/ posters.html.
186. Weber, M. A. and P. L. Ringold. 2015a. "Priority River Metrics For Residents of An Urbanized Arid Watershed". Landscape and Urban Planning. 133: 37-52.
187. Weber, M. A. and P. L. Ringold. 2015b. "Using Public Input to Define Ecosystem Services: Challenges and Insights". In preparation.
188. Weber, M. A. and S. Stewart. 2008. "Public Valuation of River Restoration Strategies for the Middle Rio Grande". Restoration Ecology. 17(6): 762-771.
189. Zandersen, M., M. Termansen, and F. S. Jensen. 2007. "Testing Benefits Transfer of Forest Recreation Values Over a 20-Year Time Horizon". Land Economics. 83: 412-440.
190. Zhao, M., R. Johnston, and E. Schultz. 2013. "What to Value and How? Ecological Indicator Choices in Stated Preference Valuation". Environmental and Resource Economics. 56: 3-25.