Systematic non-response in discrete choice experiments: implications for the valuation of climate risk reductions

Journal of Environmental Economics and Policy

Volumn 6, Issue 3, 2017, Pages 246-267

  Johnston, Robert J ^a   Abdulrahman, Abdulallah S ^a  

^a CLARK UNIVERSITY   (United States)

Author keywords

coastal adaptation; flood; Non response bias; response propensity; sea level rise; stated preference

Indexed keywords

EID: 85019179022     PISSN: 21606544     EISSN: 21606552     Source Type: Journal    
DOI: 10.1080/21606544.2017.1284695     Document Type: Article

References (59)

1. Bateman, I.J., B.H., Day, S., Georgiou, and I., Lake. 2006. “The Aggregation of Environmental Benefit Values: Welfare Measures, Distance Decay and Total WTP.” Ecological Economics 60 (2): 450–460.
2. Bliemer, M.C.J., J.M., Rose, and D.A., Hensher. 2009. “Constructing Efficient Stated Choice Experiments Allowing for Differences in Error Variances Across Subsets of Alternatives.” Transportation Research Part B 43 (1): 19–35.
3. Bockstael, N.E., I.E., Strand Jr, K.E., McConnell, and F., Arsanjani. 1990. Sample Selection Bias in the Estimation of Recreation Demand Functions: An Application to Sportfishing. ” Land Economics 66 (1): 40–49.
4. Bushway, S., B.D., Johnson, and L.A., Slocum. 2007. “Is the Magic Still There? The Use of the Heckman Two-Step Correction for Selection Bias in Criminology.” Journal of Quantitative Criminology 23: 151–178.
5. Cameron, T.A., and J.R., DeShazo, 2005. Comprehensive Selectivity Assessment for a Major Consumer Panel: Attitudes Toward Government Regulation of Environment, Health And Safety Risks. Unpublished Paper. Department of Economics, University of Oregon, Eugene, OR.
6. Cameron, T.A., and J.R., DeShazo. 2013. “Demand for Health Risk Reductions.” Journal of Environmental Economics and Management 65: 87–109.
7. Cameron, T.A., W.D., Shaw, S.R., Ragland, S., Keef, and J.M., Callaway. 1996a. Using Distance and Zip Code Census Information for Nonresponse Correction in the Analysis of Mail Survey Data (Working Paper # 751). UCLA Department of Economics, Los Angeles, CA.
8. Cameron, T.A., W.D., Shaw, S.E., Ragland, J.M., Callaway, and S., Keefe. 1996b. “Using Actual and Contingent Behavior Data with Differing Levels of Time Aggregation to Model Recreation Demand.” Journal of Agricultural and Resource Economics 21 (1): 130–149.
9. Cameron, A.C., and P.K., Trivedi. 2010. Microeconometrics Using Stata, Revised Edition. College Station, TX: Stata Press.
10. Campbell, D., R., Scarpa, and W.G., Hutchinson. 2008. “Assessing the Spatial Dependence of Welfare Estimates Obtained from Discrete Choice Experiments.” Letters in Spatial and Resource Sciences 1: 117–126.
11. Carson, R.T., and T., Groves. 2007. “Incentive and Informational Properties of Preference Questions.” Environmental and Resource Economics 37: 181–210.
12. Cuddeback, G., E., Wilson, J.G., Orme, and T., Combs-Orme. 2004. “Detecting and Statistically Correcting Sample Selection Bias.” Journal of Social Service Research 30 (3): 19–33.
13. Curtin, R., S., Presser, and E., Singer. 2000. “The Effects of Response Rate Changes on the Index of Consumer Sentiment.” Public Opinion Quarterly 64: 413–428.
14. Daly, A., S., Hess, and K., Train. 2012. “Assuring Finite Moments for Willingness to Pay in Random Coefficients Models.” Transportation 39 (1): 19–31.
15. Davidson, R., and J.G., Mackinnon. 1999. “Bootstrap Testing in Nonlinear Models. International Economic Review 40 (2): 487–580.
16. de Leeuw, E., and W., De Heer. 2002. “Trends in Household Survey Nonresponse: A Longitudinal and International Comparison.” In Survey Nonresponse, edited by R., Groves, D., Dillman, J., Eltinge, and R.J.A., Little, 41–54. New York: Wiley.
17. Dillman, D.A., G., Phelps, R., Tortora, K., Swift, J., Kohrell, J., Berck, and B.L., Messer. 2009. “Response Rate and Measurement Differences in Mixed-Mode Surveys using Mail, Telephone, Interactive Voice Response (IVR) and Internet.” Social Science Research 38 (1): 1–18.
18. Dubin, J.A., and D., Rivers. 1989. “Selection Bias in Linear Regression, Logit and Probit Models.” Sociological Methods and Research 18 (2 &3): 360–390.
19. Edwards, S.F., and G.D., Anderson. 1987. “Overlooked Biases in Contingent Valuation Surveys: Some Considerations.” Land Economics 63 (2): 168–178.
20. Ferrini, S., and R., Scarpa. 2007. “Designs with a Priori Information for Nonmarket Valuation with Choice Experiments: A Monte Carlo Study.” Journal of Environmental Economics and Management 53: 342–363.
21. Greene, W.H., 2003. Econometric Analysis. 5 ed. Upper Saddle River, NJ: Prentice Hall.
22. Groves, R.M., 2006. “Nonresponse Rates and Nonresponse Bias in Household Surveys.” The Public Opinion Quarterly 70 (5): 646–675.
23. Groves, R.M., and E., Peytcheva. 2008. “The Impact of Nonresponse Rates on Nonresponse Bias: A Meta-analysis.” Public Opinion Quarterly 72 (2): 167–189.
24. Guan, W., 2003. “From the Help Desk: Bootstrap Standard Errors.” The Stata Journal 3 (1): 71–80.
25. Hanemann, W.M., 1984. “Welfare Evaluation in Contingent Valuation Experiments with Discrete Responses.” American Journal of Agricultural Economics 66 (3): 332–341.
26. Heckman, J., 1979. “Sample Selection Bias as a Specification Error.” Econometrica 47 (1): 153–161.
27. Hensher, D., and W., Greene. 2003. “The Mixed Logit Model: The State of Practice.” Transportation 30 (2): 133–176.
28. Hole, A.R., 2007. “A Comparison of Approaches to Estimating Confidence Intervals for Willingness to Pay Measures.” Health Economics 16: 827–840.
29. Johnston, R.J., and J.C., Bergstrom. 2011. “Valuing Farmland Protection: Does Policy Guidance Depend on the Econometric Fine Print?” Applied Economic Perspectives and Policy 33 (4): 639–660.
30. Johnston, R.J., and J.M., Duke. 2007. “Willingness to Pay for Agricultural Land Preservation and Policy Process Attributes: Does the Method Matter?” American Journal of Agricultural Economics 89 (4): 1098–1115.
31. Johnston, R.J., and M., Ramachandran. 2014. “Modeling Spatial Patchiness and Hot Spots in Stated Preference Willingness to Pay.” Environmental and Resource Economics 59 (3): 363–387.
32. Johnston, R.J., J.J., Opaluch, M.J., Mazzotta, and G., Magnusson. 2005. “Who Are Resource Nonusers and What Can They Tell Us About Nonuse Values? Decomposing User and Nonuser Willingness to Pay for Coastal Wetland Restoration.” Water Resources Research 41 (7): W07017.
33. Johnston, R.J., E.T., Schultz, K., Segerson, E.Y., Besedin, and M., Ramachandran. 2012. “Enhancing the Content Validity of Stated Preference Valuation: The Structure and Function of Ecological Indicators.” Land Economics 88 (1): 102–120.
34. Johnston, R.J., S.K., Swallow, C.W., Allen, and L.A., Smith. 2002. “Designing Multidimensional Environmental Programs: Assessing Tradeoffs and Substitution in Watershed Management Plans.” Water Resources Research 38 (7): 1099–1105.
35. Johnston, R.J., S.K., Swallow, and T.F., Weaver. 1999. “Estimating Willingness to Pay and Resource Trade-offs with Different Payment Mechanisms: An Evaluation of a Funding Guarantee for Watershed Management.” Journal of Environmental Economics and Management 38 (1): 97–120.
36. Johnston, R.J., T.F., Weaver, L.A., Smith, and S.K., Swallow. 1995. “Contingent Valuation Focus Groups: Insights from Ethnographic Interview Techniques.” Agricultural and Resource Economics Review 24 (1): 56–69.
37. Kaplowitz, M., F., Lupi, and J.P., Hoehn. 2004. “Multiple Methods for Developing and Evaluating a Stated‐Choice Questionnaire to Value Wetlands.” In: Methods for Testing and Evaluating Survey Questionnaires, edited by Stanley Presser, Jennifer M. Rothgeb, Mick P. Couper, Judith T. Lessler, Elizabeth Martin, Jean Martin, and Eleanor Singer, 503–524. New York: Wiley.
38. King, G., and M.E., Roberts. 2015. “How Robust Standard Errors Expose Methodological Problems They Do Not Fix, and What to Do About It.” Political Analysis 23: 159–179.
39. Krinsky, I., and A.L., Robb. 1986. “On Approximating the Statistical Properties of Elasticities.” The Review of Economics and Statistics 68 (4): 715–719.
40. Loomis, J.B., 1987. “Expanding Contingent Value Sample Estimates to Aggregate Benefit Estimates: Current Practices and Proposed Solutions.” Land Economics 63 (4): 396–402.
41. Messonnier, M.L., J.C., Bergstrom, C.M., Cornwell, R.J., Teasley, and H.K., Cordell. 2000. “Survey Response-Related Biases in Contingent Valuation: Concepts, Remedies, and Empirical Application to Valuing Aquatic Plant Management.” American Journal of Agricultural Economics 82 (2): 438–450.
42. Murphy, K., and R., Topel, 1985. “Estimation and Inference in Two Step Econometric Models.” Journal of Business and Economic Statistics 3: 370–379.
43. National Research Council. 2013. Nonresponse in Social Science Surveys: A Research Agenda. Roger Tourangeau and Thomas J. Plewes, Editors. Panel on a Research Agenda for the Future of Social Science Data Collection, Committee on National Statistics. Division of Behavioral and Social Sciences and Education. Washington, DC: The National Academies Press.
44. Olsen, S.B., 2009. “Choosing Between Internet and Mail Survey Modes for Choice Experiment Surveys Considering Non-Market Goods.” Environmental and Resource Economics 44: 591–610.
45. Poe, G.L., K.L., Giraud, and J., Loomis. 2005. “Computational Methods for Measuring the Difference of Empirical Distributions.” American Journal of Agricultural Economics 87 (2): 353–365.
46. Rose, J.M., and M.C.J., Bliemer, 2008. “Stated Preference Experimental Design Strategies.” In Handbook of Transport Modelling, edited by D.A., Hensher and K.J., Button, 151–180. Oxford: Elsevier.
47. Sándor, Z., and M., Wedel. 2001. “Designing Conjoint Experiments Using Manager's Prior Beliefs.” Journal of Marketing Research 38: 430–444.
48. Sándor, Z., and M. Wedel., 2002. “Profile Construction in Experimental Choice Designs for Mixed Logit Models.” Marketing Science 21 (4): 455–475.
49. Sartori, A.E., 2003. “An Estimator for Some Binary-Outcome Selection Models Without Exclusion Restrictions.” Political Analysis 11 (2): 111–138.
50. Scarpa, R., and J.M., Rose. 2008. “Experimental Designs for Environmental Valuation with Choice Experiments: Monte Carlo Investigation.” Australian Journal of Agricultural and Resource Economics 52: 253–282.
51. Schkade, D.A., and J.W., Payne. 1994. “How People Respond to Contingent Valuation Questions: A Verbal Protocol Analysis of Willingness to Pay for an Environmental Regulation.” Journal of Environmental Economics and Management 26 (1): 88–109.
52. Schouten, B., F., Cobben, and J., Bethlehem. 2009. “Indicators for the Representativeness of Survey Response.” Survey Methodology 35: 101–113.
53. Skrondal, A., and S., Rabe-Hesketh. 2009. “Prediction in Multilevel Generalized Linear Models.” Journal of the Royal Statistical Society 172: 659–687.
54. Town of Old Saybrook. 2015. Report of Findings from a Study of the Effects of Sea Level Rise and Climate Change on Old Saybrook, Connecticut. Sea Level Rise Climate Adaptation Committee, Town of Old Saybrook, CT. December.
55. Train, K., 2009. Discrete Choice Methods with Simulation. 2nd ed. New York: Cambridge University Press.
56. Train, K.E., and M., Weeks. 2005. “Discrete Choice Models in Preference Space With Willingness-to-Pay Space.” In: Applications of Simulation Methods in Environmental and Resource Economics, edited by R., Scarpa, and A., Alberini, 1–16. Dordrecht: Springer.
57. Whitehead, J.C., 1991. “Environmental Interest Group Behavior and Self-selection Bias in Contingent Valuation Mail Surveys.” Growth and Change 22 (1): 10–21.
58. Whitehead, J.C., P.A., Groothuis, and G.C., Blomquist. 1993. “Testing for Non-response and Sample Selection Bias in Contingent Valuation: Analysis of a Combination Phone/Mail Survey.” Economics Letters 41: 215–220.
59. Yuan, Y., K.J., Boyle, and W., You. 2015. “Sample Selection, Individual Heterogeneity, and Regional Heterogeneity in Valuing Farmland Conservation Easements.” Land Economics 91 (4): 627–649.