Using uncertainty and sensitivity analyses in socioecological agent-based models to improve their analytical performance and policy relevance

PLoS ONE

Volumn 9, Issue 10, 2014, Pages

  Ligmann Zielinska, Arika ^a   Kramer, Daniel B ^a   Cheruvelil, Kendra Spence ^a   Soranno, Patricia A ^a  

^a MICHIGAN STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AGENT BASED MODEL; AGRICULTURAL LAND; ARTICLE; ENVIRONMENTAL PROTECTION; LAND USE; MATHEMATICAL MODEL; MEASUREMENT ACCURACY; SENSITIVITY ANALYSIS; UNCERTAINTY; AGRICULTURE; BIOLOGICAL MODEL; COMPUTER SIMULATION; ECOSYSTEM; ENVIRONMENTAL PLANNING; GEOGRAPHY; PROBABILITY; SOIL; UNITED STATES;

SOIL;

AGRICULTURE; COMPUTER SIMULATION; CONSERVATION OF NATURAL RESOURCES; ECOSYSTEM; ENVIRONMENTAL POLICY; GEOGRAPHY; MICHIGAN; MODELS, BIOLOGICAL; PROBABILITY; SOIL; UNCERTAINTY;

EID: 84908425542     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0109779     Document Type: Article

References (108)

1. An L, Linderman M, Qi J., Shortridge A, Liu J (2005) Exploring complexity in a human-environment system: An agent-based spatial model for multidisciplinary and multiscale integration. Annals of the Association of American Geographers 95: 54-79.
2. Parker DC, Manson SM, Janssen M.A., Hoffmann MJ, Deadman P (2003) Multi-agent systems for the simulation of land-use and land-cover change: A review. Annals of the Association of American Geographers 93: 314-337.
3. Parker DC, Entwisle B, Rindfuss R.R., Vanwey LK, Manson SM, et al. (2008) Case studies, cross-site comparisons, and the challenge of generalization: comparing agent-based models of land-use change in frontier regions. Journal of Land Use Science 3: 41-72.
4. Rindfuss RR, Entwisle B, Walsh S.J., An L., Badenoch N, et al. (2008) Land use change: complexity and comparisons. Journal of Land Use Science 3: 1-10.
5. Verburg PH, Kok K, Pontius JRG, Veldkamp A (2006) Modeling Land-Use and Land-Cover Change. In: Lambin EF, Geist HJ, editors. Land-Use and Land-Cover Change: Local Processes and Global Impacts. Berlin: Springer. pp. 117-135.
6. Verburg PH (2006) Simulating feedbacks in land use and land cover change models. Landscape Ecology 21: 1171-1183.
7. NRC (2013) Advancing Land Change Modeling: Opportunities and Research Requirements: The National Academies Press.
8. Bousquet F, Le Page C (2004) Multi-agent simulations and ecosystem management: a review. Ecological Modelling 176: 313-332.
9. Ligmann-Zielinska A (2010) Agent-based models. In: Warf B, editor. Encyclopedia of Geography Sage Publications. Thousand Oaks, USA: Sage Publications.
10. Huang Q, Parker DC, Sun S, Filatova T (2013) Effects of agent heterogeneity in the presence of a land-market: A systematic test in an agent-based laboratory. Computers, Environment and Urban Systems 41: 188-203.
11. Berger T (2001) Agent-based spatial models applied to agriculture: a simulation tool for technology diffusion, resource use changes and policy analysis. Agricultural Economics 25: 245-260.
12. Bert FE, Podestá GP, Rovere SL, Menéndez ÁN, North M, et al. (2011) An agent based model to simulate structural and land use changes in agricultural systems of the argentine pampas. Ecological Modelling 222: 3486-3499.
13. Evans TP, Phanvilay K, Fox J., Vogler J (2011) An agent-based model of agricultural innovation, land-cover change and household inequality: the transition from swidden cultivation to rubber plantations in Laos PDR. Journal of Land Use Science 6: 151-173.
14. Happe K, Kellermann K, Balmann A (2006) Agent-based analysis of agricultural policies: an illustration of the agricultural policy simulator AgriPoliS, its adaptation, and behavior. Ecology and Society 11.
15. Schreinemachers P, Berger T (2011) An agent-based simulation model of human-environment interactions in agricultural systems. Environmental Modelling & Software 26: 845-859.
16. Sengupta R, Lant C, Kraft S., Beaulieu J, Peterson W, et al. (2005) Modeling enrollment in the Conservation Reserve Program by using agents within spatial decision support systems: an example from southern Illinois. Environment and Planning B: Planning and Design 32: 821-834.
17. Beven K (2008) Environmental Modelling: An Uncertain Future? New York: Routledge. 328p.
18. CCSP (2009) Best Practice Approaches for Characterizing, Communicating, and Incorporating Scientific Uncertainty in Climate Decision Making. In: M. Granger Morgan HD, Max Henrion, David Keith, Robert Lempert, Sandra McBride, Mitchell Small, and Thomas Wilbanks, editor. Washington DC: Climate Change Science Program and the Subcommittee on Global Change Research. National Oceanic and Atmospheric Administration. pp. 96 pages.
19. Larocque GR, Bhatti JS, Boutin R, Chertov O (2008) Uncertainty analysis in carbon cycle models of forest ecosystems: Research needs and development of a theoretical framework to estimate error propagation. Ecological Modelling 219: 400-412.
20. Warmink JJ, Janssen JAEB, Booij MJ, Krol MS (2010) Identification and classification of uncertainties in the application of environmental models. Environmental Modelling & Software 25: 1518-1527.
21. Pontius R, Neeti N (2010) Uncertainty in the difference between maps of future land change scenarios. Sustainability Science 5: 39-50.
22. Pontius RG (2000) Quantification error versus location error in comparison of categorical maps. Photogrammetric Engineering and Remote Sensing 66: 1011-1016.
23. Couclelis H (2003) The Certainty of Uncertainty: GIS and the Limits of Geographic Knowledge. Transactions in GIS 7: 165-175.
24. Fisher P (1991) Models of uncertainty in spatial data. Geographical information systems: Principles and applications 1: 191-205.
25. Goodchild MF (2008) Imprecision and Spatial Uncertainty. In: Shekhar S, Xiong H, editors. Encyclopedia of GIS. New York: Springer.
26. Zhang J, Goodchild MF (2002) Uncertainty in Geographical Information. London: Taylor & Francis.
27. Schindler J (2013) About the Uncertainties in Model Design and Their Effects: An Illustration with a Land-Use Model. Journal of Artificial Societies and Social Simulation 16: 6.
28. Ligmann-Zielinska A (2013) Spatially-explicit sensitivity analysis of an agent-based model of land use change. International Journal of Geographical Information Science 27: 1764-1781.
29. Brown DG, Verburg PH, Pontius Jr RG, Lange MD (2013) Opportunities to improve impact, integration, and evaluation of land change models. Current Opinion in Environmental Sustainability 5: 452-457.
30. Ligmann-Zielinska A, Sun L (2010) Applying Time Dependent Variance-Based Global Sensitivity Analysis to Represent the Dynamics of an Agent-Based Model of Land Use Change. International Journal of Geographical Information Science 24: 1829-1850.
31. Saltelli A, Chan K, Scott EM (2000) Sensitivity Analysis. Chichester, England: Wiley-Interscience. 475p.
32. Campolongo F, Saltelli A, Sorensen T., Tarantola S (2000) Hitchhiker's Guide to Sensitivity Analysis. In: Saltelli A, Chan K, Scott EM, editors. Sensitivity Analysis. Chichester, England: Wiley-Interscience. pp. 15-47.
33. Saltelli A, Annoni P (2010) How to avoid a perfunctory sensitivity analysis. Environmental Modelling & Software 25: 1508-1517.
34. Saltelli A, D'Hombres B (2010) Sensitivity analysis didn't help. A practitioner's critique of the Stern review. Global Environmental Change 20: 298-302.
35. Fonoberova M, Fonoberov VA, Mezić I (2013) Global sensitivity/uncertainty analysis for agent-based models. Reliability Engineering & System Safety 118: 8-17.
36. Chu-Agor ML, Muñoz-Carpena R, Kiker G, Emanuelsson A, Linkov I (2011) Exploring vulnerability of coastal habitats to sea level rise through global sensitivity and uncertainty analyses. Environmental Modelling & Software 26: 593-604.
37. Makler-Pick V, Gal G, Gorfine M., Hipsey MR, Carmel Y (2011) Sensitivity analysis for complex ecological models - A new approach. Environmental Modelling & Software 26: 124-134.
38. Nossent J, Elsen P, Bauwens W (2011) Sobol' sensitivity analysis of a complex environmental model. Environmental Modelling & Software 26: 1515-1525.
39. Soboll A, Elbers M, Barthel R., Schmude J, Ernst A, et al. (2011) Integrated regional modelling and scenario development to evaluate future water demand under global change conditions. Mitigation and Adaptation Strategies for Global Change 16: 477-498.
40. Yang J (2011) Convergence and uncertainty analyses in Monte-Carlo based sensitivity analysis. Environmental Modelling & Software 26: 444-457.
41. Hosack GR, Li HW, Rossignol PA (2009) Sensitivity of system stability to model structure. Ecological Modelling 220: 1054-1062.
42. Mosler H-J, Martens T (2008) Designing environmental campaigns by using agent-based simulations: Strategies for changing environmental attitudes. Journal of Environmental Management 88: 805-816.
43. Estrada V, Diaz MS (2010) Global sensitivity analysis in the development of first principle-based eutrophication models. Environmental Modelling & Software 25: 1539-1551.
44. Melbourne-Thomas J, Johnson CR, Fulton EA (2011) Characterizing sensitivity and uncertainty in a multiscale model of a complex coral reef system. Ecological Modelling 222: 3320-3334.
45. Brown DG, Robinson DT (2006) Effects of heterogeneity in residential preferences on an agent-based model of urban sprawl. Ecology and Society 11.
46. Bennett D, McGinnis D (2008) Coupled and complex: Human-environment interaction in the Greater Yellowstone Ecosystem, USA. Geoforum 39: 833-845.
47. Schluter M, Pahl-Wostl C (2007) Mechanisms of resilience in common-pool resource management systems: an agent-based model of water use in a river basin. Ecology and Society 12.
48. Guzy MR, Smith CL, Bolte J.P., Hulse DW, SV G (2008) Policy research using agent-based modeling to assess future impacts of urban expansion into farmlands and forests. Ecology and Society 13.
49. Pannell DJ (1997) Sensitivity analysis of normative economic models: theoretical framework and practical strategies. Agricultural Economics 16: 139-152.
50. Alexander ER (1989) SENSITIVITY ANALYSIS IN COMPLEX DECISION-MODELS. Journal of the American Planning Association 55: 323-333.
51. Insua DR, French S (1991) A FRAMEWORK FOR SENSITIVITY ANALYSIS IN DISCRETE MULTIOBJECTIVE DECISION-MAKING. European Journal of Operational Research 54: 176-190.
52. Ligmann-Zielinska A, Jankowski P (2008) A Framework for Sensitivity Analysis in Spatial Multiple Criteria Evaluation. In: Cova TJ, Miller HJ, Beard K, Frank AU, Goodchild MF, editors. Geographic Information Science Proceedings 5th International Conference, GIScience 2008, Park City, UT, USA, September 23-26, 2008. Berlin/Heidelberg: Springer. pp. 217-233.
53. Saltelli A, Funtowicz S (2014) When All Models Are Wrong. Issues in Science and Technology: 79-85.
54. Saltelli A, Guimarães Pereira Â, Van der Sluijs JP, Funtowicz S (2013) What do I make of your latinorum? Sensitivity auditing of mathematical modelling. International Journal of Foresight and Innovation Policy 9: 213-234.
55. Parry HR, Topping CJ, Kennedy M.C., Boatman ND, Murray AWA (2013) A Bayesian sensitivity analysis applied to an Agent-based model of bird population response to landscape change. Environmental Modelling & Software 45: 104-115.
56. Segovia-Juarez JL, Ganguli S, Kirschner D (2004) Identifying control mechanisms of granuloma formation during M. tuberculosis infection using an agent-based model. Journal of Theoretical Biology 231: 357-376.
57. Dancik GM, Jones DE, Dorman KS (2010) Parameter estimation and sensitivity analysis in an agent-based model of Leishmania major infection. Journal of Theoretical Biology 262: 398-412.
58. Vanuytrecht E, Raes D, Willems P (2014) Global sensitivity analysis of yield output from the water productivity model. Environmental Modelling & Software 51: 323-332.
59. Convertino M, Muñoz-Carpena R, Chu-Agor ML, Kiker GA, Linkov I (2014) Untangling drivers of species distributions: Global sensitivity and uncertainty analyses of MaxEnt. Environmental Modelling & Software 51: 296-309.
60. Baroni G, Tarantola S (2014) A General Probabilistic Framework for uncertainty and global sensitivity analysis of deterministic models: A hydrological case study. Environmental Modelling & Software 51: 26-34.
61. Beven K (2002) Towards a Coherent Philosophy for Modelling the Environment. Proceedings: Mathematical, Physical and Engineering Sciences 458: 2465-2484.
62. Epstein JM (2008) Why Model? Journal of Artificial Societies and Social Simulation 11: 12.
63. Saltelli A, Annoni P, Azzini I., Campolongo F, Ratto M, et al. (2010) Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index. Computer Physics Communications 181: 259-270.
64. Chen Y, Yu J, Khan S (2013) The spatial framework for weight sensitivity analysis in AHP-based multi-criteria decision making. Environmental Modelling & Software 48: 129-140.
65. Daniel C (1958) 131 Note: On Varying One Factor at a Time. Biometrics 14: 2.
66. Menard A, Marceau DJ (2005) Exploration of spatial scale sensitivity in geographic cellular automata. Environment and Planning B: Planning and Design 32: 693-714.
67. Kocabas V, Dragicevic S (2006) Assessing cellular automata model behaviour using a sensitivity analysis approach. Computers, Environment and Urban Systems 30: 921-953.
68. Perez L, Dragicevic S (2009) An agent-based approach for modeling dynamics of contagious disease spread. International Journal of Health Geographics 8: 50.
69. Lilburne L, Tarantola S (2009) Sensitivity analysis of spatial models. International Journal of Geographical Information Science 23: 151-168.
70. Saltelli A, Ratto M, Andres T., Campolongo F, Cariboni J, et al. (2008) Global Sensitivity Analysis: The Primer. Chichester, England: Wiley-Interscience. 304p.
71. Ligmann-Zielinska A (2013) Spatially-Explicit Sensitivity Analysis of an Agent-Based Model of Land Use Change. International Journal of Geographical Information Science online.
72. Homma T, Saltelli A (1996) Importance measures in global sensitivity analysis of nonlinear models. Reliability Engineering & System Safety 52: 1-17.
73. Lempert R, Popper S, Bankes S (2003) Shaping the Next One Hundred Years New Methods for Quantitative, Long-Term Policy Analysis. Santa Monica, CA: RAND. MR-1626-RPC MR-1626-RPC. 210p.
74. Becker BJ, Schram CM (1994) Examining explanatory models through research synthesis. In: Cooper H, Hedges LV, editors. The handbook of research synthesis. New York: Russell Sage Foundation.
75. Lambert DM, Sullivan P, Claassen R (2007) Working Farm Participation and Acreage Enrollment in the Conservation Reserve Program. Journal of Agricultural and Applied Economics 39: 151-169.
76. Lambert DM, Sullivan P, Claassen R., Foreman L (2007) Profiles of US farm households adopting conservation-compatible practices. Land Use Policy 24: 72-88.
77. Lambert DM, Sullivan P, Claassen R., Foreman L (2006) Conservation-Compatible Practices and Programs: Who Participates?: United States Department of Agriculture. 48p.
78. Wossink GAA, Wenum JHV (2003) Biodiversity conservation by farmers: analysis of actual and contingent participation. European Review of Agricultural Economics 30: 461.
79. USDA FSA (2012) Conservation Reserve Program Overview. United States Department of Agriculture Farm Service Agency, http://www.fsa.usda.gov/.
80. USDA (2013) United States Census of Agriculture, http://www.agcensus.usda.gov/.
81. Yager RR (1988) On ordered weighted averaging aggregation operators in multi-criteria decision making. IEEE Transactions on Systems, Man and Cybernetics 18: 183-190.
82. Rinner C, Malczewski J (2002) Web-Enabled Spatial Decision Analysis Using Ordered Weighted Averaging (OWA). Journal of Geographical Systems 4: 385-403.
83. Jager W, Janssen MA, De Vries HJM, De Greef J, Vlek CAJ (2000) Behaviour in commons dilemmas: Homo economicus and Homo psychologicus in an ecological-economic model. Ecological Economics 35: 357-379.
84. USDA FSA (2010) Notice CRP-665 Grouped Soil Productivity Factors for 2010 SRR's. Washington, DC United States Department of Agriculture Farm Service Agency.
85. USDA FSA (2011) Conservation Reserve Program Sign-up 41 Environmental Benefits Index (EBI) Fact Sheet. United States Department of Agriculture Farm Service Agency.
86. USDA NASS (2012) Cropland Data Layer (CDL). United States Department of Agriculture National Agricultural Statistics Service.
87. USGS (2012) National Hydrography Dataset (NHD). United States Geological Survey.
88. Soil Survey Staff (2013) The Gridded Soil Survey Geographic (gSSURGO) Database for Michigan. Natural Resources Conservation Service, United States Department of Agriculture.
89. USGS (2013) National Elevation Dataset. USGS.
90. Schaetzl RJ, Krist FJJ, Miller BA (2012) A Taxonomically Based, Ordinal Estimate of Soil Productivity for Landscape-Scale Analyses. Soil Science 177.
91. Kingsbury L, Boggess W (1999) An Economic Analysis of Riparian Landowners' Willingness to Participate in Oregon's Conservation Reserve Enhancement Program. The Annual Meeting of the American Agricultural Economics Association pp. 15.
92. Chang H-H, Lambert D.M., Mishra AK (2008) Does participation in the conservation reserve program impact the economic well-being of farm households? Agricultural Economics 38: 201-212.
93. Greiner R, Patterson L, Miller O (2009) Motivations, risk perceptions and adoption of conservation practices by farmers. Agricultural Systems 99: 86-104.
94. Brady M, Nickerson C (2009) A Spatial Analysis of Conservation Reserve Program Participants: The Impact of Absenteeism on Participation Decisions. The Annual Meeting of the Agricultural and Applied Economics Association pp. 27.
95. USDA (2011) Agricultural Resource Management Survey (ARMS).
96. Burnham KP, Anderson DR (2002) Model selection and multimodel inference: A practical information-theoretic approach New York, USA: Springer-Verlag.
97. Saltelli A, Tarantola S, Campolongo F., Ratto M (2004) Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models. Chichester, England: Wiley. 232p.
98. USDA FSA (2013) Conservation Programs Reports and Statistics. United States Department of Agriculture Farm Service Agency.
99. Sobol' IM (1993) Sensitivity estimates for nonlinear mathematical models. Mathematical Modeling and Computational Experiment 1: 407-414.
100. Malczewski J (1999) GIS and Multicriteria Decision Analysis. New York: John Wiley & Sons, Inc.
101. McGarigal K, Marks B, J, (1995) FRAGSTATS: Spatial Pattern Analysis Program for Quantifying Landscape Structure. Portland, OR: USDA Forest Service, Pacific Northwest Research Station. PNW-GTR-351 PNW-GTR-351.
102. Hellerstein D (2010) Challenges facing the USDA's Conservation Reserve Program. USDA ERS.
103. Matthews RB, Gilbert NG, Roach A, Polhill J.G., Gotts NM (2007) Agent-based land-use models: a review of applications. Landscape Ecology 22: 1447-1459.
104. Heppenstall AJ, Crooks AT, See L.M., Batty M., editors(2012) Agent-Based Models of Geographical Systems. Dordrecht: Springer. 746p.
105. Lempert RJ (2002) Agent-based modeling as organizational and public policy simulators. Proceedings of the National Academy of Sciences of the United States of America 99: 7195-7196.
106. Rockström J, Steffen W, Noone K., Persson Å, Chapin FS, et al. (2009) A safe operating space for humanity. Nature 461: 472-475.
107. Polasky S, Carpenter SR, Folke C, Keeler B (2011) Decision-making under great uncertainty: environmental management in an era of global change. Trends in ecology & evolution 26: 398-404.
108. USDA FSA (2010) Notice CRP-663 Sign-up 41 Revised Soil Rental Rates (SRR's) for 2010. Washington, DC United States Department of Agriculture Farm Service Agency.