Global sensitivity analysis for large-scale socio-hydrological models using Hadoop

Environmental Modelling and Software

Volumn 73, Issue , 2015, Pages 231-243

  Hu, Yao ^a   Garcia Cabrejo, Oscar ^a   Cai, Ximing ^a   Valocchi, Albert J ^a   DuPont, Benjamin ^b  

^a University of Illinois at Urbana Champaign   (United States)

^b Nebland Software LLC   (United States)

Author keywords

Global Sensitivity Analysis; Hadoop; Multi agent system; Polynomial Chaos Expansion; Socio hydrological model

Indexed keywords

GROUNDWATER; HYDROLOGY; MULTI AGENT SYSTEMS;

BEHAVIORAL PARAMETERS; GLOBAL SENSITIVITY ANALYSIS; HADOOP; HYDROLOGICAL MODELING; POLYNOMIAL CHAOS EXPANSION; POLYNOMIAL CHAOS EXPANSION (PCE); SPATIO-TEMPORAL VARIATION; VARIANCE DECOMPOSITION;

SENSITIVITY ANALYSIS;

GROUNDWATER-SURFACE WATER INTERACTION; HYDROLOGICAL MODELING; RIVER BASIN; SENSITIVITY ANALYSIS; SPATIOTEMPORAL ANALYSIS; SURROGATE METHOD; WATER TABLE;

REPUBLICAN BASIN; UNITED STATES;

EID: 84940778157     PISSN: 13648152     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.envsoft.2015.08.015     Document Type: Article

References (44)

1. Alexanderian A., Winokur J., Sraj I., Srinivasan A., Iskandarani M., Thacker W.C., Knio O.M. Global sensitivity analysis in an ocean general circulation model: a sparse spectral projection approach. Comput. Geosci. 2012, 16(3):757-778.
2. Axelrod R. Advancing the Art of Simulation in the Social Sciences. Simulating Social Phenomena 1997, 21-40. Springer.
3. Bier A. A. Sensitivity Analysis Techniques for System Dynamics Models of Human Behavior 2011.
4. Borthakur D. Hadoop Distributed File System 2007, Apache Software Foundation.
5. Carnell R., Carnell M.R. Package lhs 2012.
6. Chattoe E., Saam N.J., Möhring M. Sensitivity Analysis in the Social Sciences: Problems and Prospects. Tools and Techniques for Social Science Simulation 2000, 243-273. Springer.
7. Dean J., Ghemawat S. Mapreduce: simplified data processing on large clusters. Commun. ACM 2008, 51(1):107-113. 10.1145/1327452.1327492.
8. Eldred M.S., Burkardt J. Comparison of non-intrusive polynomial chaos and stochastic collocation methods for uncertainty quantification. AIAA Proceedings 2009, 1-20.
9. Francos A., Elorza F.J., Bouraoui F., Bidoglio G., Galbiati L. Sensitivity analysis of distributed environmental simulation models: understanding the model behaviour in hydrological studies at the catchment scale. Reliab. Eng. Syst. Saf. 2003, 79(2):205-218.
10. Garcia-Cabrejo O., Valocchi A. Global sensitivity analysis for multivariate output using polynomial chaos expansion. Reliab. Eng. Syst. Saf. 2014, 126:25-36.
11. Ghanem R.G., Spanos P.D. Stochastic Finite Elements: a Spectral Approach 1991, Springer.
12. Hadoop Map/Reduce tutorial (2013). https://hadoop.apache.org/docs/r1.2.1/mapred_tutorial.html.
13. Happe K. Agent-based modelling and sensitivity analysis by experimental design and metamodelling: an application to modelling regional structural change. XIth International Congress of the European Association of Agricultural Economists 2005.
14. Homma T., Saltelli A. Importance measures in global sensitivity analysis of nonlinear models. Reliab. Eng. Syst. Saf. 1996, 52(1):1-17.
15. Hu Y., Cai X., DuPont B. Design of a web-based application of the coupled multi-agent system model and environmental model for watershed management analysis using Hadoop. Environ. Model. Softw. 2015, 10.1016/j.envsoft.2015.04.011.
16. Huard D., Mailhot A. A bayesian perspective on input uncertainty in model calibration: application to hydrological model "abc". Water Resour. Res. 2006, 42(7):W07416. 10.1029/2005WR004661.
17. Hunt R.J., Luchette J., Schreuder W.A., Rumbaugh J.O., Doherty J., Tonkin M.J., Rumbaugh D.B. Using a cloud to replenish parched groundwater modeling efforts. Ground Water 2010, 48(3). 10.1111/j.1745-6584.2010.00699.x.
18. Kelly R.A., Jakeman A.J., Barreteau O., Borsuk M.E., ElSawah S., Hamilton S.H., Rizzoli A.E., et al. Selecting among five common modelling approaches for integrated environmental assessment and management. Environ. Model. Softw. 2013, 47:159-181.
19. Kleijnen J.P., Sanchez S.M., Lucas T.W., Cioppa T.M. A User's Guide to the Brave New World of Designing Simulation Experiments 2003, Tilburg University.
20. Lee P.M. Bayesian Statistics: an Introduction 2004, Arnold Publishing. third ed.
21. Liebl F. Simulation: Problemorientierte Einführung Oldenbourg 1995.
22. McKusick V. Final Report for the Special Master with Certificate of Adoption of Rrca Groundwater Model 2003, 3605. State of Kansas v. State of Nebraska and State of Colorado, in the Supreme Court of the United States.
23. Molle F. River-basin planning and management: the social life of a concept. Geoforum 2009, 40(3):484-494.
24. Moreau P., Viaud V., Parnaudeau V., Salmon-Monviola J., Durand P. An approach for global sensitivity analysis of a complex environmental model to spatial inputs and parameters: a case study of an agro-hydrological model. Environ. Model. Softw. 2013, 47:74-87.
25. Mulligan K.B., Brown C., Yang Y.E., Ahlfeld D.P. Assessing groundwater policy with coupled economic-groundwater hydrologic modeling. Water Resour. Res. 2014, 50(3):2257-2275.
26. Murphy K.P. Conjugate Bayesian Analysis of the Gaussian Distribution 2007, Technical Report, University of British Columbia.
27. Nielsen M. Write Your First Map Reduce Program in 20 Minutes. Michael's Main Blog 2009, http://michaelnielsen.org/blog/write-your-first-mapreduce-program-in-20-minutes/.
28. North M.J., Macal C.M. Managing Business Complexity: Discovering Strategic Solutions with Agent-based Modeling and Simulation 2007, Oxford University Press.
29. Pappenberger F., Beven K.J., Ratto M., Matgen P. Multi-method global sensitivity analysis of flood inundation models. Adv. Water Resour. 2008, 31(1):1-14.
30. Republican River Compact Administration (RRCA) Republican River Compact Administration Ground Water Model 2003, http://www.republicanrivercompact.org/v12p/RRCAModelDocumentation.pdf.
31. Saltelli A. Making best use of model evaluations to compute sensitivity indices. Comput. Phys. Commun. 2002, 145(2):280-297.
32. Saltelli A., Ratto M., Andres T., Campolongo F., Cariboni J., Gatelli D., Tarantola S., et al. Global Sensitivity Analysis: the Primer 2008, John Wiley & Sons.
33. Sobol I. Sensitivity estimates for nonlinear mathematical models. Math. Model. Comput. Exp. 1993, 1:407414.
34. Stocki R. A method to improve design reliability using optimal Latin hypercube sampling. Comput. Assist. Mech. Eng. Sci. 2005, 12(4):393.
35. Storlie C.B., Helton J.C. Multiple predictor smoothing methods for sensitivity analysis: description of techniques. Reliab. Eng. Syst. Saf. 2008, 93(1):28-54.
36. Sudret B. Global sensitivity analysis using polynomial chaos expansions. Reliab. Eng. Syst. Saf. 2008, 93(7):964-979.
37. Sweetapple C., Fu G., Butler D. Identifying key sources of uncertainty in the modelling of greenhouse gas emissions from wastewater treatment. Water Res. 2013, 47(13):4652-4665.
38. Sweetapple C., Fu G., Butler D. Identifying sensitive sources and key control handles for the reduction of greenhouse gas emissions from wastewater treatment. Water Res. 2014, 62:249-259.
39. Van Hemel S.B., MacMillan J., Zacharias G.L. Behavioral Modeling and Simulation: from Individuals to Societies 2008, National Academies Press.
40. Wainwright H.M., Finsterle S., Jung Y., Zhou Q., Birkholzer J.T. Making sense of global sensitivity analyses. Comput. Geosci. 2014, 65:84-94.
41. Wiener N. The homogeneous chaos. Am. J. Math. 1938, 897-936.
42. Xiu D. Numerical Methods for Stochastic Computations: a Spectral Method Approach 2010, Princeton University Press.
43. Xiu D., Karniadakis G.E. The wiener-askey polynomial chaos for stochastic differential equations. SIAM J. Sci. Comput. 2002, 24(2):619-644.
44. Zhang C., Chu J., Fu G. Sobol's sensitivity analysis for a distributed hydrological model of Yichun river basin, china. J. Hydrology 2013, 480:58-68.