An open source framework for many-objective robust decision making

Environmental Modelling and Software

Volumn 74, Issue , 2015, Pages 114-129

  Hadka, David ^a   Herman, Jonathan ^d   Reed, Patrick ^b   Keller, Klaus ^a,c  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

^b School of Chemical and Molecular Engineering   (United States)

^c CARNEGIE MELLON UNIVERSITY   (United States)

^d Davis   (United States)

Author keywords

Deep uncertainty; Risk assessment; Robust decision making; Robustness; Scenario discovery; Threshold

Indexed keywords

APPLICATION PROGRAMMING INTERFACES (API); APPLICATION PROGRAMS; COMMERCE; COMPUTER PROGRAMMING; COMPUTER SYSTEMS PROGRAMMING; DECISION SUPPORT SYSTEMS; ECONOMIC AND SOCIAL EFFECTS; ENVIRONMENTAL MANAGEMENT; INFORMATION DISSEMINATION; LAKE POLLUTION; LAKES; OPEN SOURCE SOFTWARE; OPEN SYSTEMS; PROBLEM ORIENTED LANGUAGES; RISK ASSESSMENT; RISK PERCEPTION; ROBUSTNESS (CONTROL SYSTEMS); SOFTWARE ENGINEERING; VISUALIZATION; WATER POLLUTION; WATER QUALITY; WEBSITES;

COMPUTATIONAL EXPLORATION; DEEP UNCERTAINTIES; ENVIRONMENTAL OBJECTIVES; HIGH DIMENSIONAL DATASETS; MANY-OBJECTIVE OPTIMIZATIONS; ROBUST DECISIONS; SCENARIO DISCOVERY; THRESHOLD;

DECISION MAKING;

COMPUTER SIMULATION; DATA SET; DECISION MAKING; ENVIRONMENTAL MANAGEMENT; MULTICRITERIA ANALYSIS; OPTIMIZATION; RISK ASSESSMENT; SENSITIVITY ANALYSIS; SOFTWARE; THRESHOLD; UNCERTAINTY ANALYSIS; VISUALIZATION; WORLD WIDE WEB;

EID: 84939535868     PISSN: 13648152     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.envsoft.2015.07.014     Document Type: Article

References (77)

1. Bankes S. Exploratory modeling for policy analysis. Oper. Res. 1993, 41:435-449.
2. Ben-Haim Y. Uncertainty, probability and information-gaps. Reliab. Eng. Syst. Saf. 2004, 85(1-3):249-266.
3. Breiman L., Friedman J.H., Olshen R.A., Stone C.J. Classification and Regression Trees. 1984, Wadsworth.
4. Brill E.D., Flach J., Hopkins L., Ranjithan S. MGA: a decision support system for complex, incompletely defined problems. IEEE Trans. Syst. Man, Cybern. 1990, 20(4):745-757.
5. Brown C. Decision-scaling for Robust Planning and Policy Under Climate Uncertainty 2010, World Resources Report 2010-2011 Uncertainty Series.
6. Brown C., Ghile Y., Laverty M., Li K. Decision scaling: linking bottom-up vulnerability analysis with climate projections in the water sector. Water Resour. Res. 2012, 48:W09537.
7. Bryant B.P. Sdtoolkit: Scenario Discovery Tools to Support Robust Decision Making 2014, R package version 2.33-1. http://CRAN.R-project.org/package=sdtoolkit.
8. Bryant B.P., Lempert R.J. Thinking inside the box: a participatory, computer-assisted approach to scenario discovery. Technol. Forecast. Soc. Change 2010, 77(1):34-49.
9. Cahon S., Melab N., Talbi E.-G. ParadisEO: a framework for the reusable design of parallel and distributed metaheuristics. J. Heuristics 2004, 10(3):357-380.
10. Carpenter S.R., Ludwig D., Brock W.A. Management of eutrophication of lakes subject to potentially irreversible change. Ecol. Appl. 1999, 9(751):771.
11. Coello Coello C., Lamont G.B., van Veldhuizen D.A. Evolutionary Algorithms for Solving Multi-objective Problems 2007, Springer-Verlag New York, Inc. second ed.
12. Cohon J., Marks D. A review and evaluation of multiobjective programming techniques. Water Resour. Res. 1975, 11(2):208-220.
13. Conway J., Eddelbuettel D., Nishiyama T., Prayaga S.K., Tiffin N. RPostgreSQL: R Interface to the PostgreSQL Database System 2013, R package version 0.4. http://CRAN.R-project.org/package=RPostgreSQL.
14. D'Ervau E.L. Optimizing Early-warning Monitoring Systems for Improved Drinking Water Resource Protection 2013, (Master's thesis), Universität Stuttgart, 8 October.
15. Duong T. Prim: Patient Rule Induction Method (PRIM) 2014, R package version 1.0.14. http://CRAN.R-project.org/package=prim.
16. Durillo J.J., Nebro A.J., Alba E. The jMetal framework for multi-objective optimization: design and architecture. 2010 IEEE Congress on Evolutionary Computation, 4138-4325, 18-23 July 2010.
17. Friedman J.H., Fisher N.I. Bump-hunting for high dimensional data. Stat. Comput. 1999, 9:123-143.
18. Ghile Y., Taner M., Brown C., Grijsen J., Talbi A. Bottom-up climate risk assessment of infrastructure investment in the Niger river Basin. Clim. Change 2014, 122:97-110.
19. Giuliani M., Herman J., Castelletti A., Reed P. Many-objective reservoir policy identification and refinement to reduce policy inertia and myopia in water management. Water Resour. Res. 2014, 50(4):3355-3377.
20. Groves D.G., Lempert R.J. A new analytic method for finding policy-relevant scenarios. Glob. Environ. Change 2007, 17:73-85.
21. Haasnoot M., Kwakkel J.H., Walker W.E., ter Matt J. Dynamic adaptive policy pathways: a method for crafting robust decisions for a deeply uncertain world. Glob. Environ. Change 2013, 23:485-498.
22. Hadka D., Reed P.M., Simpson T.W. Diagnostic assessment of the borg MOEA on many-objective product family design problems. WCCI 2012 world congress on computational intelligence. Congr. Evol. Comput. 2012, 21(2):231-259.
23. Hadka D., Reed P.M. Diagnostic assessment of search controls and failure modes in many-objective evolutionary optimization. Evol. Comput. 2012, 20(3):423-452.
24. Hadka D., Reed P.M. Borg: an auto-adaptive many-objective evolutionary computing framework. Evol. Comput. 2013, 21(2):231-259.
25. Hadka D. MOEA Framework: a Free and Open Source Java Framework for Multiobjective Optimization. User Manual 2014, Version 2.4. http://www.moeaframework.org/.
26. Hadka D., Reed P.M. Large-scale parallelization of the Borg MOEA for many-objective optimization of complex environmental systems. Environ. Model. Softw. 2015, v69:353-369.
27. Hall J.W., Lempert R.J., Keller K., Hackbarth A., Mijere C., McInerney D.J. Robust climate policies under uncertainty: a comparison of robust decision making and info-gap methods. Risk Anal. 2012, 32(10):1657-1672.
28. Hamarat C., Kwakkel J.H., Pruyt E. Adaptive robust design under deep uncertainty. Technol. Forecast. Soc. Change 2013, 80(3):408-418.
29. Herman J.D., Reed P.M., Zeff H.B., Characklis G.W. How should robustness be defined for water systems planning under change?. J. Water Resour. Manag. 2015, 04015012. 10.1061/(ASCE)WR.1943-5452.0000509.
30. Herman J.D., Zeff H.B., Reed P.M., Characklis G.W. Beyond optimality: multistakeholder robustness tradeoffs for regional water portfolio planning under deep uncertainty. Water Resour. Res. 2014, 50. 10.1002/2014WR015338.
31. Hine D., Hall J.W. Information gap analysis of flood model uncertainties and regional frequency analysis. Water Resour. Res. 2010, 46:W01514.
32. Hipel K.W., Ben-Haim Y. Decision making in an uncertain world: information-gap modeling in water resources management. IEEE Trans. Syst. Man, Cybern. - C Appl. Rev. 1999, 29(4):506-517.
33. Kasprzyk J.R., Reed P.M., Kirsch B.R., Characklis G.W. Many-Objective de novo water Supply portfolio planning under deep uncertainty. Environ. Model. Softw. 2012, 34:87-104.
34. Kasprzyk J.R., Nataraj S., Reed P.M., Lempert R.J. Many objective robust decision making for complex environmental systems undergoing change. Environ. Model. Softw. 2013, 42:55-71.
35. Knight F.H. Risk, Uncertainty and Profit. Hart, Schaffner and Marx, N.Y 1921.
36. Kollat J.B., Reed P.M. A framework for visually interactive decision-making and design using evolutionary multi-objective optimization (VIDEO). Environ. Model. Softw. 2007, 22:1691-1704.
37. Korteling B., Dessai S., Kapelan Z. Using information-gap decision theory for water resources planning under severe uncertainty. Water Resour. Manag. 2013, 27:1149-1172.
38. Kwadijk J.C.J., Haasnoot M., Mulder J.P.M., Hoogvliet M.M.C., Jeuken A.B.M., van der Krogt R.A.A., van Oostrom N.G.C., Schelfhout H.A., van Velzen E.H., van Waveren H., de Wit M.J.M. Using adaptation tipping points to prepare for climate change and sea level rise: a case study in the Netherlands. WIREs Clim. Change 2010, 1:729-740.
39. Kwakkel J.H. Exploratory modelling and analysis (EMA) workbench (accessed 27.04.15.). http://simulation.tbm.tudelft.nl/ema-workbench/contents.html.
40. Kwakkel J.H., Pruyt E. Exploratory modeling and Analysis, an approach for model-based foresight under deep uncertainty. Technol. Forecast. Soc. Change 2013, 80:419-431.
41. Lempert R.J. A new decision Sciences for complex systems. Proc. Natl. Acad. Sci. 2002, 99:7309-7313.
42. Lempert R.J., Collins M. Managing the risk of an uncertain threshold response: comparison of robust, optimum, and precautionary approaches. Risk Anal. 2007, 27(4):1009-1026.
43. Lempert R.J., Sriver R., Keller K. Characterizing Uncertain Sea Level Rise Projections to Support Infrastructure Investment Decisions 2012, California Energy Commission, Publication Number CEC-500-2012-056.
44. Lempert R.J., Popper S.W., Bankes S.C. Shaping the Next One Hundred Years: New Methods for Quantitative 2013, Long-Term Policy Analyses, RAND, Santa Monica, CA.
45. Lempert R.J., Groves D.G., Popper S.W., Bankes S.C. A general, analytic method for generating robust strategies and narrative scenarios. Manag. Sci. 2006, 52(4):514-528.
46. Lempert R.J., Bryant B.P., Bankes S.C. Comparing Algorithms for Scenario Discovery 2008, RAND Corporation, Working Paper WR-557-NSF.
47. Lownsbery K.E. Quantifying the Impacts of Future Uncertainties on the Apalachicola-Chattahoochee-Flint Basin 2014, (Masters Project), Department of Civil and Environmental Engineering, University of Massachusetts - Amherst.
48. Maass A., Hufschmidt M., Dorfman R., Thomas H., Marglin S., Fair G. Design of Water-resource Systems: New Techniques for Relating Economic Objectives, Engineering Analysis, and Governmental Planning 1962, Harvard University Press, Cambridge, MA.
49. Matrosov E.S., Woods A.M., Harou J.J. Robust decision making and info-gap decision theory for water resource system planning. J. Hydrol. 2013, 494:43-58.
50. Moody P., Brown C. Robustness indicators for evaluation under climate change: application to the upper Great Lakes. Water Resour. Res. 2013, 49:W20228.
51. Nazemi A., Wheater H.S. Assessing the vulnerability of water supply to changing streamflow conditions. EOS Trans. Am. Geophys. Union 2014, 95(32):288.
52. Newell R.G., Pizer W.A. Discounting the distant future: how much do uncertain rates increase valuations?. J. Environ. Econ. Manag. 2003, 46:52-71.
53. Nicklow J., Reed P.M., Savic D., Dessalegne T., Harrell L., Chan-Hilton A., Karamouz M., Minsker B., Ostfeld A., Singh A., Zechman E. State of the art for genetic algorithms and beyond in water resources planning and management. J. Water Resour. Plan. Manag. 2010, 136(4):412-432.
54. Olson R., Sriver R., Goes M., Urban N.M., Matthews H.D., Haran M., Keller K. A climate sensitivity estimate using global average observations and an earth system model with a dynamic 3D ocean. J. Geophys. Res. Atmos. 2012, 117:D04103. 10.1029/2011JD016620.
55. Pareto V. Cours d'Économie Politique 1896, Droz, Geneva.
56. Plischke E., Borgonovo E., Smith C.L. Global sensitivity measures from given data. Eur. J. Oper. Res. 2013, 226(3):536-550.
57. Pujol G., Iooss B., Janon A., Lemaitre P., Gilguin L., Gratiet L.L., touati T., Ramos B., Fruth J., Veiga S.D. Package 'sensitivity': Sensitivity Analysis 2014, R package version 1.9. http://CRAN.R-project.org/package=sensitivity.
58. R Development Core Team R: a Language and Environment for Statistical Computing 2008, R Foundation for Statistical Computing, Vienna, Austria, ISBN: 3-900051-08-0. http://www.R-project.org/.
59. Reed P.M., Hadka D., Herman J., Kasprzyk J., Kollat J. Evolutionary multiobjective optimization in water resources: the past, present, and future. Adv. Water Resour. 2013, 51:438-456.
60. Roy B. Decision-aiding Today: What Should We Expect? Multicriteria Decision Making: Advances in MCDM Models, Algorithms, Theory, and Applications 1999, 1-35. Springer.
61. RStudio, Inc Shiny: Web Application Framework for R. R Package Version 0.10.1 2014, http://CRAN.R-project.org/package=shiny.
62. Saltelli A., Chan K., Scott E. Sensitivity Analysis 2008, Wiley, New York, NY.
63. Savage L.J. The theory of statistical decision. J. Am. Stat. Assoc. 1951, 46(253):55-67.
64. Schneller G., Sphicas G. Decision making under uncertainty: Starr's domain criterion. Theory Decis. 1983, 15(4):321-336.
65. Simon H.A. Theories of decision-making in economics and behavioral science. Am. Econ. Rev. 1959, 49(3):253-283.
66. Starr M.K. Product Design and Decision Theory. 1962, Prentice-Hall, Englewood Cliffs, N. J.
67. Singh R., Reed P.M., Keller K. Many-objective robust decision making for managing an ecosystem with a deeply uncertain threshold response. Ecol. Soc. 2015, 20(3):12. 10.5751/ES-07687-200312.
68. Triantaphyllou E. Multi-criteria Decision Making: a Comparative Study. Dordrecht 2000, Kluwer Academic Publishers, ISBN 0-7923-6607-7, The Netherlands.
69. Turner S.W., Marlow D., Ekström M., Rhodes B.G., Kularathna U., Jeffrey P.J. Linking climate projections to performance: a yield-based decision scaling assessment of a large urban water resources system. Water Resour. Res. 2014, 50:3553-3567.
70. Tsoukias A. From decision theory to decision aiding methodology. Eur. J. Oper. Res. 2008, 187(1):138-161.
71. Vrugt J.A., Robinson B.A. Improved evolutionary optimization from genetically adaptive multimethod search. Proc. Natl. Acad. Sci. 2007, 104(3):709-711.
72. Ward V., Hadka D.M., Reed P.M. Confronting Decision Cliffs: Diagnostic Assessment of Multi-objective Evolutionary Algorithm Performance for Addressing Uncertain Environmental Thresholds 2015, Accepted to Environmental Modelling & Software. http://10.1016/j.envsoft.2015.07.020.
73. Weaver C.P., Lempert R.J., Borwn C., Hall J.A., Revell D., Sarewitz D. Improving the contribution of climate model information to decision making: the value and demands of robust decision frameworks. Wiley Interdiscip. Rev. Clim. Change 2013, 4:39-60.
74. Weitzman M.L. Why the far-distant future should be discounted at its lowest possible rate. J. Environ. Econ. Manag. 1998, 36:201-208.
75. Woodruff M.J., Hadka D.M., Reed P.M., Simpson T.W. Auto-adaptive search capabilities of the new borg MOEA: a detailed comparison on product family design problems. 12th AIAA Aviation Technology, Integration, and Operations (ATIO) Conference and 14th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference, Indianapolis, Indiana 2012.
76. Woodruff M., Reed P.M., Simpson T. Many-objective visual analytics: rethinking the design of complex engineered systems. Struct. Multidiscip. Optim. 2013, 48:201-219.
77. Wu Y., Shuguang L., Wende Y. A universal model-R coupler to facilitate the use of R functions for model calibration and analysis. Environ. Model. Softw. 2014, 62:65-69.