Large-scale parallelization of the Borg multiobjective evolutionary algorithm to enhance the management of complex environmental systems

Environmental Modelling and Software

Volumn 69, Issue , 2015, Pages 353-369

  Hadka, David ^a   Reed, Patrick ^b  

^a The Pennsylvania State University   (United States)

^b Cornell University   (United States)

Author keywords

Borg MOEA; Evolutionary algorithm; Large scale parallelization; Multiobjective optimization

Indexed keywords

MULTIOBJECTIVE OPTIMIZATION; PARETO PRINCIPLE; WATER SUPPLY;

BORG MOEA; COMPLEX ENVIRONMENTAL SYSTEMS; COMPUTATIONAL CHALLENGES; EVOLUTIONARY OPTIMIZATIONS; MULTI OBJECTIVE EVOLUTIONARY ALGORITHMS; PARALLEL IMPLEMENTATIONS; PARALLELIZATIONS; PERFORMANCE AND SCALABILITIES;

EVOLUTIONARY ALGORITHMS;

ENVIRONMENTAL ISSUE; ENVIRONMENTAL MANAGEMENT; ENVIRONMENTAL MODELING; GENETIC ALGORITHM; MULTIOBJECTIVE PROGRAMMING; OPTIMIZATION; PARALLEL COMPUTING; WATER PLANNING; WATER SUPPLY;

EID: 84930634363     PISSN: 13648152     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.envsoft.2014.10.014     Document Type: Article

References (76)

1. Alba E., Luque G., Nesmachnow S. Parallel metaheuristics: recent advances and new trends. Int. Trans. Oper. Res. 2013, 20:1-48.
2. Amdahl G.M. Validity of the single processor approach to achieving large scale computing capabilities. American Federation of Information Processing Societies Spring Computer Conference 1967.
3. Amdahl G.M. Limits of expectation. Int. J. High Perform. Comput. Appl. 1988, 2:88-94.
4. Anderson T.L., Hill P.J. Water Marketing: the Next Generation 1997, Rowman and Littlefield, Lanham, MD.
5. Bäck T., Fogel D.B., Michalewicz Z. Handbook of Evolutionary Computation 1997, Taylor & Francis, New York, NY.
6. Brekke L.D., Maurer E.P., Anderson J.D., Dettinger M.D., Townsley E.S., Harrison A., Pruitt T. Assessing reservoir operations risk under climate change. Water Resour. Res. 2009, 45(4).
7. Brill E.D., Flach J., Hopkins L., Ranjithan S. MGA: a decision support system for complex, incompletely defined problems. IEEE Trans. Syst. Man, Cybern. 1990, 20(4):745-757.
8. Cantú-Paz E. Efficient and Accurate Parallel Genetic Algorithms 2000, Kluwer Academic Publishers, Norwell, MA.
9. Castelletti A., Galelli S., Ratto M., Soncini-Sessa R., Young P. Ageneral framework for dynamic emulation modelling in environmental problems. Environ. Model. Softw. 2012, 34:5-18.
10. Characklis G., Kirsch B.R., Ramsey J., Dillard K., Kelley C.T. Developing portfolios of water supply transfers. Water Resour. Res. 2006, 42(5).
11. Coello Coello C.A., Lamont G.B., Van Veldhuizen D.A. Evolutionary Algorithms for Solving Multi-objective Problems 2007, Springer Science+Business Media LLC, New York, NY.
12. Cohon J., Marks D. Areview and evaluation of multiobjective programming techniques. Water Resour. Res. 1975, 11(2):208-220.
13. Deb K., Agrawal R.B. Simulated Binary Crossover for Continuous Search Space Nov. 1994, Tech. Rep. IITK/ME/SMD-94027, Department of Mechanical Engineering, Indian Institute of Technology, Kanpur, India.
14. Deb K., Joshi D., Anand A. Real-coded evolutionary algorithms with parent-centric recombination. Proceedings of the 2002 Congress on Evolutionary Computation (CEC 2002) 2002, vol. 1:61-66.
15. Feyen L., Vrugt J.A., Nuallain B.O., van der Knijff J., Roo A.D. Parameter optimisation and uncertainty assessment for large-scale streamflow simulation with the lisflood model. J.Hydrol. 2007, 332(3-4):276-289.
16. Franssen M. Arrow's theorem, multi-criteria decision problems and multi-attribute preferences in engineering design. Res. Eng. Des. 2005, 16(1):42-56.
17. Frederick K.D., Schwarz G. Socioeconomic impacts of climate change on u.s. water supplies. J.Am. Water Resour. Assoc. 1999, 35(6):1563-1583.
18. Fu G., Kapelan Z., Kasprzyk J., Reed P.M. Optimal design of water distribution systems using many-objective visual analytics. ASCE J. Water Resour. Plan. Manag. 2013, 139(6):624-633.
19. Guidolin M., Fu G., Reed P. Parallel evolutionary multiobjective optimization of water distribution system design. 14th Water Distribution Systems Analysis Conference. Adelaide, Australia 2012.
20. Hadjigeorgalis E. Managing drought through water markets: farmer preferences in the rio grande basin. J.Am. Water Resour. Assoc. 2008, 44(3):594-605.
21. Hadka D. The Foundations, Parallelization, and Application of the Borg Multiobjective Evolutionary Algorithm 2013, Ph.D. thesis, Department of Computer Science and Engineering, The Pennsylvania State University, University Park, PA.
22. Hadka D., Madduri K., Reed P. Scalability analysis of the asynchronous, master-slave borg multiobjective evolutionary algorithm. IEEE International Parallel and Distributed Processing Symposium (IPDPS), Nature Inspired Distributed Computing Workshop (NIDISC). Cambridge, MA 2013.
23. Hadka D., Reed P. Diagnostic assessment of search controls and failure modes in many-objective evolutionary optimization. Evol. Comput. 2012, 20(3):423-452.
24. Hadka D., Reed P. Borg: an auto-adaptive many-objective evolutionary computing framework. Evol. Comput. 2013, 21(2):231-259.
25. Hadka D., Reed P., Simpson T. Diagnostic assessment of the borg moea for many-objective product family design problems. WCCI 2012 World Congress on Computational Intelligence, Congress on Evolutionary Computation (CEC 2012). Brisbane, Australia June 2012, 986-995.
26. Horn J. The Nature of Niching: Genetic Algorithms and the Evolution of Optimal, Cooperative Populations 1995, Ph.D. thesis, University of Illinois, Urbana-Champaign, Illinois.
27. Israel M., Lund J.R. Recent california water transfers: implications for water management. Nat. Resour. J. 1995, 35(1):1-32.
28. Jenkins M.W., Lund J.R. Integrating yield and shortage management under multiple uncertainties. J.Am. Water Resour. Assoc. 2000, 126(5):288-297.
29. Jin Y., Olhofer M., Sendhoff B. Aframework for evolutionary optimization with approximate fitness function. IEEE Trans. Evol. Comput. 2002, 6(5):451-494.
30. Kasprzyk J., Nataraj S., Reed P.M., Lempert R.J. Many-objective robust decision making for complex environmental systems undergoing change. Environ. Model. Softw. 2013, 42:55-71.
31. Kasprzyk J., Reed P., Kirsch B., Characklis G. Many-objective de Novo water supply portfolio planning under deep uncertainty. Environ. Model. Softw. 2012, 34:87-104.
32. Kasprzyk J.R., Reed P.M., Kirsch B.R., Characklis G.W. Managing population and drought risks using many-objective water portfolio planning under uncertainty. Water Resour. Res. 2009, 45(12).
33. Kirsch B.R., Characklis G.W., Dillard K., Kelley C.T. More efficient optimization of long-term water supply portfolios. Water Resour. Res. 2009, 45(3).
34. Kita H., Ono I., Kobayashi S. Multi-parental extension of the unimodal normal distribution crossover for real-coded genetic algorithms. Proceedings of the 1999 Congress on Evolutionary Computation (CEC 1999). Washington, DC 1999, 1581-1588.
35. Kollat J., Reed P., Maxwell R. Many-objective groundwater monitoring network design using bias-aware ensemble kalman filtering, evolutionary optimization, and visual analytics. Water Resour. Res. 2011, 47(2).
36. Kollat J.B., Reed P.M. Comparison of multi-objective evolutionary algorithms for long-term monitoring design. Adv. Water Resour. 2006, 29(6):792-807.
37. Kundzewicz Z., Mata L., Arnell N., Doll P., Kabat P., Jimenez B., Miller K.A., Oki T., Sen Z., Shiklomanov I. Freshwater resources and their management. Climate Change 2007: Impacts, Adaptation and Vulnerability 2007, 173-210. Cambridge University Press, Cambridge, England.
38. Lane M.E., Kirshen P.H., Vogel R.M. Indicators of impacts of global climate change on u.s. water resources. J.Water Resour. Plan. Manag. 1999, 125(4):194-204.
39. Lund J.R. Derived estimation of willingness to pay to avoid probabilistic shortage. Water Resour. Res. 1995, 31(5):1367-1372.
40. Macdonald I. Comparison of sampling techniques on the performance of monte-carlo based sensitivity analysis. 11th International IBPSA Conference (Building Simulation 2009). Glasgow, Scotland 2009, 992-999.
41. Mahfoud S.W. Niching Methods for Genetic Algorithms 1995, Ph.D. thesis, Department of Computer Science, University of Illinois, Urbana-Champaign, IL.
42. Maier H.R., Kapelan Z., Kasprzyk J., Kollat J., Matott L.S., Cunha M.C., Dandy G.C., Gibbs M.S., Keedwell E., Marchi A., Ostfeld A., Savic D., Solomatine D., Vrugt J.A., Zecchin A.C., Minsker B.S., Barbour E., Kuczera G., Pasha F., Castelletti A., Giuliani M., Reed P.M. Evolutionary algorithms and other metaheuristics in water resources: current status, research challenges and future directions. Environ. Model. Softw. 2014, 62:271-299. 10.1016/j.envsoft.2014.09.013.
43. Matott L.S., Bartelt-Hunt S.L., Rabideau A.J., Fowler K. Application of heuristic optimization techniques and algorithm tuning to multilayered sorptive barrier design. Environ. Sci. Technol. 2006, 40(20):6354-6360.
44. Matott L.S., Rabideau A.J., Craig J.R. Pump-and-treat optimization using analytic element method flow models. Adv. Water Resour. 2006, 29(5):760-775.
45. Milly P.C.D., Betancourt J., Falkenmark M., Hirsch R., Kundzewicz Z.W., Lettenmaier D.P., Stouffer R.J. Stationarity is dead: whither water management?. Science 2008, 319:573-574.
46. National Research Council Informing Decisions in a Changing Climaterep 2009, The National Academies Press.
47. National Research Council Challenges and Opportunities in the Hydrologic Sciences 2012, The National Academies Press.
48. Nicklow J., Reed P., Savic D., Dessalegne T., Harrell L., Chan-Hilton A., Karamouz M., Minsker B., Ostfeld A., Singh A., Zechman E. State of the art for genetic algorithms and beyond in water resources planning and management. J.Water Resour. Plan. Manag. 2010, 136:412-432.
49. Purshouse R.C., Fleming P.J. Evolutionary many-objective optimisation: an exploratory analysis. Congress on Evolutionary Computation (CEC 2003). Canberra, Australia Dec. 2003, 2066-2073.
50. Purshouse R.C., Fleming P.J. On the evolutionary optimization of many conflicting objectives. IEEE Trans. Evol. Comput. 2007, 11(6):770-784.
51. Razavi S., Tolson B., Burn D. Review of surrogate modeling in water resources. Water Resour. Res. 2012, 48. (W07401).
52. Reed P.M., Hadka D.M., Herman J.D., Kasprzyk J.R., Kollat J.B. Evolutionary multiobjective optimization in water resources: the past, present, and future. Adv. Water Resour. 2013, 51:438-456.
53. Reed P.M., Kollat J.B. Visual analytics clarify the scalability and effectiveness of massively parallel many-objective optimization: a groundwater monitoring design example. Adv. Water Resour. 2013, 56:1-13.
54. Reed P.M., Kollat J.B., Ferringer M.P., Thompson T.G. Parallel evolutionary multi-objective optimization on large, heterogeneous clusters: an applications perspective. J.Aerosp. Comput. Information, Commun. Nov. 2008, 5(11):460-478.
55. Regis R.G., Shoemaker C.A. Parallel radial basis function methods for the global optimization of expensive functions. Eur. J. oper. Res. 2007, 182(2):514-535.
56. Roshani E., Filion Y. Using parallel computing to increase the speed of water distribution network optimization. WDSA 2012: 14th Water Distribution Systems Analysis Conference. Adelaide, Australia Sept. 2012.
57. Sayeed M., Mahinthakumar G.K. Efficient parallel implementation of hybrid optimization approaches for solving groundwater inverse problems. J.Comput. Civ. Eng. 2005, 19(4):329-340.
58. Shah R., Reed P.M., Simpson T. Many-objective evolutionary optimization and visual analytics for product family design. Multi-objective Evolutionary Optimisation for Product Design and Manufacturing 2011, 137-159. Springer, London, England. L. Wang, A.H.C. Ng, K. Deb (Eds.).
59. Sheskin D.J. Handbook of Parametric and Nonparametric Statistical Procedures 2004, Chapman & Hall/CRC, Boca Raton, FL.
60. Storn R., Price K. Differential evolution - a simple and efficient heuristic for global optimization over continuous spaces. J.Glob. Optim. 1997, 11(4):341-359.
61. Tang Y., Reed P.M., Kollat J.B. Parallelization strategies for rapid and robust evolutionary multiobjective optimization in water resources applications. Adv. Water Resour. 2007, 30:335-353.
62. Top 500 Supercomputer Sites Statistics of Efficiency, Power, Cores 1993-2014 2014, [Online, Accessed 14 August 2014]. http://www.top500.org/statistics/efficiency-power-cores/.
63. Tsutsui S., Yamamura M., Higuchi T. Multi-parent recombination with simplex crossover in real coded genetic algorithms. Genetic and Evolutionary Computation Conference (GECCO 1999). Orlando, FL 1999, 657-664.
64. Vorosmarty C.J., Green P., Salisbury J., Lammers R.B. Global water resources: vulnerability from climate change and population growth. Science 2000, 289:284-288.
65. Vrugt J.A., Braak C.J.T., Clark M.P., Hyman J.M., Robinson B.A. Treatment of input uncertainty in hydrologic modeling: doing hydrology backward with markov chain monte carlo simulation. Water Resour. Res. 2008, 44(12).
66. Vrugt J.A., Robinson B.A. Improved evolutionary optimization from genetically adaptive multimethod search. Proc. Natl. Acad. Sci. 2007, 104(3):708-711.
67. Vrugt J.A., Robinson B.A., Hyman J.M. Self-adaptive multimethod search for global optimization in real-parameter spaces. IEEE Trans. Evol. Comput. April 2009, 13(2):243-259.
68. Watkins D.W., McKinney D.C. Screening water supply options for the edwards aquifier region in central texas. J.Water Resour. Plan. Manag. 1999, 125(1):14-24.
69. While L., Bradstreet L., Barone L. Afast way of calculating exact hypervolumes. IEEE Trans. Evol. Comput. 2012, 16(1):86-95.
70. Wilchfort O., Lund J.R. Shortage management modeling for urban water supply systems. J.Am. Water Resour. Assoc. 1997, 123(4):250-258.
71. Woodruff M., Hadka D., Reed P., Simpson T. Auto-adaptive search capabilities of the new borg moea: a detailed comparison on product family design problems. 12 AIAA Aviation Technology, Integration, and Operations (ATIO) Conference and 14th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference. Indianapolis, IN Sept. 2012, aIAA Paper AIAA-2012-5442.
72. Woodruff M., Reed P.M., Simpson T. Many-objective visual analytics: rethinking the design of complex engineered systems. Struct. Multidiscip. Optim. 2013, 48:201-219.
73. Zhang X., Beeson P., Link R., Manowitz D., Izaurralde R.C., Sadeghi A., Thomson A.M., Sahajpal R., Srinivasan R., Arnold J.G. Efficient multi-objective calibration of a computationally intensive hydrologic model with parallel computing software in python. Environ. Model. Softw. 2013, 46:208-218.
74. Zheng Y.W., Morad B. Comparing methods of parallel genetic optimization for pump scheduling using hydraulic model and gpu-based ann meta-model. WDSA 2012: 14th Water Distribution Systems Analysis Conference. Adelaide, Australia Sept. 2012.
75. Zheng Y.W., Morad B. Real-time pump scheduling using genetic algorithm and artificial neural network based on graphics processing unit. WDSA 2012: 14th Water Distribution Systems Analysis Conference. Adelaide, Australia Sept. 2012.
76. Zitzler E., Thiele L., Laumanns M., Fonseca C.M., da Fonseca V.G. Performance assessment of multiobjective optimizers: an analysis and review. IEEE Trans. Evol. Comput. 2002, 7(2):117-132.