A diagnostic assessment of evolutionary algorithms for multi-objective surface water reservoir control

Advances in Water Resources

Volumn 92, Issue , 2016, Pages 172-185

  Zatarain Salazar, Jazmin ^a   Reed, Patrick M ^a   Herman, Jonathan D ^b   Giuliani, Matteo ^c   Castelletti, Andrea ^c  

^a Cornell University   (United States)

^b University of California   (United States)

^c POLITECNICO DI MILANO   (Italy)

Author keywords

Benchmark; Direct policy search; Multi objective evolutionary algorithm; Multi purpose reservoir control

Indexed keywords

ALGORITHMS; BENCHMARKING; CLIMATE CHANGE; COMMERCE; COMPUTER CONTROL; INVESTMENTS; PARALLEL PROCESSING SYSTEMS; PARAMETER ESTIMATION; PARAMETERIZATION; RADIAL BASIS FUNCTION NETWORKS; RESERVOIR MANAGEMENT; RESERVOIRS (WATER); SURFACE WATERS; WATERSHEDS;

CURRENT CAPABILITY; DIRECT POLICY SEARCH; EVOLUTIONARY MULTI-OBJECTIVES; MULTI OBJECTIVE EVOLUTIONARY ALGORITHMS; OPERATING POLICIES; RADIAL BASIS FUNCTIONS; RESERVOIR CONTROLS; SUSQUEHANNA RIVER BASINS;

EVOLUTIONARY ALGORITHMS;

ALGORITHM; BENCHMARKING; POLICY APPROACH; RESERVOIR; RIVER BASIN; SURFACE WATER; TRADE-OFF; WATER MANAGEMENT;

CONOWINGO RESERVOIR; PENNSYLVANIA; SUSQUEHANNA BASIN; UNITED STATES;

EID: 84963511088     PISSN: 03091708     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.advwatres.2016.04.006     Document Type: Article

References (70)

1. Burke E.K., Gendreau M., Hyde M., Kendall G., Ochoa G., Özcan E., Qu R. Hyper-heuristics: A survey of the state of the art. J. Oper. Res. Soc. 2013, 64(12):1695-1724.
2. Busoniu L., Ernst D., De Schutter B., Babuska R. Cross-entropy optimization of control policies with adaptive basis functions. IEEE Trans. Syst. Man Cybern. Part B Cybern. 2011, 41(1):196-209.
3. Castelletti A., Antenucci J., Limosani D., Quach Thi X., Soncini-Sessa R. Interactive response surface approaches using computationally intensive models for multiobjective planning of lake water quality remediation. Water Resour. Res. 2011, 47(9):9534-9548.
4. Castelletti A., Galelli S., Restelli M., Soncini-Sessa R. Tree-based reinforcement learning for optimal water reservoir operation. Water Resour. Res. 2010, 46(9):9507-9525.
5. Castelletti A., Pianosi F., Restelli M. A multiobjective reinforcement learning approach to water resources systems operation: Pareto frontier approximation in a single run. Water Resour. Res. 2013, 49(6):3476-3486.
6. Castelletti A., Pianosi F., Soncini-Sessa R. Water reservoir control under economic, social and environmental constraints. Automatica 2008, 44(6):1595-1607.
7. Castelletti A., Pianosi F., Soncini-Sessa R. Stochastic and robust control of water resource systems: Concepts, methods and applications. System Identification, Environmental Modelling, and Control System Design 2012, 383-401. Springer London.
8. Castelletti A., de Rigo D., Rizzoli A., Soncini-Sessa R., Weber E. Neuro-dynamic programming for designing water reservoir network management policies. Control Eng. Pract. 2007, 15(8):1031-1038.
9. Castelletti A., Yajima H., Giuliani M., Soncini-Sessa R., Weber E. Planning the optimal operation of a multioutlet water reservoir with water quality and quantity targets. J. Water Resour. Plan. Manag. 2014, 140(4):496-510.
10. Coello Coello C.A. Evolutionary algorithms for solving multi-objective problems. Genetic and Evolutionary Computation 2007, Springer, New York. second ed.
11. Cohon J., Marks D. A review and evaluation of multiobjective programming techniques. Water Resour. Res. 1975, 11(2):208-220.
12. Deb K., Agrawal R.B. Simulated Binary Crossover for Continuous Search Space. Technical Report, IITK/ME/SMD-94027 1994, Indian Institute of Technology, Kanpur.
13. Deb K., Goyal M. A combined genetic adaptive search (geneas) for engineering design. Comput. Sci. Inf. 1996, 26:30-45.
14. Deb K., Agrawal S., Pratap A., Meyarivan T. A fast elitist non-dominated sorting genetic algorithm for multi-objective optimization: NSGA-II. Parallel problem solving from nature PPSN VI 2000, 849-858. Springer Berlin Heidelberg.
15. Deb K., Gupta H. Introducing robustness in multi-objective optimization. Evol. Comput. 2006, 14(4):463-494.
16. Deb K., Mohan M., Mishra S. A Fast Multi-objective Evolutionary Algorithm for Finding Well-spread Pareto-optimal Solutions. Technical Report, 2003002 2003, Kanpur Genetic Algorithms Laboratory.
17. Deb K., Pratap A., Agarwal S., Meyarivan T. A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evol. Comput. 2002, 6(2):182-197.
18. Deb K., Sinha A. Solving bilevel multi-objective optimization problems using evolutionary algorithms. Evolutionary Multi-Criterion Optimization 2009, 110-124. Springer Science Mathplus Business Media.
19. IPCC, 2014: Climate Change 2014: Mitigation of Climate Change. Contribution of Working Group III to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change 2014, Cambridge University Press, Cambridge., http://report.mitigation2014.org/drafts/final-draft-postplenary/ipcc_wg3_ar5_final-draft_postplenary_full.pdf. O. Edenhofer, R. Pichs-Madruga, Y. Sokona (Eds.).
20. Efstratiadis A., Koutsoyiannis D., Xenos D. Minimizing water cost in water resource management of athens. Urban Water J. 2004, 1(1):3-15.
21. Exelon Operations Modeling Calibration Report, Technical Report, Addendum Conowingo Hydroelectric Project- RSP 3.11 (405) and Muddy Run Pumped Storage Project- RSP 3.2 (2355). Technical Report 2010, Gomez and Sullivan Eng.
22. Federal Energy Regulatory Commission, Order approving settlement agreement for the Conowingo hydroelectric project, 1989, Tech. Rep. Proj. 405-009, Docket EL80-38-000.
23. Fleming P.J., Purshouse R.C., Lygoe R.J. Many-objective optimization: An engineering design perspective. Evolutionary Multi-criterion Optimization 2005, 14-32. Springer.
24. Giuliani M., Castelletti A. Is robustness really robust? How different definitions of robustness impact decision-making under climate change. Clim. Change 2016, 135(3):1-16.
25. Giuliani M., Castelletti A., Pianosi F., Mason E., P.M.R. Curses, tradeoffs, and scalable management: Advancing evolutionary multi-objective direct policy search to improve water reservoir operations. ASCE J. Water Resour. Plan. Manag. 2015, 142(2). 04015050-1-17.
26. Giuliani M., Herman J., Castelletti A., Reed P. Many-objective reservoir policy identification and refinement to reduce policy inertia and myopia in water management. Water Resour. Res. 2014, 50(4):3355-3377.
27. Giuliani M., Pianosi F., Castelletti A. Making the most of data: an information selection and assessment framework to improve water systems operations. Water Resour. Res. 2015, 51(11):9073-9093.
28. Goldberg D.E. The Design of Innovation: Lessons from and for Competant Genetic Algorithms 2002, Kluwer Academic Publishers, Boston.
29. Guariso G., Rinaldi S., Soncini-Sessa R. The management of Lake Como: A multiobjective analysis. Water Resour. Res. 1986, 22(2):109-120.
30. Hadka D., Reed P. Diagnostic assessment of search controls and failure modes in many-objective evolutionary optimization. Evol. Comput. 2012, 20(3):423-452.
31. Hadka D., Reed P. Borg: An auto-adaptive many-objective evolutionary computing framework. Evol. Comput. 2013, 21(2):231-259.
32. Hadka D., Reed P. Large-scale parallelization of the borg multiobjective evolutionary algorithm to enhance the management of complex environmental systems. Environ. Model. Softw. 2014, 69:353-369.
33. Hadka D., Reed P.M., Simpson T.W. Diagnostic assessment of the borg MOEA for many-objective product family design problems. Proceedings of the 2012 IEEE Congress on Evolutionary Computation (CEC) 2012, 1-10. IEEE.
34. Hashimoto T., Loucks D.P., Stedinger J.R. Robustness of water resources systems. Water Resour. Res. 1982, 18(1):21-26.
35. Hashimoto T., Stedinger J.R., Loucks D.P. Reliability, resiliency and vulnerability criteria for water resource system performance evaluation. Water Resour. Res. 1982, 18(1):14-20.
36. Iorio A.W., Li X. Improving the performance and scalability of differential evolution. Simulated Evolution and Learning 2008, 131-140. Springer.
37. Kern J.D., Characklis G.W., Foster B.T. Natural gas price uncertainty and the cost-effectiveness of hedging against low hydropower revenues caused by drought. Water Resour. Res. 2015, 51(4):2412-2427.
38. Knowles J., Corne D. On metrics for comparing nondominated sets. Proceedings of the 2002 Congress on Evolutionary Computation, CEC'02 2002, vol. 1:711-716. IEEE.
39. Kollat J.B. The Epsilon Non-Dominated Sorted Genetic Algorithm II: A Highly Effective Multi-Objective Evolutionary Algorithm for Water Resources Applications 2005, The Pennsylvania State University, (Master's thesis).
40. Kollat J.B., Reed P.M. The value of online adaptive search: A performance comparison of NSGAII, epsilon-NSGAII and epsilon-MOEA. Proceedings of the Third International Conference On Evolutionary Multi-Criterion Optimization (EMO 2005) 2005, 386-398. Springer Verlag. C. Coello Coello, A. Aguirre, E. Zitzler (Eds.).
41. Kollat J.B., Reed P.M. Comparing state-of-the-art evolutionary multi-objective algorithms for long-term groundwater monitoring design. Adv. Water Resour. 2006, 29(6):792-807.
42. Kollat J.B., Reed P.M. A computational scaling analysis of multiobjective evolutionary algorithms in long-term groundwater monitoring applications. Adv. Water Resour. 2007, 30(3):335-353.
43. Koutsoyiannis D., Economou A. Evaluation of the parameterization-simulation-optimization approach for the control of reservoir systems. Water Resour. Res. 2003, 39(6):1170-1186.
44. Kukkonen S., Lampinen J. GDE3: The third evolution step of generalized differential evolution. Proceedings of the 2005 IEEE Congress on Evolutionary Computation 2005, vol. 1:443-450. IEEE.
45. Labadie J.W. Optimal operation of multireservoir systems: State-of-the-art review. J. Water Resour. Plan. Manag. 2004, 130(2):93-111.
46. Laumanns M., Thiele L., Deb K., Zitzler E. Combining convergence and diversity in evolutionary multiobjective optimization. Evol. Comput. 2002, 10(3):263-282.
47. Maier H.R., Kapelan Z., Kasprzyk J., Kollat J., Matott L.S., Cunha M.C., Dandy G.C., Gibbs M.S., Keedwell E., Marchi A., Ostfeld A., Savic D., Solomatine D.P., Vrugt J.A., Zecchin A.C., Minsker B.S., Barbour E.J., Kuczera G., Pasha F., Castelletti A., Giuliani M., Reed P.M. Evolutionary algorithms and other metaheuristics in water resources: Current status, research challenges and future directions. Environ. Model. Softw. 2014, 62:271-299.
48. Musser, K. 2007. Susquehanna River Watershed: Wikimedia Commons. (accessed 02.09.15.). http://commons.wikimedia.org/wiki/File:Susq_sub_u.png.
49. Nalbantis I., Koutsoyiannis D. A parametric rule for planning and management of multiple-reservoir systems. Water Resour. Res. 1997, 33(9):2165-2177.
50. Nicklow J., Reed P., Savic D., Dessalegne T., Harrell L., Chan-Hilton A., Karamouz M., Minsker B., Ostfeld A., Singh A., Zechman E. State of the art for genetic algorithms and beyond in water resources planning and management. J. Water Resour. Plan. Manag. 2010, 136(4):412-432.
51. Oliveira R., Loucks D.P. Operating rules for multireservoir systems. Water Resour. Res. 1997, 33(4):839-852.
52. Reed P.M., Hadka D. Evolving many-objective water management to exploit exascale computing. Water Resour. Res. 2014, 50(10):8367-8373.
53. Reed P.M., Hadka D., Herman J.D., Kasprzyk J.R., Kollat J.B. Evolutionary multiobjective optimization in water resources: The past, present and future. Adv. Water Resour. 2013, 51:438-456.
54. Reed P.M., Kollat J.B. Visual analytics clarify the scalability and effectiveness of massively parallel many-objective optimization: A groundwater monitoring design example. Adv. Water Resour. 2013, 56:1-13.
55. Reyes-Sierra M., Coello C.C. Multi-objective particle swarm optimizers: A survey of the state-of-the-art. Int. J. Comput. Intell. Res. 2006, 2(3):287-308.
56. Rosenstein M.T., Barto A.G. Robot weightlifting by direct policy search. International Joint Conference on Artificial Intelligence 2001, vol. 17:839-846. Citeseer.
57. Sheer D.P., Dehoff A. Science-based collaboration: Finding better ways to operate the conowingo pond. Am. Water Works Assoc. J. 2009, 101(6):20.
58. Sierra M.R., Coello C.A.C. Improving PSO-based multi-objective optimization using crowding, mutation and ∈ -dominance. Evolutionary Multi-criterion Optimization 2005, 505-519. Springer.
59. Soncini-Sessa R., Weber E., Castelletti A. Integrated and Participatory Water Resources Management-Theory 2007, vol. 1. Elsevier.
60. Storn R., Price K. Differential evolution - A simple and efficient heuristic for global optimization over continuous spaces. J. Glob. Optim. 1997, 11(4):341-359.
61. Sutton R.S., McAllester D.A., Singh S.P., Mansour Y., et al. Policy gradient methods for reinforcement learning with function approximation. NIPS 1999, vol. 99:1057-1063. Citeseer.
62. Swartz P. Conowingo Pond Management Plan. Technical Report 242 2006, Susquehanna River Basin Commission.
63. Tikk D., Kóczy L.T., Gedeon T.D. A survey on universal approximation and its limits in soft computing techniques. Int. J. Approx. Reason. 2003, 33(2):185-202.
64. Vamplew P., Dazeley R., Berry A., Issabekov R., Dekker E. Empirical evaluation methods for multiobjective reinforcement learning algorithms. Mach. Learn. 2011, 84(1-2):51-80.
65. Van Veldhuizen D.A., Lamont G.B. Evolutionary computation and convergence to a pareto front. Proceedings of the 1998 Conference on Late Breaking Papers at the Genetic Programming 1998, 221-228. Citeseer.
66. Van Veldhuizen D.A., Lamont G.B. Multiobjective Evolutionary Algorithm Research: A History and Analysis. Technical Report 1998, Citeseer.
67. Ward V., Singh R., Reed P.M., Keller K. Confronting tipping points: Can multi-objective evolutionary algorithms discover pollution control tradeoffs given environmental thresholds?. Environ. Model. Softw. 2015, 73:27-43.
68. World Bank W. World Development Report 2009: Reshaping Economic Geography 2009, World Bank.
69. Zhang Q., Li H. Moea/d: A multiobjective evolutionary algorithm based on decomposition. Evolutionary Computation, IEEE Transactions on 2007, 11(6):712-731.
70. Zitzler E., Thiele L., Laumanns M., Fonseca C.M., Fonseca V.G.d. Performance assessment of multiobjective optimizers: an analysis and review. IEEE Transactions on Evolutionary Computation 2003, 7(2):117-132.