Visual analytics clarify the scalability and effectiveness of massively parallel many-objective optimization: A groundwater monitoring design example

Advances in Water Resources

Volumn 56, Issue , 2013, Pages 1-13

  Reed, Patrick M ^a   Kollat, Joshua B ^a  

^a The Pennsylvania State University   (United States)

Author keywords

Data assimilation; Groundwater monitoring; Many objective visual analytics; Multiobjective optimization; Parallelization

Indexed keywords

DATA ASSIMILATION; GROUNDWATER MONITORING; MANY-OBJECTIVE OPTIMIZATIONS; MASSIVELY PARALLELS; MULTI OBJECTIVE EVOLUTIONARY ALGORITHMS; PARALLEL SCALABILITY; PARALLELIZATIONS; VISUAL ANALYTICS;

GROUNDWATER; MULTIOBJECTIVE OPTIMIZATION; PARETO PRINCIPLE; SCALABILITY; VISUALIZATION;

GROUNDWATER RESOURCES;

ALGORITHM; DATA ASSIMILATION; GROUNDWATER; MONITORING; OPTIMIZATION; VISUAL ANALYSIS; WATER RESOURCE;

EID: 84878906039     PISSN: 03091708     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.advwatres.2013.01.011     Document Type: Article

References (78)

1. National Research Council. Challenges and Opportunities in the Hydrologic Sciences. W.S.a.T.B, editor. Committee on challenges and opportunities in the hydrologic sciences. Division of Earth and life studies. Washington, DC: The National Academies Press; 2012. ISBN: 978-0-309-22283-9.
2. Yapo P.O., Gupta H.V., Sorooshian S. Automatic calibration of conceptual rainfall-runoff models: sensitivity to calibration data. J Hydrol 1996, 181(1-4):23-48. 10.1016/0022-1694(95)02918-4.
3. Moss M.E. Some basic considerations in the design of hydrologic data networks. Water Resour Res 1979, 15(6):1673-1676. 10.1029/WR015i006p01673.
4. Milly P.C.D., Betancourt J., Falkenmark M., Hirsch R.M., Kundzewicz Z., Lettenmaier D.P., et al. Stationarity is dead: whither water management?. Science 2008, 319(5863):573-574. 10.1126/science.1151915.
5. Kollet S., Maxwell R., Woodward C.S., Smith S., Vanderborght J., Vereecken H., et al. Proof-of-concept of regional scale hydrologic simulations at hydrologic resolution utilizing massively parallel computer resources. Water Resour Res 2010, 46:W04201. 10.1029/2009WR008730.
6. Vrugt J.A., Diks C.G.H., Gupta H.V., Bouten W., Verstraten J.M. Improved treatment of uncertainty in hydrologic modeling: Combining the strengths of global optimization and data assimilation. Water Resour Res 2005, 41(1). 10.1029/2004WR003059.
7. Clark M.P., Vrugt J.A. Unraveling uncertainties in hydrologic model calibration: addressing the problem of compensatory parameters. Geophys Res Lett 2006, 33(6). 10.1029/2005GL025604.
8. Wang D.B., Cai X.M. Optimal estimation of irrigation schedule - an example of quantifying human interferences to hydrologic processes. Adv Water Resour 2007, 30(8):1844-1857. 10.1016/j.advwatres.2007.02.006.
9. Kollat J.B., Reed P.M., Maxwell R.M. Many-objective groundwater monitoring network design using bias-aware ensemble Kalman filtering, evolutionary optimization, and visual analytics. Water Resour Res 2011, 47:W02529. 10.1029/2010WR009194.
10. Vorosmarty C.J., Federer C.A., Schloss A.L. Evaporation functions compared on US watersheds: possible implications for global-scale water balance and terrestrial ecosystem modeling. J Hydrol 1998, 207(3-4):147-169. 10.1016/S0022-1694(98)00109-7.
11. Dokou Z., Pinder G. Optimal search strategy for the definition of a DNAPL source. J Hydrol 2009, 376:542-556. 10.1016/j.jhydrol.2009.07.062.
12. Herrera G.S., Pinder G.F. Space-time optimization of groundwater quality sampling networks. Water Resour Res 2005, 41(12). 10.1029/2004WR003626.
13. Cheng W.-C., Putti M., Kendall D.R., Yeh W.W.G. A real-time groundwater management model using data assimilation. Water Resour Res 2011, 47. 10.1029/2010WR009770.
14. Nowak W., Rubin Y., de Barros F.P.J. A hypothesis-driven approach to optimize field campaigns. Water Resour Res 2012, 48:W06509. doi:10.1029/2011WR011016.
15. Loucks DP, van Beek E. Water resources systems planning and management: an introduction to methods, models, and applications. Studies and Reports in Hydrology. United Nations Educational, Scientific and Cultural Organization. 2005. ISBN 92-3-103998-9.
16. Harou J., Pulido-Velazquez M., Rosenberg D., Medellin-Azuara J., Lund J., Howitt R. Hydro-economic models: concepts, design, applications, and future prospects. J Hydrol 2009, 375:627-643. 10.1016/j.jhydrol.2009.06.037.
17. Nicklow J.W., Reed P.M., Savic D., Dessalegne T., Harrell L., Chan-Hilton A., et al. State of the art for genetic algorithms and beyond in water resources planning and management. J Water Resour Plan Manage 2010, 136(4):412-432. 10.1061/(ASCE)WR.1943-5452.0000053.
18. Bergstrom S. The Development of a Snow Routine for the HBV-2 Model. Nordic Hydrol 1975, 6(2):73-92.
19. Labadie J. Optimal operation of multireservoir systems: state-of-the-art review. J Water Resour Plan Manage 2004, 130(2):93-111. 10.1061/(ASCE)0733-9496(2004)130:2(93).
20. Chankong V., Haimes Y. Multiobjective Decision Making: Theory and Methodology. North-Holland Series in System Science and Engineering 1983, North-Holland, New York, NY, ISBN: 0444007105.
21. Reed P., Kollat J.B. Save Now, Pay Later? Multi-period many-objective groundwater monitoring design given systematic model errors and uncertainty. Adv Water Resour 2012, 35:55-68. 10.1016/j.advwatres.2011.10.011.
22. National Science and Technology Council Committee on environment and natural resources. A strategy for federal science and technology to support water availability and quality in the United States. Washington, DC: Executive Office of the President of the United States; 2007.
23. National Research Council. Informing decisions in a changing climate. P.o.S.a.M.f.C.-R.D. Support, editor. Washington, DC: The National Academies Press; 2009.
24. National Research Council. Science for environmental protection: the road ahead. Washington, DC: The National Academies Press; 2012.
25. Kothe D. Science prospects and benefits with exascale computing. D.o. Energy, editor. Oak Ridge National Laboratory National Center for Computational Sciences: Oak Ridge, TN.
26. Schaake J., Duan Q.Y., Koren V., Hall A. Toward improved parameter estimation of land surface hydrology models through the model parameter estimation experiment (MOPEX). Soil-vegetation-atmosphere transfer schemes and large-scale hydrological models 2001, 91-97. Int Assoc Hydrological Sciences, Wallingford. A.J. Dolman (Ed.).
27. Vrugt J.A., Nuallain B.O., Robinson B.A., Bouten W., Dekker S.C., Sloot P.M.A. Application of parallel computing to stochastic parameter estimation in environmental models. Comput Geosci 2006, 32(8):1139-1155. 10.1016/j.cageo.2005.10.015.
28. Karpouzos D.K., Delay F., Katsifarakis K.L., de Marsily G. A multipopulation genetic algorithm to solve the inverse problem in hydrogeology. Water Resour Res 2001, 37(9):2291-2302. 10.1029/2000WR900411.
29. Babbar M, Minsker BS. A multiscale master-slave parallel genetic algorithm with application to groundwater remediation design. In: Late breaking papers of the proceedings of the genetic and evolutionary computation conference (GECCO 2002). Morgan Kaufmann Publishers: New York, NY; 2002.
30. Cui L., Kuczera G. Optimizing urban water supply headworks using probabilistic search methods. J Water Resour Plan Manage 2003, 129(5):380-387. 10.1061/(ASCE)0733-9496(2003)129:5(380).
31. Cui L., Kuczera G. Optimizing water supply headworks operating rules under stochastic inputs: Assessment of genetic algorithm performance. Water Resour Res 2005, 41:W05016. 10.1029/2004WR003517.
32. Fu G, Kapelan Z, Kasprzyk JR, Reed P. Optimal design of water distribution systems using many-objective visual analytics. Water Resour Plan Manage, in press.
33. Mahinthakumar G., Sayeed M. Hybrid genetic algorithm: local search methods for solving groundwater source identification inverse problems. J Water Resour Plan Manage 2005, 131(1):45-57. 10.1061/(ASCE)0733-9496(2005)131:1(45).
34. Tang Y., Reed P., Kollat J.B. Parallelization strategies for rapid and robust evolutionary multiobjective optimization in water resources applications. Adv Water Resour 2007, 30(3):335-353. 10.1016/j.advwatres.2006.06.006.
35. Hadka D., Reed P.M. Diagnostic assessment of search controls and failure modes in many-objective evolutionary optimization. Evol Comput 2012, 20(3):423-452.
36. Reed P., Ferringer M., Thompson T., Kollat J.B. Parallel evolutionary multi-objective optimization on large, heterogeneous clusters: an applications perspective. J Aerosp Comput Inf Commun 2008, 5:460-478. 10.2514/1.36467.
37. Coello Coello C., Lamont G.B., Van Veldhuizen D.A. Evolutionary algorithms for solving multi-objective problems 2007, Springer, New York, NY. 2nd ed.
38. Cantu-Paz E. Efficient and accurate parallel genetic algorithms 2000, Kluwer Academic Publishers, Norwell, MA.
39. Reed P.M., Hadka D., Herman J.D., et al. Evolutionary multiobjective optimization in water resources: the past, present, and future. Adv Water Resour 2013, 51:438-456. 10.1016/j.advwatres.2012.01.005.
40. Evensen G. The ensemble Kalman filter: theoretical formulation and practical implementation. Ocean Dyn 2003, 53:343-367.
41. Drécourt J., Madsen H., Rosbjery D. Bias aware Kalman filters: comparison and improvements. Adv Water Resour 2006, 29:707-718. 10.1016/j.advwatres.2005.07.006.
42. Kollat J.B., Reed P., Rizzo D. Addressing bias and uncertainty in groundwater transport forecasts for a three-dimensional physical aquifer experiment. Geophys Res Lett 2008, 35:L17402. 10.1029/2008GL035021.
43. Kollat J.B., Reed P.M., Kasprzyk J.R. A new epsilon-dominance hierarchical bayesian optimization algorithm for large multi-objective monitoring network design problems. Adv Water Resour 2008, 31(5):828-845. 10.1016/j.advwatres.2008.01.017.
44. Illuminating the path: the research and develoment agenda for visual analytics 2005, IEEE Computer Society Press, Los Alamitos, CA. J. Thomas, K.A. Cook (Eds.).
45. Thomas J., Kielman J. Challenges for visual analytics. Inf Visual 2009, 8(4):309-314. 10.1057/ivs.2009.26.
46. Kollat J.B., Reed P. A Framework for visually interactive decision-making and design using evolutionary multiobjective optimization (VIDEO). Environ Model Softw 2007, 22(12):1691-1704. 10.1016/j.envsoft.2007.02.001.
47. Ashby S.F., Falgout R.D. A parallel multigrid preconditioned conjugate gradient algorithm for groundwater flow simulations. Nucl Sci Eng 1996, 124(1):145-159.
48. Jones J.E., Woodward C.S. Newton-Krylov-multigrid solvers for large-scale, highly heterogeneous, variably saturated flow problems. Adv Water Resour 2001, 24(7):763-774. 10.1016/S0309-1708(00)00075-0.
49. Kollet S.J., Maxwell R.M. Integrated surface-groundwater flow modeling: a free-surface overland flow boundary condition in a parallel groundwater flow model. Adv Water Resour 2006, 29(7):945-958. 10.1016/j.advwatres.2005.08.006.
50. Maxwell R., Kollet S. Interdependence of groundwater dynamics and land-energy feedbacks under climate change. Nature Geosci 2008, 1(10):665-669. 10.1038/ngeo315.
51. Tompson A.F.B., Dougherty D.E. Particle-grid methods for reacting flows in porous-media with application to fisher equation. Appl Math Model 1992, 16(7):374-383. 10.1016/0307-904X(92)90071-A.
52. Tompson A.F.B., Gelhar L.W. Numerical-simulation of solute transport in 3-Dimensional, randomly heterogeneous porous-media. Water Resour Res 1990, 26(10):2541-2562. 10.1029/93WR01526.
53. Maxwell R., Kastenberg W. A model for assessing and managing the risks of environmental lead emissions. Stochastic Environ Res Risk Assess 1999, 13(4):231-250. 10.1007/s004770050041.
54. Maxwell R., Welty C., Harvey R. Revisiting the cape cod bacteria injection experiment using a stochastic modeling approach. Environ Sci Technol 2007, 41(15):5548-5558. 10.1021/es062693a.
55. Kollat J.B., Reed P. Addressing bias and uncertainty in groundwater transport forecasts for a three-dimensional physical aquifer experiment. Geophys Res Lett 2008, 35:L17402. 10.1029/2008GL035021.
56. Pasetto D., Camporese M., Putti M. Ensemble Kalman filter versus particle filter for a physically-based coupled surface-subsurface model. Adv Water Resour 2012, 47:1-13. 10.1016/j.advwatres.2012.06.009.
57. Mitchell H.L., Houtekamer P.L., Pellerin G. Ensemble size, and model-error representation in an ensemble Kalman filter. Mon Weather Rev 2002, 130:2791-2808. 10.1175/1520-0493(2002)130<2791:ESBAME>2.0.CO;2.
58. Shah R., Reed P.M. Comparative analysis of multiobjective evolutionary algorithms for random and correlated instances of the multiobjective d-dimensional Knapsack problems. Eur J Oper Res 2011, 211(3):466-479. 10.1016/j.ejor.2011.01.030.
59. Pelikan M., Goldberg D.E. A hierarchy machine: learning to optimize from nature and humans. Complexity 2003, 8(5):36-45.
60. Laumanns M., Thiele L., Deb K., Zitzler E. Combining convergence and diversity in evolutionary multiobjective optimization. Evol Comput 2002, 10(3):263-282. 10.1162/106365602760234108.
61. Knowles J, Corne D. On metrics for comparing non-dominated sets. In: Congress on evolutionary computation (CEC 2002). 2002; p. 711-16.
62. Zitzler E., Thiele L., Laumanns M., Fonseca C.M., da Fonseca V.G. Performance assessment of multiobjective optimizers: an analysis and review. IEEE Trans Evol Comput 2003, 7(2):117-132. 10.1109/TEVC.2003.810758.
63. Van Veldhuizen D.A., Lamont G.B. Evolutionary computation and convergence to a pareto front. Proceedings of the third annual conference on genetic programming 1998 1998, 22-25. Morgan Kaufmann, San Francisco, California. J.R. Koza (Ed.).
64. Fleming P.J., Purshouse R.C., Lygoe R.J. Many-objective optimization: an engineering design perspective. Lecture notes in computer science 2005, Springer, Guanajuato, Mexico.
65. Ferringer M., Spencer D., Reed P. Many-objective reconfiguration of operational satellite constellations with the large-cluster epsilon non-dominated sorting genetic algorithm-II. IEEE congress on evolutionary computation, CEC 09 2009, IEEE.
66. Kasprzyk J.R., Reed P.M., Kirsch B., Characklis G. Many-objective de novo water supply portfolio planning under deep uncertainty. Environ Model Softw 2012, 34(6):87-104. 10.1016/j.envsoft.2011.04.003.
67. Kasprzyk J.R., Reed P.M., Kirsch B., Characklis G. Managing population and drought risks using many-objective water portfolio planning under uncertainty. Water Resour Res 2009, 45:W12401. 10.1029/2009WR008121.
68. Castelletti A., Lotov A.V., Soncini-Sessa R. Visualization-based multi-objective improvement of environmental decision-making using linearization of response surfaces. Environ Model Softw 2010, 25(12):1552-1564. 10.1016/j.envsoft.2010.05.011.
69. Kasprzyk J.R., Reed P.M., Characklis G.W., et al. Many-objective de Novo water supply portfolio planning under deep uncertainty. Environ Model Softw 2012, 34:87-104. 10.1016/j.envsoft.2011.04.003.
70. Pelikan M. Bayesian optimization algorithm: from single level to hierarchy. Computer Science 2002, University of Illinois, Urbana-Champaign.
71. Reed P.M., Hadka D., Herman J.D., et al. Kollat JB. Evolutionary multiobjective optimizatin in water resources: the past, present, and future. Adv. Water Res 2013, 51:438-456. 10.1016/j.advwatres.2012.01.005.
72. Kollat J.B., Reed P. Comparing state-of-the-art evolutionary multi-objective algorithms for long-term groundwater monitoring design. Adv Water Resour 2006, 29(6):792-807. 10.1016/j.advwatres.2005.07.010.
73. Tang Y., Reed P., Wagener T. How efficient and effective are evolutionary multiobjective algorithms at hydrologic model calibration?. Hydrol Earth Syst Sci 2006, 10:289-307.
74. Brockhoff D., Friedrich T., Hebbinghaus N., Klein C., Neumann F., Zitzler E. Do additional objectives make a problem harder?. Genetic and evolutionary computation conference (GECCO '07) 2007, ACM, London, England, 9781595936974/07/0007.
75. Teytaud O. How entropy-theorems can show that on-line approximating high-dim Pareto fronts is too hard. In: 10th International conference on parallel problem solving from nature (PPSN-BTN Workshop). Reykjavik; 2006.
76. Teytaud O. On the hardness of offline multi-objective optimization. Evol Comput 2007, 15(4):475-491. 10.1162/evco.2007.15.4.475.
77. Brill E.D., Flach J., Hopkins L., Ranjithan S. MGA: A decision support system for complex, incompletely defined problems. IEEE Trans Syst Man Cybern 1990, 20(4):745-757. 10.1109/21.105076.
78. Woodruff M, Reed, PM, Simpson T, Many-objective visual analytics: rethinking the design of complex engineered systems. Struct Multi Optim, in press.