A selective improvement technique for fastening neuro-dynamic programming in water resource network management

IFAC Proceedings Volumes (IFAC-PapersOnline)

Volumn 38, Issue 1, 2005, Pages 7-12

  Castelletti, A ^a   De Rigo, D ^a   Rizzoli, A E ^b   Soncini Sessa, R ^a   Weber, E ^a  

^a POLITECNICO DI MILANO   (Italy)

^b DALLE MOLLE INSTITUTE FOR ARTIFICIAL INTELLIGENCE IDSIA   (Switzerland)

Author keywords

Evolutionary algorithm; Integrated water resources management; Neurodynamic programming; Stochastic dynamic programming

Indexed keywords

EVOLUTIONARY ALGORITHMS; NETWORK MANAGEMENT; STOCHASTIC SYSTEMS; WATER RESOURCES;

CURSE OF DIMENSIONALITY; EFFECTIVE SOLUTION; IMPROVED TECHNIQUES; IMPROVEMENT TECHNIQUE; INTEGRATED WATER RESOURCES MANAGEMENT; NEURO DYNAMIC PROGRAMMING; NEW APPROACHES; STOCHASTIC DYNAMIC PROGRAMMING;

DYNAMIC PROGRAMMING;

EID: 79960729066     PISSN: 14746670     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3182/20050703-6-CZ-1902.02172     Document Type: Conference Paper

References (20)

1. Archibald, T. W., McKinnon, K.I.M., and Thomas, L. C., An aggregate stochastic dynamic programming model of multireservoir systems, Water Resour. Res., 33, pp. 333-340, 1997.
2. Bellman, R. E., and Dreyfus, S. E., Functional approximations and dynamic programming, Mathematical Tables and Other Aids to Computation, 13, pp. 247- 251, 1959.
3. Bellman, R. E., Kabala, R., Kotkin, B., Polynomial approximation - a new computational technique in dynamic programming, Mathematical Tables and Other Aids to Computation, 17, pp. 155-161, 1963.
4. Bertsekas, D. P., Dynamic Programming and Optimal Control, Athena Scientific, Belmont, MA, 1995.
5. Bertsekas, D. P., and J. N. Tsitsiklis, Neuro-Dynamic Programming, Athena Scientific, Belmont, MA, 1996.
6. De Rigo, D., Rizzoli, A. E., Soncini-Sessa, R., Weber, E., Zenesi, P., Neuro-Dynamic Programming for the Efficient Management of Reservoir Networks, presented at: MODSIM 2001, Canberra, Australia, 2001.
7. Georgakakos, A. P., and Marks, D. H., A new method for real-time operation of reservoir systems, Water Resour. Res., 23(7), pp. 1376-1390, 1987.
8. Georgakakos, A. P., Extended Linear Quadratic Gaussian Control for the real-time operation of reservoir systems, in Dynamic Programming for Optimal Water Resources Systems Analysis, A. Esogbue, ed., Prentice Hall Publishing Company, NJ, pp. 329-360, 1989.
9. Hornik, K., Multilayer feedforward networks are universal approximators, Neural Networks, 2, pp. 359-366, 1989.
10. Kreinovich, V., Arbitrary nonlinearity is sufficient to represent all functions by neural networks: a theorem, Neural Networks, vol. 4, pp. 381-383, 1991.
11. Lamond, B. F., Boukhtouta, A., Optimizing future hydropower production using Markov Decision Processes, Working Paper 95-44, CRAEDO, Université Laval, Quebec, 1997.
12. Maas, A., M. M. Hufschmidt, R. Dorfam, H. A. Thomas, S. A. Marglin and G. M. Fair, Design of Water Resource Systems, Harvard Univ. Press, 1962.
13. Piccardi, C. and R. Soncini-Sessa, Stochastic dynamic programming for reservoir optimal control: dense discretization and inflow correlation assumption made possible by parallel computing. Water Resour. Res., 27(2), pp. 729-741, 1991.
14. Rippl, W., The capacity of storage reservoirs for water supply. Minutes Proc. Inst. Civ. Eng., 71, pp. 270- 278, 1883.
15. Saad, M., Turgeon, A., Bigras, P., Duquette, R., Learning Disaggregation Technique for the Operation of Long-Term Hydroelectric Power Systems, Water Resour. Res., 30(11), pp. 3195-3203, 1994.
16. Soncini-Sessa, R., Castelletti, A., Rizzoli, A. E., Weber, E., New ideas in the design of water reservoir management policies, invited paper at: IFAC Workshop "Modelling and Control in Environmental Issues", Yokohama, Japan, 2001.
17. Tejada-Guibert, J. A., Johnson, S. A., Stedinger, J. R., Comparison of two approaches for implementing multi-reservoir operating policies using dynamic programming, Water Resour. Res., 29, pp. 369-380, 1993.
18. Turgeon, A., A decomposition method for the long-term scheduling of reservoirs in series, Water Resour. Res., 17, pp. 1565-1570, 1981.
19. Yakowitz, S., Dynamic programming applications in water resources, Water Resour. Res., 18, pp. 673- 696, 1982.
20. Yeh, W., Reservoir management and operations models: a state of the art review, Water Resour. Res., 21, pp. 1797-1818, 1985.