An emergent approach for the control of wastewater treatment plants by means of reinforcement learning techniques

Expert Systems with Applications

Volumn 39, Issue 3, 2012, Pages 2355-2360

  Hernández Del Olmo, Félix ^a   Llanes, Félix H ^b   Gaudioso, Elena ^a  

^a UNIVERSIDAD NACIONAL DE EDUCACIÓN A DISTANCIA   (Spain)

^b PYCSA Infraestructuras   (Spain)

Author keywords

Artificial intelligence; Control of wastewater treatment plants; Emergent approach; Reinforcement learning

Indexed keywords

AUTONOMOUS SYSTEMS; DIRECT INTERACTIONS; EMERGENT APPROACH; INFLUENT LOADS; LEARNING CAPABILITIES; PLANT OPERATORS; REINFORCEMENT LEARNING TECHNIQUES; REMOVAL PROCESS; SIMULATION MODEL; WASTEWATER TREATMENT PLANTS;

ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; EXPERT SYSTEMS; RECLAMATION; REINFORCEMENT LEARNING; SEWAGE PUMPING PLANTS; WASTEWATER; WATER TREATMENT PLANTS;

WASTEWATER TREATMENT;

EID: 80255137505     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2011.08.062     Document Type: Article

References (31)

1. L. Belanche, J.J. Valdes, J. Comas, I.R. Roda, and M. Poch Prediction of the bulking phenomenon in wastewater treatment plants Artificial Intelligence in Engineering 14 4 2000 307 317 (Pubitemid 32029223)
2. D.P. Bertsekas 3rd ed. Dynamic programming and optimal control Vol. 2 2007 Athenas Scientific
3. E.F. Carrasco, J. Rodriguez, A. Punyal, E. Roca, and J.M. Lema Rule-based diagnosis and supervision of a pilot-scale wastewater treatment plant using fuzzy logic techniques Expert Systems with Applications 22 1 2002 11 20 (Pubitemid 33076561)
4. E.F. Carrasco, J. Rodriguez, A. Punyal, E. Roca, and J.M. Lema Diagnosis of acidification states in an anaerobic wastewater treatment plant using a fuzzy-based expert system Control Engineering Practice 12 1 2004 59 64 (Pubitemid 38098423)
5. J.C. Chen, N.B. Chang, and W.K. Shieh Assessing wastewater reclamation potential by neural network model Engineering Applications of Artificial Intelligence 16 2 2003 149 157
6. Copp, J. (2002). The COST simulation benchmark: Description and simulator manual. Office for Official Publications of the European Community, Luxembourg, ISBN: 92-894-1658-0 (p. 154)
7. U. Cortes, M. Sanchez-Marre, L. Ceccaroni, I. R-Roda, and M. Poch Artificial intelligence and environmental decision support systems Applied Intelligence 13 1 2000 77 91
8. P. Fritzson Principles of object-oriented modeling and simulation with modelica 2.1 2004 IEEE Press
9. Gaudioso E.; & Talavera, L. (2006). Data mining to support tutoring in virtual learning communities: Experiences and challenges. In Romero C.; Ventura S.; Eds.; Data Mining in e-learning, (pp. 157-171).
10. E. Gaudioso, M. Montero, L. Talavera, and F. Hernández del Olmo Supporting teachers in collaborative student modeling: A framework and an implementation Expert Systems with Applications 36 2 2009 2260 2265
11. Hernández del Olmo, F.; & Llanes, F.H. (2009). Artificial intelligence in wastewater systems: An emergent approach. In 10th IWA conference on instrumentation, control and automation.
12. Hernández del Olmo, F.; & Llanes, F.H. (2010). An emergent approach for oxygen control in the n-ammonia removal process. In International IWA conference on sustainable solutions for small water systems.
13. F. Hernández del Olmo, E. Gaudioso, and J.G. Boticario A reinforcement learning approach to achieve unobtrusive and interactive recommendation systems for web-based communities Adaptive hypermedia and adaptive web-based systems LNCS Vol. 3137 2004 Springer Eindhoven, Holanda 409 412
14. F. Hernández del Olmo, E. Gaudioso, and E.H. Martín The task of guiding in adaptive recommender systems Expert Systems with Applications 36 2, Part 1 2009 1972 1977
15. M. Huang, J. Wan, Y. Ma, W. Li, X. Sun, and Y. Wan A fast predicting neural fuzzy model for on-line estimation of nutrient dynamics in an anoxic/oxic process Bioresource Technology 101 6 2010 1642 1651
16. M. Huang, J. Wan, M. Yongwen, W. Yan, L. Weijiang, and S. Xiaofei Control rules of aeration in a submerged biofilm wastewater treatment process using fuzzy neural networks Expert Systems with Applications 36 7 2009 10428 10437
17. L.P. Kaelbling, M.L. Littman, and A.W. Moore Reinforcement learning: A survey Journal of Artificial Intelligence Research 4 1996 237 285 (Pubitemid 126646155)
18. S. Krovviddy, and W.G. Wee Wastewater treatment system from case-based reasoning Machine Learning 10 1993 341 363
19. S. Krovviddy, W.G. Wee, M. Suidan, R.S. Summers, J.J. Coleman, and L. Rossman Intelligent sequence planning for wastewater treatment systems IEEE Expert: Intelligent Systems and Their Applications 9 1994 15 20
20. P. Langley Elements of machine learning 1996 Morgan Kaufman San Francisco, California
21. S. Liao Expert system methodologies and applications: A decade review from 1995 to 2004 Expert Systems with Appications 28 2005 93 103
22. Metcalf-Eddy Inc. (1998). Wastewater engineering: Treatment, Disposal, Reuse. McGraw-Hill Interamericana.
23. T. Mitchell Machine learning 1997 McGraw Hill
24. G. Olsson, M. Nielsen, Z. Yuan, A. Lynggaard-Jensen, and J.P. Steyer Instrumentation control and automation in wastewater systems 2005 IWA Publishing
25. P. Samuelsson, B. Halvarsson, and B. Carlsson Cost-efficient operation of a denitrifying activated sludge process Water Research 41 2007 2325 2332 (Pubitemid 46670195)
26. M. Sánchez, U. Cortés, J. Lafuente, I.R. Roda, and M. Poch DAI-DEPUR: An integrated and distributed architecture for wastewater treatment plants supervision Artificial Intelligence in Engineering 10 3 1996 275 285 (Pubitemid 126358813)
27. P. Serra, M. Sánchez-Marre, J. Lafuente, U. Cortés, and M. Poch DEPUR: A knowledge based tool for wastewater treatment plants Engineering Applications of Artificial Intelligence 7 1994 23 30
28. A. Stare, D. Vrecko, N. Hvala, and S. Strmcnik Comparison of control strategies for nitrogen removal in activated sludge process in terms of operating costs: A simulation study Water Research 41 2007 2004 2014 (Pubitemid 46528973)
29. R. Sutton, and A. Barto Reinforcement learning: An introduction 1998 Mit Press Cambridge
30. D. Vernon, G. Metta, and G. Sandini A survey of artificial cognitive systems: Implications of mental capabilities in computational agents IEEE Transactions on Evolutionary Computation 11 2 2007 151 179
31. C.H. Wen, and C.A. Vassiliadis Applying hybrid artificial intelligence in wastewater treatment Engineering Applications of Artificial Intelligence 11 1998 685 705 (Pubitemid 128409032)