Model-free learning control of neutralization processes using reinforcement learning

Engineering Applications of Artificial Intelligence

Volumn 20, Issue 6, 2007, Pages 767-782

  Syafiie, S ^a   Tadeo, F ^a   Martinez, E ^b  

^a UNIVERSITY OF VALLADOLID   (Spain)

^b Facultad de Ciencias Naturales e Instituto M Lillo   (Argentina)

Author keywords

Goal seeking control; Intelligent control; Learning control; Neutralization process; Online learning; pH control; Process control

Indexed keywords

ALGORITHMS; E-LEARNING; INTELLIGENT CONTROL; NONLINEAR SYSTEMS; REINFORCEMENT LEARNING; THREE TERM CONTROL SYSTEMS; TIME VARYING CONTROL SYSTEMS;

GOAL SEEKING CONTROL; LEARNING CONTROL; NEUTRALIZATION PROCESS; ONLINE LEARNING; PH CONTROL;

COMPUTER CONTROL;

EID: 34250765648     PISSN: 09521976     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.engappai.2006.10.009     Document Type: Article

References (27)

1. Babuska R., Oosterhoff J., Oudshoorn A., and Bruijn P.M. Fuzzy self tuning PI control of pH in fermentation. Journal of Engineering Application of Artificial Intelligence 15 (2002) 3-15
2. Biasizzo K.K., Skrjanc I., and Matko D. Fuzzy predictive control of highly nonlinearity pH process. Computers and Chemical Engineering 21 (1997) s613-s618
3. Chen J., and Huang T.C. Applying neural networks to on-line updated PID controller for nonlinear process control. Journal of Process Control 14 (2004) 211-230
4. Dietterich, T.G., 1997. Hierarchical reinforcement learning with the MAXQ value function decomposition. Technical Report, Department of Computer Science, Oregon State University.
5. Edgar C.R., and Postlethwaite B.E. MIMO fuzzy internal model control. Automatica 34 (2000) 867-877
6. Gustafsson T.K., and Waller K.V. Dynamic modeling and reaction invariant control of pH. Chemical Engineering Science 38 3 (1983) 389-398
7. Gustafsson T.K., Skrifvars B.O., Sandström K.V., and Waller K.V. Modeling of pH for control. Industrial Engineering Chemical Research 34 (1995) 820-827
8. Henson M.A., and Seborg D.E. Adaptive nonlinear control of a pH neutralization process. IEEE Transactions on Control Systems Technology 2 3 (1994) 169-182
9. Kalafatis A.D., Wang L., and Cluett W.R. Linearizing feedforward-feedback control of pH process based on Wiener model. Journal of Process Control 15 (2005) 103-112
10. Krishnapura V.G., and Jutan A. A neural adaptive controller. Chemical Engineering Science 55 (2000) 3803-3812
11. Kwok, D.P., Deng, Z.D, Li, C.M.K., Leung, T.P., Sun, Z.Q., Wong, J.C.K., 2003. Fuzzy neural control of systems with unknown dynamics using Q-learning strategies. In: Proceeding of The 12th IEEE International Conference on Fuzzy Systems, vol. 1, St. Louis, MO, USA, 25-28 May, pp. 482-487.
12. Loh A.P., Looi K.O., and Fong K.F. Neural network modeling and control strategies for a pH process. Journal of Process Control 6 (1995) 355-362
13. McGovern, A., Sutton, R.S., 1998. Macro-actions in reinforcement learning: an empirical analysis. Amberst Technical Report No. 98-70.
14. Mwembeshi M.M., Kent C.A., and Salhi S. A genetic algorithm based approach to intelligent modelling and control of pH in reactor. Computer and Chemical Engineering 28 9 (2004) 1743-1757
15. Norquay S.J., Palazoglu A., and Romagnoli J.A. Model predictive control based on Wiener models. Chemical Engineering Science 53 1 (1998) 75-84
16. Parr, R., 1998. Hierarchical Control and learning for Markov decision processes. Ph.D. Thesis, University of California at Berkeley.
17. Precup, D., 2000. Temporal abstraction in reinforcement learning. Ph.D. Dissertation, Department of Computer Science, University of Massachusetts, Amherst.
18. Ramirez N., and Jackson H. Application of neural networks to chemical process control. Computers and Chemical Engineering 37 (1999) 387-390
19. Riedmiller M. High quality thermostat control by reinforcement learning-a case study. Proceedings of the Conald Workshop 1998 (1998), Carnegie Mellon University
20. Sabharwal, J., Chen, J., 1996. Intelligent pH control using fuzzy invariant clustering. In: Proceedings of the 28th Southeastern Symposium on System Theory, Baton Rouge, LA, USA, pp. 514-518.
21. Schmidt R.J. Industrial catalytic process-phenol production. Applied Catalysis A: General 280 (2005) 89-103
22. Schoknecht, R., Riedmiller, M., 2003. Learning to control at multiple time scales. In: Proceeding of ICANN 2003, Istanbul, Turkey, 26-29 June, pp. 479-487.
23. Shinskey F.G. pH and pIon Control in Process and Waste Stream (1973), Wiley, New York
24. Sung S., and Lee I. pH control using a simple set point change. Industrial and Engineering Chemistry Research 34 50 (1995) 1730-1734
25. Sutton R.S., and Barto A.G. Reinforcement Learning: An Introduction (1998), The MIT Press, Cambridge, MA
26. Sutton R.S., Precup D., and Singh S. Between MDPs and semi-MDPs: a framework for temporal abstraction in reinforcement learning. Artificial Intelligence 112 1-2 (1999) 181-211
27. Wright R.A., and Kravaris C. Nonlinear control of pH processes using the strong acid equivalent. Industrial and Engineering Chemistry Research 30 7 (1991) 1561-1572