Multiple model-based control using finite controlled markov chains

Cognitive Computation

Volumn 1, Issue 3, 2009, Pages 234-243

  Ikonen, Enso ^a   Najim, Kaddour ^b  

^a UNIVERSITY OF OULU   (Finland)

^b UNIVERSITÉ DE TOULOUSE   (France)

Author keywords

Dynamic programming; Intelligent control; Markov decision processes; Multiple models; Physical models; Probabilistic models

Indexed keywords

ADAPTIVE CONTROL; BEST MODEL; CONTROL PROCESS; CONTROLLED MARKOV CHAINS; FINITE MARKOV CHAIN; FREQUENTIST; KULLBACK-LEIBLER INFORMATION; MARKOV DECISION PROCESSES; MODEL SELECTION METHODS; MULTI VARIABLES; MULTIPLE MODELS; NON-MINIMUM PHASE; ONLINE DATA; PHYSICAL MODEL; PLANT IDENTIFICATION; PLANT MODEL; PROBABILISTIC MODELS; SIGNALS AND SYSTEMS; STOCHASTIC NATURE;

ADAPTIVE CONTROL SYSTEMS; COMPUTER SIMULATION; CONTROL THEORY; CONTROLLERS; DYNAMIC PROGRAMMING; DYNAMICS; INTELLIGENT CONTROL; MARKOV PROCESSES; MODELS;

PROCESS CONTROL;

EID: 78651575854     PISSN: 18669956     EISSN: 18669964     Source Type: Journal    
DOI: 10.1007/s12559-009-9020-0     Document Type: Article

References (33)

1. Berthiaux H, Mizonov V. Applications of Markov chains in particulate process engineering: a review. Can J Chem Eng. 2004; 82: 1143-68.
2. Bertsekas DP. Dynamic programming and optimal control. Belmont, Massachusetts: Athena Scientific; 2007.
3. Chen H, Kremling A, Allgöwer F. Nonlinear predictive control of a benchmark CSTR. In: Proceedings of the 3rd european control conference, Rome, Italy; 1995. p. 3247-58.
4. Filev D. Model bank based intelligent control. In Proceedings of the NAFIPS, New Orleans, USA; 2002. p. 583-6.
5. Ghahramani Z, Jordan MI. Learning From Incomplete Data. Lab Memo No. 1509, Center for Biological and Computational learning, Department of Brain and Cognitive Sciences, Paper No. 108, MIT Artificial Intelligence Laboratory; 1994.
6. Gosavi, A. Reinforcement learning: A tutorial survey and recent advances. INFORMS J Comput. 2009; 21(2): 178-92.
7. Häggström O. Finite Markov chains and algorithmic applications. Cambridge: Cambridge University Press; 2002.
8. Hsu CS. Cell-to-cell mapping-a method of global analysis for nonlinear systems. New York: Springer-Verlag; 1987.
9. Hussain A, Abdullah R, Chambers J, Gurney K, Redgrave P. Emergent common functional principles in control theory and the vertebrate brain: a case study with autonomous vehicle control. Artificial Neural Networks-ICANN, Prague, Czech Republic; 2008. p. 949-58.
10. Hyötyniemi H. Neocybernetics in biology. Helsinki University of Technology, Control Engineering Laboratory, Report 151, Finland, 2006; 267 p.
11. Ikonen E, Najim K. Process identification and control. New York: Marcel Dekker; 2002. p. 310.
12. Jacobs R, Jordan M, Nowlan S, Hinton G. Adaptive mixtures of local experts. Neural Comput. 1991; 3: 79-87.
13. Johansen TA, Murray-Smith R. The operating regime approach to nonlinear modelling and control. In: Murray-Smith R, Johansen TA (eds) Multiple model approaches to modelling and control. London: Taylor and Francis; 1997, p. 3-72.
14. Kaelbling LP, Littman ML, Moore AW. Reinforcement learning: a survey. J Artif Intell Res. 1996; 4: 237-85.
15. Kárný M, Kracík J, Guy TV. Cooperative decision making without facilitator. St. Petersburg, Russia: IFAC ALCOSP; 2007.
16. Kemeny JG, Snell JL. Finite Markov chains. Princeton: van Nostrand; 1960.
17. Kulhavy R. Kullback-Leibler distance approach to system identification. In: IFAC symposium on adaptive systems in control and signal processing, Budapest, 1995; p. 55-66.
18. Lee JM, Lee JH. Approximate dynamic programming strategies and their applicability for process control: a review and future directions. Int J Control Autom Syst. 2004; 2(3): 263-78.
19. Li XR, Zhao Z, Li X-B. General model-set design methods for multiple-model approach. IEEE Trans Autom Control. 2005; 50(9): 1260-76.
20. Lunze J. On the Markov property of quantised state measurement sequences. Automatica. 1998; 32(11): 1439-44.
21. Lunze J, Nixdorf B, Richter H. Process supervision by means of a hybrid model. J Proc Cont. 2001; 11: 89-104.
22. Motter M, Principe JC. Predictive multiple model switching control with the self-organizing map. Int J Robust Nonlinear Control. 2002; 12(11): 1029-51.
23. Murray-Smith R, Johansen TA. Multiple model approaches to modelling and control. London: Taylor & Francis; 1997.
24. Narendra KS, Balakrishnan J, Ciliz MK. Adaptation and learning using multiple models, switching and tuning. IEEE Control Syst. 1995; 15(3): 37-51.
25. Poznyak AS, Najim K, Gómez-Ramírez E. Self-learning control of finite Markov chains. New York: Marcel Dekker; 2000.
26. Puterman ML. Markov decision processes-discrete stochastic dynamic programming. New York: Wiley & Sons; 1994.
27. Riordon JS. An adaptive automation controller for discrete-time Markov processes. Automatica. 1969; 5: 721-730.
28. Sanz, R. Cognition and control. A preparatory workshop for EU seventh research framework programme, 9 March 2006, Luxembourg; 2006.
29. Shah S, Cluett W. Recursive least squares based estimation schemes for self-tuning control. Can J Chem Eng. 1991; 69: 89-96.
30. Shorten R, Murray-Smith R, Bjorgan R, Gollee H. On the interpretation of local models in blended multiple model structures. Int J Control. 1999; 72(7/8): 620-8.
31. White DJ. Real applications of Markov decision processes. Interfaces. 1985; 15(6): 73-83.
32. White DJ. Further real applications of Markov decision processes. Interfaces. 1989; 18(5): 55-61.
33. White DJ. A survey of applications of Markov decision processes. J Oper Res Soc. 1993; 44(11): 1073-96.