Almost sure stabilization for feedback controls of regime-switching linear systems with a hidden Markov Chain

IEEE Transactions on Automatic Control

Volumn 54, Issue 9, 2009, Pages 2114-2125

  Bercu, Bernard ^a   Dufour, François ^a   Yin, G George ^b  

^a UNIVERSITÉ DE BORDEAUX   (France)

^b WAYNE STATE UNIVERSITY   (United States)

Author keywords

Adaptive control; Almost sure stabilization; Hidden Markov chain

Indexed keywords

ADAPTIVE CONTROL SYSTEMS; CHAINS; DIFFERENTIAL EQUATIONS; FEEDBACK CONTROL; LINEAR SYSTEMS; LYAPUNOV FUNCTIONS; MARKOV PROCESSES; SIGNAL THEORY; STABILIZATION;

ADAPTIVE CONTROL; AVERAGE CRITERIA; CONTINUOUS DYNAMICS; CONTROLLED PROCESS; CONTROLLED SYSTEM; HIDDEN MARKOV CHAINS; REGIME SWITCHING; SAMPLE PATH PROPERTIES;

PROCESS CONTROL;

EID: 70349435287     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAC.2009.2026938     Document Type: Article

References (28)

1. W. P. Blair and D. D. Sworder, "Feedback control of a class of linear discrete systems with jump parameters and quadratic cost criteria," Int. J. Control, vol. 21, pp. 833-841, 1986.
2. P. E. Caines and J.-F. Zhang, "On the adaptive control of jump parameter systems via nonlinear filtering," SIAM J. Control Optim. vol. 33, pp. 1758-1777, 1995.
3. S. Chen, X. Li, and X. Y. Zhou, "Stochastic linear quadratic regulators with indefinite control weight costs," SIAM J. Control Optim., vol. 36, pp. 1685-1702, 1998.
4. G. B. Di Masi and L. Stettner, "Ergodicity of filtering process by vanishing discount approach," Syst. Control Lett., vol. 57, pp. 150-157, 2008.
5. V. Dragan, T. Morozan, and A.-M. Stoica, Mathematical Methods in Robust Control of Linear Stochastic Systems. New York: Springer, 2006.
6. T. E. Duncan, L. Guo, and B. Pasik-Duncan, "Adaptive continuous-time linear quadratic Gaussian control," IEEE Trans. Automat. Control, vol. 44, no. 9, pp. 1653-1662, Sep. 1999.
7. F. Dufour and P. Bertrand, "Stabilizing control law for hybrid modes," IEEE Trans. Automat. Control, vol. 39, no. 11, pp. 2354-2357, Nov. 1994.
8. Y. Ephraim and N. Merhav, "Hidden Markov processes," IEEE Trans. Inform. Theory, vol. 48, no. 6, pp. 1518-1569, Jun. 2002.
9. Y. Ji and H. J. Chizeck, "Controllability, stabilizability, and continuous-time Markovian jump linear quadratic control," IEEE Trans. Automat. Control, vol. 35, no. 7, pp. 777-788, Jul. 1990.
10. H. Abou-Kandil, G. Greling, and G. Jank, "Solution and asymptotic behavior of coupled Riccati equations in jump linear systems," IEEE Trans. Automat. Control, vol. 39, no. 8, pp. 1631-1636, Aug. 1994.
11. I. I. Kac and N. N. Krasovskii, "On the stability of systems with random parameters," J. Appl. Math. Mech., vol. 24, pp. 1225-1246, 1960.
12. R. Z. Khasminskii, Stochastic Stability of Differential Equations. Alphen aan den Rijn, Netherlands: Sijthoff and Noordhoff, 1980.
13. R. Z. Khasminskii, C. Zhu, and G. Yin, "Stability of regime-switcing diffusions," Stoachstic Proc. Appl., vol. 117, pp. 1037-1051, 2007.
14. H. J. Kushner, Stochastic Stability and Control. New York: Academic Press, 1967.
15. R. Liptser, "A strong law of large numbers for local martingales," Stochastics, vol. 3, pp. 217-228, 1980.
16. R. S. Liptser and A. N. Shiryayev, Statistics of Random Processes I & II. New York: Springer-Verlag, 2001.
17. S.-J. Liu, J. F. Zhang, and Z. P. Jiang, "Decentralized adaptive output-feedback stabilization for large-scale stochastic nonlinear systems," Automatica, vol. 43, pp. 238-251, 2007.
18. X. Mao, Stochastic Differential Equations and Applications, 2nd ed. Chichester, U.K.: Horwood, 2007.
19. X. Mao, "Stability of stochastic differential equations with Markovian switching," Stochastic Process. Appl., vol. 79, pp. 45-67, 1999.
20. X. Mao, G. Yin, and C. Yuan, "Stabilization and destabilization of hybrid systems of stochastic differential equations," Automatica, vol. 43, pp. 264-273, 2007.
21. X. Mao and C. Yuan, Stochastic Differential Equations with Markovian Switching. London, U.K.: Imperial College Press, 2006.
22. M. Mariton and P. Bertrand, "Robust jump linear quadratic control: A mode stabilizing solution," IEEE Trans. Automat. Control, vol. AC-30, no. 11, pp. 1145-1147, Nov. 1985.
23. S. P. Sethi, H. Zhang, and Q. Zhang, Average-Cost Control of Stochastic Manufacturing Systems. New York: Springer-Verlag, 2004.
24. A. V. Skorohod, Asymptotic Methods in the Theory of Stochastic Differential Equations. Providence, RI: Amer. Math. Soc., 1989.
25. W. M. Wonham, "Some applications of stochastic differential equations to optimal nonlinear filtering," SIAM J. Control, vol. 2, pp. 347-369, 1965.
26. W. M. Wonham, "Liapunov criteria for weak stochastic stability," J. Differential Eqs., vol. 2, pp. 195-207, 1966.
27. X. Y. Zhou and G. Yin, "Markowitz's mean-variance portfolio selection with regime switching: A continuous-time model," SIAM J. Control Optim, vol. 42, pp. 1466-1482, 2003.
28. C. Zhu and G. Yin, "Asymptotic properties of hybrid diffusion systems," SIAM J. Control Optim., vol. 46, pp. 1155-1179, 2007.