Stability of hybrid dynamic systems containing singularly perturbed random processes

IEEE Transactions on Automatic Control

Volumn 47, Issue 12, 2002, Pages 2021-2032

  Badowski, Grazyna ^a   Yin, G George ^b  

^a UNIVERSITY OF MARYLAND   (United States)

^b WAYNE STATE UNIVERSITY   (United States)

Author keywords

Hybrid system; Lyapunov method; Markov chain; Singular perturbation; Stability; Switching diffusion

Indexed keywords

DIFFERENTIAL EQUATIONS; LYAPUNOV METHODS; MARKOV PROCESSES; OPTIMIZATION; PROBLEM SOLVING; SWITCHING SYSTEMS;

HYBRID DYNAMIC SYSTEMS;

STOCHASTIC CONTROL SYSTEMS;

EID: 0036944901     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAC.2002.805682     Document Type: Article

References (24)

1. P. Billingsley, Convergence of Probability Measures. New York: Wiley, 1968.
2. W. P. Blair and D. D. Sworder, "Feedback control of a class of linear discrete systems with jump parameters and quadratic cost criteria," Int. J. Control, vol. 21, pp. 833-841, 1986.
3. G. B. Blankenship and G. C. Papanicolaou, "Stability and control of stochastic systems with wide band noise," SIAM J. Appl. Math., vol. 34, pp. 437-476, 1978.
4. X. Feng, K.A. Loparo, Y. Ji, and H.J. Chizeck, "Stochastic stability properties of jump linear systems," IEEE Trans. Automat. Contr., vol. 37, pp. 38-53, Jan. 1992.
5. A. Graham, Kronecker Products and Matrix Calculus with Applications. Chinchester, U.K.: Ellis Horwood, 1981.
6. J.K. Hale, Ordinary Differential Equations. Malabar, FL: Krieger, 1980.
7. Y. Ji and H. J. Chizeck, "Controllability, stabilizability, and continuous-time Markovian jump linear quadratic control," IEEE Trans. Automat. Contr., vol. 35, pp. 777-788, July 1990.
8. R. Z. Khasminskii, Stochastic Stability of Differential Equations. Alphen aan den Rijn, The Netherlands: Sijthoff & Noordhoff, 1980.
9. R. Z. Khasminskii, G. Yin, and Q. Zhang, "Asymptotic expansions of singularly perturbed systems involving rapidly fluctuating Markov chains," SIAM J. Appl. Math., vol. 56, pp. 277-293, 1996.
10. H. J. Kushner, Stochastic Stability and Control. New York: Academic, 1967.
11. _, Approximation and Weak Convergence Methods for Random Processes, with Applications to Stochastic Systems Theory. Cambridge, MA: MIT Press, 1984.
12. H. J. Kushner and G. Yin, Stochastic Approximation Algorithms and Applications. New York: Springer-Verlag, 1997.
13. X. Mao, Exponential Stability of Stochastic Differential Equations. New York: Marcel Dekker, 1994.
14. _, "Stability of stochastic differential equations with Markovian switching," Stoch. Process. Appl., vol. 79, pp. 45-67, 1999.
15. M. Mariton and P. Bertrand, "Robust jump linear quadratic control: A mode stabilizing solution," IEEE Trans: Automat. Contr., vol. AC-30, pp. 1145-1147, Nov. 1985.
16. G. C. Papanicolaou, D. Stroock, and S. R. S. Varadhan, "Martingale approach to some limit theorems," in Proceedings of the Conference on Statistical Mechanics, Dynamical Systems, and Turbulence, M. Reed, Ed. Durham, NC: Duke Univ., 1977, vol. 3.
17. A. A. Pervozvanskii and V. G. Gaitsgori, Theory of Suboptimal Decisions: Decomposition and Aggregation. Dordrecht, The Netherlands: Kluwer, 1988.
18. H. A. Simon and A. Ando, "Aggregation of variables in dynamic systems," Econometrica, vol. 29, pp. 111-138, 1961.
19. S. P. Sethi and Q. Zhang, Hierarchical Decision Making in Stochastic Manufacturing Systems. Boston, MA: Birkhäuser, 1994.
20. G. Yin, R. H. Liu, and Q. Zhang, "Recursive algorithms for stock liquidation: A stochastic optimization approach," SIAM J. Optim., vol. 13, pp. 241-258, 2002.
21. G. Yin and J. F. Zhang, "Hybrid singular systems of differential equations," Scientia Sinica, vol. 45, pp. 241-258, 2002.
22. G. Yin and Q. Zhang, Continuous-Time Markov Chains and Applications: A Singular Perturbation Approach. New York: Springer-Verlag, 1998.
23. G. Yin, Q. Zhang, and G. Badowski, "Asymptotic properties of a singularly perturbed Markov chain with inclusion of transient states," Ann. Appl. Probab., vol. 10, pp. 549-572, 2000.
24. Q. Zhang and G. Yin, "On nearly optimal controls of hybrid LQG problems," IEEE Trans. Automat. Contr., vol. 44, pp. 2271-2282, Dec. 1999.