Asymptotic properties of hybrid diffusion systems

SIAM Journal on Control and Optimization

Volumn 46, Issue 4, 2007, Pages 1155-1179

  Zhu, C ^a   Yin, G ^b  

^a UNIVERSITY OF WISCONSIN MILWAUKEE   (United States)

^b WAYNE STATE UNIVERSITY   (United States)

Author keywords

Ergodicity; Liapunov function; Positive recurrence; Switching diffusion; Weak stochastic stability

Indexed keywords

APPLIED MATHEMATICS; ASYMPTOTIC PROPERTIES; CONTROL AND OPTIMIZATION; DISCRETE TIME MARKOV CHAIN (DTMC); ERGODICITY; HYBRID DIFFUSION SYSTEMS; HYBRID SYSTEM (HS); LIAPUNOV FUNCTIONS; NECESSARY AND SUFFICIENT CONDITIONS; POSITIVE RECURRENCE; REGIME-SWITCHING; STOCHASTIC STABILITY;

ASYMPTOTIC ANALYSIS; CONTROL SYSTEMS; DIFFUSION; LYAPUNOV FUNCTIONS; MARKOV PROCESSES; SEMICONDUCTOR DOPING; SWITCHING SYSTEMS; TURBULENT FLOW;

ASYMPTOTIC STABILITY;

EID: 47049084345     PISSN: 03630129     EISSN: None     Source Type: Journal    
DOI: 10.1137/060649343     Document Type: Article

References (34)

1. A. ARAPOSTATHIS, M.K. GHOSH, AND S.I. MARCUS, Hamack's inequality for cooperative weakly coupled elliptic systems, Comm. Partial Differential Equations, 24 (1999), pp. 1555-1571.
2. G.K. BASAK, A. BISI, AND M.K. GHOSH, Stability of a random diffusion with linear drift, J. Math. Anal. Appl., 202 (1996), pp. 604-622.
3. A. BENSOUSSAN, Perturbation Methods in Optimal Control, John Wiley, Chichester, UK, 1988.
4. A. BENSOUSSAN AND P.L. LIONS, Optimal control of random evolutions, Stochastics, 5 (1981), pp. 169-190.
5. T. BJÖRK, Finite dimensional optimal filters for a class of Ito processes with jumping parameters, Stochastics, 4 (1980), pp. 167-183.
6. Z.Q. CHEN AND Z. ZHAO, Potential theory for elliptic systems, Ann. Probab., 24 (1996), pp. 293-319.
7. Z.Q. CHEN AND Z. ZHAO, Harnack inequality for weakly coupled elliptic systems, J. Differential Equations, 139 (1997), pp. 261-282.
8. E.B. DYNKIN, Markov Processes, Vols. I and II, Academic Press, New York, Springer-Verlag, Berlin, 1965.
9. M.K. GHOSH. A. ARAPOSTATHIS, AND S.I. MARCUS, Ergodic control of switching diffusions, SIAM J. Control Optim., 35 (1997), pp. 1952-1988.
10. D. GILBARG AND N.S. TRUDINGER, Elliptic Partial Differential Equations of Second Order, Springer-Verlag, Berlin, 2001.
11. A.M. IL'IN, R.Z. KHASMINSKII, AND G. YIN, Asymptotic expansions of solutions of integro-differential equations for transition densities of singularly perturbed switching diffusions, J. Math. Anal. Appl., 238 (1999), pp. 516-539.
12. J. JACOD AND A.N. SHIRYAYEV, Limit Theorems for Stochastic Processes, Springer-Verlag, New York, 1980.
13. Y. JI AND H.J. CHIZECK, Controllability, stabilizability, and continuous-time Markovian jump linear quadratic control, IEEE Trans. Automat. Control, 35 (1990), pp. 777-788.
14. J.P. HESPANHA, Stochastic Hybrid Systems: Application to Communication Networks, Springer, Berlin, 2004.
15. J.P. HESPANHA, A model for stochastic hybrid systems with application to communication networks, Nonlinear Anal., 62 (2005), pp. 1353-1383.
16. R.Z. KHASMINSKII, Stochastic Stability of Differential Equations, Sijthoff and Noordhoff, Alphen aan den Rijn, The Netherlands, 1980.
17. R.Z. KHASMINSKII AND G. YIN, Asymptotic behavior of parabolic equations arising from one-dimensional null-recurrent diffusions, J. Differential Equations, 161 (2000), pp. 154-173.
18. R.Z. KHASMINSKII, C. ZHU, AND G. YIN, Stability of regime-switching diffusions, Stochastic Process. Appl., to appear.
19. H.J. KUSHNER, Approximation and Weak Convergence Methods for Random Processes, with Applications to Stochastic Systems Theory, MIT Press, Cambridge, MA, 1984.
20. H.J. KUSHNER, Weak Convergence Methods and Singularly Perturbed Stochastic Control and Filtering Problems, Birkhäuser Boston, Boston, MA, 1990.
21. H.J. KUSHNER AND G. YIN, Stochastic Approximation and Recursive Algorithms and Applications, 2nd ed., Springer-Verlag, New York, 2003.
22. J.P. LASALLE AND S. LEFSCHITZ, The Stability by Liapunov Direct Method, Academic Press, New York, 1961.
23. X. MAO, Stability of stochastic differential equations with Markovian switching, Stochastic Process. Appl., 79 (1999), pp. 45-67.
24. M. MARITON, Jump Linear Systems in Automatic Control, Marcel Dekker, New York, 1990.
25. K. PICHÓR AND R. RUDNICKI, Stability of Markov semigroups and applications to parabolic systems, J. Math. Anal. Appl., 215 (1997), pp. 56-74.
26. M. PRANDINI, J. HU, J. LYGEROS, AND S. SASTRY, A probabilistic approach to aircraft conflict detection, IEEE Trans. Intell. Transportation Systems, 1 (2000), pp. 199-220.
27. M.H. PROTTER AND H.F. WEINBERGER, Maximum Principles in Differential Equations, Prentice-Hall, Englewood Cliffs, NJ, 1967.
28. A.V. SKOROHOD, Asymptotic Methods in the Theory of Stochastic Differential Equations, Amer. Math. Soc., Providence, RI, 1989.
29. D.D. SWORDER AND V.G. ROBINSON, Feedback regulators for jump parameters systems with state and control dependent transition rates, IEEE Tran. Automat. Control, AC-18 (1973), pp. 355-360.
30. J.T. WLOKA, B. ROWLEY, AND B. LAWRUK, Boundary Value Problems for Elliptic Systems, Cambridge University Press, Cambridge, UK, 1995.
31. W.M. WONHAM, Liapunov criteria for weak stochastic stability, J. Differential Equations, 2 (1966), pp. 195-207.
32. G. YIN, H.M. YAN, AND X.C. LOU, On a class of stochastic optimization algorithms with applications to manufacturing models, in Model-Oriented Data Analysis, W.G. Müller, H.P. Wynn, and A.A. Zhigljavsky, eds., Physica-Verlag, Heidelberg, 1993, pp. 213-226.
33. C. YUAN AND X. MAO, Asymptotic stability in distribution of stochastic differential equations with Markovian switching, Stochastic Process. Appl., 103 (2003), pp. 277-291.
34. Q. ZHANG, Stock trading: An optimal selling rule, SIAM J. Control Optim., 40 (2001), pp. 64-87.