Stability of piecewise-deterministic markov. processes

SIAM Journal on Control and Optimization

Volumn 37, Issue 5, 1999, Pages 1483-1502

  Dufour, François ^a   Costa, Oswaldo L V ^b  

^a UNIV PARIS SUD   (France)

^b UNIVERSITY OF SÃO PAULO   (Brazil)

Author keywords

Invariant measure; Markov chain; Piecewise deterministic Markov process

Indexed keywords

BOUNDARY CONDITIONS; LYAPUNOV METHODS; MATHEMATICAL MODELS; PIECEWISE LINEAR TECHNIQUES; PROBABILITY DISTRIBUTIONS; STATE SPACE METHODS; SYSTEM STABILITY;

FOSTER-LYAPUNOV CRITERION; INVARIANT PROBABILITY MEASURE; PIECEWISE DETERMINISTIC MARKOV PROCESSES; RADON-NIKODYM DERIVATIVE;

MARKOV PROCESSES;

EID: 0033141140     PISSN: 03630129     EISSN: None     Source Type: Journal    
DOI: 10.1137/S0363012997330890     Document Type: Article

References (18)

1. J. AZEMA, M. KAPLAN-DUFLO, AND D. REVUZ, Mesure invariante sur les classes récurrente des processus de markov, Z. Wahrscheinlichkeitstheorie verw. Geb., 8 (1967), pp. 157-181.
2. O. COSTA, Stationary distributions for piecewise-deterministic Markov processes, 3. Appl Probab., 27 (1990), pp. 60-73.
3. M. DAVIS, Piecewise-deterministic markov processes: A general class of non-diffusion stochastic models, J. Roy. Statist. Soc. Ser. B, 46 (1984), pp. 353-388.
4. M. DAVIS, Markov Models and Optimization, Chapman and Hall, London, 1993.
5. M. DAVIS, M. DEMPSTER, S. SETHI, AND D. VERMES, Optimal capacity expansion under uncertainty, Adv. in Appl. Probab., 19 (1987), pp. 156-176.
6. J. DlEUDONNE, Eléments d'Analyse, Tome 2, Gauthier-Villard, Paris, 1974.
7. S. FOGUEL, The ergodic theory of positive operators on continuous functions, Ann. Scuol Norm. Sup. Pisa, C. Sci. (4) 27, (1973), pp. 19-51.
8. O. HERNANDEZ-LERMA AND J.-B. LASSERRE, Existence and uniqueness of fixed points for Markov operators and Markov processes, Proc. London Math. Soc. (3), 76 (1998), pp. 711- 736.
9. J.-B. LASSERRE, Invariant probabilities for Markov chains on a metric space, Statis. Probab Lett., 34 (1997), pp. 259-266.
10. M. LlN, Conservative Markov processes on a topological space, Israel J. Math., 8 (1970) pp. 165-186.
11. S. P. MEYN, Ergodic theorems for discrete time stochastic systems using a stochastic Lyapuno function, SIAM J. Control Optim., 27 (1989), pp. 1409-1439.
12. S. P. MEYN AND P. E. GAINES, Asymptotic behavior of stochastic systems possessing Markovia realizations, SIAM J. Control Optim., 29 (1991), pp. 535-561.
13. S. MEYN AND R. TWEEDIE, Criteria for stability of markovian processes III: Foster-Lyapunov criteria for continuous time processes, with examples, Adv. in Appl. Probab., 25 (1993), pp. 518-548.
14. S. MEYN AND R. TWEEDIE, Markov Chains and Stochastic Stability, Springer-Verlag, Berlin 1993.
15. S. MEYN AND R. TWEEDIE, Stability of markovian processes II: Continuous-time processes an sampled chains, Adv. in Appl. Prob., 25 (1993), pp. 487-517.
16. E. NUMMELIN, General Irreducible Markov Chains and Non-negative Operators, Cambridg University Press, Cambridge, 1984.
17. D. REVUZ, Markov Chains, North-Holland, Amsterdam, 1975.
18. K. YOSIDA, Functional Analysis, 6th ed., Springer-Verlag, New York, 1980.