Stability and ergodicity of piecewise deterministic Markov processes

SIAM Journal on Control and Optimization

Volumn 47, Issue 2, 2008, Pages 1053-1077

  Costa, O L V ^a   Dufour, F ^b  

^a UNIVERSITY OF SÃO PAULO   (Brazil)

^b UNIVERSITÉ DE BORDEAUX   (France)

Author keywords

Ergodicity; Piecewise deterministic Markov process; Recurrence

Indexed keywords

CHAINS; IMPORTANCE SAMPLING; STOCHASTIC CONTROL SYSTEMS;

CAPACITY EXPANSION; DISCRETE TIME MARKOV CHAINS; ERGODICITY; FOSTER-LYAPUNOV CRITERION; LOCAL CHARACTERISTICS; PIECEWISE DETERMINISTIC MARKOV PROCESS; POSITIVE HARRIS RECURRENCE; RECURRENCE;

MARKOV PROCESSES;

EID: 55549086499     PISSN: 03630129     EISSN: None     Source Type: Journal    
DOI: 10.1137/060670109     Document Type: Article

References (19)

1. J. AZÉMA, M. DUFLO, and D. REVUZ, Mesure invariante sur les classes récurrentes des processus de Markov, Z. Wahrscheinlichkeitstheorie und Verw. Gebiete, 8 (1967), pp. 157-181.
2. J. AZÉMA, M. DUFLO, and D. REVUZ, Propriétés relatives des processus de Markov récurrents, Z. Wahrscheinlichkeitstheorie und Verw. Gebiete, 13 (1969), pp. 286-314.
3. O. L. V. COSTA, Stationary distributions for piecewise-deterministic Markov processes, J. Appl. Probab., 27 (1990), pp. 60-73.
4. J. G. DAI, On positive Harris recurrence of multiclass queueing networks: A unified approach via fluid limit models, Ann. Appl. Probab., 5 (1995), pp. 49-77.
5. J. G. DAI and S. P. MEYN, Stability and convergence of moments for multiclass queueing networks via fluid limit models, IEEE Trans. Automat. Control, 40 (1995), pp. 1889-1904.
6. M. H. A. DAVIS, Markov Models and Optimization, Chapman and Hall, London, 1993.
7. M. H. A. DAVIS, M. A. H. DEMPSTER, S. P. SETHI, and D. VERMES, Optimal capacity expansion under uncertainty, Adv. in Appl. Probab., 19 (1987), pp. 156-176.
8. F. DUFOUR and O. L. V. COSTA, Stability of piecewise-deterministic Markov processes, SIAM J. Control Optim., 37 (1999), pp. 1483-1502.
9. V. A. MALY̌SEV AND M. V. MEN'̌sikov, Ergodicity, continuity and analyticity of countable Markov chains, Trans. Moscow Math. Soc., 1 (1982), pp. 1-48.
10. S. P. MEYN and R. L. TWEEDIE, Stability of Markovian processes I: Criteria for discrete-time chains, Adv. in Appl. Probab., 24 (1992), pp. 542-574.
11. S. P. MEYN and R. L. TWEEDIE, Generalized resolvents and Harris recurrence of Markov processes, in Doeblin and Modern Probability (Blaubeuren, 1991), Contemp. Math. 149, AMS, Providence, RI, 1993, pp. 227-250.
12. S. P. MEYN and R. L. TWEEDIE, Markov Chains and Stochastic Stability, Springer-Verlag, Berlin, 1993.
13. S. P. MEYN and R. L. TWEEDIE, Stability of Markovian processes II: Continuous-time processes and sampled chains, Adv. in Appl. Probab., 25 (1993), pp. 487-517.
14. S. P. MEYN and R. L. TWEEDIE, Stability of Markovian processes III: Foster-Lyapunov criteria for continuous-time processes, Adv. in Appl. Probab., 25 (1993), pp. 518-548.
15. S. P. MEYN and R. L. TWEEDIE, State-dependent criteria for convergence of Markov chains, Ann. Appl. Probab., 4 (1994), pp. 149-168.
16. S. NIEMI and E. NUMMELIN, On nonsingular renewal kernels with application to a semigroup of transition kernels, Stochastic Process. Appl., 22 (1986), pp. 177-202.
17. E. NUMMELIN, General Irreducible Markov Chains and Nonnegative Operators, Cambridge University Press, Cambridge, UK, 1984.
18. D. REVUZ, Markov Chains, 2nd ed., North-Holland Math. Library 11, North-Holland, Amsterdam, 1984.
19. P. TUOMINEN and R. TWEEDIE, The recurrence structure of general Markov processes, Proc. London Math. Soc., 39 (1978), pp. 554-576.