Markov chains with discontinuous drifts have differential inclusion limits

Performance Evaluation

Volumn 69, Issue 12, 2012, Pages 623-642

  Gast, Nicolas ^a,b   Gaujal, Bruno ^c  

^a UNIV GRENOBLE ALPES   (France)

^b EPFL   (Switzerland)

^c INRIA RHÔNE ALPES   (France)

Author keywords

Differential inclusion; Fluid limit; Mean field; Non smooth dynamics; Queuing systems; Stability

Indexed keywords

DIFFERENTIAL INCLUSIONS; FLUID LIMITS; MEAN FIELD; NON-SMOOTH; QUEUING SYSTEMS;

APPROXIMATION ALGORITHMS; APPROXIMATION THEORY; CONVERGENCE OF NUMERICAL METHODS; DIFFERENTIAL EQUATIONS; DYNAMICS; QUEUEING NETWORKS;

MARKOV PROCESSES;

EID: 84867576210     PISSN: 01665316     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.peva.2012.07.003     Document Type: Article

References (34)

1. J.G. Dai On positive Harris recurrence of multiclass queueing networks: a unified approach via fluid limit models The Annals of Applied Probability 5 1 1995 49 77
2. M. Bramson Stability of queueing networks Probability Surveys 5 169-345 2008
3. G. Bianchi Performance analysis of the IEEE 802.11 distributed coordination function IEEE Journal on Selected Areas in Communications 18 3 2000 535 547
4. C. Bordenave, D. Mcdonald, A. Proutière, Random multi-access algorithms: a mean field analysis, in: Proceedings of Allerton Conference, Citeseer, 2005.
5. M. Mitzenmacher Studying balanced allocations with differential equations Combinatorics, Probability and Computing 8 5 1999 473 482 (Pubitemid 129640101)
6. N. Gast, and B. Gaujal A mean field model of work stealing in large-scale systems ACM SIGMETRICS Performance Evaluation Review 38 1 2010 13 24
7. T.G. Kurtz Approximation of Population Processes 1981 Society for Industrial Mathematics
8. M. Benaim, and J.-Y. Le Boudec A class of mean field interaction models for computer and communication systems Performance Evaluation 65 11-12 2008 823 838
9. G. Fort, S. Meyn, E. Moulines, and P. Priouret The ODE method for stability of skip-free Markov chains with applications to MCMC The Annals of Applied Probability 18 2 2008 664 707
10. F. Bouchut, and F. James One-dimensional transport equations with discontinuous coefficients Nonlinear Analysis 32 7 1998 891
11. F. Lempio Euler's method revisited Proceedings of the Steklov Institute of Mathematics 211 4 1995 429 449
12. N. Gast, B. Gaujal, J.-Y. Le Boudec, Mean field for Markov decision processes: from discrete to continuous optimization, INRIA RR, 7239, 2010.
13. A.L. Stolyar On the stability of multiclass queueing networks: a relaxed sufficient condition via limiting fluid processes Markov Processes and Related Fields 1 4 1995 491 512
14. S.P. Meyn, R.L. Tweedie, and J.L. Hibey Markov Chains and Stochastic Stability 1993 Springer London et al
15. U. Ayesta, M. Erausquin, M. Jonckheere, I.M. Verloop, Scheduling in a random environment: stability and asymptotic optimality, 2011. Arxiv Preprint: arXiv:1101.5794.
16. P. van de Ven, S. Borst, and S. Shneer Instability of MaxWeight scheduling algorithms INFOCOM 2009, IEEE 2009 IEEE 1701 1709
17. S. Borst, M. Jonckheere, and L. Leskelä Stability of parallel queueing systems with coupled service rates Discrete Event Dynamic Systems 18 4 2008 447 472
18. M. Jonckheere, S. Shneer, Stability of multi-dimensional birth-and-death processes with state-dependent 0-homogeneous jumps, EURANDOM Report 2009-029, 2009.
19. R.W.R. Darling, and J.R. Norris Differential equation approximations for Markov chains Probability Surveys 5 2008 37 79
20. A.-S. Sznitman Topics in propagation of chaos Cours de l'Ecole d'été de Saint-Flour Lecture Notes in Mathematics Vol. 1464 1989 Springer
21. C. Graham Chaoticity on path space for a queueing network with selection of the shortest queue among several Journal of Applied Probability 37 1 2000 198 211
22. C. Bordenave, D. McDonald, and A. Proutière A particle system in interaction with a rapidly varying environment: mean field limits and applications Networks and Heterogeneous Media (NHM) 5 1 2010 31 62
23. M. Benaim, J.-Y. Le Boudec, On mean field convergence and stationary regime, 2011. Arxiv Preprint: arXiv:1111.5710.
24. R. Mané, and S. Levy Ergodic Theory and Differentiable Dynamics vol. 258 1987 Springer-Verlag Berlin
25. M. Faure, G. Roth, Stochastic approximations of set-valued dynamical systems: convergence with positive probability to an attractor, 2009. Arxiv Preprint: arXiv:0905.1858.
26. M. Benaim, J. Hofbauer, and S. Sorin Stochastic approximation and differential inclusions SIAM Journal on Control and Optimization 44 1 2005 328 348
27. J.N. Tsitsiklis, K. Xu, On the power of (even a little) centralization in distributed processing, in: ACM Sigmetrics, San Jose, 2011.
28. J.N. Tsitsiklis, K. Xu, On the power of (even a little) centralization in distributed processing, Technical Report, 2011. http://web.mit.edu/jnt/www/ Papers/TXSIG11.pdf.
29. V. Acary, and B. Brogliato Numerical Methods for Nonsmooth Dynamical Systems: Applications in Mechanics and Electronics 2008 Springer Verlag
30. M. Kunze Non-Smooth Dynamical Systems 2000 Springer Berlin, Heidelberg
31. J. Dieudonne Foundations of Modern Analysis 1960 Academic Press
32. W. Rudin Functional Analysis 1991 McGraw-Hill Science
33. W.J. Stewart Numerical Solution of Markov Chains 1991 CRC
34. R. Durrett Probability: Theory and Examples 1996 Duxbury Press