Countable-state-space Markov chains with two time scales and applications to queueing systems

Advances in Applied Probability

Volumn 34, Issue 3, 2002, Pages 662-688

  Yin, G ^a   Zhang, Hanqin ^a  

^a WAYNE STATE UNIVERSITY   (United States)

Author keywords

Asymptotic expansion; Countable state space; Fluid model; Functional central limit theorem; Mt Mt 1 queue; Markov chain; Occupation measure; Singular perturbation

Indexed keywords

APPROXIMATION THEORY; ASYMPTOTIC STABILITY; MATHEMATICAL MODELS; PERTURBATION TECHNIQUES; PROBABILITY; QUEUEING NETWORKS; TIME VARYING NETWORKS;

ASYMPTOTIC EXPANSION; COUNTABLE STATE SPACES;

MARKOV PROCESSES;

EID: 0036754735     PISSN: 00018678     EISSN: None     Source Type: Journal    
DOI: 10.1239/aap/1033662170     Document Type: Article

References (26)

1. Asmussen, S. and Bladt, M. (1994). A sample path approach to mean busy periods for Markov-modulated queues and fluids. Adv. Appl. Prob. 26, 1117-1121.
2. Billingsley, P. (1968). Convergence of Probability Measures. John Wiley, New York.
3. Bogoliubov, N.N. and Mitropolskii, Y.A., (1961). Asymptotic Methods in the Theory of Nonlinear Oscillator. Gordon and Breach, New York.
4. Doob, J.L. (1990). Stochastic Processes. John Wiley, New York.
5. t/G/∞ queue. Operat. Res. 41, 731-742.
6. Ethier, S.N. and Kurtz, T.G. (1986). Markov Processes: Characterization and Convergence. John Wiley, New York.
7. Harrison, J.M. (1985). Brownian Motions and Stochastic Flow Systems. John Wiley, New York.
8. Hutson, V. and Pym, J.S. (1980). Applications of Functional Analysis and Operator Theory. Academic Press, London.
9. Ilin, A.M. (1992). Matching of Asymptotic Expansions of Solutions of Boundary Value Problems (Trans. Math. Monogr. 102). American Mathematical Society, Providence, RI.
10. Ilin, A.M., Khasminskii, R.Z. and Yin, G. (1999). Singularly perturbed switching diffusions: rapid switchings and fast diffusions. J. Optim. Theory Appl. 102, 555-591.
11. Khasminskii, R.Z. (1966). On stochastic processes defined by differential equations with a small parameter. Theory Prob. Appl. 11, 211-228.
12. Khasminskii, R.Z., Yin, G. and Zhang, Q. (1996). Asymptotic expansions of singularly perturbed systems involving rapidly fluctuating Markov chains. SIAM J. Appl. Math. 56, 277-293.
13. Knessl, C., Matkowsky, B.J., Schuss, Z. and Tier, C. (1986). Asymptotic analysis of a state-dependent M/G/1 queueing system. SIAM J. Appl. Math. 46, 483-505.
14. Kushner, H.J. (1984). Approximation and Weak Convergence Methods for Random Processes, With Applications to Stochastic Systems Theory. MIT Press, Cambridge, MA.
15. Ladas, G.E. and Lakshmikantham, V. (1972). Differential Equations in Abstract Spaces. Academic Press, New York.
16. Massey, W. (1985). Asymptotic analysis of the time dependent M/M/1 queue. Math. Operat. Res. 10, 305-327.
17. Massey, W.A. and Whitt, W. (1998). Uniform acceleration expansions for Markov chains with time-varying rates. Ann. Appl. Prob. 8, 1130-1155.
18. Neuts, M.F. (1981). Matrix-Geometric Solutions in Stochastic Models. The Johns Hopkins University Press, Baltimore, MD.
19. O'Malley, R.E. Jr. (1991). Singular Perturbation Methods for Ordinary Differential Equations. Springer, New York.
20. ∞-control of Markovian jump linear systems and solutions to associated piecewise-deterministic differential games. In New Trends in Dynamic Games and Applications, ed. G.J. Olsder. Birkhäuser, Boston, MA, pp. 61-94.
21. Pazy, A. (1983). Semigroups of Linear Operators and Applications to Partial Differential Equations. Springer, New York.
22. Saaty, T.L. (1961). Elements of Queueing Theory. McGraw-Hill, New York.
23. Skorohod, A.V. (1982). Studies in the Theory of Random Processes. Dover, New York.
24. Vasil'eava, A.B. and Butuzov, V.F. (1990). Asymptotic Methods in Singular Perturbations Theory. Vysshaya Shkola, Moscow (in Russian).
25. Yin, G. and Zhang, Q. (1998). Continuous-Time Markov Chains and Applications: A Singular Perturbation Approach. Springer, New York.
26. Yin, G., Zhang, Q. and Badowski, G. (2000). Asymptotic properties of a singularly perturbed Markov chain with inclusion of transient states. Ann. Appl. Prob. 10, 549-572.