Generalized product-form stationary distributions for markov chains in random environments with queueing applications

Advances in Applied Probability

Volumn 37, Issue 1, 2005, Pages 185-211

  Economou, Antonis ^a  

^a UNIVERSITY OF ATHENS   (Greece)

Author keywords

Continuous time Markov chain; ESTA property; Partial balance; Potential; Product form stationary distribution; Queueing; Random environment; Resolvent

Indexed keywords

EIGENVALUES AND EIGENFUNCTIONS; MATHEMATICAL MODELS; MATRIX ALGEBRA; PROBABILITY; QUEUEING THEORY; RANDOM PROCESSES;

CONTINUOUS TIME MARKOV CHAIN; EVENTS SEE TIME AVERAGES (ESTA) PROPERTY; PARTIAL BALANCE; PRODUCT FORM STATIONARY DISTRIBUTION; QUEUEING; RANDOM ENVIRONMENT;

MARKOV PROCESSES;

EID: 17744391300     PISSN: 00018678     EISSN: None     Source Type: Journal    
DOI: 10.1239/aap/1113402405     Document Type: Article

References (35)

1. Anisimov, V. and Sztrik, J. (1989). Asymptotic analysis of some complex renewable systems operating in random environments. Europ. J. Operat. Res. 41, 162-168.
2. Bourgin, R. D. and Cogburn, R. (1981). On determining absorption probabilities for Markov chains in random environments. Adv. Appl. Prob. 13, 369-387.
3. Chang, C.-S. and Nelson, R. (1993). Perturbation analysis of the M/M/1 queue in a Markovian environment via the matrix-geometric method. Commun. Statist. Stoch. Models 9, 233-246.
4. Chao, X., Pinedo, M. and Miyazawa, M. (1999). Queueing Networks: Negative Customers, Signals and Product Form. John Wiley, New York.
5. Çinlar, E. (1975). Introduction to Stochastic Processes. Prentice-Hall, Englewood Cliffs, NJ.
6. Cogburn, R. ( 1991 ). On the central limit theorem for Markov chains in random environments. Ann. Prob. 19, 587-604.
7. Cogburn, R. and Torrez, W. C. (1981). Birth and death processes with random environments in continuous time. J. Appl. Prob. 18, 19-30.
8. El-Taha, M. and Stidham, S., Jr. (1999). Sample-Path Analysis of Queueing Systems. Kluwer, Boston, MA.
9. Fakinos, D. (1982). The generalized MIG/k blocking system with heterogeneous servers. J. Operat. Res. Soc. 33, 801-809.
10. Fakinos, D. (1991). Insensitivity of generalized semi-Markov processes evolving in a random environment. J. Operat. Res. Soc. 42, 1111-1115.
11. Fakinos, D. and Economou, A. (1998). Overall station balance and decomposability for non-Markovian queueing networks. Adv. Appl. Prob. 30 870-887.
12. Falin, G. (1996). A heterogeneous blocking system in a random environment. J. Appl. Prob. 33, 211-216.
13. Gaver, D. P., Jacobs, P. A. and Latouche, G. (1984). Finite birth-and-death models in randomly changing environments. Adv. Appl. Prob. 16, 715-731.
14. Gupta, P. L. and Gupta, R. D. (1990). A bivariate random environmental stress model. Adv. Appl. Prob. 22, 501-503.
15. Hambly, B. (1992). On the limiting distribution of a supercritical branching process in a random environment. J. Appl. Prob. 29 499-518.
16. Helm, W. E. and Waldmann, K.-H. (1984). Optimal control of arrivals to multiserver queues in a random environment. J. Appl. Prob. 21 602-615.
17. Karlin, S. and McGregor, J. L. (1965). Ehrenfest urn models. J. Appl. Prob. 2, 352-376.
18. Kelly, F. P. (1979). Reversibility and Stochastic Networks. John Wiley, New York.
19. Lefèvre, C. and Milhaud, X. (1990). On the association of the lifelengths of components subjected to a stochastic environment. Adv. Appl. Prob. 22, 961-964.
20. Melamed, B. and Yao, D. D. (1995). The ASTA property. In Advances in Queueing(Prob. Stoch. Ser.), ed. J. H. Dshalalow, CRC, Boca Raton, FL, pp. 195-224.
21. Mitrani, I. and Chakka, R. (1995). Spectral expansion solution for a class of Markov models: application and comparison with the matrix-geometric method. Perf. Eval. 23, 241-260.
22. Neuts, M. F. (1981). Matrix-Geometric Solutions in Stochastic Models. An Algorithmic Approach (Johns Hopkins Ser. Math. Sci. 2). Johns Hopkins University Press, Baltimore, MD.
23. Norris, J. R. (1997). Markov Chains. Cambridge University Press.
24. Núñez-Queija, R. (1997). Steady-state analysis of a queue with varying service rate. Res. Rep. PNA-R9712, CWI.
25. O'cinneide, C. A. and Purdue, P. (1986). The M/M/∞ queue in a random environment. J. Appl. Prob. 23, 175-184.
26. Posner, M. J. M. and Zuckerman, D. (1990). Optimal R & D programs in a random environment. J. Appl. Prob. 27, 343-350.
27. Serfozo, R. (1999). Introduction to Stochastic Networks. Springer, New York.
28. Stidham, S., Jr. and El-Taha, M. (1995). Sample-path techniques in queueing theory. In Advances in Queueing (Prob. Stoch. Ser.), ed. J. H. Dshalalow, CRC, Boca Raton, FL, pp. 119-166.
29. Sztrik, J. (1987). On the heterogeneous M/G/n blocking system in a random environment. J. Operat. Res. Soc. 38, 57-63.
30. Tsitsiashvili, G. Sh., Osipova, M. A., Koliev, N. V. and Baum, D. (2002). A product theorem for Markov chains with application to PF-queueing networks. Ann. Operat. Res. 113, 141-154.
31. Van Assche, W., Parthasar Athy, P. R. and Lenin, R. B. (1999). Spectral representation of four finite birth and death processes. Math. Scientist 24, 105-112.
32. Van Dijk, N. M. (1993). Queueing Networks and Product Forms: A System Approach. John Wiley, Chichester.
33. Yamazaki, G. and Miyazawa, M. (1995). Decomposability in queues with background states. Queueing Systems 20, 453-469.
34. Zhu, Y. (1991). A Markov-modulated M/M/1 queue with group arrivals. Queueing Systems 8, 255-263.
35. Zhu, Y. (1994). Markovian queueing networks in a random environment. Operat. Res. Lett. 15, 11-17.