Convergence Analysis of an Iterative Aggregation/disaggregation Method for Computing Stationary Probability Vectors of Stochastic Matrices

Numerical Linear Algebra with Applications

Volumn 5, Issue 4, 1998, Pages 253-274

  Marek, Ivo ^a   Mayer, Petr ^a  

^a CHARLES UNIVERSITY   (Czech Republic)

Author keywords

Aggregation disaggregation iterative methods; Stochastic matrix

Indexed keywords

EID: 0032344877     PISSN: 10705325     EISSN: None     Source Type: Journal    
DOI: 10.1002/(SICI)1099-1506(199807/08)5:4<253::AID-NLA124>3.0.CO;2-B     Document Type: Article

References (32)

1. V. A. Barker. Numerical solution of sparse singular systems of equations arising from ergodic Markov chains. Commun. Statist. - Stochastic Models 5, 335-381, 1989.
2. A. Herman and R. J. Plemmons. Nonnegative Matrices in the Mathematical Sciences. Academic Press, New York 1979.
3. E. Bohl and I. Marek. A model of amplification. J. Comp. Appl. Math. 63, 27-47, 1995.
4. W.-L. Cao and W. J. Stewart. Iterative aggregation/disaggregation techniques for nearly uncoupled Markov chains. Journal of the Association for Computing Machinery, 32, (3), 702-719, 1985.
5. F. Chatelin and W. L. Miranker. Acceleration by aggregation of successive approximation methods. Linear Algebra and Its Applications 43, 17-47, 1984.
6. F. Chatelin and W. L. Miranker. Aggregation/disaggregation for eigenvalue problems. SIAM J. Numer. Anal., 21, 567-582, 1984.
7. I. S. Duff and J. K. Reid. An implementation of Tarjan's algorithm for the block triangularization of a matrix. ACM Transactions on Mathematical Software, 4, 137-147, 1978.
8. F. R. Gantmacher. The Theory of Matrices Gos. Izd. Lit., Moscow, 1954, in Russian. English translation: Applications of the Theory of Matrices, Interscience, New York, 1959.
9. F. R. Gantmacher. The Theory of Matrices Gos. Izd. Lit., Moscow, 1954, in Russian. English translation: Applications of the Theory of Matrices, Interscience, New York, 1959.
10. W. A. Grassmann, M. I. Taksar and D. P. Heyman. Regenerative analysis and steady state distributions. Oper. Res., 33, 1107-1116, 1985.
11. M. Haviv. Aggregation/disaggregation methods for computing the stationary distribution of a Markov chain. SIAM J. Numer. Anal., 14, 952-966, 1987.
12. H. D. Kafeety, C. D. Meyer and W. J. Stewart. A general framework for iterative aggregation/disaggregation methods for the numerical solution of Markov chains. Technical Report TR 06039101, Center for Research in Scientific Computation, North Carolina State University, Raleigh, North Carolina, November 1990. See also the Proceedings of the Copper Mountains Conference On Iterative Methods, Copper Mountain, Colorado, 1992.
13. H. D. Kafeety, C. D. Meyer and W. J. Stewart. A general framework for iterative aggregation/disaggregation methods for the numerical solution of Markov chains. Technical Report TR 06039101, Center for Research in Scientific Computation, North Carolina State University, Raleigh, North Carolina, November 1990. See also the Proceedings of the Copper Mountains Conference On Iterative Methods, Copper Mountain, Colorado, 1992.
14. U. Krieger. On iterative aggregation/disaggregation methods for finite Markov chains. Preprint Deutsche Bundespost Telekom, Research and Technology Centre, 1990.
15. U. Krieger. Numerical solution methods for large finite Markov chains. In K. Hare et al., editors, Performance and Reliability Evaluation, Pages 267-318, R. Oldenbourg, Wien, 1994.
16. J. Mandel and B. Sekerka. A local convergence proof for the iterative aggregation method. Linear Algebra and Its Applications, 51, 163-172, 1983.
17. I. Marek. Aggregation methods of computation of stationary distributions of Markov processes. In J. Albrecht and W. Velte, editors, Series of Numerical Mathematics Vol. 96, pages 155-166, Birkhäuser Verlag, Basel, 1991.
18. I. Marek. Frobenius theory of positive operators. Comparison theorems and applications. SIAM J. Appl. Math., 19, 608-628, 1970.
19. I. Marek and Mayer P. Global convergence of an iterative aggregation/disaggregation method for computing stationary probability vectors of stochastic matrices. ZAMM, 75 (SII), S649-S650, 1995.
20. I. Marek and D. Szyld. Local convergence of the (exact and inexact) iterative aggregation method for linear systems and Markov chains. Numer. Math., 69, 61-82, 1994.
21. I. Marek and D. Szyld. Some iterative and semiiterative methods for computation of stationary probability vectors of stochastic operators. Math. Comp., 204, 719-731, 1993.
22. I. Marek and D. Szyld. Splittings of M-operators: irreducibility and the index of the iteration operator. Numerical Functional Analysis and Optimization, 11, 529-553, 1990.
23. I. Marek and K. Žitný. Matrix Analysis for Applied Sciences. Vol. 1, Teubner-Texte zur Mathematik, Band 60, Leipzig, 1983.
24. W. L. Miranker and V. Ya. Pan. Methods of aggregation. Linear Algebra and Its Applications, 29, 231-257, 1980.
25. D. P. O'Leary and Y.-J Wu. A block-GTH algortihm for finding the stationary vector of a Markov chain. SIAM J. Matrix Anal. Appl., 17, 470-488, 1996.
26. J. Polák. Aggregation and disaggregation in Markov Chains. Ph. D. Thesis, Charles University, Prague, 1990, in Czech.
27. P. J. Schweitzer. Aggregation methods for large Markov chains. In G. Iazeolla, P. J. Courtois and A. Hordijk, editors. Mathematical Computer Performance and Reliability, pages 275-286, Dord-Holland, Amsterdam, New York, Oxford, 1984.
28. P. J. Schweitzer. A survey of aggregation-disaggregation in large Markov chains. In W. J. Stewart, editor, Numerical Solution of Markov Chains, pages 63-88, New York, Basel, Hong Kong, 1991, Marcel Dekker.
29. B. Sekerka. An iteration method for solving input/output models. Ekonomicko-matematický obzor, 17, 241-250, 1981, in Czech.
30. K. Tanabe. The conjugate gradient method for computing all extremal stationary probability vectors of a stochastic matrix. Ann. Inst. Stat. Math., 37 (Part B), 173-187, 1985.
31. I. Y. Vakhutinsky, L. M. Dudkin and A. A. Rivkin. Iterative aggregation - a new approach to the solution of large-scale problems. Econometrica, 47, 821-841, 1979.
32. R. S. Varga. Matrix Iterative Analysis Prentice-Hall, Englewood Cliffs, New Jersey, 1962.