Fast multilevel methods for Markov chains

Numerical Linear Algebra with Applications

Volumn 18, Issue 6, 2011, Pages 961-980

  Sterck, Hans De ^a   Miller, Killian ^a   Treister, Eran ^b   Yavneh, Irad ^b  

^a UNIVERSITY OF WATERLOO   (Canada)

^b TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Markov chain; Multigrid; Multilevel aggregation; Over correction; Stationary probability vector

Indexed keywords

EID: 82455162418     PISSN: 10705325     EISSN: 10991506     Source Type: Journal    
DOI: 10.1002/nla.800     Document Type: Article

References (46)

1. Horton G, Leutenegger ST. A multi-level solution algorithm for steady-state Markov chains. Proceedings of the 1994 ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, 1994; 191-200.
2. Treister E, Yavneh I. On-the-fly adaptive smoothed aggregation multigrid for Markov chains. Accepted to SIAM Journal on Scientific Computing 2011. DOI: 10.1137/100799034.
3. De Sterck H, Manteuffel TA, McCormick SF, Miller K, Pearson J, Ruge J, Sanders G. Algebraic multigrid for Markov chains. SIAM Journal on Scientific Computing 2010; 32:544-562.
4. Stewart WJ. An Introduction to the Numerical Solution of Markov Chains. Princeton University Press: Princeton, New Jersey, 1994.
5. De Sterck H, Manteuffel T, Miller K, Sanders G. Top-level acceleration of adaptive algebraic multilevel methods for steady-state solution to Markov chains. Advances in Computational Mathematics 2010. DOI: 10.1007/s10444-010-9168-x. Accepted [15 April 2010].
6. Philippe B, Saad Y, Stewart WJ. Numerical methods in Markov chain modeling. Operations Research 1992; 40(6):1156-1179.
7. Stewart WJ. MARCA Models: A collection of markov chain models, August 2008. Accessed date: [1 August 2008].
8. Leutenegger ST, Horton G. On the utility of the multi-level algorithm for the solution of nearly completely decomposable Markov chains. Technical Report 94-44, ICASE, 1994.
9. Krieger UR. Numerical solution of large finite Markov chains by algebraic multigrid techniques. In Computations with Markov Chains, Stewart W (ed.). Kluwer: Boston, 1995; 403-424.
10. Takahashi Y. A lumping method for numerical calculations of stationary distributions of Markov chains. Technical Report B-18, Department of Information Sciences, Tokyo Institute of Technology, 1975.
11. Simon HA, Ando A. Aggregation of variables in dynamic systems. Econometrica 1961; 29:111-138.
12. Chatelin F, Miranker WL. Acceleration by aggregation of successive approximation methods. Linear Algebra and its Applications 1982; 43:17-47.
13. Mandel J, Sekerka B. A local convergence proof for the iterative aggregation method. Linear Algebra and its Applications 1983; 51:163-172.
14. Koury JR, McAllister DF, Stewart WJ. Iterative methods for computing stationary distributions of nearly completely decomposable Markov chains. SIAM Journal on Algebraic and Discrete Methods 1984; 5(2):164-186.
15. Cao W-L, Stewart WJ. Iterative aggregation/disaggregation techniques for nearly uncoupled Markov chains. Journal of the ACM 1985; 32(3):702-719.
16. Haviv M. Aggregation/disaggregation methods for computing the stationary distribution of Markov chains. SIAM Journal on Numerical Analysis 1987; 24(4):952-966.
17. Krieger UR. On a two-level multigrid solution method for Markov chains. Linear Algebra and its Applications 1995; 223-224:415-438.
18. Marek I, Mayer P. Convergence analysis of an iterative aggregation/disaggregation method for computing stationary probability vectors of stochastic matrices. Numerical Linear Algebra with Applications 1998; 5:253-274.
19. Marek I, Mayer P. Convergence theory of some classes of iterative aggregation/disaggregation methods for computing stationary probability vectors of stochastic matrices. Linear Algebra and its Applications 2003; 363:177-200.
20. Marek I, Szyld DB. Algebraic Schwarz methods for the numerical solution of Markov chains. Linear Algebra and its Applications 2004; 386:67-81.
21. Benzi M, Kuhlemann V. Restricted additive Schwarz methods for Markov chains. Numerical Linear Algebra with Applications 2000; 00:1-20.
22. Saad Y. Iterative Methods for Sparse Linear Systems, Second edn. SIAM: Philadelphia, Pennsylvania, 2003.
23. Buchholz P. Multilevel solutions for structured Markov chains. SIAM Journal on Matrix Analysis and Applications 2000; 22(2):342-357.
24. De Sterck H, Manteuffel TA, McCormick SF, Nguyen Q, Ruge J. Multilevel adaptive aggregation for Markov chains, with application to web ranking. SIAM Journal on Scientific Computing 2008; 30:2235-2262.
25. De Sterck H, Manteuffel TA, McCormick SF, Miller K, Pearson J, Ruge J, Sanders G. Smoothed aggregation multigrid for Markov chains. SIAM Journal on Scientific Computing 2010; 32:40-61.
26. De Sterck H, Miller K, Sanders G, Winlaw M. Recursively accelerated multilevel aggregation for Markov chains. SIAM Journal on Scientific Computing 2010; 32(3):1652-1671.
27. Treister E, Yavneh I. Square and stretch multigrid for stochastic matrix eigenproblems. Numerical Linear Algebra with Applications 2010; 17:229-251.
28. Seibold B. Performance of algebraic multigrid methods for non-symmetric matrices arising in particle methods. Numerical Linear Algebra with Applications 2010; 17:433-451.
29. Berman A, Plemmons RJ. Nonnegative Matrices in the Mathematical Sciences. SIAM: Philadelphia, Pennsylvania, 1987.
30. Briggs WL, Henson VE, McCormick SF. A Multigrid Tutorial, Second edn. SIAM: Philadelphia, Pennsylvania, 2000.
31. Brezina M, Manteuffel TA, McCormick SF, Ruge J, Sanders G. Towards adaptive smooth aggregation (αSA) for nonsymmetric problems. SIAM Journal on Scientific Computing 2010; 32:14-39.
32. Grassmann W, Taksar M, Heyman D. Regenerative analysis and steady-state distributions for Markov chains. Operations Research 1985; 33(5):1107-1116.
33. Krieger UR, Müller-Clostermann B, Sczittnick M. Modeling and analysis of communication systems based on computational methods for Markov chains. IEEE Journal on Selected Areas in Communications 1990; 8(9):1630-1648.
34. Brezina M, Falgout RD, MacLachlan S, Manteuffel TA, McCormick SF, Ruge J. Adaptive algebraic multigrid. SIAM Journal on Scientific Computing 2006; 27:1261-1286.
35. Brezina M, Falgout RD, MacLachlan S, Manteuffel TA, McCormick SF, Ruge J. Adaptive smoothed aggregation (αSA) multigrid. SIAM Journal on Scientific Computing 2005; 25:317-346.
36. Klaus S. Algebraic multigrid (amg): an introduction with applications. Technical Report 70, GMD - Forschungszentrum Informationstechnik GmbH, 1999.
37. Vaněk P, Míka S. Modification of two-level algorithm with overcorrection. Applications of Mathematics 1992; 37:13-28.
38. Blaheta R. A multilevel method with overcorrection by aggregation for solving discrete elliptic problems. Journal of Computational and Applied Mathematics 1988; 24:227-239.
39. Braess D. Towards algebraic multigrid for elliptic problems of second order. Computing 1995; 55:379-393.
40. Brandt A, Yavneh I. Accelerated multigrid convergence and high-Reynolds recirculating flows. SIAM Journal on Scientific Computing 1993; 14(3):607-626.
41. Guillard H, Vaněk P. An aggregation multigrid solver for convection-diffusion problems on unstructured meshes. Technical Report UCD-CCM-130, University of Colorado at Denver, 1998.
42. Zhang J. Residual scaling techniques in multigrid, I: equivalence proof. Applied Mathematics and Computation 1997; 86:283-303.
43. Zhang J. Residual scaling techniques in multigrid, II: practical applications. Applied Mathematics and Computation 1998; 90:229-252.
44. Zhang J. Minimal residual smoothing in multi-level iterative method. Applied Mathematics and Computation 1997; 84:1-25.
45. Dayar T, Stewart WJ. Comparison of partitioning techniques for two-level iterative solvers on large, sparse, Markov chains. SIAM Journal on Scientific Computing 2000; 21:1691-1705.
46. Barrett R, Berry MW, Chan TF, Demmel J, Donato J, Dongarra J, Eijkhout V, Pozo R, Romine C, van der Vorst H. Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods. SIAM: Philadelphia, Pennsylvania, 1993.