A power sparse approximate inverse preconditioning procedure for large sparse linear systems

Numerical Linear Algebra with Applications

Volumn 16, Issue 4, 2009, Pages 259-299

  Jia, Zhongxiao ^a   Zhu, Baochen ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

Dropping strategy; Frobenius norm minimization; Krylov solvers; Preconditioner; Preconditioning; PSAI; QR decomposition; SPAI; Sparse approximate inverse; Sparse linear systems

Indexed keywords

EID: 67650317483     PISSN: 10705325     EISSN: None     Source Type: Journal    
DOI: 10.1002/nla.614     Document Type: Article

References (58)

1. Saad Y, Schultz MH. GMRES: a generalized minimal residual algorithm for solving nonsymmetric linear systems. SIAM Journal on Scientific and Statistical Computing 1986; 7:856-869.
2. Fletcher R. Conjugate gradient methods for indefinite systems. In Proceedings of the Dundee Biennial Conference on Numerical Analysis, Watson GA (ed.), 1974. Springer: New York, 1975; 73-89.
3. Sonneveld P. CGS, a fast Lanczos-type solver for nonsymmetric linear systems. SIAM Journal on Scientific and Statistical Computing 1989; 10:36-52.
4. van der Vorst HA. Bi-CGSTAB: a fast and smoothly converging variant of Bi-CG for the solution of non-symmetric linear systems. SIAM Journal on Scientific and Statistical Computing 1992; 12:631-644.
5. Axelsson O. Iterative Solution Methods. Cambridge University Press: Cambridge, UK, 1994.
6. Barrett R, Berry M, Chan T, Demmel J, Donato J, Dongarra J, Eijkhout V, Romine R, van der Vorst H. Templates for the Solution of Linear Systems. SIAM: Philadelphia, PA, 1994.
7. Saad Y. Iterative Methods for Sparse Linear Systems (2nd edn). SIAM: Philadelphia, PA, 2003.
8. Freund RW, Golub GH, Nachtigal NN. Iterative solutions of linear systems. Acta Numerica 1992; 57-100.
9. Bruaset AM. A Survey of Preconditioned Iterative Methods. Longman: Essex, England, 1995.
10. Evans DJ. The use of pre-conditioning in iterative methods for solving linear equations with symmetric positive definite matrices. Journal of Institute for Mathematics and Applications 1968; 4:295-314.
11. Kolotilina LYu, Yeremin AYu. Factorized sparse approximate inverse preconditioning. I. Theory. SIAM Journal on Matrix Analysis and Applications 1993; 14:45-58.
12. Benzi M, Meyer CD, Tüma M. A sparse approximate inverse preconditioner for the conjugate gradient method. SIAM Journal on Scientific Computing 1996; 17:1135-1149.
13. Benzi M, Tüma M. A sparse approximate inverse preconditioner for nonsymmetric linear systems. SIAM Journal on Scientific Computing 1998; 19:968-994.
14. Benzi M, Tüma M. Numerical experiments with two approximate inverse preconditioners. BIT 1998; 38:234-247.
15. Benzi M, Tüma M. A comparative study of sparse approximate inverse preconditioners. Applied Numerical Mathematics 1999; 30:305-340.
16. Bollhöfer M, Mehrmann V. Algebraic multilevel methods and sparse approximate inverses. SIAM Journal on Matrix Analysis and Applications 2002; 24:191-218.
17. Bollhöfer M, Saad Y. A factored approximate inverse preconditioner with pivoting. SIAM Journal on Matrix Analysis and Applications 2002; 23:92-705.
18. Kharchenko SA, Kolotilina LYu, Nikishin AA, Yeremin AYu. A robust AINV-type method for constructing sparse approximate inverse preconditioners in factored form. Numerical Linear Algebra with Applications 2001; 8:165-179.
19. Kolotilina LYu, Nikishin AA, Yeremin AYu. Factorized sparse approximate inverse preconditionings. IV: simple approaches to rising efficiency. Numerical Linear Algebra with Applications 1999; 6:515-531.
20. Kolotilina LYu, Yeremin AYu. Factorized sparse approximate inverse preconditioning. II: solution of 3D FE systems on massively parallel computers. International Journal of High Speed Computing 1995; 7:191-215.
21. Benson MW. Iterative solution of large scale linear systems. Master's Thesis, Lakehead University, Thunder Bay, Canada, 1973.
22. Benson MW, Frederickson PO. Iterative solution of large sparse linear systems in certain multidimensional approximation problems. Utilitas Mathematica 1982; 22:127-140.
23. Benson MW, Krettmann J, Wright M. Parallel algorithms for the solution of certain large sparse linear systems. International Journal of Computer Mathematics 1984; 16:245-260.
24. Alléon G, Benzi M, Giraud 1. Sparse approximate inverse preconditioning for dense linear systems arising in computational electromagnetics. Numerical Algorithms 1997; 16:1-15.
25. Barnard ST, Bernardo LM, Simon HD. An MPI implementation of the SPAI preconditioner on the T3E. International Journal of High Performance Computing Applications 1999; 13:107-141.
26. Barnard ST, Clay RL. A portable MPI implementation of the SPAI preconditioner in ISIS ++. In Proceedings of the Eight SIAM Conference on Parallel Processing for Scientific Computing, Heath M et al. (eds). SIAM: Philadelphia, PA, 1997.
27. Barnard ST, Grote MJ. A block version of the SPAI preconditioner. In Proceedings of the Ninth SIAM Conference on Parallel Processing for Scientific Computing, Hendrickson BA et al. (eds). SIAM: Philadelphia, PA, 1999.
28. Chan T, Tang W-P, Wan W. Wavelet sparse approximate inverse preconditioners. BIT 1997; 37:644-660.
29. Chen K, Hughes MD. A two-level sparse approximate inverse preconditioner for unsymmetric matrices. IMA Journal of Numerical Analysis 2006; 26:11-24.
30. Chow E. A priori sparsity patterns for parallel sparse approximate inverse preconditioners. SIAM Journal on Scientific Computing 2000; 21:1804-1822.
31. Chow E, Saad Y. Approximate inverse preconditioners via sparse-sparse iterations. SIAM Journal on Scientific Computing 1998; 19:995-1023.
32. Gilbert JR. Predicting structure in sparse matrix computations. SIAM Journal on Matrix Analysis and Applications 1994; 15:62-79.
33. Golub GH, van Loan CF. Matrix Computations (3rd edn). The John Hopkins University: Baltimore, 1996.
34. Gould NIM, Scott JA. Sparse approximate-inverse preconditioners using norm-minimization techniques. SIAM Journal on Scientific Computing 1998; 19:605-625.
35. Grote M, Huckle T. Parallel preconditioning with sparse approximate inverses. SIAM Journal on Scientific Computing 1997; 18:838-853.
36. Huckle T. Approximate sparsity patterns for the inverse of a matrix and preconditioning. Applied Numerical Mathematics 1999; 30:291-303.
37. Kaporin IE. Explicitly preconditioned conjugate gradient method for the solution of unsymmetric linear systems. International Journal of Computer Mathematics 1992; 40:169-187.
38. Kaporin IE. Two-level explicit preconditioning of conjugate gradient method. Differential Equations 1992; 28:280-289.
39. Kaporin IE. New convergence results and preconditioning strategies for the conjugate gradient method. Numerical Linear Algebra with Applications 1994; 1:179-210.
40. Lifshitz JB, Nikishin AA, Yeremin AYu. Sparse approximate inverse preconditionings for solving 3D CFD problems on massively parallel computers. In Iterative Methods in Linear Algebra, Proceedings of the IMACS International Symposium, Beauwens R, de Groen P (eds), Brussels, 1992; 83-84.
41. Maubach JM. Almost optimal order approximate inverse based preconditioners for 3-d convection dominated problems on tensor-grids. Technical Report 06-40, Department of Mathematics, Utrecht University, The Netherlands, 2006.
42. Saad Y. A flexible inner-outer preconditioned GMRES(20) algorithm. SIAM Journal on Scientific Computing 1993; 14:461-469.
43. Tang W-P. Towards an effective sparse approximate inverse preconditioner. SIAM Journal on Matrix Analysis and Applications 1999; 20:970-986.
44. Tang W-P, Wan WL. Sparse approximate inverse smoother for multigrid. SIAM Journal on Matrix Analysis and Applications 2000; 21:1236-1252.
45. Vavasis SA. Preconditioning for boundary integral equations. SIAM Journal on Matrix Analysis and Applications 1992; 13:905-925.
46. Benzi M. Preconditioning techniques for large linear systems: a survey. Journal of Computational Physics 2002; 182:418-477.
47. Duff IS, Erisman AM, Gear CW, Reid JK. Sparsity structure and Gaussian elimination. SIGNUM News 1988; 23:2-8.
48. Cosgrove JDF, Diaze JC, Griewank A. Approximate inverse preconditionings for sparse linear systems. International Journal of Computer Mathematics 1992; 44:91-110.
49. De Boor C. Dichotomies for banded matrices. SIAM Journal on Numerical Analysis 1980; 17:894-907.
50. Demko S. Inverses of band matrices and local convergence of spline projections. SIAM Journal on Numerical Analysis 1977; 14:616-619.
51. Demko S, Moss WF, Smith PW. Decay rates for inverses of band matrices. Mathematics of Computation 1984; 43:491-499.
52. Eijkout V, Polman B. Decay rates of inverse of banded m-matrices that are near to Toeplitz matrices. Linear Algebra and its Applications 1988; 109:247-277.
53. Meurant G. A review on the inverse of symmetric tridiagonal and block tridiagonal matrices. SIAM Journal on Matrix Analysis and Applications 1992; 13:707-727.
54. Tang W-P. Schwarz splitting and template operators. Ph.D. Thesis, Department of Computer Science, Stanford University, Stanford, CA, 1987.
55. Kolotilina LYu. Explicit preconditioning of systems of linear algebraic equations with dense matrices. Journal of Soviet Mathematics 1988; 43:2566-2573.
56. Chen K. On a class of preconditioning methods for dense linear systems from boundary elements. SIAM Journal on Scientific Computing 1998; 20:684-698.
57. Duff IS, Grimes RG, Lewis JG. Users' guide for the Harwell-Boeing Sparse Matrix Collection (Release 1). Technical Report RAL-92-086, Rutherford Appleton Laboratory, Chilton, UK, 1992.
58. Davis T. Sparse matrix collection. NA Digest, 94(42), October 1994. Available from: http://www.cise.ufl.edu~davis/sparse.