Parallel sparse approximate inverse preconditioning on graphic processing units

IEEE Transactions on Parallel and Distributed Systems

Volumn 24, Issue 9, 2013, Pages 1852-1862

  Dehnavi, Maryam Mehri ^a   Fernandez, David M ^b   Gaudiot, Jean Luc ^c   Giannacopoulos, Dennis D ^b  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b MCGILL UNIVERSITY   (Canada)

^c University of California at Irvine   (United States)

Author keywords

conditioning; graphics processors; Numerical algorithms; parallel algorithms; parallel programming

Indexed keywords

AMD OPTERON 252 PROCESSORS; BICONJUGATE GRADIENT STABILIZED; GRAPHIC PROCESSING UNITS; GRAPHICS PROCESSOR; NUMERICAL ALGORITHMS; PRECONDITIONING TECHNIQUES; SPARSE APPROXIMATE INVERSE; SPARSE LINEAR SYSTEMS;

ALGORITHMS; COMPUTER GRAPHICS EQUIPMENT; ITERATIVE METHODS; LINEAR SYSTEMS; NATURAL GAS CONDITIONING; NUMBER THEORY; PARALLEL ALGORITHMS; PARALLEL ARCHITECTURES; PARALLEL PROGRAMMING; SMART CARDS;

RADAR ANTENNAS;

EID: 84881061313     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPDS.2012.286     Document Type: Article

References (44)

1. Y. Saad, Iterative Methods for Sparse Linear Systems, pp. 10-349, SIAM, 2003.
2. J.M. Jin, The Finite Element Method in Electromagnetics, pp. 19-44, Wiley-IEEE Press, 2002.
3. R. Barrett et al., Templates for the Solution of Linear Systems. SIAM, 1994.
4. J. Zhongxiao and Z. Baochen, "A Power Sparse Approximate Inverse Preconditioning Procedure for Large Sparse Linear Systems," Numerical Linear Algebra with Applications, vol. 16, no. 4, pp. 259-299, 2009.
5. E. Chow, "Parallel Implementation and Practical Use of Sparse Approximate Inverse Preconditioners with a Priori Sparsity Patterns," Int'l J. High Performance Computing Applications, vol. 15, no. 1, pp. 56-74, 2001. (Pubitemid 32252490)
6. E. Chow, "A Priori Sparsity Patterns for Parallel Sparse Approximate Inverse Preconditioners," SIAM J. Scientific Computing, vol. 21, no. 5, pp. 1804-1822, 1999.
7. https://computation.llnl.gov/casc/parasails/parasails.html, 2013.
8. T. Huckle et al., "An Efficient Parallel Implementation of the MSPAI Preconditioner," Parallel Computing, vol. 36, nos. 5/6, pp. 273-284, 2010.
9. M.J. Grote and T. Huckle, "Parallel Preconditioning with Sparse Approximate Inverses," SIAM J. Scientific Computing, vol. 18, no. 3, pp. 838-853, 1997. (Pubitemid 127640885)
10. P. Raghavan and K. Teranishi, "Parallel Hybrid Preconditioning: Incomplete Factorization with Selective Sparse Approximate Inversion," SIAM J. Scientific Computing, vol. 32, no. 3, pp. 1323- 1345, 2010.
11. P. Gonzale'z, T.F. Pena, and J.C. Cabaleiro, "Parallel Sparse Approximate Preconditioners Applied to the Solution of BEM Systems," Eng. Analysis with Boundary Elements, vol. 28, no. 9, pp. 1061-1068, 2004.
12. M. Benson et al., "Parallel Algorithms for the Solution of Certain Large Sparse Linear Systems," Int'l J. Computer Math., vol. 16, nos. 3/4, pp. 245-260, 1984. (Pubitemid 15465115)
13. S.T. Barnard, L.M. Bernardo, and H.D. Simon, "An MPI Implementation of the SPAI Preconditioner on the T3E," Int'l J. High Performance Computing Applications, vol. 13, no. 2, pp. 107-123, 2010.
14. G.A. Gravavis et al., "Finite Element Approximate Inverse Preconditioning Using POSIX Threads on Multicore Systems," Proc. Int'l Multiconf. Computer Science and Information Technology, pp. 297-302, 2010.
15. G.A. Gravavis, "High Performance Inverse Preconditioning," Archives of Computational Methods in Eng., vol. 16, no. 1, pp. 77- 108, 2009.
16. K. Xu et al., "FSAI Preconditioned CG Algorithm Combined with GPU Technique for the Finite Element Analysis of Electromagnetic Scattering Problems," Finite Elements in Analysis and Design, vol. 47, no. 4, pp. 387-393, 2011.
17. J.D. Owens et al., "A Survey of General-Purpose Computation on Graphics Hardware," Computer Graphics Forum, vol. 26, no. 1, pp. 80-113, 2007. (Pubitemid 46481097)
18. http://developer.nvidia.com/cuda-toolkit-32-downloads, 2013.
19. D.F. Cosgrove, J.C. Dias, and A. Griewank, "Approximate Inverse Preconditioning for Sparse Linear Systems," Int'l J. Computer Math., vol. 44, no. 1-4, pp. 91-110, 1992.
20. E. Chow and Y. Saad, "Approximate Inverse Preconditioners via Sparse-Sparse Iterations," SIAM J. Scientific Computing, vol. 19, no. 3, pp. 995-1023, 1998. (Pubitemid 128622542)
21. http://www.computational.unibas.ch/software/spai/spaidoc.html, 2013.
22. M.J. Grote and H.D. Simon, "Parallel Preconditioning and Approximate Inverses on the Connection Machine," Parallel Processing for Scientific Computing, vol. 2, pp. 519-523, 1992.
23. T. Huckle, "Approximate Sparsity Patterns for the Inverse of a Matrix and Preconditioning," Proc. IMACS World Congress on Scientific Computation, 1997.
24. L. Kolotilina, "Explicit Preconditioning of Systems of Linear Algebraic Equations with Dense Matrices," SIAM J. Matrix Analysis and Applications, vol. 13, pp. 2566-2573, 1992.
25. L. Kolotilina and A.Y. Yeremin, "Factorized Sparse Approximate Inverse Preconditionings I: Theory," SIAM J. Matrix Analysis and Applications, vol. 14, no. 1, pp. 45-58, 1993.
26. M. Benzi, C.D. Meyer, and M. Tuma, "A Sparse Approximate Inverse Preconditioner for the Conjugate Gradient Method," SIAM J. Scientific Computing, vol. 17, no. 5, pp. 1135-1149, 1998.
27. M. Benzi and M. Tuma, "A Sparse Approximate Inverse Preconditioner for Nonsymmetric Linear Systems," SIAM J. Scientific Computing, vol. 19, no. 3, pp. 968-994, 1998. (Pubitemid 128622541)
28. M. Benzi and M. Tuma, "A Comparative Study of Sparse Approximate Inverse Preconditioners," Applied Numerical Math., vol. 30, no. 2/3, pp. 305-340, 1999.
29. M. Bollho? fer and V. Mehrmann, "Algebraic Multilevel Methods and Sparse Approximate Inverses," SIAM J. Matrix Analysis and Applications, vol. 24, no. 1, pp. 191-218, 2002.
30. M. Bollho? fer and Y. Saad, "A Factored Approximate Inverse Preconditioner with Pivoting," SIAM J. Matrix Analysis and Applications, vol. 23, no. 3, pp. 692-705, 2001.
31. S. Kharchenko et al., "A Robust AINV-Type Method for Constructing Sparse Approximate Inverse Preconditioners in Factored Form," Numerical Linear Algebra with Applications, vol. 8, no. 3, pp. 165-179, 2001. (Pubitemid 33692486)
32. M. Benzi and M. Tuma, "A Comparative Study of Sparse Approximate Inverse Preconditioners," J. Applied Numerical Math., vol. 30, no. 2/3, pp. 305-340, 1999.
33. W. Tang, "Towards an Effective Sparse Approximate Inverse Preconditioner," SIAM J. Matrix Analysis and Applications, vol. 20, no. 4, pp. 970-986, 1999. (Pubitemid 129330053)
34. J. Cosgrove et al., "Structural Properties of the Graph of Augmented Sparse Approximate Inverses," Proc. Symp. Applied Computing, pp. 131-136, 1990.
35. G. All'eon et al., "Sparse Approximate Inverse Preconditioning for Dense Linear Systems Arising in Computational Electromagnetics," Numerical Algorithms, vol. 16, no. 1, pp. 1-15, 1997.
36. W. Tang and W. Wan, "Sparse Approximate Inverse Smoother for Multigrid," SIAM J. Matrix Analysis and Applications, vol. 21, no. 4, pp. 1236-1252, 2000. (Pubitemid 33217067)
37. M. Mehri Dehnavi, D. Fernandez, and D. Giannacopoulos, "Finite Element Sparse Matrix Vector Multiplication on GPUs," IEEE Trans. Magnetics, vol. 46, no. 8, pp. 2982-2985, Aug. 2010.
38. N. Bell and M. Garland, "Efficient Sparse Matrix-Vector Multiplication on CUDA," technical report, NVIDIA, 2008.
39. T.D. Davis, Direct Methods for Sparse Linear Systems, pp. 7-17, SIAM, 2006.
40. M. Mehri Dehnavi, D. Fernandez, and D. Giannacopoulos, "Enhancing the Performance of Conjugate Gradient Solvers on Graphic Processing Units," IEEE Trans. Magnetics, vol. 47, no. 5, pp. 1162-1165, May 2011.
41. http://developer.download.nvidia.com/compute/cuda/4-0-rc2/toolkit/docs/ CUSPARSE-Library.pdf, 2013.
42. http://developer.download.nvidia.com/compute/cuda/2-0/ docs/CUBLAS-Library-2.0.pdf, 2013.
43. http://www.cise.ufl.edu/research/sparse/matrices, 2013.
44. https://www.sharcnet.ca, 2013.