A scalable, numerically stable, high-performance tridiagonal solver using GPUs

International Conference for High Performance Computing, Networking, Storage and Analysis, SC

Volumn , Issue , 2012, Pages

  Chang, Li Wen ^a   Stratton, John A ^a   Kim, Hee Seok ^a   Hwu, Wen Mei W ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

GPGPU; GPU Computing; SPIKE; Tridiagonal Solver

Indexed keywords

GPGPU; GPU COMPUTING; HIGH-THROUGHPUT DATA; MEMORY EFFICIENCY; OPTIMIZATION STRATEGY; SPIKE; STABLE SOLUTIONS; TRI-DIAGONAL SOLVER;

ALGORITHMS; DIGITAL STORAGE; MATLAB; MATRIX ALGEBRA; METADATA;

PROGRAM PROCESSORS;

EID: 84877702106     PISSN: 21674329     EISSN: 21674337     Source Type: Conference Proceeding    
DOI: 10.1109/SC.2012.12     Document Type: Conference Paper

References (38)

1. A. Lefohn, U. C. Davis, J. Owens, and U. C. Davis, "Interactive depth of field using simulated diffusion," tech. rep., 2006.
2. S. Sengupta, M. Harris, Y. Zhang, and J. D. Owens, "Scan primitives for GPU computing," in Graphics Hardware 2007, pp. 97-106, Aug. 2007.
3. N. Sakharnykh, "Tridiagonal solvers on the GPU and applications to fluid simulation," NVIDIA GPU Technology Conference, September 2009.
4. N. Sakharnykh, "Efficient tridiagonal solvers for ADI methods and fluid simulation," NVIDIA GPU Technology Conference, September 2010.
5. R. W. Hockney, "A fast direct solution of Poisson's equation using Fourier analysis," J. ACM, vol. 12, pp. 95-113, January 1965.
6. A. Greenbaum, Iterative Methods for Solving Linear Systems. Philadelphia: SIAM, 1997.
7. L.-W. Chang, M.-T. Lo, N. Anssari, K.-H. Hsu, N. Huang, and W.-M. Hwu, "Parallel implementation of multi-dimensional ensemble empirical mode decomposition," International Conference on Acoustics, Speech, and Signal Processing, May 2011.
8. D. Göddeke and R. Strzodka, "Cyclic reduction tridiagonal solvers on GPUs applied to mixed-precision multigrid," IEEE Transactions on Parallel and Distributed Systems, vol. 22, pp. 22-32, 2011.
9. A. Davidson, Y. Zhang, and J. D. Owens, "An auto-tuned method for solving large tridiagonal systems on the GPU," in Proceedings of the 25th IEEE International Parallel and Distributed Processing Symposium, May 2011.
10. H.-S. Kim, S. Wu, L.-W. Chang, and W.-M. Hwu, "A scalable tridiagonal solver for gpus," in Parallel Processing (ICPP), 2011 International Conference on, pp. 444-453, sept. 2011.
11. R. W. Hockney and C. R. Jesshope, Parallel computers : architecture, programming and algorithms / R.W. Hockney, C.R. Jesshope. Hilger, Bristol :, 1981.
12. S. D. Conte and C. W. D. Boor, Elementary Numerical Analysis: An Algorithmic Approach. McGraw-Hill Higher Education, 3rd ed., 1980.
13. NVIDIA Corporation, CUDA CUSPARSE Library, Jan. 2012.
14. A. Davidson and J. D. Owens, "Register packing for cyclic reduction: A case study," in Proceedings of the Fourth Workshop on General Purpose Processing on Graphics Processing Units, Mar. 2011.
15. D. Egloff, "High performance finite difference PDE solvers on GPUs." http://download.quantalea.net/fdm-gpu.pdf, Feb. 2010.
16. D. Egloff, "Pricing financial derivatives with high performance finite dierence solvers on GPUs," in GPU Computing Gems, in press.
17. Y. Zhang, J. Cohen, and J. D. Owens, "Fast tridiagonal solvers on the GPU," in Proceedings of the 15th ACM SIGPLAN symposium on Principles and practice of parallel programming, PPoPP '10, (New York, NY, USA), pp. 127-136, ACM, 2010.
18. Y. Zhang, J. Cohen, A. A. Davidson, and J. D. Owens, "A hybrid method for solving tridiagonal systems on the GPU," in GPU Computing Gems, vol. 2, Morgan Kaufmann, Aug. 2011.
19. H. S. Stone, "An efficient parallel algorithm for the solution of a tridiagonal linear system of equations," J. ACM, vol. 20, pp. 27-38, January 1973.
20. E. Polizzi and A. H. Sameh, "A parallel hybrid banded system solver: The SPIKE algorithm," Parallel Computing, vol. 32, no. 2, pp. 177-194, 2006. (Pubitemid 43120209)
21. E. Polizzi and A. Sameh, "SPIKE: A parallel environment for solving banded linear systems," Computers and Fluids, vol. 36, no. 1, pp. 113-120, 2007. (Pubitemid 44615421)
22. J. B. Erway, R. F. Marcia, and J. Tyson, "Generalized diagonal pivoting methods for tridiagonal systems without interchanges," IAENG International Journal of Applied Mathematics, vol. 4, no. 40, pp. 269-275, 2010.
23. I.-J. Sung, J. A. Stratton, and W.-M. W. Hwu, "Data layout transformation exploiting memory-level parallelism in structured grid manycore applications," in Proceedings of the 19th international conference on Parallel architectures and compilation techniques, PACT '10, (New York, NY, USA), pp. 513-522, ACM, 2010.
24. I.-J. Sung, G. D. Liu, and W.-M. W. Hwu, "DL: A data layout transformation system for heterogeneous computing," in IEEE Conference on Innovative Parallel Computing (In Press), May 2012.
25. MPI Forum, "Message Passing Interface (MPI) Forum Home Page." http://www.mpi-forum.org/.
26. OpenMP, "The OpenMP API specification for parallel programming." http://openmp.org.
27. Intel, "Math Kernel Library." http://developer.intel.com/ software/products/mkl/.
28. Intel, "Intel adaptive spike-based solver." http://software.intel.com/en-us/articles/intel-adaptive-spike-based-solver/.
29. MATLAB, version 7.10.0 (R2010a). Natick, Massachusetts: The MathWorks Inc., 2010.
30. NVIDIA Corporation, CUDA Programming Guide 4.1, Nov. 2011.
31. K. Group, "OpenCL." http://www.khronos.org/opencl/.
32. I. Gelado, J. E. Stone, J. Cabezas, S. Patel, N. Navarro, and W.-M. W. Hwu, "An asymmetric distributed shared memory model for heterogeneous parallel systems," in Proceedings of the fifteenth edition of ASPLOS on Architectural support for programming languages and operating systems, ASPLOS '10, (New York, NY, USA), pp. 347-358, ACM, 2010.
33. J. R. Bunch and L. Kaufman, "Some stable methods for calculating inertia and solving symmetric linear systems," Math. Comp., pp. 63-179, January 1977.
34. NVIDIA Corporation, Compute VIsual PRofiler, Jan. 2012.
35. V. V. Kindratenko, J. J. Enos, G. Shi, M. T. Showerman, G. W. Arnold, J. E. Stone, J. C. Phillips, and W.-M. Hwu, "GPU clusters for high-performance computing," 2009 IEEE International Conference on Cluster Computing and Workshops, pp. 1-8, 2009.
36. National Center for Supercomputing Applications at the University of Illinois, "Dell nvidia linux cluster forge." http://www.ncsa.illinois. edu/UserInfo/Resources/Hardware/DellNVIDIACluster/.
37. I. S. Dhillon, "Reliable computation of the condition number of a tridiagonal matrix in o(n) time," SIAM J. Matrix Anal. Appl., vol. 19, pp. 776-796, July 1998.
38. G. I. Hargreaves, "Computing the condition number of tridiagonal and diagonal-plus-semiseparable matrices in linear time," SIAM J. Matrix Anal. Appl., vol. 27, pp. 801-820, July 2005.