LU-GPU: Efficient algorithms for solving dense linear systems on graphics hardware

Proceedings of the ACM/IEEE 2005 Supercomputing Conference, SC'05

Volumn 2005, Issue , 2005, Pages

  Galoppo, Nico ^a   Govindaraju, Naga K ^a   Henson, Michael ^a   Manocha, Dinesh ^a  

^a UNIVERSITY OF NORTH CAROLINA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FRAGMENT PROCESSORS; GRAPHICS HARDWARE; GRAPHICS PROCESSOR UNITS (GPU);

ALGORITHMS; BANDWIDTH; BUFFER STORAGE; COMPUTER HARDWARE; LINEAR SYSTEMS; PARALLEL PROCESSING SYSTEMS;

MICROPROCESSOR CHIPS;

EID: 33845468997     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SC.2005.42     Document Type: Conference Paper

References (37)

1. AHN, J. H., DALLY, W. J., KHAILANY, B., KAPASI, U. J., AND DAS, A. 2004. Evaluating the imagine stream architecture. In Proceedings of the 31st Annual International Symposium on Computer Architexture, Munich, Germany.
2. BOLZ, J., FARMER, I., GRINSPUN, E., AND SCHRÖDER, P. 2003. Sparse matrix solvers on the gpu: conjugate gradients and multigrid. ACM Trans. Graph. 22, 3, 917-924.
3. BUCK., I., FOLEY, T., HORN, D., SUGERMAN, J., FATAHALIAN, K., HOUSTON, M., AND HANRAHAN, P. 2004. Brook for gpus: stream computing on graphics hardware. ACM Trans. Graph. 23, 3, 777-786.
4. CHATTERJEE, S., LEBECK, A. R., PATNALA, P. K., AND THOTTETHODI, M. 1999. Recursive array layouts and fast parallel matrix multiplication. In ACM Symposium on Parallel Algorithms and Architectures, 222-231.
5. DALLY, W. J., HANRAHAN, P., EREZ, M., KNIGHT, T. J., LABONTE, F., A., J.-H., JAYASENA, N., KAPASI, U. J., DAS, A., GUMMARAJU, J., AND BUCK, I. 2003. Merrimac: Supercomputing with streams. In SC'03.
6. DEMMEL, J. W. 1997. Applied Numerical Linear Algebra. SIAM Books.
7. DONGARRA, J. J., DUFF, I. S., SORENSEN, D. C., AND VAN DER VORST, H. A. 1998. Numerical Linear Algebra for High-Performance Computers. SIAM.
8. DONGARRA, J. J., LUSZCZEK., P., AND PETITET, A. 2003. The LINPACK benchmark: Past, present, and future. Concurrency and Computation: Practice and Experience 15, 1-18.
9. EREZ, M., AHN, J., GARG, A., DALLY, W. J., AND DARVE, E. 2004. Analysis and Performance Results of a Molecular Modeling Application on Merrimac. In SC'04.
10. FAN, Z., QIU, F., KAUFMAN, A., AND YOAKUM-STOVER, S. 2004. Gpu cluster for high performance computing. In ACM/IEEE Supercomputing Conference 2004.
11. FATAHALIAN, K., SUGERMAN, J., AND HANRAHAN, P. 2004. Understanding the efficiency of gpu algorithms for matrix-matrix multiplication. In Proceedings of the ACM SIGGRAPH/EUROGRAPHICS conference on Graphics hardware, Eurographics Association.
12. GÖDDEKE, D. 2005. Gpgpu performance tuning. Tech. rep., University of Dortmund, Germany. http://www.mathematik.uni-dortmund.de/~goeddeke/ gpgpu/.
13. GPUBENCH, 2004. A GPU benchmarking suite. GP2 Workshop, Los Angeles. Available online: http://graphics.stanford.edu/projects/gpubanch/.
14. GRAMA, A., GUPTA, A., KARYPIS, G., AND KUMAR, V. 2003. Introduction to Parallel Computing (2nd ed.). Addison Wesley.
15. HAKURA, Z., AND GUPTA, A. 1997. The design and analysis of a cache architecture for texture mapping. In Proc. of the 24th International Symposium on Computer Architecture, 108-120.
16. HALL, J. D., CARR, N., AND HART, J. 2003. Cache and bandwidth aware matrix multiplication on the gpu. Technical Report UIUCDCS-R-2003-2328, University of Illinois at Urbana-Champaign.
17. HAMMERSTONE, CRAIGHEAD, AND AKELEY, 2003. ARB_vertex_buffer_object OpenGL specification. http://oss.sgi.com/projects/ogl-sample/ registry/ARB/ vartex_buffer_object.txt.
18. HARRIS, M. J., BAXTER, W. V., SCHEUERMANN, T., AND LASTRA, A. 2003. Simularion of cloud dynamics on graphics hardware. In HWWS '03: Proceedings of the ACM SIGGRAPH/EUROGRAPHICS conference on Graphics hardware, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 92-101.
19. KIM, T., AND LIN, M. 2003. Visual simulation of ice crystal growth. In Proc. of ACM SIGGRAPH/Eurographics Symposium on Computer Animcation.
20. KRÜGER, J., AND WESTERMANN, R. 2003. Linear algebra operators for gpu implementation of numerical algorithms. ACM Trans. Graph. 22, 3, 908-916.
21. LARSEN, E. S., AND MCALLISTER, D. 2001. Fast matrix multiplies using graphics hardware. In Proceedings of the 2001 ACM/IEEE conference on Supercomputing (CDROM), ACM Press, 55-55.
22. LASTRA, A., LIN, M., AND MANOCHA, D. 2004. ACM workshop on general purpose computation on graphics processors.
23. MCCOOL, M., TOIT, S. D., POPA, T., CHAN, B., AND MOULE, K. 2004. Shader algebra. ACM Trans. Graph. 23, 3, 787-795.
24. MCGINN, S., AND SHAW, R. 2002. Parallel gaussian elimination using openmp and mpi. In Proceedings. 16th Annual International Symposium on High Performance Computing Systems and Applications, 169-173.
25. MCLEOD, I., AND YU, H. 2002. Timing comparisons of mathematica, matlab, r, s-plus, c & fortran. Technical report. Available online: http://fisher.stats. uwo.ca/faculty/aim/epubs/MatrixInverseTiming/dafault.htm.
26. MITRAN, S. 2000. Closure models for the computation of dilute bubbly flows. Wissenschaftliche Belichte FZKA 6357, Forschungszentrum Karlsruhe, April.
27. NVIDIA CORPORATION. 2004. The geforce 6 series of gpus high performance and quality for complex image effects. Tech. rep. Available on: http://www.nvidia. com/object/IO_12394.html.
28. OLIKER, L., CANNING, A., CARTER, J., AND SHALF, J. 2004. Scientific computations on modern parallel vector systems. In Supercomputing 2004.
29. PENG, S., SEDUKHIN, S., AND SEDUKHIN, I. 1996. Parallel algorithm and architecture for two-step division-free gaussian elimination. In 1996 International Conference on Application-Specific Systems, Architectures and Processors (ASAP'96).
30. RUMPF, M., AND STRZODKA, R. 2001. Using graphics cards for quantized FEM computations. In Proc. of IASTED Visualization, Imaging and Image Processing Conference (VIIP'01), 193-202.
31. RUSSO, G., AND SMEREKA, P. 1996. Kinetic theory for bubbly flow i: Collisionless case. SIAM J. Appl. Math. 56, 2, 327-357.
32. RUSSO, G., AND SMEREKA, P. 1996. Kinetic theory for bubbly flow II: Fluid dynamic limit. SIAM J. Appl. Math. 56, 2, 358-371.
33. SUH, J., KIM, E.-G., CRAGO, S. P., SRINIVASAN, L., AND FRENCH, M. C. 2003. A performance analysis of pim, stream processing, and tiled processing on memory-intensive signal processing kernels. In Proceedings of the International Symposium on Computer Architecture.
34. TAYLOR, M. B., KIM, J., MILLER, J., WENTZLAFF, D., GHODRAT, F., GREENWALD, B., HOFFMANN, H., JOHNSON, P., LEE, J.-W., LEE, W., MA, A., SARAF, A., SBNESKI, M., SHNIDMAN, N., FRANK, V. S. M., AMARASINGHE, S., AND AGARWAL, A. 2002. The raw microprocessor: A computational fabric for software circuits and general purpose programs. IEEE Micro.
35. THOTTETHODI, M. S. 1998. Tuning Strassen's matrix multiplication for memory efficiency. In Proceedings of the 1998 ACM/IEEE conference on Supercomputing (CDROM), IEEE Computer Society, 1-14.
36. WHALEY, R. C., PETITET, A., AND DONGARRA, J. J. 2001. Automated empirical optimization of software and the ATLAS project. Parallel Computing 27, 1-2, 3-35
37. . Also available as University of Tennessee LAPACK Working Note #147, UT-CS-00-448, 2000 (www.netlib.org/lapack/lawns/lawn147.ps).