Optimizing sparse matrix-vector product computations using unroll and jam

International Journal of High Performance Computing Applications

Volumn 18, Issue 2 SPEC. ISS., 2004, Pages 225-236

  Mellor Crummey, John M ^a   Garvin, John ^a  

^a Rice University   (United States)

Author keywords

Data structures; Matrix vector product; Microfactors; Performance optimization; Sparse matrices; Sparse matrix format

Indexed keywords

BANDWIDTH; BUFFER STORAGE; COMPUTER ARCHITECTURE; COMPUTER SYSTEMS; DATA STRUCTURES; OPTIMIZATION; VECTORS;

MICROFACTORS; PERFORMANCE OPTIMIZATION; SPARSE MATRIX FORMAT; SPARSE MATRIX-VECTOR PRODUCT;

MATRIX ALGEBRA;

EID: 2942628343     PISSN: 10943420     EISSN: None     Source Type: Journal    
DOI: 10.1177/1094342004038951     Document Type: Article

References (18)

1. Agarwal, R., Gustavson, F., and Zubair, M. November 1992. A high performance algorithm using pre-processing for the sparse matrix-vector multiplication. In Proceedings of Supercomputing 1992, Minneapolis, MN.
2. Allen, F., and Cocke, J., 1972. A catalogue of optimizing transformations. In J. Rustin, editor, Design and Optimization of Compilers, Prentice-Hall, Englewood Cliffs, NJ.
3. Callahan, D., Carr, S., and Kennedy, K., June 1990. Improving register allocation for subscripted variables. In Proceedings of the SIGPLAN'90 Conference on Programming Language Design and Implementation, White Plains, NY.
4. Callahan, D., Cocke, J., and Kennedy, K., 1988. Estimating interlock and improving balance for pipelined machines. Journal of Parallel and Distributed Computing 5(4):334-358.
5. Carr, S., and Kennedy, K., 1994 Improving the ratio of memory operations to floating-point operations in loops. ACM Transactions on Programming Languages and Systems 16(6):1768-1810.
6. Das, R., Mavriplis, D., Saltz, J., Gupta, S., and Ponnusamy, R., January 1992. The design and implementation of a parallel unstructured Euler solver using software primitives, AIAA-92-0562. In Proceedings of the 30th Aerospace Sciences Meeting, AIAA.
7. George, A., and Liu, G., 1981. Computer Solution of Large Sparse Positive Definite Systems, Prentice-Hall, Englewood Cliffs, NJ.
8. Gropp, W., Kaushik, D., Keyes, D., and Smith, B. July 2000. Improving the performance of sparse matrix-vector multiplication by blocking. Talk presented at SIAM Annual Meeting, San Juan, Puerto Rico. Available as http://www.icase.edu/~keyes/multivec.pdf.
9. Im, E.-J., 2000. Optimizing the performance of sparse matrix-vector multiplication. PhD thesis, University of California Berkeley.
10. Im, E.-J., and Yelick, K.A., 2001. Optimizing sparse matrix computations for register reuse in SPARSITY. In V. N. Alexandrov, J. Dongarra, B. A. Juliano, R. S. Renner, and C. J. K. Tan, editors, Proceedings of International Conference on Computational Science, Lecture Notes in Computer Science Vol. 2073, Springer, Berlin, pp. 127-136.
11. Kerbyson, D., Alme, H., Hoisie, A., Petrini, F., Wasserman, H., and Gittings, M., November 2001. Predictive performance and scalability modeling of a large-scale application. In Supercomputing 2001, Denver, CO.
12. National Institute of Standards and Technology (NIST), 2003. Matrix market. http:.//math.nist.gov/MatrixMarket
13. Oppe, T., Joubert, W., and Kinkaid, D., December 1988. NSPCG user's guide. Technical Report, Center for Numerical Analysis, The University of Texas at Austin.
14. Pai, V.S., Ranganathan, P., and Adve, S.V., February 1997. RSIM: an execution-driven simulator for ILP-based shared-memory multiprocessors and uniprocessors. In Proceedings of the Third Workshop on Computer Architecture Education. Also appears in IEEE TCCA Newsletter (October).
15. Paolini, G., and di Brozolo, G.R., 1989. Data structures to vectorize CG algorithms for general sparsity patterns. BIT 29:703:718.
16. Saad, Y., 1988. Krylov subspace methods on supercomputers. Technical Report 88.40, Research Institute for Advanced Computer Science, NASA Research Center.
17. Toledo, S., 1997. Improving the memory-system performance of sparse-matrix vector multiplication. IBM Journal of Research and Development 41(6):711-725.
18. Vuduc, R., Demmel, J., Yelick, K., Kamil, S., Nishtala, R., and Lee, B., November 2002. Performance optimizations and bounds for sparse matrix-vector multiply. Proceedings of SC'02: High Performance Networking and Computing.