SRUMMA: A matrix multiplication algorithm suitable for clusters and scalable shared memory systems

Proceedings - International Parallel and Distributed Processing Symposium, IPDPS 2004 (Abstracts and CD-ROM)

Volumn 18, Issue , 2004, Pages 987-996

  Krishnan, Manojkumar ^a   Nieplocha, Jarek ^a  

^a PACIFIC NORTHWEST NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BASIC LINEAR ALGEBRA SUBROUTINES (BLAS); MASSIVELY PARALLEL PROCESSOR (MPP); REMOTE MEMORY ACCESS (RMA) COMMUNICATION; SRUMMA;

ALGEBRA; COMPUTATIONAL METHODS; COMPUTER ARCHITECTURE; COMPUTER PROGRAMMING; COMPUTER SOFTWARE; DATA STORAGE EQUIPMENT; INSTALLATION; MATRIX ALGEBRA; OPTIMIZATION;

PARALLEL ALGORITHMS;

EID: 12444253004     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (39)

1. R. Whaley and J. Dongarra, "Automatically Tuned Linear Algebra Software (ATLAS)", Supercomputing'89.
2. L. E. Cannon, "A cellular computer to implement the Kalman Filter Algorithm", Ph.D. dissertation, Montana State University, 1969.
3. G. C. Fox, S. W. Otto, and A. J. G. Hey, "Matrix algorithms on a hypercube I: Matrix multiplication", Parallel Computing, vol. 4, pp. 17-31. 1987.
4. G. C. Fox, M. Johnson, G. Lyzenga, S. Otto, J. Salmon, and D. Walker, Solving Problems on Concurrent Processors. vol. 1, Prentice Hall, 1988.
5. G.H. Golub and C.H Van Loan. Matrix Computations. Johns Hopkins University Press, 1989.
6. J. Berntsen, Communication efficient matrix multiplication on hypercubes, Parallel Computing, vol. 12, pp. 335-342, 1989.
7. A. Gupta and V. Kumar, "Scalability of Parallel Algorithms for Matrix Multiplication", Proc. ICPP, 1993
8. C. Lin and L.Snyder, "A matrix product algorithm and its comparative performance on hypercubes", in Scalable High Performance Computing Conference, 1992,
9. Q. Luo and J. B. Drake, "A Scalable Parallel Strassen's Matrix Multiply Algorithm for Distributed Memory Computers", http://citeseer.nj. nec.com/517382.html
10. S. Huss-Lederman, E. M. Jacobson, and A. Tsao, "Comparison of Scalable Parallel Matrix Multiplication Libraries," in Scalable Parallel Libraries Conference, IEEE Computer Society Press, 1994, pp. 142-149.
11. C. T. Ho, S. L. Johnsson and A. Edelman, "Matrix multiplication on hypercubes using full bandwidth and constant storage", in Proceeding of the Sixth Distributed Memory Computing Conference. 1991, pp. 447-451.
12. H. Gupta and P. Sadayappan, "Communication Efficient Matrix Multiplication on Hypercubes", in Proc Sixth ACM SPAA, 1994.
13. J. Li, A. Skjellum, and R. D. Falgout, "A Poly-Algorithm for Parallel Dense Matrix Multiplication on Two-Dimensional Process Grid Topologies," Concurrency, Practice and Experience, vol. 9(5), 1997.
14. E. Dekel, D. Nassimi, and S. Sahni, "Parallel matrix and graph algorithms", SIAM Journal on Computing, vol. 10, pp. 657-673, 1981.
15. S. Ranka and S. Sahni. Hypercube Algorithms for Image Processing and Pattern Recognition. Springer-Verlag, New York, NY, 1990.
16. J. Choi, J. Dongarra, and D. W. Walker, "PUMMA: Parallel Universal Matrix Multiplication Algorithms on distributed memory concurrent computers," Concurrency: Practice and Experience, vol. 6(7), pp. 543-570, 1994.
17. S. Huss-Lederman, E. Jacobson, A. Tsao, and G. Zhang, "Matrix Multiplication on the Intel Touchstone DELTA", Concurrency: Practice and Experience, vol. 6 (7) pp. 571-594. Oct 1994.
18. R. C. Agarwal, F. Gustavson, and M. Zubair, "A high performance matrix multiplication algorithm on a distributed memory parallel computer using overlapped communication," IBM J. of Research and Development, vol. 38 (6), 1994.
19. R. van de Geijn, R. and J. Watts, "SUMMA: Scalable Universal Matrix Multiplication Algorithm," Concurrency: Practice and Experience, vol. 9(4), pp. 255-274, 1997.
20. J. Choi, J. Dongarra, S. Ostrouchov, A. Petitet, D. Walker, and, R. C. Whaley, "A Proposal for a Set of Parallel Basic Linear Algebra Subprograms", University of Tennessee, Knoxville, Tech. Rep. CS-95-292, May 1995.
21. L. S. Blackford et al., ScaLAPACK Users' Guide, SIAM, 1997, Philadelphia, PA.
22. J. Choi, "A Fast Scalable Universal Matrix Multiplication Algorithm on Distributed-Memory Concurrent Computers", in Proc. IPPS '97, 1997.
23. C. Addison and Y. Ren, "OpenMP Issues Arising in the Development of Parallel BLAS and LAPACK libraries", in Proceedings EWOMP'01. 2001.
24. G. R. Luecke and W. Lin, "Scalability and Performance of OpenMP and MPI on a 128-Processor SGI Origin 2000", Concurrency and Computation: Practice and Experience, vol. 13, pp 905-928. 2001.
25. M. Wu, S. Aluru, and R. A. Kendall, "Mixed Mode Matrix Multiplication", IEEE CLUSTER'02, 2002.
26. T. Betcke, "Performance analysis of various parallelization methods for BLAS3 routines on cluster architectures", John von Neumann-Instituts für Computing, Tech. Rep. FZJ-ZAM-IB-2000-15, Nov, 2000.
27. J. L. Träff, H. Ritzdorf, R. Hempel "The Implementation of MPI-2 One-Sided Communication for the NEC SX-5", in Proceedings of Supercomputing, 2000.
28. J. Liu, J. Wu, S. P. Kinis, P. Wyckoff, and D. K. Panda, "High Performance RDMA-Based MPI Implementation over InfiniBand", in Proc of 17th ACM International Conference on Supercomputing, 2003.
29. J. Nieplocha, V. Tipparaju, M. Krishnan, G. Santhanaraman, and D.K. Panda,"Optimizing Mechanisms for Latency Tolerance in Remote Memory Access Communication on Clusters", IEEE CLUSTER, 2003.
30. A. Grama, A. Gupta, G. Karypis, and V. Kumar, Introduction to Parallel Computing, Addison Wesley, 2003.
31. Optimizing Applications on the Cray X1TM System. http://www.cray.com/ craydoc/20/manuals/S-2315-50/html-S-2315-50/S-2315-50-toc.html
32. J. Nieplocha and B. Carpenter, "ARMCI: A Portable Remote Memory Copy Library for Distributed Array Libraries and Compiler Run-time Systems", in Proceedings of RTSPP IPPS/SDP, 1999.
33. ARMCI Web page. http://www.emsl.pnl.gov/docs/parsoft/armci/
34. J. Nieplocha, V. Tipparaju, J. Ju, and E. Apra, "One-sided communication on Myrinet", Cluster Computing, vol. 6, pp. 115-124, 2003.
35. J. Nieplocha, V. Tipparaju, A. Saify, and D. Panda, "Protocols and Strategies for Optimizing Remote Memory Operations on Clusters", Proc CAC/IPDPS'02.2002.
36. ORNL Tom Dunigan's Evaluation of Early Systems Webpage. http://www.csm.ornl.gov/~dunigan/
37. V. Tipparaju, M. Krishnan, J. Nieplocha, G. Santhanaraman, and D.K. Panda, "Exploiting Non-blocking Remote Memory Access Communication in Scientific Benchmarks", Proc. HiPC'2003, 2003.
38. B. Lawry, R. Wilson, A. B. Maccabe, and R. Brightwell, "COMB: A Portable Benchmark Suite for Assessing MPI Overlap", IEEE Cluster, 2002.
39. J. B. White and S. W. Bova, "Where's the overlap? Overlapping communication and computation in several popular MPI implementations", in Proceedings of the Third MPI Developers' and Users' Conference, 1999.