Optimizing parallel multiplication operation for rectangular and transposed matrices

Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS

Volumn 10, Issue , 2004, Pages 257-266

  Krishnan, Manojkumar ^a   Nieplocha, Jarek ^a  

^a PACIFIC NORTHWEST NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BASIC LINEAR ALGEBRA SUBROUTINES (BLAS); PARALLEL MULTIPLICATION OPERATION; REMOTE MEMORY ACCESS (RMA); TRANSPOSED MATRICES;

ALGORITHMS; COMMUNICATION SYSTEMS; COMPUTER ARCHITECTURE; LINEAR SYSTEMS; MATHEMATICAL TECHNIQUES; MATRIX ALGEBRA; NETWORK PROTOCOLS;

PARALLEL PROCESSING SYSTEMS;

EID: 4544240248     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICPADS.2004.1316103     Document Type: Conference Paper

References (36)

1. M. Krishnan, J. Nieplocha, "SRUMMA: A Matrix Multiplication Algorithm Suitable for Clusters and Scalable Shared Memory Systems", in IPDPS'2004.
2. L. E. Cannon, "A cellular computer to implement the Kalman Filter Algorithm", Montana State University, 1969.
3. G. C. Fox, S. W. Otto, and A. J. G. Hey, "Matrix algorithms on a hypercube I: Matrix multiplication", Parallel Computing, vol. 4, pp. 17-31. 1987.
4. G. C. Fox, M. Johnson, G. Lyzenga, S. Otto, J. Salmon, D. Walker, Solving Problems on Concurrent Processors, v. 1, 1988.
5. G.H. Golub, C.H Van Loan. Matrix Computations. 1989.
6. J. Berntsen, "Communication efficient matrix multiplication on hypercubes", Parallel Computing, vol. 12, 1989.
7. A. Gupta and V. Kumar, "Scalability of Parallel Algorithms for Matrix Multiplication", Proc. Parallel Processing,'93.
8. C. Lin and L.Snyder, "A matrix product algorithm and its comparative performance on hypercubes", in SHPCC, 1992.
9. Q. Luo and J. Drake, "A Scalable Parallel Strassen's Matrix Multiply Algorithm for Distributed Memory Computers", http://citeseer.nj.nec.com/517382.html
10. S. Huss-Lederman, E. M. Jacobson, and A. Tsao, "Comparison of Scalable Parallel Matrix Multiplication Libraries",Proc. Scalable Parallel Libraries Conference'94.
11. C. T. Ho, S. L. Johnsson, A. Edelman, Matrix multiplication on hypercubes using full bandwidth and constant storage, Proc.of Distributed Memory Computing Conference. 1991.
12. H. Gupta and P. Sadayappan, "Communication Efficient Matrix Multiplication on Hypercubes", in Proc. of ACM Symposium on Parallel Algorithms and Architectures, 1994.
13. J. Li, A. Skjellum, and R. D. Falgout, "A Poly-Algorithm for Parallel Dense Matrix Multiplication on Two-Dimensional Process Grid Topologies," Concurrency, Practice and Experience, vol. 9(5),'97.
14. E. Dekel, D. Nassimi, and S. Sahni, "Parallel matrix and graph algorithms", SIAM Journal on Computing'81, vol.10.
15. S. Ranka and S. Sahni. Hypercube Algorithms for Image Processing and Pattern Recognition, 1990.
16. J. Choi, J. Dongarra, and D. W. Walker, "PUMMA: Parallel Universal Matrix Multiplication Algorithms on distributed memory concurrent computers," Concurrenc:,Practice and Experience, vol. 6(7),'94.
17. S. Huss-Lederman, E. Jacobson, A. Tsao, and G. Zhang, "Matrix Multiplication on the Intel Touchstone DELTA", Concurrency: Practice and Experience, vol. 6 (7). 1994.
18. R. C. Agarwal, F. Gustavson, and M. Zubair, "A high performance matrix multiplication algorithm on a distributed memory parallel computer using overlapped communication," IBM J. of Research and Development '94.
19. R. van de Geijn, R. J. Watts, "SUMMA: Scalable Universal Matrix Multiplication Algorithm" Concurrency: Practice and Experience, vol.9(4),'97.
20. J. Choi, J. Dongarra, S. Ostrouchov, A. Petitet, D. Walker, and, R. C. Whaley, "A Proposal for a Set of Parallel Basic Linear Algebra Subprograms", University of Tennessee, Knoxville, Tech. Rep. CS-95-292, 1995.
21. L. S. Blackford et. al., ScaLAPACK Users' Guide, 1997.
22. J. Choi, "A Fast Scalable Universal Matrix Multiplication Algorithm on Distributed-Memory Concurrent Computers", in Proc. of IPPS, 1997.
23. G.R. Luecke, W. Lin, Scalability and performance of OpenMP and MPI on 128-Processor SGI Origin-2000, Concurrency and Computation: Practice and Experience,13, 2001.
24. M. Wu, S. Aluru, and R. A. Kendall, "Mixed Mode Matrix Multiplication", in Proc. IEEE CLUSTER'02.
25. J. L. Träff, H. Ritzdorf, R. Hempel "The Implementation of MPI-2 One-Sided Communication for the NEC SX-5", SC'2000.
26. J. Liu, J. Wu, S. P. Kini, P. Wyckoff, and D. K. Panda, "High Performance RDMA-Based MPI Implementation over InfmiBand" in ACM ICS, 2003.
27. J. Nieplocha, V. Tipparaju, M. Krishnan, G. Santhanaraman, and D.K. Panda," Optimizing Mechanisms for Latency Tolerance in Remote Memory Access Communication on Clusters", IEEE Cluster Computing'03.
28. A. Grama, A. Gupta, G. Karypis, and V. Kumar, Introduction to Parallel Computing, 2003.
29. Optimizing Applications on the Cray X1TM System. http://www.cray.com/craydoc/20/manuals/S-2315-50/html-S-2315-50/S-2315-50-toc. html
30. J. Nieplocha, B. Carpenter, ARMCI: A Portable Remote Memory Copy Library for Distributed Array Libraries and Compiler Run-time Systems, Proc. RTSPP IPPS/SDP 1999.
31. J. Nieplocha, V. Tipparaju, J. Ju, and E. Apra, "One-sided communication on Myrinet", Cluster Computing'03, vol. 6.
32. J. Nieplocha, V. Tipparaju, A. Saify, and D. Panda, "Protocols and Strategies for Optimizing Remote Memory Operations on Clusters", Proc. CAC Workshop IPDPS'02.
33. http://www.csm.ornl.gov/evaluation
34. http://www.csm.ornl.gov/~dunigan/
35. V. Tipparaju, M. Krishnan, J. Nieplocha, G. Santhanaraman, and D.K. Panda, "Exploiting Non-blocking Remote Memory Access Communication in Scientific Benchmarks", Proceedings of HiPC, 2003.
36. B. Lawry, R. Wilson, A. B. Maccabe, and R. Brightwell, "COMB: A Portable Benchmark Suite for Assessing MPI Overlap", IEEE Cluster, 2002.