A poly-algorithm for parallel dense matrix multiplication on two-dimensional process grid topologies

Concurrency Practice and Experience

Volumn 9, Issue 5, 1997, Pages 345-389

  Li, J ^a   Skjellum, A ^a   Falgout, R D ^b  

^a MISSISSIPPI STATE UNIVERSITY   (United States)

^b LAWRENCE LIVERMORE NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

HEURISTIC METHODS; MATRIX ALGEBRA; PARALLEL PROCESSING SYSTEMS; TOPOLOGY;

DATA DISTRIBUTION FUNCTIONS; MATRIX MULTIPLICATION ALGORITHMS; PERMUTATION COMPATIBILITY;

PARALLEL ALGORITHMS;

EID: 0031146653     PISSN: 10403108     EISSN: None     Source Type: Journal    
DOI: 10.1002/(SICI)1096-9128(199705)9:5<345::AID-CPE258>3.0.CO;2-7     Document Type: Article

References (27)

1. M. Aboelaze, N. P. Chrisochoides, E. N. Houstis and C. E. Houstis, 'The parallelization of level 2 and 3 BLAS operations on distributed memory machines', Technical Report CSD-TR-91-007, Purdue University, West Lafayette, IN, 1991.
2. L. Cannon, A Cellular Computer to Implement the Kalman Filter Algorithm, PhD thesis, Montana State University, Bozeman, MN, 1969.
3. J. W. Demmel, M. T. Heath and H. A. van der Vorst, 'Parallel numerical linear algebra', Technical Report CSD-92-703, Computer Science Division, U. C. Berkeley, Berkeley, CA, 1992.
4. G. C. Fox, M. A. Johnson, G. A. Lyzenga, S. W. Otto, J. K. Salmon and D. W. Walker, Solving Problems on Concurrent Processors, vol. 1, Prentice Hall, Englewood Cliffs, New Jersey, 1988.
5. K. K. Mathur and L. S. Johnsson, 'Multiplication of matrices of arbitrary shape on a data parallel computer', Parallel Comput., 20, 919-951 (1994).
6. J. Choi, J. J. Dongarra and D. W. Walker, 'PUMMA: Parallel universal matrix multiplication algorithms on distributed memory concurrent computers', Concurrency,Pract. Exp., 6, 543-570 (1994).
7. S. Huss-Lederman, E. M. Jacobson, A. Tsao and G. Zhang, 'Matrix multiplication on the Intel Touchstone DELTA', Concurrency, Pract. Exp., 6, 571-594 (1994).
8. R. C. Agarwal, F. G. Gustavson and M. Zubair, 'A high-performance matrix-multiplication algorithm on a distributed-memory parallel computer using overlapped communication', IBM J. Res. Dev., 38, (6), 673-681 (1994).
9. R. A. van de Geijn and J. Watts, 'SUMMA: Scalable universal matrix multiplication algorithm', Technical Report TR-95-13, Department of Computer Science, The University of Texas at Austin, Austin, TX, 1995.
10. R. D. Falgout, A. Skjellum, S. G. Smith and C. H. Still, 'The multicomputer toolbox approach to concurrent BLAS and LACS', in J. Saltz (Ed.), Proc. Scalable High Performance Computing Conf. (SHPCC), IEEE Press, Los Alamitos, CA, 1992, pp. 121-128, also available as LLNL Technical Report UCRL-JC-109775.
11. R. D. Falgout, A. Skjellum, S. G. Smith and C. H. Still, 'The multicomputer toolbox approach to concurrent BLAS', Technical Report MSU-CS-TR931001, Department of Computer Science, Mississippi State University, Mississippi State, MS, October 1993.
12. E. F. van de Velde, 'Data redistribution and concurrency', Parallel Comput., 16, 125-38 (1990).
13. E. F. van de Velde and J. Lorenz, 'Adaptive data distribution for concurrent continuation', Technical Report CRPC-89-4, California Institute of Technology, 1989, Caltech/Rice Center for Research in Parallel Computation.
14. A. Skjellum and C. H. Baldwin, 'The multicomputer toolbox: scalable parallel libraries for large-scale concurrent applications', Technical Report UCRL-JC-109251, Lawrence Livermore National Laboratory, December 1991.
15. A. Skjellum, Concurrent Dynamic Simulation: Multicomputer Algorithms Research Applied to Ordinary Differential-Algebraic Process Systems in Chemical Engineering, PhD thesis, Chemical Engineering, California Institute of Technology, May 1990.
16. P. V. Bangalore, The Data-Distribution-Independent Approach to Scalable Parallel Libraries, Master's thesis, Mississippi State University, May 1995, also available as ftp://cs.msstate.edu/pub/reports/bangalore-ms.ps.Z.
17. J. Li, A. Skjellum, P. V. Bangalore and P. J. Brennan, Poly-Algorithms for Remapping of Dense Arrays, Technical Report, Department of Computer Science, Mississippi State University, in preparation, 1996.
18. W. Gropp, E. Lusk and A. Skjellum, Using MPI: Portable Parallel Programming with the Message-Passing Interface, The MIT Press, Cambridge, Massachusetts, 1994.
19. A. Skjellum and P. V. Bangalore, 'Driving issues in scalable libraries: poly-algorithms, data distribution independence, redistribution, local storage schemes', in David H. Bailey et al., (Ed.), Proc. of the Seventh SIAM Conference on Parallel Processing for Scientific Computing, SIAM Press, Philadelphia, PA, February 1995, pp. 734-737.
20. A. Skjellum, N. E. Doss and P. V. Bangalore, 'Writing libraries in MPI', in Anthony Skjellum and Donna Reese, (Ed.), Proc. Scalable Parallel Libraries Conference, IEEE Computer Society Press, October 1993, pp. 166-173.
21. S. Huss-Lederman, E. M. Jacobson and A. Tsao, 'Comparison of scalable parallel matrix multiplication libraries', in Anthony Skjellum and Donna Reese (Eds.), Proc. Scalable Parallel Libraries Conference, IEEE Computer Society Press, October 1993, pp. 142-149.
22. R. C. Agarwal, S. M. Balle, F. G. Gustavson, M. Joshi and P. Palkar, 'A 3-dimensional approach to parallel matrix multiplication', IBM J. Res. Develop., 39, (5), 1-8 (1995).
23. V. Kumar, A. Grama, A. Gupta and G. Karypis, Introduction to Parallel Computing: Design and Analysis of Algorithms, The Benjamin/Cummings Publishing Company, Redwood City, California, 1994.
24. V. Strassen, 'Gaussian elimination is not optimal', Numer. Math., 13, 354-356 (1969).
25. C. C. Douglas, M. Heroux, G. Slishman and R. M. Smith, 'GEMMW: A portable level 3 BLAS Winograd variant of Strassen's matrix-matrix multiply algorithm', J. Comput. Phys., 110, 1-10 (1994).
26. E. Dekel, D. Nassimi and S. Sahni, 'Parallel matrix and graph algorithms', SIAM J. Comput., 10, (4), 657-73 (1981).
27. J. O. Coplien, Advanced C++ Programming Styles and Idioms, Addison-Wesley Publishing Company, Reading, Massachusetts, 1992.