Impact of mixed-parallelism on parallel implementations of the Strassen and Winograd matrix multiplication algorithms

Concurrency and Computation: Practice and Experience

Volumn 16, Issue 8, 2004, Pages 771-797

  Desprez, F ^a   Suter, F ^b  

^a CNRS   (France)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Grid computing; Mixed parallelism; ScaLAPACK; Strassen; Winograd

Indexed keywords

ALGORITHMS; COMPUTER PROGRAMMING LANGUAGES; DISTRIBUTED COMPUTER SYSTEMS; LINEAR ALGEBRA; NATURAL SCIENCES COMPUTING;

GRID COMPUTING; MIXED PARALLELISM; SCALAPACK; STRASSEN; WINOGRAD;

PARALLEL PROCESSING SYSTEMS;

EID: 3042820917     PISSN: 15320626     EISSN: None     Source Type: Journal    
DOI: 10.1002/cpe.791     Document Type: Article

References (14)

1. Bal H, Haines M. Approaches for integrating task and data parallelism. IEEE Concurrency 1998; 6(3):74-84.
2. Rauber T, Rünger G. Scheduling of data parallel modules for scientific computing. Proceedings of the Ninth SIAM Conference on Parallel Processing for Scientific Computing (PP99), San Antonio, TX, March. SIAM: Philadelphia, PA, 1999.
3. Ramaswany S. Simultaneous exploitation of task and data parallelism in regular scientific applications. PhD Thesis, University of Illinois at Urbana-Champaign, 1996.
4. Matsuoka S, Nakada H, Sato M, Sekiguchi S. Design issues of network enabled server systems for the Grid. APM WG Whitepaper, Grid Forum, 2000.
5. Strassen V. Gaussian elimination is not optimal. Numerische Mathematik 1969; 14(3):354-356.
6. Fischer P, Probert R. Efficient procedures for using matrix algorithms. Automata, Languages and Programming (Lecture Notes in Computer Science, vol. 14). Springer: Berlin, 1974; 413-427.
7. Blackford LS, Choi J, Cleary A, D'Azevedo E, Demmel J, Dhillon I, Dongarra J, Hammarling S, Henry G, Petitet A, Stanley K, Walker D, Whaley RC. ScaLAPACK Users' Guide. SIAM: Philadelphia, PA, 1997.
8. Huss-Lederman S, Jacobson E, Johnson J, Tsao A, Turnbull T. Strassen's algorithm for matrix multiplication: Modeling, analysis, and implementation. Technical Report CCS-TR-96-147, Center for Computing Sciences, Argonne National Laboratory, 1996.
9. Desprez F, Suter F. Mixed parallel implementations of the top level step of Strassen and Winograd matrix multiplication algorithms. Proceedings 15th International Parallel and Distributed Processing Symposium (IPDPS'01), San Francisco, April 2001. IEEE Computer Society Press: Los Alamitos, CA, 2001.
10. Caron E, Suter F. Parallel extension of a dynamic performance forecasting tool. Proceedings of the International Symposium on Parallel and Distributed Computing, Iasi, Romania, July 2002. Editura Universitatii 'Alexandru Loan Cuzo', 2002.
11. Prylli L, Tourancheau B. Fast runtime block cyclic data redistribution on multiprocessors. Journal of Parallel and Distributed Computing 1997; 45(1):63-72.
12. Beaumont O, Boudet V, Legrand A, Rastello F, Robert Y. Heterogeneous matrix-matrix multiplication, or partitioning a square into rectangles: NP-completeness and approximation algorithms. EuroMicro Workshop on Parallel and Distributed Computing (EuroMicro'2001). IEEE Computer Society Press: Los Alamitos, CA, 2001; 298-305.
13. Beaumont O, Boudet V, Rastello F, Robert Y. Matrix multiplication on heterogeneous platforms. IEEE Transactions on Parallel Distributed Systems 2001; 12(10):1033-1051.
14. Chen Z, Dongarra J, Luszczel P, Roche K. Self adapting software for numerical linear algebra and LAPACK for clusters (LAPACK Working Note 160). CS Technical Report UT-CS-03-499, University of Tennessee, 2003.