Scalapack: A portable linear algebra library for distributed memory computers - Design issues and performance

Proceedings of the International Conference on Supercomputing

Volumn 1996-November, Issue , 1996, Pages

  Blackford, L S ^a   Choi, J ^b   Cleary, A ^a   Demmel, J ^c   Dhillon, I ^c   Dongarra, J ^a,d   Hammarling, S ^a   Henry, G ^e   Petitet, A ^a   Stanley, K ^c   Walker, D ^d   Whaley, R C ^a  

^a University of Tennessee Knoxville   (United Kingdom)

^b Soongsil University   (South Korea)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d OAK RIDGE NATIONAL LABORATORY   (United States)

^e INTEL CORPORATION   (United States)

Author keywords

Math libraries; Numerical linear algebra; Parallel computing

Indexed keywords

LIBRARIES; LINEAR ALGEBRA; MEMORY ARCHITECTURE; PARALLEL PROCESSING SYSTEMS;

COMPUTER DESIGNS; DESIGN ISSUES; DESIGN PERFORMANCE; DISTRIBUTED-MEMORY COMPUTERS; LINEAR ALGEBRA LIBRARIES; MATH LIBRARY; NUMERICAL LINEAR ALGEBRA; PARALLEL COM- PUTING; PERFORMANCE; SCALAPACK;

MESSAGE PASSING;

EID: 85117332702     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SUPERC.1996.183513     Document Type: Conference Paper

References (33)

1. E. Anderson, Z. Bai, C. Bischof, J. Demmel, J. Dongarra, J. Du Croz, A. Greenbaum, S. Hammarling, A. McKenney, S. Ostrouchov, and D. Sorensen. “LAPACK Users’ Guide, Second Edition”. SIAM, Philadelphia, PA, 1995.
2. E. Anderson, Z. Bai, and J. J. Dongarra. Generalized QR Factorization and its Applications. Linear Algebra and Its Applications, pages 162–164:243–273, 1992.
3. Z. Bai and J. Demmel. Design of a parallel nonsymmetric eigenroutine toolbox, Part I. In Proceedings of the Sixth SIAM Conference on Parallel Proceesing for Scientific Computing. SIAM, 1993. Long version available as UC Berkeley Computer Science report all.ps.Z via anonymous ftp from tr-ftp.cs.berkeley.edu, directory pub/tech-reports/csd/csd-92-718.
4. Z. Bai, J. Demmel, J. Dongarra, A. Petitet, H. Robinson, and K. Stanley. The spectral decomposition of nonsymmetric matrices on distributed memory computers. LAPACK Working Note #91 Technical report UT CS–95–273, University of Tennessee, 1995.
5. Z. Bai, J. Demmel, and M. Gu. Inverse free parallel spectral divide and conquer algorithms for nonsymmetric eigenproblems. Num. Math., 1996. to appear.
6. L. S. Blackford, A. Cleary, J. Demmel, I. Dhillon, J. Dongarra, S. Hammarling, A. Petitet, H. Ren, K. Stanley, R. C. Whaley. Practical experience in the dangers of heterogeneous computing. LAPACK Working Note #112 Technical report UT CS–96–330, University of Tennessee, 1996.
7. S. Chakrabarti, J. Demmel, and K. Yelick. Modeling the benefits of mixed data and task parallelism. In Symposium on Parallel Algorithms and Architectures (SPAA), July 1995.
8. J. Choi, J. Demmel, I. Dhillon, J. Dongarra, S. Ostrouchov, A. Petitet, K. Stanley, D. Walker, and R. C. Whaley. ScaLAPACK: A portable linear algebra library for distributed memory computers – design issues and performance. LAPACK Working Note #95 Technical report UT CS–95–283, University of Tennessee, 1995.
9. J. Choi, J. Dongarra, S. Ostrouchov, A. Petitet, D. Walker, and R. C. Whaley. A proposal for a set of parallel basic linear algebra subprograms. LAPACK Working Note #100 Technical report UT CS–95–292, University of Tennessee, 1995.
10. J. Choi, J. Dongarra, R. Pozo, and D. Walker. “ScaLAPACK: A Scalable Linear Algebra Library for Distributed Memory Concurrent Computers”. Technical Report UT CS-92-181, LAPACK Working Note #55, University of Tennessee, 1992.
11. J. Choi, J. Dongarra, and D. Walker. “Parallel Matrix Transpose Algorithms on Distributed Concurrent Computers”. Technical Report UT CS-93-215, LAPACK Working Note #65, University of Tennessee, 1993.
12. J. Demmel, J. J. Dongarra, S. Hammarling, S. Ostrouchov, and K. Stanley. The dangers of heterogeneous network computing: Heterogenous networks considered harmful. In Proceedings Heterogeneous Computing Workshop’96, pages 64–71. IEEE, 1996.
13. J. Demmel and K. Stanley. “The Performance of Finding Eigenvalues and Eigenvectors of Dense Symmetric Matrices on Distributed Memory Computers”. In Proceedings of the Seventh SIAM Conference on Parallel Proceesing for Scientific Computing. SIAM, 1994.
14. J. Dongarra, J. Du Croz, I. Duff, and S. Hammarling. “A Set of Level 3 Basic Linear Algebra Subprograms”. ACM Transactions on Mathematical Software, 16(1):1–28, 1990.
15. J. Dongarra, J. Du Croz, S. Hammarling, and R. Hanson. “An Extended Set of Fortran Basic Linear Algebra Subprograms”. ACM Transactions on Mathematical Software, 14(1):1–32, 1988.
16. J. Dongarra and L. Johnsson. Solving banded systems on a parallel processor. Parallel Computing, 5:219–246, 1987.
17. J. Dongarra and D. W. Walker. The Design of Linear Algebra Libraries for High Performance Computers. Technical Report UT CS-93-192, LAPACK Working Note #58, University of Tennessee, 1993.
18. J. Dongarra and R. C. Whaley. “A User’s Guide to the BLACS v1.0”. Technical Report UT CS-95-281, LAPACK Working Note #94, University of Tennessee, 1995.
19. G. Fox, M. Johnson, G. Lyzenga, S. Otto, J. Salmon, and D. Walker. “Solving Problems on Concurrent Processors”, volume 1. Prentice Hall, Englewood Cliffs, N.J, 1988.
20. A. Geist, A. Beguelin, J. Dongarra, W. Jiang, R. Manchek, and V. Sunderam. PVM: Parallel Virtual Machine. A Users’ Guide and Tutorial for Networked Parallel Computing. The MIT Press Cambridge, Massachusetts, 1994.
21. G. Golub and C. F. Van Loan. “Matrix Computations - 2nd Edition”. Johns Hopkins University Press, Baltimore, MD, 1989.
22. S. Hammarling. The numerical solution of the general Gauss-Markov linear model. In T. S. Durrani et al., editor, Mathematics in Signal Processing. Clarendon Press, Oxford, 1986.
23. High Performance Forum. “High Performance Fortran Language Specification”. Technical Report CRPC-TR92225, Center for Research on Parallel Computation, Rice University, Houston, TX, May 1993.
24. W. Hsu, G. Thanh Nguyen, and X. Jiang. “Going Beyond Binary”. http://www.cs.berkeley.edu/ xjiang/cs258/project 1.html, 1995. CS 258 Class project.
25. Koebel, C., Loveman, D., Schreiber, R., Steele, G., Zosel, M.: The High Performance Fortran Handbook. The MIT Press, Cambridge, Massachusetts, 1994.
26. C. Lawson, R. Hanson, D. Kincaid, and F. Krogh. “Basic Linear Algebra Subprograms for Fortran Usage”. ACM Transactions on Mathematical Software, 5(3):308–323, 1979.
27. Message Passing Interface Forum. “MPI: A Message-Passing Interface standard”. International Journal of Supercomputer Applications, 8(3/4), 1994.
28. B. De Moor and P. Van Dooren. Generalization of the singular value and QR decompositions. SIAM J. Matrix Anal. Appl., 13:993–1014, 1992.
29. C. Paige. Fast numerically stable computations for generalized linear least squares problems. SIAM J. Num. Anal., 16:165–179, 1979.
30. C. Paige. Some aspects of generalized QR factorization. In M. Cox and S. Hammarling, editors, Reliable Numerical Computations. Clarendon Press, Oxford, 1990.
31. B. Parlett, I. Dhillon, and V. Fernando. Private Communication, 1995.
32. ScaLAPACK Users’ Guide. http://www.netlib.org/scalapack/scalapack ug.ps. To be published by SIAM.
33. M. Snir, S. W. Otto, S. Huss-Lederman, D. W. Walker, and J. J. Dongarra. MPI: The Complete Reference. MIT Press, Cambridge, Massachusetts, 1996.