A parallel eigensolver for dense symmetric matrices based on multiple relatively robust representations

SIAM Journal on Scientific Computing

Volumn 27, Issue 1, 2005, Pages 43-66

  Bientinesi, Paolo ^a   Dhillon, Inderjit S ^a   Van Geijn, Robert A D E ^a  

^a University of Texas at Austin   (United States)

Author keywords

Eigenvalues; Eigenvectors; Parallel computing; Relatively robust representations; Symmetric matrix

Indexed keywords

ALGORITHMS; MATRIX ALGEBRA; PARALLEL PROCESSING SYSTEMS; QUANTUM THEORY; ROBUSTNESS (CONTROL SYSTEMS);

COMPUTATIONAL QUANTUM CHEMISTRY; EIGENVALUES; RELATIVELY ROBUST REPRESENTATIONS; SYMMETRIC MATRIX;

EIGENVALUES AND EIGENFUNCTIONS;

EID: 33144474872     PISSN: 10648275     EISSN: None     Source Type: Journal    
DOI: 10.1137/030601107     Document Type: Article

References (45)

1. E. ANDERSON, Z. BAI, C. BISCHOF, J. DEMMEL, J. DONGARRA, J. DU CROZ, A. GREENBAUM, S. HAMMARLING, A. MCKENNEY, S. OSTROUCHOV, AND D. SORENSEN, LAPACK Users' Guide, 2nd ed., SIAM, Philadelphia, 1995.
2. D. BERNHOLDT AND R. HARRISON, Orbital invariant second order many-body perturbation on parallel computers: An approach for large molecules, J. Chem. Physics, 102 (1995), pp. 9582-9589.
3. H. J. BERNSTEIN AND M. GOLDSTEIN, Parallel implementation of bisection for the calculation of eigenvalues of tridiagonal symmetric matrices, Computing, 37 (1986), pp. 85-91.
4. P. BIENTINESI, I. S. DHILLON, AND R. VAN DE GEIJN, A Parallel Eigensolver for Dense Symmetric Matrices Based on Multiple Relatively Robust Representations, Technical report TR-03-26, Department of Computer Sciences, University of Texas, Austin, TX, 2003.
5. C. BISCHOF, S. HUSS-LEDERMAN, X. SUN, A. TSAO, AND T. TURNBULL, Parallel performance of a symmetric eigensolver based on the invariant subspace decomposition approach, in Proceedings of the Scalable High Performance Computing Conference, Knoxville, TN, 1994.
6. C. BISCHOF AND C. VAN LOAN, The WY representation for products of Householder matrices, SIAM J. Sci. Statist. Comput., 8 (1987), pp. s2-s13.
7. L. BLACKFORD, A. CLEARY, J. DEMMEL, I. S. DHILLON, J. DONGARRA, S. HAMMARLING, A. PETITET, H. REN, K. STANLEY, AND R. WHALEY, Practical experience in the numerical dangers of heterogeneous computing, ACM Trans. Math. Software, 23 (1997), pp. 133-147.
8. L. S. BLACKFORD, J. CHOI, A. CLEARY, E. D'AZEVEDO, J. DEMMEL, I. S. DHILLON, J. DONGARRA, S. HAMMARLING, G. HENRY, A. PETITET, K. STANLEY, D. WALKER, AND R. C. WHALEY, ScaLAPACK Users' Guide, SIAM, Philadelphia, 1997.
9. R. P. BRENT, Algorithms for Minimization without Derivatives, Prentice-Hall, Englewood Cliffs, NJ, 1973.
10. J. J. M. CUPPEN, A divide and conquer method for the symmetric tridiagonal eigenproblem, Numer. Math., 36 (1981), pp. 177-195.
11. T. J. DEKKER, Finding a zero by means of successive linear interpolation, in Constructive Aspects of the Fundamental Theorem of Algebra, B. Dejon and P. Henrici, eds., Wiley-Interscience, New York, 1969, pp. 37-48.
12. J. DEMMEL AND K. VESELIĆ, Jacobi's method is more accurate than QR, SIAM J. Matrix Anal. Appl., 13 (1992), pp. 1204-1245.
13. 2) Algorithm for the Symmetric Tridiagonal Eigenvalue/Eigenvector Problem, Ph.D. thesis, Computer Science Division, University of California, Berkeley, CA, 1997; available as UC Berkeley Technical report UCB//CSD-97-971.
14. I. S. DHILLON, Current inverse iteration software can fail, BIT, 38 (1998), pp. 685-704.
15. I. S. DHILLON, G. FANN, AND B. N. PARLETT, Application of a new algorithm for the symmetric eigenproblem to computational quantum chemistry, in Proceedings of the Eighth SIAM Conference on Parallel Processing for Scientific Computing (Minneapolis, MN, 1997), CD-ROM, SIAM, Philadelphia, 1997.
16. I. S. DHILLON AND A. N. MALYSHEV, Inner deflation for symmetric tridiagonal matrices, Linear Algebra Appl., 358 (2002), pp. 139-144.
17. I. S. DHILLON AND B. N. PARLETT, Multiple representations to compute orthogonal eigenvectors of symmetric tridiagonal matrices, Linear Algebra Appl., 387 (2004), pp. 1-28.
18. I. S. DHILLON AND B. N. PARLETT, Orthogonal eigenvectors and relative gaps, SIAM J. Matrix Anal. Appl., 25 (2004), pp. 858-899.
19. J. DONGARRA, J. DU CROZ, I. DUFF, AND S. HAMMARLING, A set of level 3 basic linear algebra subprograms, ACM Trans. Math. Software, 16 (1990), pp. 1-17.
20. J. J. DONGARRA AND D. C. SORENSEN, A fully parallel algorithm for the symmetric eigenvalue problem, SIAM J. Sci. Statist. Comput., 8 (1987), pp. s139-s154.
21. J. DONGARRA, R. VAN DE GEIJN, AND D. WALKER, A look at scalable dense linear algebra libraries, in Proceedings of the Scalable High-Performance Computing Conference, IEEE Computer Society Press, Los Alamitos, CA, 1992, pp. 372-379.
22. J. DONGARRA, S. J. HAMMARLING, AND D. C. SORENSEN, Block reduction of matrices to condensed forms for eigenvalue computations, J. Comput. Appl. Math., 27 (1989), pp. 215-227.
23. D. ELWOOD, G. FANN, AND R. LITTLEFIELD, PeIGS User's Manual, Pacific Northwest National Laboratory, Richland, WA, 1993.
24. K. FERNANDO AND B. PARLETT, Accurate singular values and differential qd algorithms, Numer. Math., 67 (1994), pp. 191-229.
25. K. V. FERNANDO, On computing an eigenvector of a tridiagonal matrix. Part I: Basic results, SIAM J. Matrix Anal. Appl., 18 (1997), pp. 1013-1034.
26. G. J. F. FRANCIS, The QR transformation: A unitary analogue to the LR transformation. I, Comput. J., 4 (1961/1962), pp. 265-271.
27. G. J. F. FRANCIS The QR transformation. II, Comput. J., 4 (1961/1962), pp. 332-345.
28. W. J. GIVENS, Numerical Computation of the Characteristic Values of a Real Symmetric Matrix, Technical report ORNL-1574, Oak Ridge National Laboratory, Oak Ridge, TN, 1954.
29. K. GOTO AND R. A. VAN DE GEIJN, On Reducing TLB Misses in Matrix Multiplication, Technical report CS-TR-02-55, Department of Computer Sciences, University of Texas, Austin, TX, 2002; see also http://www.cs.utexas.edu/users/kgoto.
30. M. GU AND S. C. EISENSTAT, A divide-and-conquer algorithm for the symmetric tridiagonal eigenproblem, SIAM J. Matrix Anal. Appl., 16 (1995), pp. 172-191.
31. J. GUNNELS, C. LIN, G. MORROW, AND R. VAN DE GEIJN, A flexible class of parallel matrix multiplication algorithms, in Proceedings of First Merged International Parallel Processing Symposium and Symposium on Parallel and Distributed Processing, 1998, pp. 110-116.
32. B. HENDRICKSON, E. JESSUP, AND C. SMITH, Toward an efficient parallel eigensolver for dense symmetric matrices, SIAM J. Sci. Comput., 20 (1999), pp. 1132-1154.
33. C. G. F. JACOBI, Concerning an easy process for solving equations occurring in the theory of secular disturbances, J. Reine Angew. Math., 30 (1846), pp. 51-94.
34. E. R. JESSUP AND I. C. F. IPSEN, Improving the accuracy of inverse iteration, SIAM J. Sci. Statist. Comput., 13 (1992), pp. 550-572.
35. M. F. KAPLAN, Implementation of Automated Multilevel Substructuring for Frequency Response Analysis of Structures, Ph.D. thesis, University of Texas, Austin, TX, 2001.
36. V. N. KUBLANOVSKAYA, On some algorithms for the solution of the complete eigenvalue problem, Zh. Vych. Mat., 1 (1961), pp. 555-570.
37. T. Y. LI AND Z. G. ZENG, The Laguerre iteration in solving the symmetric tridiagonal eigen-problem, revisited, SIAM J. Sci. Statist. Comput., 15 (1994), pp. 1145-1173.
38. B. N. PARLETT, The Symmetric Eigenvalue Problem, 2nd ed., SIAM, Philadelphia, 1997.
39. B. N. PARLETT, Laguerre's method applied to the matrix eigenvalue problem, Math. Comp., 18 (1964), pp. 464-485.
40. B. N. PARLETT AND I. S. DHILLON, Fernando's solution to Wilkinson's problem: An application of double factorization, Linear Algebra Appl., 267 (1997), pp. 247-279.
41. B. N. PARLETT AND I. S. DHILLON, Relatively robust representations of symmetric tridiagonals, Linear Algebra Appl., 309 (2000), pp. 121-151.
42. G. PETERS AND J.H. WILKINSON, The calculation of specified eigenvectors by inverse iteration, contribution II/18, in Handbook of Automatic Computation, Vol. 2, Springer-Verlag, New York, Heidelberg, Berlin, 1971, pp. 418-439.
43. F. TISSEUR AND J. DONGARRA, A parallel divide and conquer algorithm for the symmetric eigenvalue problem on distributed memory architectures, SIAM J. Sci. Comput., 20 (1999), pp. 2223-2236.
44. R. VAN DE GEIJN, Using PLAPACK: Parallel Linear Algebra Package, MIT Press, Cambridge, MA, 1997.
45. J. H. WILKINSON, The Algebraic Eigenvalue Problem, Oxford University Press, Oxford, 1965.