Families of algorithms related to the inversion of a symmetric positive definite matrix

ACM Transactions on Mathematical Software

Volumn 35, Issue 1, 2008, Pages 1-22

  Bientinesi, Paolo ^a   Gunter, Brian ^b   Geijn, Robert A Van De ^c  

^a RWTH AACHEN UNIVERSITY   (Germany)

^b DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

^c University of Texas at Austin   (United States)

Author keywords

Inversion; Libraries; Linear algebra; Symmetric positive definite

Indexed keywords

LIBRARIES; LINEAR ALGEBRA; MEMORY ARCHITECTURE;

CHOLESKY FACTORIZATIONS; DISTRIBUTED MEMORY ARCHITECTURE; DISTRIBUTED-MEMORY PARALLEL COMPUTERS; HIGH PERFORMANCE IMPLEMENTATIONS; INVERSION; SYMMETRIC MULTI-PROCESSORS; SYMMETRIC POSITIVE DEFINITE; SYMMETRIC POSITIVE DEFINITE MATRICES;

MATRIX ALGEBRA;

EID: 48849099645     PISSN: 00983500     EISSN: 15577295     Source Type: Journal    
DOI: 10.1145/1377603.1377606     Document Type: Article

References (42)

1. ANDERSEN, B. S., GUNNELS, J. A., GUSTAVSON, F. G., AND WASNIEWSKI, J. 2002. A recursive formulation of the inversion of symmetric positive definite matrices in packed storage data format. In Proceedings of the Applied Parallel Computing New Paradigms for HPC in Industry and Academia 7th International Workshop (PARA'02) . Lecture Notes in Computer Science, vol. 2367. Springer, 287-296.
2. ANDERSON, E., BAI, Z., BISCHOF, C. H., BLACKFORD, S., DEMMEL, J. W., DONGARRA, J. J., CROZ, J. J. D., GREENBAUM, A., HAMMARLING, S. J., MCKENNEY, A., AND SORENSEN, D. C. 1999. LAPACK Users' Guide, 3rd Ed. Society for Industrial Mathematics.
3. BAUER, F. L. AND REINSCH, C. 1970. Inversion of positive definite matrices by the Gauss-Jordan methods. In Handbook for Automatic Computation Vol. 2: Linear Algebra, J. H. Wilkinson and C. Reinsch, Eds. Springer, Berlin, Germany, 45-49.
4. BIENTINESI, P. 2006. Mechanical derivation and systematic analysis of correct linear algebra algorithms. Ph.D. thesis, Department of Computer Sciences, The University of Texas.
5. BIENTINESI, P., GUNNELS, J. A., MYERS, M. E., QUINTANA-ORTÍ, E. S., AND VAN DE GEIJN, R. A. 2005a. The science of deriving dense linear algebra algorithms. ACM Trans. Math. Softw. 31, 1, 1-26.
6. BIENTINESI, P., GUNTER, B., AND VAN DE GEIJN, R. 2006. Families of algorithms related to the inversion of a symmetric positive definite matrix. FLAME Working Note #19 CS-TR-06-20, Department of Computer Sciences, The University of Texas at Austin.
7. BIENTINESI, P., QUINTANA-ORTÍ, E. S., AND VAN DE GEIJN, R. A. 2005b. Representing linear algebra algorithms in code: The FLAME application programming interfaces. ACM Trans. Math. Softw. 31, 1.
8. BIENTINESI, P. AND VAN DE GEIJN, R. 2006. Representing dense linear algebra algorithms: A farewell to indices. FLAME Working Note #17 CS-TR-06-10, Department of Computer Sciences, The University of Texas at Austin.
9. BILMES, J., ASANOVIĆ, K., WHYE CHIN, C., AND DEMMEL, J. 1997. Optimizing matrix multiply using PHiPAC: A portable, high-performance, ANSI C coding methodology. In Proceedings of the International Conference on Supercomputing. Vienna, Austria.
10. BLACKFORD, L. S., CHOI, J., CLEARY, A., D'AZEVEDO, E., DEMMEL, J., DHILLON, I., DONGARRA, J., HAMMARLING, S., HENRY, G., PETITET, A., STANLEY, K., WALKER, D., AND WHALEY, R. C. 1997. ScaLAPACK Users' Guide. SIAM.
11. CHOI, J., DONGARRA, J., POZO, R., AND WALKER, D. 1992. ScaLAPACK: A Scalable Linear Algebra Library for Distributed Memory Concurrent Computers. In Proceedings of the 4th Symposium on the Frontiers of Massively Parallel Computation. IEEE Computer Society Press, 120-127.
12. CHTCHELKANOVA, A., GUNNELS, J., MORROW, G., OVERFELT, J., AND VAN DE GEIJN, R. 1997. Parallel implementation of BLAS: General techniques for level 3 BLAS. Concurrency: Prac. Exper. 9, 9, 837-857.
13. DACKLAND, K. AND KÅGSTRÖM, B. 1996. A hierarchical approach for performance analysis of scaLAPACK-based routines using the distributed linear algebra machine. In Proceedings of the 3rd International Workshop on Applied Parallel Computing, Industrial Computation and Optimization (PARA'96). Lecture Notes in Computer Science, vol. 1184. Springer-Verlag, 186-195.
14. DEMMEL, J. AND DONGARRA, J. 2005. LAPACK 2005 prospectus: Reliable and scalable software for linear algebra computations on high end computers. LAPACK Working Note 164 UT-CS-05-546, University of Tennessee.
15. DONGARRA, J., DU CROZ, J., HAMMARLING, S., AND DUFF, I. 1990. A set of level 3 basic linear algebra subprograms. ACM Trans. Math. Softw. 16, 1, 1-17.
16. DONGARRA, J., DU CROZ, J., HAMMARLING, S., AND HANSON, R. 1988. An extended set of FORTRAN basic linear algebra subprograms. ACM Trans. Math. Softw. 14, 1, 1-17.
17. DONGARRA, J., DUFF, I., SORENSEN, D., AND VAN DER VORST, H. A. 1991. Solving Linear Systems on Vector and Shared Memory Computers. SIAM, Philadelphia, PA.
18. GEORGIEVA, G., GUSTAVSON, F. G., AND YALAMOV, P. Y. 2000. Inversion of symmetric matrices in a new block packed storage. In Proceedings of the 2nd International Conference on Numerical Analysis and Its Applications (NAA'00). Springer, 333-340.
19. GOTO, K. AND VAN DE GEIJN, R. 2008. Anatomy of high-performance matrix multiplication. ACM Trans. Math. Softw. 34, 3.
20. GOTO, K. AND VAN DE GEIJN, R. A. 2002. On reducing TLB misses in matrix multiplication. Tech. rep. CS-TR-02-55, Department of Computer Sciences, The University of Texas at Austin.
21. GRIES, D. AND SCHNEIDER, F. B. 1992. A Logical Approach to Discrete Math. Texts and Monographs in Computer Science. Springer-Verlag.
22. GROPP, W. AND LUSK, E. 1994. User's guide for mpich, a portable implementation of MPI. Tech. rep. ANL-06/6, Argonne National Laboratory.
23. GROPP, W., LUSK, E., AND SKJELLUM, A. 1994. Using MPI. The MIT Press.
24. GULLBERG, G., HUESMAN, R., ROY, D. G., QI, J., AND REUTTER, B. 2003. Estimation of the parameter covariance matrix for a one-compartment cardiac perfusion model estimated from a dynamic sequence reconstructed using map iterative reconstruction algorithms. In Nuclear Science Symposium Conference Record. vol. 5. IEEE, 3019-3023.
25. GUNNELS, J. A. 2001. A systematic approach to the design and analysis of parallel dense linear algebra algorithms. Ph.D. thesis, Department of Computer Sciences, The University of Texas.
26. GUNNELS, J. A., GUSTAVSON, F. G., HENRY, G. M., AND VAN DE GEIJN, R. A. 2001a. A family of highperformance matrix multiplication algorithms. In Computational Science (ICCS'01), Part I, V. N. Alexandrov, J. J. Dongarra, B. A. Juliano, R. S. Renner, and C. K. Tan, Eds. Lecture Notes in Computer Science, vol. 2073. Springer-Verlag, 51-60.
27. GUNNELS, J. A., KATZ, D. S., QUINTANA- ORTÍ, E. S., AND VAN DE GEIJN, R. A. 2001b. Fault-tolerant high-performance matrix multiplication: Theory and practice. In Proceedings of the International Conference for Dependable Systems and Networks (DSN'01). 47-56.
28. GUNTER, B. 2004. Computational methods and processing strategies for estimating earth's gravity field. Ph.D. thesis, Department of Aerospace Engineering and Engineering Mechanics, The University of Texas at Austin.
29. HENDRICKSON, B. AND WOMBLE, D. 1994. The torus-wrap mapping for dense matrix calculations on massively parallel computers. SIAM J. Sci. Stat. Comput. 15, 5, 1201-1226.
30. HIGHAM, N. J. 2002. Accuracy and Stability of Numerical Algorithms, 2nd Ed. Society for Industrial and Applied Mathematics, Philadelphia, PA.
31. HOUSEHOLDER, A. 1964. The Theory of Matrices in Numerical Analysis. Dover, New York, NY.
32. HUESMAN, R., KADRMAS, D., DIBELLA, E., AND GULLBERG, G. 1999. Analytical propagation of errors in dynamic SPECT: estimators, degrading factors, bias and noise. Phys. Med. Biol. 44, 1999-2014.
33. JONSSON, I. AND KÅGSTRÖM, B. 2002a. Recursive blocked algorithms for solving triangular systems - part I: One-sided and coupled Sylvester-type matrix equations. ACM Trans. Math. Softw. 28 4, 392-415.
34. JONSSON, I. AND KÅGSTRÖM, B. 2002b. Recursive blocked algorithms for solving triangular systems - part II: Two-sided and generalized Sylvester and Lyapunov matrix equations. ACM Trans. Math. Softw. 28, 4, 416-435.
35. KÅGSTRÖM, B., LING, P., AND LOAN, C. V. 1998. GEMM-based level 3 BLAS: High performance model implementations and performance evaluation benchmark. ACM Trans. Math. Softw. 24, 3, 268-302.
36. QUINTANA, E. S., QUINTANA, G., SUN, X., AND VAN DE GEIJN, R. 2001. A note on parallel matrix inversion. SIAM J. Sci. Comput. 22, 5, 1762-1771.
37. SANSO, R. AND RUMMEL, R., Eds. 1989. Theory of satellite geodesy and gravity field determination. Lecture Notes in Earth Sciences, vol. 25. Springer-Verlag, Berlin, Germany.
38. SNIR, M., OTTO, S. W., HUSS-LEDERMAN, S., WALKER, D. W., AND DONGARRA, J. 1996. MPI: The Complete Reference. The MIT Press.
39. STEWART, G. 1990. Communication and matrix computations on large message passing systems. Para. Comput. 16, 27-40.
40. TAPLEY, B., SCHUTZ, B., AND BORN, G. 2004. Statistical Orbit Determination. Elsevier Academic Press.
41. VAN DE GEIJN, R. A. 1997. Using PLAPACK: Parallel Linear Algebra Package. The MIT Press.
42. WHALEY, R. C. AND DONGARRA, J. J. 1998. Automatically tuned linear algebra software. In Proceedings of Supercomputing (SC'98).