Newton’s iteration for matrix inversion, advances and extensions

Matrix Methods: Theory, Algorithms and Applications: Dedicated to the Memory of Gene Golub

Volumn , Issue , 2010, Pages 364-381

  Pan, Victor Y ^a  

^a CITY UNIVERSITY OF NEW YORK   (United States)

Author keywords

Continuation (homotopy); Divide and conquer algorithms; Matrix inversion; Matrix structure; Newton s iteration; Null spaces

Indexed keywords

SINGULAR VALUE DECOMPOSITION; VECTOR SPACES;

DIVIDE-AND-CONQUER ALGORITHM; HOMOTOPIES; MATRIX INVERSIONS; MATRIX STRUCTURE; NULL SPACE;

ITERATIVE METHODS;

EID: 77950368381     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1142/9789812836021_0024     Document Type: Chapter

References (45)

1. T. S0derstr0m, G. W. Stewart, On the Numerical Properties of an Iterative Method for Computing the Moore-Penrose Generalized Inverse, SIAM Journal on Numerical Analysis, 11, 61-74, 1974.
2. V. Y. Pan, R. Schreiber, An Improved Newton Iteration for the Generalized Inverse of a Matrix, with Applications, SIAM Journal on Scientific and Statistical Computing, 12, 5, 1109-1131, 1991.
3. G. H. Golub, C. F. Van Loan, Matrix Computations, 3rd edition, The Johns Hopkins University Press, Baltimore, Maryland, 1996.
4. G. W. Stewart, Matrix Algorithms, Vol I: Basic Decompositions, SIAM, Philadelphia, 1998.
5. G. W. Stewart, Matrix Algorithms, Vol II: Eigensystems, SIAM, Philadelphia, 1998 (first edition), 2001 (second edition).
6. J. W. Demmel Applied Numerical Linear Algebra, SIAM, Philadelphia, 1997.
7. L. N. Trefethen, D. Bau, III, Numerical Linear Algebra, SIAM, Philadelphia, 1997.
8. N. J. Higham, Accuracy and Stability in Numerical Analysis, SIAM, Philadelphia, 2002 (second edition).
9. H. Hotelling, Analysis of a Complerx Statistocal Variable into Principal Components, J. of Educational Psysh., 24, 417-441, 498-520, 1933.
10. G. Schultz, Iterative Berechnung der Reciproken Matrix, Z. Angew. Meth. Mech., 13, 57-59, 1933.
11. A. Ben-Israel, A Note on Iterative Method for Generalized Inversion of Matrices, Mathematics of Computation, 20, 439-440, 1966.
12. A. Ben-Israel, D. Cohen, On Iterative Computation of Generalized Inverses and Associated Projections, SIAM Journal on Numerical Analysis, 3, 410-419, 1966.
13. R. Schreiber, Computing Generalized Inverses and Eigenvalues of Symmetric Matrices Using Systolic Arrays, in Computing Methods in Applied Scence and En- geneering (edited by R. Glowinski and J.-L. Lions), North-Holland, Amsterdam, 1984.
14. V. Y. Pan, J. Reif, Fast and Efficient Parallel Solution of Dense Linear Systems, Computers and Math, (with Applications), 17, 11, 1481-1491, 1989.
15. G. Codevico, V. Y. Pan, M. Van Barel, Newton-like Iteration Based on Cubic Polynomials for Structured Matrices, Numerical Algorithms, 36, 365-380, 2004.
16. I. V. Oceledetz, E. E. Tyrtyshnikov, Approximate Inversion of Matrices in the Process of Solving a Hypersingular Integral Equation, Computational Math, and Math. Physics, 45, 2, 302-313, 2005 (Translated from JVM i MF, 45, 2, 315-326, 2005).
17. V. Olshevsky, I.V. Oseledets, and E.E. Tyrtyshnikov, Tensor Properties of Multilevel Toeplitz and Related Matrices, Linear Algebra and Its Applications, 412, 1-21, 2006.
18. V. Olshevsky, I.V. Oseledets, and E.E. Tyrtyshnikov, Superfast Inversion of Two- Level Toeplitz Matrices Using Newton Iteration and Tensor-Displacement Structure, Operator Theory: Advances and Applications, 179, 229-240, 2008.
19. T. Kailath, S.-Y. Kung, M. Morf, Displacement Ranks of Matrices and Linear Equations, J. Math. Anal. Appl., 68(2), 395-407, 1979.
20. I. Gohberg, V. Olshevsky, Complexity of Multiplication with Vectors for Structured Matrices, Linear Algebra and Its Applications, 202, 163-192, 1994.
21. V. Y. Pan, Structured Matrices and Polynomials: Unified Superfast Algorithms, Birkhauser/Springer, Boston/New York, 2001.
22. V. Y. Pan, X. Wang, Inversion of Displacement Operators, SIAM Journal on Matrix Analysis and Applications, 24, 3, 660-677, 2003.
23. V. Y. Pan, Parallel Solution of Toeplitz-like Linear Systems, J. of Complexity, 8, 1-21, 1992.
24. V. Y. Pan, Concurrent Iterative Algorithm for Toepliz-like Linear Systems, IEEE Transactions on Parallel and Distributed Systems, 4, 5, 592-600, 1993.
25. V. Y. Pan, Decreasing the Displacement Rank of a Matrix, SIAM Journal on Matrix Analysis and Applications, 14, 1, 118-121, 1993.
26. V. Y. Pam, S. Branham, R. Rosholt, A. Zheng, Newton’s Iteration for Structured Matrices amd Linear Systems of Equations, SIAM volume on Fast Reliable Algorithms for Matrices with Structure (edited by T. Kailath and A. H. Sayed), 189-210, SIAM Publications, Philadelphia, 1999.
27. V. Y. Pam, Y. Rami, Newton’s Iteration for the Inversion of Structured Matrices, in Structured Matrices: Recent Developments in Theory and Computation, (edited by D. Bini, E. Tyrtyshnikov and P. Yalamov), 79-90, Nova Science Publishers, USA, 2001.
28. D. A. Bini, B. Meini, Approximate Displacement Rank and Applications, in AMS Conference –Structured Matrices in Operator Theory, Control, Signal and Image Processing—, Boulder, 1999 (edited by V. Olshevsky), American Math. Society, 215-232, Providence, RI, 2001.
29. V. Y. Pan, Y. Rami, X. Wang, Structured Matrices and Newton's Iteration: Unified Approach, Linear Algebra and Its Applications, 343-344, 233-265, 2002.
30. V. Y. Pam, M. Van Barel, X. Wang, G. Codevico, Iterative Inversion of Structured Matrices, Theoretical Computer Science, 315, 2-3 (SpecialIssue on Algebraic and Numerical Computing), 581-592, 2004.
31. R. Vamdebril, M. Van Barel, G. Golub, N. Mastronardi, A Bibliography on Semiseparable Matrices, Calcolo, 42, 3-4, 249-270, 2005.
32. D. Bini, V. Y. Pan, Improved Parallel Computations with Toeplitz-like and Hankel-like Matrices, Linear Algebra and Its Applications, 188/189, 3-29, 1993.
33. D. Bini, V. Y. Pan, Polynomial and Matrix Computations, Vol.l: Fundamental Algorithms, Birkhauser, Boston, 1994.
34. V. Y. Pan, A. Zheng, X. Huang, O. Dias, Newton’s Iteration for Inversion of Cauchy-like and Other Structured Matrices, Journal of Complexity, 13, 108-124, 1997.
35. V. Y. Pan, A Homotopic Residual Correction Process, Proc. of the Second Conference on Numerical Analysis and Applications (edited by L. Vulkov, J. Was- niewsky and P. Yalamov), Lecture Notes in Computer Science, 1988, 644-649, Springer, Berlin, 2001.
36. V. Y. Pan, M. Kunin, R. Rosholt, H. Kodal, Homotopic Residual Correction Processes, Math, of Computation, 75, 345-368, 2006.
37. V. Y. Pm, New Homotopic/Factorization and Symmetrization Techniques for Newton’s and Newton/Structured Iteration, Computer and Math, with Applications, 54, 721-729, 2007.
38. V. Y. Pan, Computations with Dense Structured Matrices, Math, of Comp., 55(191), 179-190, 1990. Proc. version in Proc. Annual ACM-SIGSAM International Symposium on Symbolic and Algebraic Computation (ISSAC’89), 34-42, ACM Press, New York, 1989.
39. I. Gohberg, T. Kailath, V. Olshevsky, Past Gaussian Blimination with Partial Pivoting for Matrices with Displacement Structure, Math, of Comp., 64(212), 1557-1576, 1995.
40. V. Y. Pan, Computations in the Null Spaces with Additive Preconditioning, Technical Report TR 2007009, CUNY Ph.D. Program in Computer Science, Graduate Center, City University of New York, April 2007. Available at http://www.es. gc.cuny.edu/tr/techreport.php?id=352
41. V. Y. Pan, G. Qian, Solving Homogeneous Linear Systems with Weakly Random Additive Preprocessing, Technical Report TR 2008009, CUNY Ph.D. Program in Computer Science, Graduate Center, the City University of New York, 2008. Available at http://www.cs.gc.cimy.edu/tr/techreport.php?id=352
42. V. Y. Pan, D. Ivolgin, B. Murphy, R. B. Rosholt, Y. Tang, X. Yan, Additive Preconditioning for Matrix Computations, Tech. Report TR 2008004, Ph.D. Program in Computer Science, Graduate Center, the City University of New York, 2008. Available at http://www.cs.gc.cuny.edu/tr/techreport.php?id=352 Proceedings version in Proc. of the Third International Computer Science Symposium in Russia (CSR 2008), Lecture Notes in Computer Science (LNCS), 5010, 372-383, 2008.
43. V. Y. Pan, X. Yan, Additive Preconditioning, Eigenspaces, and the Inverse Iteration, Linear Algebra and Its Applications, in press.
44. V. Y. Pan, D. Grady, B. Murphy, G. Qian, R. B. Rosholt, A. Ruslanov, Schur Aggregation for Linear Systems and Determinants, Theoretical Computer Science, Special Issue on Symbolic-Numerical Algorithms (D.A. Bini, V.Y. Pan, and J. Verschelde, editors), in press.
45. N. J. Higham, Functions of Matrices: Theory and Applications, SIAM, Philadelphia, 2008.