Core problems in linear algebraic systems

SIAM Journal on Matrix Analysis and Applications

Volumn 27, Issue 3, 2005, Pages 861-875

  Paige, Christopher C ^a   Strakos, Zdeněk ^b  

^a MCGILL UNIVERSITY   (Canada)

^b INSTITUTE OF COMPUTER SCIENCE   (Czech Republic)

Author keywords

Bidiagonalization; Core problem; Data least squares; Ill posed problems; Least squares; Minimum 2 norm solutions; Orthogonal reduction; Orthogonal regression; Scaled total least squares; Singular value decomposition

Indexed keywords

LEAST SQUARES APPROXIMATIONS; LINEAR SYSTEMS; MATHEMATICAL MODELS; NUMBER THEORY; PROBLEM SOLVING;

BIDIAGONALIZATION; CORE PROBLEM; DATA LEAST SQUARES; ILL-POSED PROBLEMS; LEAST SQUARES; MINIMUM 2-NORM SOLUTIONS; ORTHOGONAL REDUCTION; ORTHOGONAL REGRESSION; SCALED TOTAL LEAST SQUARES; SINGULAR VALUE DECOMPOSITION;

ALGEBRA;

EID: 33746132377     PISSN: 08954798     EISSN: 10957162     Source Type: Journal    
DOI: 10.1137/040616991     Document Type: Article

References (28)

1. A. BJÖRCK, Numerical Methods for Least Squares Problems, SIAM, Philadelphia, 1996.
2. A. BJÖRCK, E. GRIMME, AND P. VAN DOOREN, An implicit shift bidiagonalization algorithm for ill-posed problems, BIT, 34 (1994), pp. 510-534.
3. L. ELDÉN, Partial least-squares us. Lanczos bidiagonalization-I: Analysis of a projection method for multiple regression, Comput. Statist. Data Anal., 46 (2004), pp. 11-31.
4. R. D. FIERRO AND J. R. BUNCH, Collinearity and total least squares, SIAM J. Matrix Anal. Appl., 15 (1994), pp. 1167-1181.
5. R. D. FIERRO AND J. R. BUNCH, Perturbation theory for orthogonal projection methods with applications to least squares and total least squares, Linear Algebra Appl., 234 (1996), pp. 71-96.
6. R. D. FIERRO, G. H. GOLUB, P. C. HANSEN, AND D. P. O'LBARY, Regularization by truncated total least squares, SIAM J. Sci. Comput., 18 (1997), pp. 1333-1241.
7. G. H. GOLUB, Some modified matrix eigenvalue problems, SIAM Rev., 15 (1973), pp. 318-334.
8. G. H. GOLUB, P. C. HANSEN, AND D. P. O'LEARY, Tikhonov regularization and total least squares, SIAM J. Matrix. Anal. Appl., 31 (1999), pp. 185-194.
9. G. H. GOLUB, A. HOFFMAN, AND G. W. STEWART, A generalization of the Eckart-Young-Mirsky matrix approximation theorem, Linear Algebra Appl., 88/89 (1987), pp. 317-337.
10. G. H. GOLUB AND C. REINSCH, Singular value decomposition and least squares solutions, Numer. Math., 14 (1970), pp. 403-420.
11. G. H. GOLUB AND C. F. VAN LOAN, An analysis of the total least squares problem, SIAM J. Numer. Anal., 17 (1980), pp. 883-893.
12. G. H. GOLUB AND C. F. VAN LOAN, Matrix Computations, 3rd ed., The Johns Hopkins University Press, Baltimore, MD, 1996.
13. R. D. D. GROAT AND E. M. DOWLING, The data least squares problem and channel equalization, IEEE Trans. Signal Process., 42 (1993), pp. 407-411.
14. M. HANKE, On Lanczos based methods for the regularization of discrete ill-posed problems, BIT, 41 (2001), pp. 1008-1018.
15. P. C. HANSEN, Rank-Deficient and Discrete Ill-Posed problems: Numerical Aspects of Linear Inversion, SIAM Monogr. Math. Model, Comput. 4, SIAM, Philadelphia, 1997.
16. P. C. HANSEN, T. SEKII, AND H. SHIBAHASHI, The modified truncated SVD method for regularization in general form, SIAM J. Sci. Statist. Comput., 13 (1992), pp. 1142-1150.
17. R. A. HORN AND C. R. JOHNSON, Topics in Matrix Analysis, Cambridge University Press, Cambridge, UK, 1991.
18. D. P. O'LEARY AND J. A. SIMMONS, A bidiagonalization-regularization procedure for large-scale discretizations of ill-posed problems, SLAM J. Sci. Statist. Comput., 2 (1981), pp. 474-489.
19. C. C. PAIGE AND M. A. SAUNDERS, LSQR: An algorithm for sparse linear equations and sparse least squares, ACM Trans. Math. Software, 8 (1982), pp. 43-71.
20. C. C. PAIGE AND Z. STRAKOŠ, Scaled total least squares fundamentals, Numer. Math., 91 (2002), pp. 117-146.
21. C. C. PAIGB AND Z. STRAKOŠ, Unifying least squares, total least squares and data least squares, In Total Least Squares and Errors-in-Variables Modeling, S. van Huffel and P. Lemmerling, eds., Kluwer Academic Publishers, Dordrecht, The Netherlands, 2002, pp. 35-34.
22. B. D. RAO, Unified treatment of LS, TLS, and truncated SVD methods using a weighted TLS framework, In Recent Advances In Total Least Squares Techniques and Errors-in-Variables Modelling, S. Van Huffel, ed., SIAM, Philadelphia, 1997, pp. 11-20.
23. A. VAN DER SLUIS, Stability of the solutions of linear least squares problems, Numer. Math., 23 (1975), pp. 341-254.
24. A. VAN DER SLUIS AND G. W. VELTKAMP, Restoring rank and consistency by orthogonal projection, Linear Algebra Appl., 28 (1979), pp. 257-278.
25. S. VAN HUFFEL AND J. VANDEWALLE, The Total Least Squares Problem: Computational Aspects and Analysis, Frontiers Appl. Math. 9, SIAM, Philadelphia, 1991.
26. J. H. WILKINSON, The Algebraic Eigenvalue Problem, Clarendon Press, Oxford, UK, 1965.
27. S. WOLD, A. RUHE, H. WOLD, AND W. J. DUNN, III, The collinearity problem in linear regression. The partial least squares (PLS) approach to generalised inverses, SIAM J. Sci. Statist. Comput., 5 (1984), pp. 735-743.
28. A. I. ZHDANOV AND O. A. KATSYUBA, Strong consistency of estimates made by the method of orthogonal projections, Internat, J. Systems 3d., 21 (1990), pp. 1463-1471.