Towards a backward perturbation analysis for data least squares problems

SIAM Journal on Matrix Analysis and Applications

Volumn 30, Issue 4, 2008, Pages 1281-1301

  Chang, X W ^a   Paige, C C ^a  

^a MCGILL UNIVERSITY   (Canada)

Author keywords

Asymptotic estimate; Backward errors; Data least squares; Iterative methods; Numerical stability; Perturbation analysis; Stopping criteria

Indexed keywords

ASYMPTOTIC ESTIMATE; BACKWARD ERRORS; DATA LEAST SQUARES; NUMERICAL STABILITY; PERTURBATION ANALYSIS; STOPPING CRITERIA;

CONTROL THEORY; CONVERGENCE OF NUMERICAL METHODS; DYNAMIC LIGHT SCATTERING; DYNAMIC LOADS; ERRORS; ITERATIVE METHODS; STABILITY CRITERIA;

ASYMPTOTIC ANALYSIS;

EID: 68349126508     PISSN: 08954798     EISSN: 10957162     Source Type: Journal    
DOI: 10.1137/060668626     Document Type: Article

References (36)

1. M. Arioli, I. Duff, and D. Ruiz, Stopping criteria for iterative solvers, SIAM J.Matrix Anal. Appl., 13 (1992), pp. 138-144.
2. Å. Björck, Numerical Methods for Least Squares Problems, SIAM, Philadelphia, 1996.
3. X.-W. Chang, C. C. Paige, and D. Titley-Peloquin, Characterizing matrices that are consistent with given solutions, SIAM J. Matrix Anal. Appl., to appear.
4. A. J. Cox and N. J. Higham, Backward error bounds for constrained least squares problems, BIT, 39 (1999), pp. 210-227.
5. R. D. DeGroat and E. M. Dowling, The data least squares problem and channel equalization, IEEE Trans. Signal Process., 42 (1993), pp. 407-411.
6. G. H. Golub and G. Meurant, Matrices, moment and quadrature, in Proceedings of the 15th Dundee Conference, 1993, Longman Scientific & Technical, D. F. Griffiths and G. A.Watson, eds., 1994, pp. 105-156.
7. G. H. Golub and C. F. Van Loan, An analysis of the total least squares problem, SIAM J. Numer. Anal., 17 (1980), pp. 883-893.
8. G. H. Golub and C. F. Van Loan, Matrix Computations, 3rd ed., The Johns Hopkins University Press, Baltimore MD, 1996.
9. J. F. Grcar, Optimal Sensitivity Analysis of Linear Least Squares, Technical report LBNL- 52434, Lawrence Berkeley National Laboratory, Berkeley, CA, 2003.
10. J. F. Grcar, The optimum inverse problem of numerical error analysis, Householder Symposium XVI, Champion, PA, 2005.
11. J. F. Grcar, M. A. Saunders, and Z. Su, Estimates of Optimal Backward Perturbations for Linear Least Squares Problems, manuscript, 2004.
12. M. Gu, Backward perturbation bounds for linear least squares problems, SIAM J. Matrix Anal. Appl., 20 (1998), pp. 363-372.
13. N. J. Higham, Accuracy and Stability of Numerical Algorithms, 2nd ed., SIAM, Philadelphia, 2002.
14. D. J. Higham and N. J. Higham, Backward error and condition of structured linear systems, SIAM J. Matrix Anal. Appl., 13 (1992), pp. 162-175.
15. R. A. Horn and C. R. Johnson, Matrix Analysis, Cambridge University Press, Cambridge, UK, 1985.
16. T. Kato, Perturbation Theory for Linear Operators, 2nd ed., Springer-Verlag, New York, 1980.
17. R. Karlson and B. Waldén, Estimation backward perturbation bounds for the linear least squares problem, BIT, 37 (1997), pp. 862-869.
18. A. N. Malyshev, Optimal backward perturbation bounds for the LSS problems, BIT, 41 (2001), pp. 430-432.
19. A. N. Malyshev and M. Sadkane, Computation of optimal backward perturbation bounds for large sparse linear least squares problems, BIT, 41 (2002), pp. 739-747.
20. C. C. Paige and M. A. Saunders, LSQR: An algorithm for sparse linear equations and sparse least squares, ACM Trans. Math. Software, 8 (1982), pp. 43-71.
21. C. C. Paige and Z. Strakoš, Scaled total least squares fundamentals, Numer. Math., 91 (2002), pp. 117-146.
22. C. C. Paige and Z. Strakoš, Unifying least squares, total least squares and data least squares, in Total Least Squares and Errors-in-Variables Modeling, S. van Huffel and P. Lemmerling, eds., Kluwer Academic Publishers, Dordrecht, 2002, pp. 25-34.
23. B. D. Rao, Unified treatment of LS, TLS and truncated SVD methods using a weighted TLS framework, in Recent Advances in Total Least Squares Techniques and Errors-in-Variables Modelling, S. Van Huffel, ed., SIAM Publications, Philadelphia, 1997, pp. 11-20.
24. F. Rellich, Perturbation Theory of Eigenvalue Problems, Gordon and Breach, New York, 1969.
25. J. L. Rigal and J. Gaches, On the compatibility of a given solution with the data of a linear system, J. ACM, 14 (1967), pp. 543-548.
26. G. W. Stewart, On the perturbation of pseudo-inverses, projections, and linear least squares problems, SIAM Rev., 19 (1977), pp. 634-662.
27. Z. Su, Computational Methods for Least Squares Problems and Clinical Trials, Ph.D. thesis, Stanford University, Palo Alto, CA, 2005.
28. J.-G. Sun, Optimal backward perturbation bounds for the linear least squares problem with multiple right-hand sides, IMA J. Numer. Anal., 16 (1996), pp. 1-11.
29. J.-G. Sun, On optimal backward perturbation bounds for the linear least-squares problem, BIT, 37 (1997), pp. 179-188.
30. J.-G. Sun, Bounds for the structured backward errors of Vandermonde systems, SIAMJ.Matrix Anal. Appl., 20 (1998), pp. 45-59.
31. J.-G. Sun, A note on backward errors for structured linear systems, Numer. Linear Algebra Appl., 12 (2005), pp. 585-603.
32. J.-G. Sun and Z. Sun, Optimal backward perturbation bounds for underdetermined systems, SIAM J. Matrix Anal. Appl., 18 (1997), pp. 393-402.
33. S. Van Huffel and J. Vandewalle, The Total Least Squares Problem: Computational Aspects and Analysis, SIAM Publications, Philadelphia, 1991.
34. J. M. Varah, Backward error estimates for Toeplitz systems, SIAM J. Matrix Anal. Appl., 15 (1994), pp. 408-417.
35. B. Waldén, R. Karlson and J.-G. Sun, Optimal backward perturbation bounds for the linear least squares problem, Numer. Linear Algebra Appl., 2 (1995), pp. 271-286.
36. H. Xiang and Y. Wei, On normwise structured backward errors for saddle point systems, SIAM J. Matrix Anal. Appl., 29 (2007), pp. 838-849