On the solution of the tikhonov regularization of the total least squares problem

SIAM Journal on Optimization

Volumn 17, Issue 1, 2007, Pages 98-118

  Beck, Amir ^a   Ben Tal, Aharon ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Fractional programming; Nonconvex optimization; Tikhonov regularization; Total least squares; Trust region subproblem

Indexed keywords

ALGORITHMS; NUMERICAL METHODS; OPTIMIZATION; PROBLEM SOLVING;

FRACTIONAL PROGRAMMING; NONCONVEX OPTIMIZATION; TIKHONOV REGULARIZATION; TOTAL LEAST SQUARES (TLS); TRUST REGION SUBPROBLEM;

LEAST SQUARES APPROXIMATIONS;

EID: 33847101829     PISSN: 10526234     EISSN: None     Source Type: Journal    
DOI: 10.1137/050624418     Document Type: Article

References (34)

1. A. BECK, A. BEN-TAL, AND M. TEBOULLE, Finding a global optimal solution for a quadratically constrained fractional quadratic problem with applications to the regularized total least squares, SIAM J. Matrix Anal. Appl., to appear.
2. A. BEN-TAL AND M. TEBOULLE, Hidden convexity in some nonconvex quadratically constrained quadratic programming, Math. Programming, 72 (1996), pp. 51-63.
3. D. P. BERTSEKAS, Nonlinear Programming, 2nd ed., Athena Scientific, Belmont, MA, 1999.
4. A. BJÖRCK, Numerical Methods for Least Squares Problems, SIAM, Philadelphia, 1996.
5. A. R. CONN, N. I. M. GOULD, AND P. L. TOINT, Trust-Region Methods, MPS/SIAM Ser. Optim. 1, SIAM, Philadelphia, 2000.
6. W. DINKELBACH, On nonlinear fractional programming, Management Sci., 13 (1967), pp. 492-498.
7. C. FORTIN AND H. WOLKOWICZ, The trust region subproblem and semidefinite programming, Optim. Methods Softw., 19 (2004), pp. 41-67.
8. W. GANDER, G. H. GOLUB, AND U. VON MATT, A constrained eigenvalue problem, Linear Algebra Appl., 114/115 (1989), pp. 815-839.
9. J. GAUVIN AND F. DUBEAU, Differential properties of the marginal function in mathematical programming, Math. Programming Stud., 19 (1982), pp. 101-119.
10. G. H. GOLUB, P. C. HANSEN, AND D. P. O'LEARY, Tikhonov regularization and total least squares, SIAM J. Matrix Anal. Appl., 21 (1999), pp. 185-194.
11. G. H. GOLUB AND C. F. VAN LOAN, An analysis of the total least-squares problem, SIAM J. Numer. Anal., 17 (1980), pp. 883-893.
12. G. H. GOLUB AND C. F. VAN LOAN, Matrix Computations, 3rd ed., The Johns Hopkins University Press, Baltimore, MD, 1996.
13. N. I. M. GOULD, S. LUCIDI, M. ROMA, AND P. L. TOINT, Solving the trust-region subproblem using the Lanczos method, SIAM J. Optim., 9 (1999), pp. 504-525.
14. H. GUO AND R. RENAUT, A regularized total least squares algorithm, in Total Least Squares and Errors-in-Variables Modeling, Kluwer Academic Publishers, Dordrecht, The Netherlands, 2002, pp. 57-66.
15. M. HANKE AND P. C. HANSEN, Regularization methods for large-scale problems, Surveys Math. Indust., 3 (1993), pp. 253-315.
16. P. C. HANSEN AND D. P. O'LEARY, The use of the L-curve in the regularization of discrete ill-posed problems, SIAM J. Sci. Comput., 14 (1993), pp. 1487-1503.
17. P. C. HANSEN, Regularization tools: A Matlab package for analysis and solution of discrete ill-posed problems, Numer. Algorithms, 6 (1994), pp. 1-35.
18. P. C. HANSEN, Rank-Deficient and Discrete Ill-Posed Problems: Numerical Aspects of Linear Inversion, SIAM, Philadelphia, 1998.
19. S. VAN HUFFEL AND J. VANDEWALLE, The Total Least Squares Problem: Computational Aspects and Analysis, Frontiers Appl. Math. 9, SIAM, Philadelphia, PA, 1991.
20. A. K. JAIN, Fundamentals of Digital Image Processing, Prentice-Hall, Englewood Cliffs, NJ, 1989.
21. C. L. LAWSON AND R. J. HANSON, Solving least squares problems, Prentice-Hall, Englewood Cliffs, NJ, 1974.
22. O. L. MANGASARIAN, Nonlinear programming, McGraw-Hill, New York, 1969.
23. J. J. MORÉ AND D. C. SORENSEN, Computing a trust region step, SIAM J. Sci. Statist. Comput., 4 (1983), pp. 553-572.
24. R. A. RENAUT AND H. GUO, Efficient algorithms for solution of regularized total least squares, SIAM J. Matrix Anal, Appl., 26 (2005), pp. 457-476.
25. F. RENDEL AND H. WOLKOWICZ, A semidefinite framework for trust region subproblems with applications to large scale minimization, Math. Programming, 77 (1997), pp. 273-299.
26. A. SHAPIRO, Second order sensitivity analysis and asymptotic theory of parameterized nonlinear programs, Math. Programming, 33 (1985), pp. 280-299.
27. B. W. SILVERMAN, On the estimation of a probability density function by the maximum penalized likelihood method, Ann. Statist., 10 (1982), pp. 795-810.
28. D. SIMA, S. VAN HUFFEL, AND G. H. GOLUB, Regularized total least squares based on quadratic eigenvalue problem solvers, BIT, 44 (2004), pp. 793-812.
29. D. C. SORENSEN, Minimization of a large-scale quadratic function subject to a spherical constraint, SIAM J. Optim., 7 (1997), pp. 141-161.
30. T. STEIHAUG, The conjugate gradient method and trust regions in large scale optimization, SIAM J. Numer. Anal., 20 (1983), pp. 626-637.
31. R. J. STERN AND H. WOLKOWICZ, Indefinite trust region subproblems and nonsymmetric eigen-value perturbations, SIAM J. Optim., 5 (1995), pp. 286-313.
32. P. D. TAO AND L. T. H. AN, A D.C. optimization algorithm for solving the trust-region subproblem, SIAM J. Optim., 8 (1998), pp. 476-505.
33. A. N. TIKHONOV AND V. Y. ARSENIN, Solution of Ill-Posed Problems, V.H. Winston, Washington, DC, 1977.
34. F. ZHANG, Matrix Theory, Springer, New York, 1999.