Algebraic rules for quadratic regularization of Newton’s method

Computational Optimization and Applications

Volumn 60, Issue 2, 2015, Pages 343-376

  Karas, Elizabeth W ^a   Santos, Sandra A ^b   Svaiter, Benar F ^c  

^a FEDERAL UNIVERSITY OF PARANÁ   (Brazil)

^b UNIVERSITY OF CAMPINAS   (Brazil)

^c IMPA   (Brazil)

Author keywords

Computational results; Global convergence; Local convergence; Newton s method; Regularization; Smooth unconstrained minimization

Indexed keywords

NEWTON-RAPHSON METHOD;

COMPUTATIONAL RESULTS; GLOBAL CONVER-GENCE; LOCAL CONVERGENCE; REGULARIZATION; S-METHOD; UNCONSTRAINED MINIMIZATION;

ALGEBRA;

EID: 84924222053     PISSN: 09266003     EISSN: 15732894     Source Type: Journal    
DOI: 10.1007/s10589-014-9671-y     Document Type: Article

References (25)

1. Birgin, E.G., Gentil, J.M.: Evaluating bound-constrained minimization software. Comput. Optim. Appl. 53(2), 347–373 (2012)
2. Cartis, C., Gould, N.I.M., Toint, Ph.L.: Evaluation complexity of adaptive cubic regularization methods for convex unconstrained optimization. Optim. Methods Softw. 27(2), 197–219 (2012)
3. Cartis, C., Gould, N.I.M., Toint, Ph.L.: Adaptive cubic regularisation methods for unconstrained optimization. Part I: motivation, convergence and numerical results. Math. Program. 127(2), 245–295 (2011)
4. Cartis, C., Gould, N.I.M., Toint, Ph.L.: Adaptive cubic regularisation methods for unconstrained optimization. Part II: worst-case function- and derivative-evaluation complexity. Math. Program. 130(2), 295–319 (2011)
5. Cartis, C., Gould, N.I.M., Toint, Ph.L.: An adaptive cubic regularization algorithm for nonconvex optimization with convex constraints and its function-evaluation complexity. IMA J. Numer. Anal. 32(4), 1662–1695 (2012)
6. Conn, A.R., Gould, N.I.M., Toint, Ph.L.: Trust-Region Methods. MPS/SIAM Series on Optimization. SIAM, Philadelphia, PA (2000)
7. Dennis, J.E., Schnabel, R.B.: Numerical Methods for Unconstrained Optimization and Nonlinear Equations, Classics in Applied Mathematics. SIAM, Philadelphia, PA (1996). (Corrected reprint of the 1983 original)
8. Fletcher, R.: Practical Methods of Optimization, 2nd edn. John Wiley, Chichester (1987)
9. Fuentes, M., Malick, J., Lemaréchal, C.: Descentwise inexact proximal algorithms for smooth optimization. Comput. Optim. Appl. 53(3), 755–769 (2012)
10. Gill, P.E., Murray, W., Wright, R.H.: Practical Optimization. Academic Press Inc., San Diego (1981)
11. Goldfeld, S.M., Quandt, R.E., Trotter, H.F.: Maximization by quadratic hill-climbing. Econometrica 34, 541–551 (1966)
12. Gould, N.I.M., Porcelli, M., Toint, Ph.L.: Updating the regularization parameter in the adaptive cubic regularization algorithm. Comput. Optim. Appl. 53(1), 1–22 (2012)
13. Griewank, A.: The modification of Newton’s method for unconstrained optimization by bounding cubic terms. Technical Report NA/12, Department of Applied Mathematics and Theoretical Physics, University of Cambridge (1981)
14. Hager, W.W., Zhang, H.: Self-adaptive inexact proximal point methods. Comput. Optim. Appl. 39(2), 161–181 (2008)
15. Hebden, M. D.: An algorithm for minimization using exact second derivatives. Technical Report T.P. 515, AERE Harwell Laboratory, Harwell, Oxfordshire (1973)
16. Lehoucq, R.B., Sorensen, D.C., Yang, C.: ARPACK Users Guide, Software, Environments, and Tools. SIAM, Philadelphia, PA (1998)
17. Levenberg, K.: A method for the solution of certain non-linear problems in least squares. Quart. Appl. Math. 2, 164–168 (1944)
18. Martinet, B.: Régularisation d’inéquations variationnelles par approximations successives. Rev. Française Info Recherche Opérationnelle, 4:154–158 (1970)
19. Moré, J. J.: Recent developments in algorithms and software for trust region methods. In: Proceedings of the Mathematical programming: the state of the art (Bonn, 1982), pp. 258–287. Springer, Berlin (1983)
20. Nesterov, Y., Polyak, B. T.: Cubic regularization of Newton method and its global performance. Math. Program. 108(1):177–205 (2006)
21. Nocedal, J., Wright, S.J.: Numerical Optimization. Operations Research and Financial Engineering, 2nd edn. Springer, New York (2006)
22. Schnabel, R.B., Koontz, J.E., Weiss, B.E.: A modular system of algorithms for unconstrained minimization. ACM Trans. Math. Softw. 11(4), 419–440 (1985)
23. Tikhonov, A. N.: On the stability of inverse problems (39, pp. 176–179). C. R. (Doklady) Acad. Sci. URSS (N.S), Moscow (1943)
24. Tukey, J.W.: Exploratory Data Analysis. Behavioral Science: Quantitative Methods. Addison-Wesley Publishing Company, Reading, MA (1977)
25. Weiser, M., Deuflhard, P., Erdmann, B.: Affine conjugate adaptive Newton methods for nonlinear elastomechanics. Optim. Methods Softw. 22(3), 413–431 (2007)