Quasi-Newton bundle-type methods for nondifferentiable convex optimization

SIAM Journal on Optimization

Volumn 8, Issue 2, 1998, Pages 583-603

  Mifflin, Robert ^a   Sun, Defeng ^b,c   Qi, Liqun ^b  

^a WASHINGTON STATE UNIVERSITY   (United States)

^b UNIVERSITY OF NEW SOUTH WALES   (Australia)

^c INSTITUTE OF APPLIED MATHEMATICS   (China)

Author keywords

Bundle method; Moreau Yosida regularization; Quasi Newton method; Superlinear convergence

Indexed keywords

EID: 0032222087     PISSN: 10526234     EISSN: None     Source Type: Journal    
DOI: 10.1137/S1052623496303329     Document Type: Article

References (27)

1. J. F. BONNANS, J. CH. GILBERT, C. LEMARÉCHAL, AND C. A. SAGASTIZÁBAL, A family of variable metric proximal methods, Math. Programming, 68 (1995), pp. 15-47.
2. R. H. BYRD, D. C. LIU, AND J. NOCEDAL, On the behavior of Broyden's class of quasi-Newton methods, SIAM J. Optim., 2 (1992), pp. 533-557.
3. R. H. BYRD AND J. NOCEDAL, A tool for the analysis of quasi-Newton methods with application to unconstrained minimization, SIAM J. Numer. Anal., 26 (1989), pp. 727-739.
4. R. H. BYRD, J. NOCEDAL, AND Y. YUAN, Global convergence of a class of quasi-Newton methods on convex problems, SIAM J. Numer. Anal., 24 (1987), pp. 1171-1189.
5. J. V. BURKE AND M. QIAN, A variable metric proximal point algorithm for monotone operators, SIAM J. Optim., to appear.
6. J. V. BURKE AND M. QIAN, On the superlinear convergence of the variable metric proximal point algorithm using Broyden and BFGS matrix secant updating, Math. Programming, 1998, submitted.
7. X. CHEN AND M. FUKUSHIMA, Proximal Quasi-Newton Methods for Nondifferentiable Convex Optimization, Applied Mathematics report 95/32, School of Mathematics, The University of New South Wales, Sydney, Australia, 1995.
8. R. CORREA AND C. LEMARÉCHAL, Convergence of some algorithms for convex optimization, Math. Programming, 62 (1993), pp. 261-275.
9. J. E. DENNIS AND J. J. MORÉ, Quasi-Newton methods, motivation and theory, SIAM Rev., 19(1977), pp. 46-89.
10. U. FELGENHAUER, On the stable global convergence of particular quasi-Newton methods, Optimization, 26 (1992), pp. 97-113.
11. M. FUKUSHIMA, A descent algorithm for nonsmooth convex optimization, Math. Programming, 30 (1984), pp. 163-175.
12. M. FUKUSHIMA AND L. QI, A globally and superlinearly convergent algorithm for nonsmooth convex minimization, SIAM J. Optim., 6 (1996), pp. 1106-1120.
13. J. B. HIRIART-URRUTY AND C. LEMARÉCHAL, Convex Analysis and Minimization Algorithms, vols. 1 and 2, Springer-Verlag, Berlin, Heidelberg, New York, 1993.
14. C. -M. IP AND J. KYPARISIS, Local convergence of quasi-Newton methods for B-differentiable equations, Math. Programming, 56 (1992), pp. 71-89.
15. K. C. KIWIEL, Proximal control in bundle methods for convex nondifferentiable minimization, Math. Programming, 46 (1990), pp. 105-122.
16. C. LEMARÉCHAL AND C. SAGASTIZABAL, An approach to variable metric methods, in Systems Modelling and Optimization, in Lecture Notes in Control and Inform. Sci. 197, J. Henry and J. -P. Yvon, eds., Springer-Verlag, Berlin, 1994.
17. C. LEMARÉCHAL AND C. SAGASTIZÁBAL, Practical aspects of the Moreau-Yosida regularization I: Theoretical preliminaries, SIAM J. Optim., 7 (1997), pp. 367-385.
18. R. MIFFLIN, A quasi-second-order proximal bundle algorithm, Math. Programming, 73 (1996), pp. 51-72.
19. J. J. MOREAU, Proximite et dualite dans un espace hilbertien, Bull. Soc. Math. France, 93 (1965), pp. 273-299.
20. J. -S. PANG, Newton's method for B-differentiable equations, Math. Oper. Res., 15 (1990), pp. 311-341.
21. M. J. D. POWELL, Some global convergence properties of a variable metric algorithm for minimization without exact line searches, in Non-Linear Programming, R. W. Cottle and C. E. Lemke, eds., SIAM-AMS Proceedings 9, AMS, Provindence, RI, 1976.
22. L. QI, Convergence analysis of some algorithms for solving nonsmooth equations, Math. Oper. Res., 18 (1993), pp. 227-244.
23. L. QI, Second-order analysis of the Moreau-Yosida regularization of a convex function, Applied Mathematics report 94/20, revised version, School of Mathematics, The University of New South Wales, Sydney, Australia, 1995.
24. L. QI, On superlinear convergence of quasi-Newton methods for nonsmooth equations, Oper. Res. Lett., 20 (1997), pp. 223-228.
25. R. T. ROCKAFELLAR, Convex Analysis, Princeton University Press, Princeton, NJ, 1970.
26. R. T. ROCKAFELLAR, Maximal monotone relations and the second derivatives of nonsmooth functions, Ann. Inst. H. Poincaré Anal. Non Linéaire, 2 (1985), pp. 167-186.
27. K. YOSIDA, Functional Analysis, Springer-Verlag, Berlin, 1964.