On the complexity of the hybrid proximal extragradient method for the iterates and the ergodic mean

SIAM Journal on Optimization

Volumn 20, Issue 6, 2010, Pages 2755-2787

  Monteiro, Renato D C ^a   Svaiter, B F ^b  

^a Georgia Institute of Technology   (United States)

^b IMPA   (Brazil)

Author keywords

Complementarity problems; Complexity; Extragradient; Korpelevich and Newton methods; Maximal monotone operator; Variational inequality

Indexed keywords

COMPLEMENTARITY PROBLEMS; COMPLEXITY; EXTRAGRADIENT; MAXIMAL MONOTONE OPERATORS; NEWTON METHODS; VARIATIONAL INEQUALITIES;

NEWTON-RAPHSON METHOD; VARIATIONAL TECHNIQUES;

MATHEMATICAL OPERATORS;

EID: 79251488812     PISSN: 10526234     EISSN: None     Source Type: Journal    
DOI: 10.1137/090753127     Document Type: Article

References (27)

1. R. E. Bruck, Jr., On the weak convergence of an ergodic iteration for the solution of variational inequalities for monotone operators in Hilbert space, J. Math. Anal. Appl., 61 (1977), pp. 159-164.
2. R. S. Burachik, A. N. Iusem, and B. F. Svaiter, Enlargement of monotone operators with applications to variational inequalities, Set-Valued Anal., 5 (1997), pp. 159-180.
3. R. S. Burachik, C. A. Sagastizábal, and B. F. Svaiter, ε-enlargements of maximal monotone operators: Theory and applications, in Reformulation: Nonsmooth, Piecewise Smooth, Semismooth and Smoothing Methods (Lausanne, 1997), Appl. Optim. 22, Kluwer Academic Publishers, Dordrecht, The Netherlands 1999, pp. 25-43.
4. R. S. Burachik and B. F. Svaiter, ε-enlargements of maximal monotone operators in Banach spaces, Set-Valued Anal., 7 (1999), pp. 117-132.
5. F. Facchinei and J.-S. Pang, Finite-Dimensional Variational Inequalities and Complementarity Problems, Vol. II, Springer-Verlag, New York, 2003.
6. E. G. Goĺshteǐn, A method for solving variational inequalities defined by monotone mappings, Zh. Vychisl. Mat. Mat. Fiz., 42 (2002), pp. 958-968.
7. E. G. Golshtein and N. V. Tretyakov, Modified Lagrangians and Monotone Maps in Optimization, Wiley-Intersci. Ser. Discrete Math. Optim., John Wiley & Sons, New York, 1996 (translated from the 1989 Russian original by Tretyakov).
8. I. V. Konnov, Combined relaxation methods for the search for equilibrium points and solutions of related problems, Izv. Vyssh. Uchebn. Zaved. Mat., (1993), pp. 46-53.
9. I. V. Konnov, A class of combined iterative methods for solving variational inequalities, J.Optim. Theory Appl., 94 (1997), pp. 677-693.
10. I. V. Konnov, Combined relaxation methods for generalized monotone variational inequalities, in Generalized Convexity and Related Topics, Lecture Notes in Econom. and Math. Systems 583, Springer-Verlag, Berlin, 2007, pp. 3-31.
11. G. M. Korpelevič, An extragradient method for finding saddle points and for other problems, Èkonom. i Mat. Metody, 12 (1976), pp. 747-756.
12. C. Lemaréchal, A. Nemirovskii, and Y. Nesterov, New variants of bundle methods, Math. Program., 69 (1995), pp. 111-147
13. P.-L. Lions, Une méthode itérative de résolution d'une inéquation variationnelle, Israel J. Math., 31 (1978), pp. 204-208.
14. T. L. Magnanti and G. Perakis, A unifying geometric solution framework and complexity analysis for variational inequalities, Math. Program., 71 (1995), pp. 327-351.
15. A. Nemirovski, Prox-method with rate of convergence O(1/t) for variational inequalities with Lipschitz continuous monotone operators and smooth convex-concave saddle point problems, SIAM J. Optim., 15 (2004), pp. 229-251.
16. A. S. Nemirovskiǐ, Effective iterative methods for solving equations with monotone operators, Èkonom. i Mat. Metody, 17 (1981), pp. 344-359.
17. A. S. Nemirovskiǐ and D. B. Judin, Cesàro convergence of the gradient method for the approximation of saddle points of convex-concave functions, Dokl. Akad. Nauk SSSR, 239 (1978), pp. 1056-1059.
18. Y. Nesterov, Dual extrapolation and its applications to solving variational inequalities and related problems, Math. Program., 109 (2007), pp. 319-344.
19. Y. E. Nesterov, Smooth minimization of nonsmooth functions, Math. Program., 103 (2005), pp. 127-152.
20. R. T. Rockafellar, On the maximal monotonicity of subdifferential mappings, Pacific J. Math., 33 (1970), pp. 209-216.
21. R. Tyrrell Rockafellar, Monotone operators and the proximal point algorithm, SIAM J. Control Optim., 14 (1976), pp. 877-898.
22. M. V. Solodov and B. F. Svaiter, A hybrid approximate extragradient-proximal point algorithm using the enlargement of a maximal monotone operator, Set-Valued Anal., 7 (1999), pp. 323-345.
23. M. V. Solodov and B. F. Svaiter, A hybrid projection-proximal point algorithm, J. Convex Anal., 6 (1999), pp. 59-70.
24. M. V. Solodov and B. F. Svaiter, An inexact hybrid generalized proximal point algorithm and some new results on the theory of Bregman functions, Math. Oper. Res., 25 (2000), pp. 214-230.
25. M. V. Solodov and B. F. Svaiter, A unified framework for some inexact proximal point algorithms, Numer. Funct. Anal. Optim., 22 (2001), pp. 1013-1035.
26. P. Tseng, On linear convergence of iterative methods for the variational inequality problem, J. Comput. Appl. Math., 60 (1995), pp. 237-252.
27. P. Tseng, A modified forward-backward splitting method for maximal monotone mappings, SIAM J. Control Optim., 38 (2000), pp. 431-446.