Modified forward-backward splitting method for maximal monotone mappings

SIAM Journal on Control and Optimization

Volumn 38, Issue 2, 2000, Pages 431-446

  Tseng, Paul ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL GEOMETRY; CONVERGENCE OF NUMERICAL METHODS; ITERATIVE METHODS; MATHEMATICAL PROGRAMMING;

FORWARD-BACKWARD SPLITTING METHODS; MAXIMAL MONOTONE MAPPING; VARIATIONAL INEQUALITY;

POLES AND ZEROS;

EID: 0033884548     PISSN: 03630129     EISSN: None     Source Type: Journal    
DOI: 10.1137/S0363012998338806     Document Type: Article

References (63)

1. D. P. BERTSEKAS, Constrained Optimization and Lagrange Multiplier Methods, Academic Press, New York, 1982.
2. D. P. BERTSEKAS AND E. M. GAFNI, Projection methods for variational inequalities with application to the traffic assignment problem. Math. Programming Stud., 17 (1982). pp. 139-159.
3. L. M. BREGMAN, The method of successive projection for finding a common point of convex sets, Akad. Nauk SSSR Doklady, 162 (1965), pp. 487-490; English translation in Soviet Math. Doklady, 162 (1965), pp. 688-692.
4. L. M. BREGMAN, The method of successive projection for finding a common point of convex sets, Akad. Nauk SSSR Doklady, 162 (1965), pp. 487-490; English translation in Soviet Math. Doklady, 162 (1965), pp. 688-692.
5. H. BRÉZIS, Opérateurs Maximaux Monotones, North-Holland, Amsterdam, 1973.
6. H.-G. CHEN, Forward-Backward Splitting Techniques: Theory and Applications, Ph.D. thesis, Department of Applied Mathematics, University of Washington, Seattle. WA, 1994.
7. H.-G. CHEN AND R. T. ROCKAFELLAR, Convergence rates in forward-backward splitting, SIAM J. Optim., 7 (1997), pp. 421-444.
8. G. CHEN AND M. TEBOULLE, A proximal-based decomposition method for convex minimization problems, Math. Programming, 64 (1994), pp. 81-101.
9. J. ECKSTEIN AND D. P. BERTSEKAS, On the Douglas-Rachford splitting method and the proximal point algorithm for maximal monotone operators, Math. Programming, 55 (1992), pp. 293-318.
10. J. ECKSTEIN AND M. C. FERRIS, Operator-splitting methods for monotone affine variational inequalities, with a parallel application to optimal control, INFORMS J. Comput., 10 (1998), pp. 218-235.
11. J. ECKSTEIN AND M. FUKUSHIMA, Some reformulations and applications of the alternating direction method of multipliers, in Large Scale Optimization: State of the Art, W. W. Hager, D. W. Hearn, and P. M. Pardalos, eds., Kluwer Academic Publishers, Dordrecht, The Netherlands, 1994, pp. 115-134.
12. M. FORTIN AND R. GLOWINSKI, EDS., Augmented Lagrangian Methods: Applications to the Numerical Solution of Boundary Value Problems, North-Holland, Amsterdam, 1983.
13. D. GABAY, Méthods Numériques pour l'Optimisation Nonlinéaire, Thésis de Doctorat d'Etat et Science Mathématiques, Université Pierre et Marie Curie, Paris, 1979.
14. D. GABAY, Applications of the method of multipliers to variational inequalities, in Augmented Lagrangian Methods: Applications to the Numerical Solution of Boundary Value Problems, M. Fortin and R. Glowinski, eds., North-Holland, Amsterdam, 1983, pp. 299-331.
15. R. GLOWINSKI AND P. LE TALLEC, Augmented Lagrangian and Operator-Splitting Methods in Nonlinear Mechanics, SIAM Stud. Appl. Math. 9, SIAM, Philadelphia, PA, 1989.
16. O. GÜLER, On the convergence of the proximal point algorithm for convex minimization, SIAM J. Control Optim., 29 (1991), pp. 403-419.
17. S. P. HAN AND G. Lou, A parallel algorithm for a class of convex programs, SIAM J. Control Optim., 26 (1988), pp. 345-355.
18. A. N. IUSEM, An iterative algorithm for the variational inequality problem, Mat. Apl. Comput., 13 (1994), pp. 103-114.
19. K. C. KIWIEL, Proximal minimization methods with generalized Bregman functions, SIAM J. Control Optim., 35 (1997), pp. 1142-1168.
20. G. M. KORPELEVICH, The extragradient method for finding saddle points and other problems, Matecon, 12 (1976), pp. 747-756.
21. B. LEMAIRE, Coupling optimization methods and variational convergence, in Trends in Mathematical Optimization, K.-H. Hoffman, J.-B. Hiriart-Urruty, J. Zowe, and C. Lemarechal. eds., Birkhäuser-Verlag, Basel, 1988, pp. 163-179.
22. B. LEMAIRE, The proximal algorithm, in New Methods in Optimization and Their Industrial Uses, Internat. Series Numer. Math. 87, Birkhäuser, Basel, Boston, 1989, pp. 73-87.
23. P. L. LIONS AND B. MERCIER, Splitting algorithms for the sum of two nonlinear operators, SIAM J. Numer. Anal., 16 (1979), pp. 964-979.
24. Z.-Q. Luo AND P. TSENG, Error bounds and convergence analysis of feasible descent methods: A general approach, Ann. Oper. Res., 46/47 (1993), pp. 157-178.
25. X.-D. LUO AND P. TSENG, On a global projection-type error bound for the linear complementarity problem, Linear Algebra Appl., 253 (1997), pp. 251-278.
26. T. L. MAGNANTI AND G. PERAKIS, The orthogonality theorem and the strong-f-monotonicity condition for variational inequality algorithms. SIAM J. Optim., 7 (1997), pp. 248-273.
27. P. MARCOTTE, Application of Khobotov's algorithm to variational inequalities and network equilibrium problems, Inform. Systems Oper. Res., 29 (1991), pp. 258-270.
28. B. MARTINET, Regularisation d'inéquations variationelles par approximations successives, Rev. Française Informat. Recherche Opérationnelle, 4 (1970), pp. 154-158.
29. B. MARTINET, Determination approchée d'un point fixe d'une application pseudo-contractante, C. R. Acad. Sci. Paris Ser. A-B, 274 (1972). pp. 163-165.
30. B. MERCIER, Lectures on Topics in Finite Element Solution of Elliptic Problems, Lectures on Mathematics 63, Tata Institute of Fundamental Research. Bombay, 1979.
31. B. MERCIER, Inéquations Variationnelles de la Mécanique, Publ. Math. Orsay, 80.01, Université de Paris-Sud, Orsay, 1980.
32. G. J. MINTY, On the maximal domain of a "monotone" function, Michigan Math. J., 8 (1961). pp. 135-137.
33. G. J. MINTY, Monotone (nonlinear) operators in Hilbert space, Duke Math. J., 29 (1962), pp. 341-346.
34. K. MOUALLIF, V. H. NGUYEN, AND J.-J. STRODIOT, A perturbed parallel decomposition method for a class of nonsmooth convex minimization problems, SIAM J. Control Optim., 29 (1991), pp. 829-847.
35. A. MOUDAFI AND M. THÉRA, Finding a zero of the sum of two maximal monotone operators, J. Optim. Theory Appl., 94 (1997), pp. 425-448.
36. J.-S. PANG, A posteriori error bounds for the linearly-constrained variational inequality problem, Math. Oper. Res., 12 (1987), pp. 474-484.
37. D. PASCALI AND S. SBURLAN, Nonlinear Mappings of Monotone Type, Editura Academiei, Bucharest, 1978.
38. G. B. PASSTY, Ergodic convergence to a zero of the sum of monotone operators in Hilbert space, J. Math. Anal. Appl., 72 (1979), pp. 383-390.
39. R. R. PHELPS. Convex Functions, Monotone Operators and Differentiability, Springer-Verlag, New York, 1989.
40. A. RENAUD AND G. COHEN, Conditioning and regularization of nonsymmetric operators, J. Optim. Theory Appl., 92 (1997), pp. 127-148.
41. S. M. ROBINSON. Some continuity properties of polyhedral multifunctions, Math. Programming Stud., 14 (1981), pp. 206-214.
42. R. T. ROCKAFELLAR, Local boundedness of nonlinear monotone operators. Michigan Math. J., 16 (1969), pp. 397-407.
43. R. T. ROCKAFELLAR, On the maximality of sums of nonlinear monotone operators, Trans. Amer. Math. Soc., 149 (1970), pp. 75-88.
44. R. T. ROCKAFELLAR, Convex Analysis, Princeton University Press, Princeton, NJ. 1970.
45. R. T. ROCKAFELLAR, Monotone operators and the proximal point algorithm, SIAM J. Control Optim., 14 (1976), pp. 877-898.
46. R. T. ROCKAFELLAR, Augmented Lagrangians and applications of the proximal point algorithm in convex programming. Math. Oper. Res., 1 (1976), pp. 97-116.
47. R. T. ROCKAFELLAR AND R. J.-B. WETS. Generalized linear-quadratic problems of deterministic and stochastic optimal control in discrete time, SIAM J. Control Optim., 28 (1990). pp. 810-822.
48. R. T. ROCKAFELLAR, Variational Analysis, Springer-Verlag, Berlin. 1998.
49. D. SALINGER, A Splitting Algorithm for Multistage Stochastic Programming with Application to Hydropower Scheduling, Ph.D. thesis, Department of Applied Mathematics, University of Washington, Seattle, WA, 1990.
50. M. SIBONY, Méthodes itératives pour les équations et inéquations aux dérivées partielles nonlinéares de type monotone, Calcolo, 7 (1970), pp. 65-183.
51. M. V. SOLODOV AND B. F. SVAITER, A hybrid projection-roximal, point algorithm, J. Convex Anal., 6 (1999), pp. 59-70.
52. M. V. SOLODOV AND B. F. SVAITER, A Hybrid Approximate Extragradient-Proximal Point Algorithm Using the Enlargement of a Maximal Monotone Operator, Report, Institute de Matemática Pura e Aplicada, Rio de Janeiro, 1998; Set-Valued Anal., to appear.
53. M. V. SOLODOV AND B. F. SVAITER, A Hybrid Approximate Extragradient-Proximal Point Algorithm Using the Enlargement of a Maximal Monotone Operator, Report, Institute de Matemática Pura e Aplicada, Rio de Janeiro, 1998; Set-Valued Anal., to appear.
54. M. V. SOLODOV AND P. TSENG, Modified projection-type methods for monotone variational inequalities, SIAM J. Control Optim., 34 (1996), pp. 1814-1830.
55. J. E. SPINGARN, Applications of the method of partial inverses to convex programming decomposition. Math. Programming, 32 (1985). pp. 199-223.
56. D. SUN, A new step-size skill for solving a class of nonlinear projection equations. J. Comput. Math., 13 (1995), pp. 357-368.
57. D. SUN, A class of iterative methods for solving nonlinear projection equations, J. Optim. Theory Appl., 91 (1996), pp. 123-140.
58. P. TSENG, Further applications of a splitting algorithm to decomposition in variational inequalities and convex programming, Math. Programming, 48 (1990), pp. 249-263.
59. P. TSENG, Applications of a splitting algorithm to decomposition in convex programming and variational inequalities, SIAM J. Control Optim., 29 (1991), pp. 119-138.
60. P. TSENG, On linear convergence of iterative methods for the variational inequality problem, J. Comput. Appl. Math., 60 (1995). pp. 237-252.
61. P. TSENG, Alternating projection-proximal methods for convex programming and variational inequalities, SIAM J. Optim., 7 (1997), pp. 951-965.
62. E. H. ZARANTONELLO, Projections on convex sets in Hubert space and spectral theory, in Contributions to Nonlinear Functional Analysis. E. H. Zarantonello, ed., Academic Press, New York, 1971, pp. 237-424.
63. E. ZEIDLER, Nonlinear Functional Analysis and Its Applications: Nonlinear Monotone Operators, II/B, Springer-Verlag, New York. 1990.