A proximal-projection method for finding zeros of set-valued operators

SIAM Journal on Control and Optimization

Volumn 47, Issue 4, 2008, Pages 2096-2136

  Butnariu, Dan ^a   Kassay, Gábor ^a  

^a BABE BOLYAI UNIVERSITY   (Romania)

Author keywords

Bregman distance; Bregman projection; D f nonexpansivity pole; D f resolvent; Df antiresolvent; Df firm operator; Df inverse strongly monotone operator; Df nonexpansive operator

Indexed keywords

BANACH SPACES; CONVEX OPTIMIZATION; VARIATIONAL TECHNIQUES;

BREGMAN DISTANCES; BREGMAN PROJECTION; DF-ANTIRESOLVENT; DF-FIRM OPERATOR; DF-RESOLVENT; INVERSE-STRONGLY MONOTONE OPERATORS; NONEXPANSIVE;

ITERATIVE METHODS;

EID: 55549108063     PISSN: 03630129     EISSN: None     Source Type: Journal    
DOI: 10.1137/070682071     Document Type: Article

References (78)

1. Y. I. ALBER, Generalized projection operators in Banach spaces: Properties and applications, in Functional-Differential Equations, M. E. Draklin and E. Litsyn, eds., Differential Equations Israel Sem. 1, Coll. Judea Samaria, Ariel, 1993, pp. 1-21.
2. Y. I. ALBER, Metric and generalized projection operators in Banach spaces: Properties and applications, in Theory and Applications of Nonlinear Operators of Accretive and Monotone Type, A. G. Kartsatos, ed., Lecture Notes in Pure and Appl. Math. 178, Marcel Dekker, New York, 1996, pp. 15-50.
3. Y. I. ALBER, Generalized projections, decompositions, and the Pythagorean-type theorem in Banach spaces, Appl. Math. Lett., 11 (1998), pp. 115-121.
4. Y. I. ALBER, Stability of the proximal projection algorithm for nonsmooth convex optimization problems with perturbed constraint sets, J. Nonlinear Convex Anal., 4 (2003), pp. 1-14.
5. Y. I. ALBER AND D. BUTNARIU, Convergence of Bregman projection methods for solving consistent convex feasibility problems in reflexive Banach spaces, J. Optim. Theory Appl., 92 (1997), pp. 33-61.
6. Y. I. ALBER, D. BUTNARIU, AND G. KASSAY, On the convergence and stability of a regularization method for maximal monotone inclusions and its applications to convex optimization, in Variational Inequalities and Applications, F. Giannessi and G. Maugeri, eds., Springer-Verlag, New York, 2005, pp. 89-132.
7. Y. I. ALBER, D. BUTNARIU, AND I. RYAZANTSEVA, Regularization methods for ill-posed inclusions and variational inequalities with domain perturbations, J. Nonlinear Convex Anal., 2 (2001), pp. 53-79.
8. Y. I. ALBER, D. BUTNARIU, AND I. RYAZANTSEVA, Regularization of monotone variational inequalities with Mosco approximations of the constraint sets, Set-Valued Anal., 13 (2005), pp. 265-290.
9. Y. I. ALBER, D. BUTNARIU, AND I. RYAZANTSEVA, Regularization and resolution of monotone variational inequalities with operators given by hypomonotone approximations, J. Nonlinear Convex Anal., 6 (2005), pp. 23-53.
10. Y. I. ALBER AND S. GUERRE-DELABRIERE, On the projection method for fixed point problems, Analysis (Munich), 21 (2001), pp. 17-39.
11. Y. I. ALBER, A. N. IUSEM, A. N. SOLODIV, AND M. V. SOLODOV, Minimization of nonsmooth convex functionals in Banach spaces, J. Convex Anal., 4 (1997), pp. 235-255.
12. Y. I. ALBER, A. G. KARTSATOS, AND E. LITSYN, Iterative solutions of unstable variational inequalities on approximately given sets, Abstr. Appl. Anal., 1 (1996), pp. 45-54.
13. Y. I. ALBER AND Z. M. NASHED, Iterative-projection regularization of ill-posed variational inequalities, Analysis (Munich), 24 (2004), pp. 19-39.
14. Y. I. ALBER AND S. REICH, An iterative method for solving a class of nonlinear operator equations in Banach spaces, Panamer. Math. J., 4 (1994), pp. 39-54.
15. H. ATTOUCH, Variational Convergence for Functions and Operators, Pitman, Boston, 1984.
16. J. P. AUBIN AND H. FRANKOWSKA, Set-Valued Analysis, Birkhäuser, Boston, 1990.
17. A. B. BAKUSHINSKII AND B. T. POLJAK, On the solution of variational inequalities, Soviet Math. Dokl., 15 (1974), pp. 1705-1710.
18. H. H. BAUSCHKE AND J. M. BORWEIN, On projection algorithms for solving convex feasibility problems, SIAM Rev., 38 (1996), pp. 367-426.
19. H. H. BAUSCHKE AND J. M. BORWEIN, Legendre functions and the method of random Bregman projections, J. Convex Anal., 4 (1997), pp. 27-67.
20. H. H. BAUSCHKE, J. M. BORWEIN, AND P. L. COMBETTES, Essential smoothness, essential strict convexity, and Legendre functions in Banach spaces, Commun. Contemp. Math., 3 (2001), pp. 615-647.
21. H. H. BAUSCHKE, J. M. BORWEIN, AND P. L. COMBETTES, Bregman monotone optimization algorithms, SIAM J. Control Optim., 42 (2003), pp. 596-636.
22. H. H. BAUSCHKE AND P. L. COMBETTES, Construction of best Bregman approximations in reflexive Banach spaces, Proc. Amer. Math. Soc., 131 (2003), pp. 3757-3766.
23. H. H. BAUSCHKE, P. L. COMBETTES, AND D. NOLL, Joint minimization with alternating Bregman proximity operators, Pac. J. Optim., 2 (2006), pp. 401-424.
24. L. M. BREGMAN, The relaxation method for finding common points of convex sets and its application to the solution of problems in convex programming, Comput. Math. Math. Phys., 7 (1967), pp. 200-217.
25. J. F. BONNANS AND A. SHAPIRO, Perturbation Analysis of Optimization Problems, Springer-Verlag, New York, 2000.
26. J. M. BORWEIN AND Q. J. ZHU, Techniques of Variational Analysis, Springer, New York, 2005.
27. F. E. BROWDER, Multivalued monotone nonlinear mappings and duality mappings in Banach spaces, Trans. Amer. Math. Soc., 118 (1965), pp. 338-351.
28. F. E. BROWDER, Existence and approximation of solutions of nonlinear variational inequalities, Proc. Nat. Acad. Sci. U.S.A., 56 (1966), pp. 1080-1086.
29. F. E. BROWDER, Nonlinear operators and nonlinear equations of evolution in Banach spaces, in Nonlinear Functional Analysis (Proc. Sympos. Pure Math., Vol. XVIII, Part 2, Chicago, IL, 1968), American Mathematical Society, Providence, RI, 1976, pp. 1-308.
30. R. E. BRUCK, An iterative solution for a variational inequality for certain monotone operators in Hilbert space, Bull. Amer. Math. Soc., 81 (1975), pp. 890-892. [Corrigendum: Bull. Amer. Math. Soc., 81 (1976), p. 353.]
31. R. S. BURACHIK AND S. SCHEIMBERG, A proximal point method for the variational inequality problem in Banach spaces, SIAM J. Control Optim., 39 (2000), pp. 1633-1649.
32. D. BUTNARIU AND A. N. IUSEM, On a proximal point method for convex optimization in Banach spaces, Numer. Funct. Anal. Optim., 18 (1997), pp. 723-744.
33. D. BUTNARIU AND A. N. IUSEM, Totally Convex Functions for Fixed Points Computation and Infinite Dimensional Optimization, Kluwer Academic Publishers, Dordrecht, 2000.
34. D. BUTNARIU, A. N. IUSEM, AND E. RESMERITA, Total Convexity for Powers of the Norm in Uniformly Convex Banach Spaces, J. Convex Anal., 7 (2000), pp. 319-334.
35. D. BUTNARIU, A. N. IUSEM, AND C. Zǎlinescu, On uniform convexity, total convexity and convergence of the proximal point and outer Bregman projection algorithms in Banach spaces, J. Convex Anal., 10 (2003), pp. 35-61.
36. D. BUTNARIU AND G. KASSAY, On classes of Legendre functions with special properties, in preparation.
37. D. BUTNARIU AND E. RESMERITA, Averaged subgradient methods for constrained convex optimization and Nash equilibria computation, Optimization, 51 (2002), pp. 863-888.
38. D. BUTNARIU AND E. RESMERITA, Bregman distances, totally convex functions, and a method for solving operator equations in Banach spaces, Abstr. Appl. Anal., 2006, 84919.
39. D. BUTNARIU, S. REICH, AND A. ZASLAVSKI, Weak convergence for orbits of nonlinear operators in reflexive Banach spaces, Numer. Funct. Anal. Optim., 24 (2003), pp. 489-508.
40. A. CSASZAR, General Topology, Akademiai Kiado, Budapest, 1978.
41. A. L. DONTCHEV AND T. ZOLEZZI, Well-Posed Optimization Problems, Springer-Verlag, Berlin, 1993.
42. J. ECKSTEIN, Nonlinear proximal point algorithms using Bregman functions, with application to convex programming, Math. Oper. Res., 18 (1993), pp. 202-226.
43. P. P. B. EGGERMONT, Multiplicative iterative algorithms for convex programming, Linear Algebra Appl., 130 (1990), pp. 25-42.
44. J. ERIKSSON, An Interval Primal-Dual Algorithm for Linear Programming, Technical report 85-10, Department of Mathematics, Linköping University, Linköping, Sweden, 1985.
45. S. ERLANDER, Entropy in linear programs, Math. Program., 21 (1981), pp. 137-151.
46. Y. M. ERMOLIEV, Methods for solving nonlinear extremal problems, Kibernetika (Kiev), 1 (1966), pp. 1-17 (Russian).
47. F. FACCHINEI AND J.-S. PANG, Finite-Dimensional Variational Inequalities and Complementarity Problems, Vol. 1, Springer-Verlag, New York, 2003.
48. K. GOEBEL AND S. REICH, Uniform Convexity, Hyperbolic Geometry, and Nonexpansive Mappings, Marcel Dekker, New York, Basel, 1984.
49. E. G. GOLHSTEIN AND N. TRETYAKOV, Modified Lagrangians and Monotone Maps in Optimization, Wiley, New York, 1996.
50. G. KASSAY, The proximal point algorithm for reflexive Banach spaces, Studia Math., 30 (1985), pp. 9-17.
51. M. A. KRASNOSELSKII, Two observations about the method of successive approximations, Uspekhi Mat. Nauk, 10 (1955), pp. 123-127 (in Russian).
52. E. KREYSZIG, Introductory Functional Analysis, John Wiley & Sons, New York, 1978.
53. L. LANDWEBER, An iterative formula for Fredholm integral equations of the first kind, Amer. J. Math., 73 (1951), pp. 615-624.
54. B. LEMAIRE, The proximal algorithm, in New Methods in Optimization and Their Industrial Uses, Internat. Schriftenreihe Numer. Math. 87, J. P. Penot, ed., Birkhäuser, Basel, 1989, pp. 73-87.
55. O. A. LISKOVETS, External approximations for the regularization of monotone variational in-equalities, Soviet Math. Dokl., 36 (1988), pp. 220-224.
56. O. A. LISKOVETS, Regularized variational inequalities with pseudo-monotone operators on approximately given sets, Differential Equations, 11 (1989), pp. 1970-1977 (in Russian).
57. B. MARTINET, Régularisation d'inéquations variationelles par approximations successives, Rev. Fraņcaise Informat. Recherche Opérationelle, 4 (1970), pp. 154-158.
58. B. MARTINET, Algorithmes pour la résolution des problèmes d'optimisation et minimax, Thèse d'état, Université de Grenoble, Grenoble, France, 1972.
59. J.-J. MOREAU, Fonctions convexes duales et points proximaux dans un espace Hilbertien, C. R. Acad. Sci. Paris, 255 (1962), pp. 2897-2899.
60. J.-J. MOREAU, Propriétés des applications 'prox', C. R. Acad. Sci. Paris, 256 (1963), pp. 1069-1071.
61. J.-J. MOREAU, Proximité et dualité dans un espace Hilbertien, Bull. Soc. Math. France, 93 (1965), pp. 273-299.
62. U. MOSCO, Convergence of convex sets and of solutions of variational inequalities, Adv. Math., 3 (1969), pp. 510-585.
63. Z. OPIAL, Weak convergence of the sequence of successive approximations for nonexpansive mappings, Bull. Amer. Math. Soc., 73 (1967), pp. 591-597.
64. D. PASCALI AND S. SBURLAN, Nonlinear Mappings of Monotone Type, Martinus Nijhoff, The Hague; Sijthoff & Noordhoff International Publishers, Alphen ann den Rijn, 1978.
65. R. R. PHELPS, Convex Functions, Monotone Operators, and Differentiability, 2nd ed., Springer-Verlag, Berlin, 1993.
66. B. T. POLYAK, A general method for solving extremum problems, Dokl. Akad. Nauk SSSR, 174 (1967), pp. 593-597.
67. B. T. POLYAK, Introduction to Optimization, Optimization Software, Inc., New York, 1987.
68. R. T. ROCKAFELLAR, Level sets and continuity of conjugate convex functions, Trans. Amer. Math. Soc., 123 (1966), pp. 46-63.
69. R. T. ROCKAFELLAR, On the maximality of sums of nonlinear operators, Trans. Amer. Math. Soc., 49 (1970), pp. 75-88.
70. R. T. ROCKAFELLAR, Monotone operators and the proximal point algorithm, SIAM J. Control Optim., 14 (1976), pp. 877-898.
71. R. T. ROCKAFELLAR, Augmented Lagrangians and applications of the proximal point algorithm in convex programming, Math. Oper. Res., 1 (1976), pp. 97-116.
72. R. T. ROCKAFELLAR AND R. J.-B. WETS, Variational Analysis, Springer-Verlag, Berlin, 1998.
73. W. RUDIN, Functional Analysis, McGraw-Hill, New York, 1991.
74. A. RUSZCZÝNSKI, A merit function approach of the subgradient method, Optim. Methods Softw., 23 (2008), pp. 161-172.
75. N. Z. SHOR, Application of the method of gradient descent to the solution of the network transportation problem, in "Materials of the Scientific Seminar on Theoretical and Applied Questions of Cybernetics and Operation Research", Ukrainian Academy of Sciences, Kiev, 1962, pp. 1-17 (Russian).
76. N. Z. SHOR, Minimization Methods for Nondifferentiable Functions, Springer-Verlag, Berlin, 1985.
77. A. N. TIKHONOV, Regularization of incorrectly posed problems, Dokl. Akad. Nauk, 4 (1963), pp. 1035-1038.
78. K. YOSIDA, Lectures on Differential and Integral Equations, Interscience Publishers, London, 1960.