Projection and proximal point methods: Convergence results and counterexamples

Nonlinear Analysis, Theory, Methods and Applications

Volumn 56, Issue 5, 2004, Pages 715-738

  Bauschke, Heinz H ^a   Matoušková, Eva ^b   Reich, Simeon ^c  

^a UNIVERSITY OF GUELPH   (Canada)

^b MATHEMATICAL INSTITUTE   (Czech Republic)

^c TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Alternating projections; Averaged projections; Hilbert space; Nonexpansive; Proximal point algorithm; Weak convergence

Indexed keywords

ALGORITHMS; CONVERGENCE OF NUMERICAL METHODS; MATHEMATICAL OPERATORS; PROBLEM SOLVING; SET THEORY; THEOREM PROVING;

ALTERNATING PROJECTIONS; AVERAGED PROJECTIONS; HILBERT SPACE; PROXIMAL POINT ALGORITHMS;

ITERATIVE METHODS;

EID: 0347269125     PISSN: 0362546X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.na.2003.10.010     Document Type: Article

References (55)

1. H. Attouch, H. Brézis, Duality for the sum of convex functions in general Banach spaces, in: J.A. Barroso (Ed.), Aspects of Mathematics and its Applications, North-Holland Math. Library, Vol. 34, North-Holland, Amsterdam, The Netherlands, 1986, pp. 125-133.
2. A. Auslender, Méthodes Numériques pour la Résolution des Problèmes d'Optimisation avec Constraintes, Thèse, Faculté des Sciences, Grenoble, 1969.
3. Baillon J.-B., Bruck R.E., Reich S. On the asymptotic behavior of nonexpansive mappings and semigroups in Banach spaces. Houston J. Math. 4:1978;1-9.
4. H.H. Bauschke, Projection Algorithms and Monotone Operators, Ph.D. Thesis, Simon Fraser University, 1996. Available as Preprint 96:080 at www.cecm.sfu.ca/preprints/1996pp.html.
5. Bauschke H.H. Projection algorithms: results and open problems. Butnariu D., Censor Y., Reich S. Inherently Parallel Algorithms in Feasibility and Optimization and Their Applications, Haifa, 2000. 2001;11-22 Elsevier, Amsterdam, The Netherlands.
6. Bauschke H.H., Borwein J.M. On the convergence of von Neumann's alternating projection algorithm for two sets. Set-Valued Analysis. 1:1993;185-212.
7. Bauschke H.H., Borwein J.M. Dykstra's alternating projection algorithm for two sets. J. Approx. Theory. 79:1994;418-443.
8. Bauschke H.H., Borwein J.M. On projection algorithms for solving convex feasibility problems. SIAM Rev. 38:1996;367-426.
9. Bauschke H.H., Borwein J.M., Lewis A.S. The method of cyclic projections for closed convex sets in Hilbert space. Censor Y., Reich S. Recent Developments in Optimization Theory and Nonlinear Analysis, Jerusalem, 1995. Contemporary Mathematics. Vol. 204:1997;1-38 American Mathematical Society, Providence, RI.
10. H.H. Bauschke, J.V. Burke, F.R. Deutsch, H.S. Hundal, J.D. Vanderwerff, A new proximal point iteration that converges weakly but not in norm, Proc. Amer. Math. Soc., available at http://www.cecm.sfu.ca/preprints/2002pp.html as Preprint 02:191.
11. Bauschke H.H., Combettes P.L. A weak-to-strong convergence principle for Fejér-monotone methods in Hilbert spaces. Math. Oper. Res. 26:2001;248-264.
12. Bauschke H.H., Deutsch F., Hundal H., Park S.-H. Fejér monotonicity and weak convergence of an accelerated method of projections. Théra M. Constructive, Experimental, and Nonlinear Analysis, Limoges, 1999. 2000;1-6 American Mathematical Society, Providence, RI.
13. Bauschke H.H., Deutsch F., Hundal H., Park S.-H. Accelerating the convergence of the method of alternating projections. Trans. Am. Math. Soc. 355:2003;3433-3461.
14. Y. Benyamini, J. Lindenstrauss, Geometric Nonlinear Functional Analysis, Vol. 1, American Mathematical Society, Providence, RI, 2000.
15. Bregman L.M. The method of successive projection for finding a common point of convex sets. Sov. Math. Dokl. 6:1965;688-692.
16. Brézis H. Opérateurs Maximaux Monotones et Semi-Groupes de Contractions dans les Espaces de Hilbert. 1973;North-Holland, Amsterdam.
17. Brézis H., Lions P.-L. Produits infinis de résolvantes. Isr. J. Math. 29:1978;329-345.
18. Bruck R.E., Reich S. Nonexpansive projections and resolvents of accretive operators in Banach spaces. Houston J. Math. 3:1977;459-470.
19. D. Butnariu, Y. Censor, S. Reich (Eds.), Inherently Parallel Algorithms in Feasibility and Optimization and Their Applications, Elsevier, Amsterdam, The Netherlands, 2001.
20. Censor Y. On sequential and parallel projection algorithms for feasibility and optimization. Censor Y., Ding M. Visualization and Optimization Techniques. Proceedings of SPIE. Vol. 4553:2001;1-9 SPIE - The International Society for Optical Engineering, Bellingham, WA.
21. Censor Y., Elfving T., Herman G.T. Averaging strings of sequential iterations for convex feasibility problems. Butnariu D., Censor Y., Reich S. Inherently Parallel Algorithms in Feasibility and Optimization and Their Applications, Haifa, 2000. 2001;101-114 Elsevier, Amsterdam, The Netherlands.
22. Censor Y., Tom E. Convergence of string-averaging projection schemes for inconsistent convex feasibility problems. Optim. Methods Software. 18:2003;543-554.
23. Censor Y., Zenios S.A. Parallel Optimization. 1997;Oxford University Press, New York, NY.
24. G. Cimmino, Calcolo approssimato per le soluzioni dei sistemi di equazioni lineari, La Ricerca Scientifica ed il Progresso Tecnico nell'Economia Nazionale, Roma, Vol. 1, 1938, pp. 326-333.
25. Combettes P.L. Hilbertian convex feasibility problem. convergence of projection methods Appl. Math. Optim. 35:1997;311-330.
26. Crombez G. Finding common fixed points of strict paracontractions by averaging strings of sequential iterations. J. Nonlinear and Convex Anal. 3:2002;345-351.
27. Deutsch F. Best Approximation in Inner Product Spaces. 2001;Springer, New York, NY.
28. Dye J.M., Reich S. On the unrestricted iteration of projections in Hilbert space. J. Math. Anal. Appl. 156:1991;101-119.
29. Genel A., Lindenstrauss J. An example concerning fixed points. Isr. J. Math. 22:1975;81-86.
30. Goebel K., Kirk W.A. Topics in Metric Fixed Point Theory. 1990;Cambridge University Press, Cambridge, UK.
31. Goebel K., Reich S. Uniform Convexity, Hyperbolic Geometry, and Nonexpansive Mappings. 1984;Marcel Dekker, New York, NY.
32. Güler O. On the convergence of the proximal point algorithm for convex minimization. SIAM J. Control Optim. 29:1991;403-419.
33. Hiriart-Urruty J.-B. A general formula on the conjugate of the difference of functions. Can. Math. Bull. 29:1986;482-485.
34. H. Hundal, An alternating projection that does not converge in norm, Nonlinear Anal., available at http://www.cecm.sfu.ca/preprints/2002pp.html as Preprint 02:189.
35. Kirszbraun M.D. Über die zusammenziehenden und Lipschitzschen Transformationen. Fund Math. 22:1934;77-108.
36. Kuczumow T., Reich S., Shoikhet D. Fixed points of holomorphic mappings: a metric approach. Kirk W.A., Sims B. Handbook of Metric Fixed Point Theory. 2001;437-515 Kluwer, Dordrecht, The Netherlands.
37. Kuzcumow T., Stachura A. Extensions of nonexpansive mappings in the Hilbert ball with the hyperbolic metric II. Commentat. Math. Univ. Carolin. 29:1988;403-410.
38. Martinet B. Régularisation d'inéquations variationnelles par approximations successives. Rev. Fr. d'Informatique Recherche Opér. 4:1970;154-158.
39. Merzlyakov Y.I. On a relaxation method of solving systems of linear inequalities. USSR Comput. Math. Math. Phys. 2:1963;504-510.
40. Minty G.J. Monotone (nonlinear) operators in Hilbert space. Duke Math. J. 29:1962;341-346.
41. Moreau J.-J. Proximité et dualité dans un espace hilbertien. Bull. Soc. Math. France. 93:1965;273-299.
42. Reich S. Product formulas, nonlinear semigroups, and accretive operators. J. Funct. Anal. 36:1980;147-168.
43. Reich S. On the asymptotic behavior of nonlinear semigroups and the range of accretive operators. J. Math. Anal. Appl. 79:1981;113-126.
44. Reich S. On the asymptotic behavior of nonlinear semigroups and the range of accretive operators II. J. Math. Anal. Appl. 87:1982;134-146.
45. Reich S. A limit theorem for projections. Linear and Multilinear Algebra. 13:1983;281-290.
46. Reich S. Averaged mappings in the Hilbert ball. J. Math. Anal. Appl. 109:1985;199-206.
47. Reich S. The alternating algorithm of von Neumann in the Hilbert ball. Dynamic Systems Appl. 2:1993;21-25.
48. Rockafellar R.T. On the maximal monotonicity of subdifferential mappings. Pacific J. Math. 33:1970;209-216.
49. Rockafellar R.T. Monotone operators and the proximal point algorithm. SIAM J. Control Optim. 14:1976;877-898.
50. von Neumann J. On rings of operators. Reduction theory. Ann. Math. 50:1949;401-485.
51. von Neumann J. Functional Operators II: The Geometry of Orthogonal Spaces. 1950;Princeton University Press, Princeton, NJ. (This is a reprint of mimeographed lecture notes first distributed in 1933.).
52. Wiener N. On the factorization of matrices. Comment. Math. Helv. 29:1955;97-111.
53. Yamada I. The hybrid steepest descent method for the variational inequality problem over the intersection of fixed points sets of nonexpansive mappings. Butnariu D., Censor Y., Reich S. Inherently Parallel Algorithms in Feasibility and Optimization and Their Applications, Haifa, 2000. 2001;473-504 Elsevier, Amsterdam, The Netherlands.
54. Zǎlinescu C. Convex Analysis in General Vector Spaces. 2002;World Scientific, River Edge, NJ.
55. Zarantonello E.H. Projections on convex sets in Hilbert space and spectral theory. Zarantonello E.H. Contributions to Nonlinear Functional Analysis. 1971;237-424 Academic Press, New York, NY.