Nonconvex notions of regularity and convergence of fundamental algorithms for feasibility problems

SIAM Journal on Optimization

Volumn 23, Issue 4, 2013, Pages 2397-2419

  Hesse, Robert ^a   Luke, D Russell ^a  

^a UNIVERSITY OF GÖTTINGEN   (Germany)

Author keywords

Averaged alternating reflections; Constraint qualification; Convex set; Douglas Rachford; Fej r monotone; Firmly nonexpansive; Linear convergence; Linear regularity; Method of alternating projections; Metric regularity; Nonconvex set; Nonexpansive; Normal cone; Projection operator; Quasi nonexpansive; Reflection operator; Strong regularity; Superregularity

Indexed keywords

CONSTRAINT QUALIFICATION; CONVEX SET; DOUGLAS-RACHFORD; FIRMLY NONEXPANSIVE; LINEAR CONVERGENCE; LINEAR REGULARITY; METHOD OF ALTERNATING PROJECTIONS; METRIC REGULARITY; NONCONVEX; NONEXPANSIVE; NORMAL CONES; PROJECTION OPERATOR; STRONG REGULARITIES; SUPERREGULARITY;

SET THEORY;

ALGORITHMS;

EID: 84892884190     PISSN: 10526234     EISSN: None     Source Type: Journal    
DOI: 10.1137/120902653     Document Type: Article

References (35)

1. F. A. Artacho and J. Borwein, Global Convergence of a Non-convex Douglas-Rachford Iteration, arXiv:1203. 2392, 2012.
2. F. A. Artacho, A. Dontchev, and M. Geoffroy, Convergence of the proximal point method for metrically regular mappings, ESAIM Proc., 17 (2007), pp. 1-8.
3. F. A. Artacho and M. Geoffroy, Uniformity and inexact version of a proximal method for metrically regular mappings, J. Math. Anal. Appl., 335 (2007), pp. 168-183.
4. H. Attouch, J. Bolte, P. Redont, and A. Soubeyran, Proximal alternating minimization and projection methods for nonconvex problems: An approach based on the Kurdyka-Łojasiewicz inequality, Math. Oper. Res., 35 (2010), pp. 438-457.
5. H. H. Bauschke and J. M. Borwein, On projection algorithms for solving convex feasibility problems, SIAM Rev., 38 (1996), pp. 367-426.
6. H. H. Bauschke and P. L. Combettes, Convex Analysis and Monotone Operator Theory in Hilbert Spaces, Springer, New York, 2011.
7. H. H. Bauschke, P. L. Combettes, and D. R. Luke, Finding best approximation pairs relative to two closed convex sets in Hilbert spaces, J. Approx. Theory, 127 (2004), pp. 178-314.
8. H. H. Bauschke, D. R. Luke, H. M. Phan, and X. Wang, Restricted normal cones and the method of alternating projections: Applications, Set-Valued Variational Anal., 21(2013), pp. 475-501.
9. H. H. Bauschke, D. R. Luke, H. M. Phan, and X. Wang, Restricted normal cones and the method of alternating projections: Theory, Set-Valued Variational Anal., 21(2013), pp. 431-473.
10. J. M. Borwein and B. Sims, The Douglas-Rachford algorithm in the absence of convexity, in Fixed-Point Algorithms for Inverse Problems in Science and Engineering, Optim. Appl., 49 Springer, New York, 2011, pp. 93-109.
11. R. S. Burachik and A. N. Iusem, Set-Valued Mappings and Enlargements of Monotone Operators, Optim. Appl. 8, Springer, New York, 2008.
12. P. L. Combettes and T. Pennanen, Proximal methods for cohypomonotone operators, SIAM J. Control Optim., 43 (2004), pp. 731-742.
13. L. Demanet and X. Zhang, Eventual Linear Convergence of the Douglas-Rachford Iteration for Basis Pursuit, arXiv:1301.0542[math.NA], 2013.
14. F. Deutsch, The Angle Between Subspaces of a Hilbert Space, in Approximation Theory, Wavelets and Applications, S. Singh, ed., NATO Sci. Ser. 454, Springer, 1995, pp. 107-130.
15. F. Deutsch, Best Approximation in Inner Product Spaces, Springer, New York, 2001.
16. F. Deutsch and H. Hundal, The rate of convergence for the cyclic projections algorithm III: Regularity of convex sets, J. Approx. Theory, 155 (2008), pp. 155-184.
17. F. Deutsch and H. Hundal, The rate of convergence for the cyclic projections algorithm III: Regularity of convex sets, J. Approx. Theory, 155 (2008), pp. 155-184.
18. K. Friedrichs, On certain inequalities and characteristic value problems for analytic functions and for functions of two variables, Trans. Amer. Math. Soc., 41 (1937), pp. 321-364.
19. K. Goebel and W. A. Kirk, Topics in Metric Fixed Point Theory, Cambridge University Press, Cambridge, UK, 1990.
20. K. Goebel and S. Reich, Uniform Convexity, Hyperbolic Geometry, and Nonexpansive Mappings, Pure Appl. Math., 83, CRC Press, Boca Raton, FL, 1984.
21. L. G. Gubin, B. T. Polyak, and E. Raik, The method of projections for finding the common point of convex sets, Comput. Math. Math. Phys., 7 (1967), pp. 1-24.
22. A. D. Ioffe, Metric regularity and subdifferential calculus, Russian Math. Surveys, 55 (2000), pp. 501-558.
23. A. Iusem, T. Pennanen, and B. Svaiter, Inexact versions of the proximal point algorithm without monotonicity, SIAM J. Optim., 13 (2003), pp. 1080-1097.
24. D. Klatte and B. Kummer, Optimization methods and stability of inclusions in Banach spaces, Math. Program. B, 117 (2009), pp. 305-350.
25. A. Y. Kruger., Weak stationarity: Eliminating the gap between necessary and sufficient conditions, Optimization, 53 (2004), pp. 147-164.
26. A. Y. Kruger, About regularity of collections of sets, Set-Valued Anal., 14 (2006), pp. 187-206.
27. A. S. Lewis, D. R. Luke, and J. Malick, Local linear convergence for alternating and averaged nonconvex projections, Found. Comput. Math., 9 (2009), pp. 485-513.
28. P. L. Lions and B. Mercier, Splitting algorithms for the sum of two nonlinear operators, SIAM J. Numer. Anal., 16 (1979), pp. 964-979.
29. D. R. Luke, Finding best approximation pairs relative to a convex and a prox-regular set in a Hilbert space, SIAM J. Optim., 19 (2008), pp. 714-739.
30. B. Mordukhovich, Variational Analysis and Generalized Differentiation, I: Basic Theory, Grundlehren Math. Wiss., Springer, New York, 2006.
31. H. V. Ngai and M. Théra, Metric inequality, subdifferential calculus and applications, Set-Valued Anal., 9 (2001), pp. 187-216.
32. T. Pennanen, Local convergence of the proximal point algorithm and multiplier methods without monotonicity, Math. Oper. Res., 27 (2002), pp. 170-191.
33. R. A. Poliquin, R. T. Rockafellar, and L. Thibault, Local differentiability of distance functions, Trans. Amer. Math. Soc., 352 (2000), pp. 5231-5249.
34. R. T. Rockafellar and R. J.-B. Wets, Variational Analysis, Grundlehren Math. Wiss., Springer, New York, 1998.
35. E. H. Zarantonello, Projections on convex sets in Hilbert space and spectral theory, in Contributions to Nonlinear Functional Analysis, E. H. Zarantonello, ed., Academic Press, New York, 1971, pp. 237-424.