Systems of structured monotone inclusions: Duality, algorithms, and applications

SIAM Journal on Optimization

Volumn 23, Issue 4, 2013, Pages 2420-2447

  Combettes, Patrick L ^a,b  

^a SORBONNE UNIVERSITÉ   (France)

^b KING ABDULAZIZ UNIVERSITY   (Saudi Arabia)

Author keywords

Convex minimization; Coupled system; Infimal convolution; Monotone inclusion; Monotone operator; Operator splitting; Parallel algorithm; Structured minimization problem

Indexed keywords

CONVEX MINIMIZATION; COUPLED SYSTEMS; INFIMAL CONVOLUTION; MINIMIZATION PROBLEMS; MONOTONE INCLUSIONS; MONOTONE OPERATORS; OPERATOR-SPLITTING;

MATHEMATICAL OPERATORS; PARALLEL ALGORITHMS;

ALGORITHMS;

EID: 84892839386     PISSN: 10526234     EISSN: None     Source Type: Journal    
DOI: 10.1137/130904160     Document Type: Article

References (47)

1. F. Acker and M. A. Prestel, Convergence d'un schéma de minimisation alternée, Ann. Fac. Sci. Toulouse Math., 2 (1980), pp. 1-9.
2. H. Attouch, J. Bolte, P. Redont, and A. Soubeyran, Alternating proximal algorithms for weakly coupled convex minimization problems. Applications to dynamical games and PDE's, J. Convex Anal., 15 (2008), pp. 485-506.
3. H. Attouch, L. M. Briceño-Arias, and P. L. Combettes, A parallel splitting method for coupled monotone inclusions, SIAM J. Control Optim., 48 (2010), pp. 3246-3270.
4. H. Attouch, A. Cabot, P. Frankel, and J. Peypouquet, Alternating proximal algorithms for linearly constrained variational inequalities: Application to domain decomposition for PDE's, Nonlinear Anal., 74 (2011), pp. 7455-7473.
5. H. Attouch, P. Redont, and A. Soubeyran, A new class of alternating proximal minimization algorithms with costs-to-move, SIAM J. Optim., 18 (2007), pp. 1061-1081.
6. F. Bach, R. Jenatton, J. Mairal, and G. Obozinski, Optimization with sparsity-inducing penalties, Found. Trends Machine Learning, 4 (2012), pp. 1-106.
7. A. B. Bakušinskiǐ and B. T. Polyak, The solution of variational inequalities, Soviet Math. -Doklady, 15 (1974), pp. 1705-1710.
8. H. H. Bauschke and P. L. Combettes, Convex Analysis and Monotone Operator Theory in Hilbert Spaces, Springer, New York, 2011.
9. H. H. Bauschke, P. L. Combettes, and D. R. Luke, Finding best approximation pairs relative to two closed convex sets in Hilbert spaces, J. Approx. Theory, 127 (2004), pp. 178-192.
10. H. H. Bauschke, P. L. Combettes, and S. Reich, The asymptotic behavior of the composition of two resolvents, Nonlinear Anal., 60 (2005), pp. 283-301.
11. S. R. Becker and P. L. Combettes, An algorithm for splitting parallel sums of linearly composed monotone operators, with applications to signal recovery, J. Convex Nonlinear Anal., to appear.
12. H. Brézis and M. Sibony, Méthodes d'approximation et d'itération pour les opérateurs monotones, Arch. Ration. Mech. Anal., 28 (1967/1968), pp. 59-82.
13. L. M. Briceño-Arias and P. L. Combettes, Convex variational formulation with smooth coupling for multicomponent signal decomposition and recovery, Numer. Math. Theory Methods Appl., 2 (2009), pp. 485-508.
14. L. M. Briceño-Arias and P. L. Combettes, A monotone+skew splitting model for composite monotone inclusions in duality, SIAM J. Optim., 21 (2011), pp. 1230-1250.
15. L. M. Briceño-Arias, P. L. Combettes, J.-C. Pesquet, and N. Pustelnik, Proximal algorithms for multicomponent image recovery problems, J. Math. Imaging Vision, 41 (2011), pp. 3-22.
16. J.-F. Cai, B. Dong, S. Osher, and Z. Shen, Image restoration: Total variation, wavelet frames, and beyond, J. Amer. Math. Soc., 25 (2012), pp. 1033-1089.
17. P. L. Combettes, Construction d'un point fixe commun à une famille de contractions fermes, C. R. Acad. Sci. Paris Sér. I Math., 320 (1995), pp. 1385-1390.
18. P. L. Combettes, Solving monotone inclusions via compositions of nonexpansive averaged operators, Optimization, 53 (2004), pp. 475-504.
19. P. L. Combettes and P. Bondon, Hard-constrained inconsistent signal feasibility problems, IEEE Trans. Signal Process., 47 (1999), pp. 2460-2468.
20. P. L. Combettes and J.-C. Pesquet, Primal-dual splitting algorithm for solving inclusions with mixtures of composite, Lipschitzian, and parallel-sum type monotone operators, Set-Valued Var. Anal., 20 (2012), pp. 307-330.
21. P. L. Combettes and V. R. Wajs, Signal recovery by proximal forward-backward splitting, Multiscale Model. Simul., 4 (2005), pp. 1168-1200.
22. J. Douglas, Jr., and H. H. Rachford, Jr., On the numerical solution of heat conduction problems in two or three space variables, Trans. Amer. Math. Soc., 82 (1956), pp. 421-439.
23. J. M. Dye and S. Reich, Unrestricted iterations of nonexpansive mappings in Hilbert space, Nonlinear Anal., 18 (1992), pp. 199-207.
24. J. Eckstein and D. P. Bertsekas, On the Douglas-Rachford splitting method and the proximal point algorithm for maximal monotone operators, Math. Program., 55 (1992), pp. 293-318.
25. F. Facchinei and J.-S. Pang, Finite-Dimensional Variational Inequalities and Complementarity Problems, Springer-Verlag, New York, 2003.
26. P. Frankel, Alternating proximal algorithm with costs-to-move, dual description and application to PDE's, Discrete Contin. Dyn. Syst. Ser. S, 5 (2012), pp. 545-557.
27. C. F. Gauss, Theoria Motus Corporum Coelestium, Perthes and Besser, Hamburg, 1809.
28. J. Gilles, Noisy image decomposition: A new structure, texture and noise model based on local adaptivity, J. Math. Imaging Vision, 28 (2007), pp. 285-295.
29. R. Glowinski and P. Le Tallec, eds., Augmented Lagrangian and Operator-Splitting Methods in Nonlinear Mechanics, SIAM, Philadelphia, 1989.
30. M. Goldburg and R. J. Marks II, Signal synthesis in the presence of an inconsistent set of constraints, IEEE Trans. Circuits Systems, 32 (1985), pp. 647-663.
31. G. M. Korpelevich, The extragradient method for finding saddle points and other problems, Matecon, 12 (1976), pp. 747-756.
32. A. M. Legendre, Nouvelles Méthodes pour la Détermination de l'Orbite des Comètes. Courcier, Paris, 1805.
33. N. Lehdili and B. Lemaire, The barycentric proximal method, Comm. Appl. Nonlinear Anal., 6 (1999), pp. 29-47.
34. E. S. Levitin and B. T. Polyak, Constrained minimization methods, U.S.S.R. Comput. Math. Math. Phys., 6 (1966), pp. 1-50.
35. P.-L. Lions and B. Mercier, Splitting algorithms for the sum of two nonlinear operators, SIAM J. Numer. Anal., 16 (1979), pp. 964-979.
36. P. Mahey and D. T. Pham, Partial regularization of the sum of two maximal monotone operators, RAIRO Modél. Math. Anal. Numér., 27 (1993), pp. 375-392.
37. B. Mercier, Topics in Finite Element Solution of Elliptic Problems, Lectures on Mathematics, 63, Tata Institute of Fundamental Research, Bombay, 1979.
38. B. Mercier, Inéquations Variationnelles de la Mécanique, Publications Mathématiques d'Orsay 80.01, Université de Paris-XI, Orsay, France, 1980.
39. 1-type functionals, Commun. Math. Sci., 9 (2011), pp. 797-827.
40. M. Sibony, Méthodes itératives pour les équations et inéquations aux dérivées partielles non linéaires de type monotone, Calcolo, 7 (1970), pp. 65-183.
41. J. E. Spingarn, Partial inverse of a monotone operator, Appl. Math. Optim., 10 (1983), pp. 247-265.
42. J.-L. Starck, M. Elad, and D. L. Donoho, Image decomposition via the combination of sparse representations and a variational approach, IEEE Trans. Image Process., 14 (2005), pp. 1570-1582.
43. P. Tseng, Applications of a splitting algorithm to decomposition in convex programming and variational inequalities, SIAM J. Control Optim., 29 (1991), pp. 119-138.
44. P. Tseng, A modified forward-backward splitting method for maximal monotone mappings, SIAM J. Control Optim., 38 (2000), pp. 431-446.
45. R. S. Varga, Matrix Iterative Analysis, 2nd ed., Springer-Verlag, New York, 2000.
46. B. C. Vũ, A splitting algorithm for dual monotone inclusions involving cocoercive operators, Adv. Comput. Math., 38 (2013), pp. 667-681.
47. C. Zǎlinescu, Convex Analysis in General Vector Spaces, World Scientific, River Edge, NJ, 2002.