Douglas-rachford splitting: Complexity estimates and accelerated variants

Proceedings of the IEEE Conference on Decision and Control

Volumn 2015-February, Issue February, 2014, Pages 4234-4239

  Patrinos, Panagiotis ^a   Stella, Lorenzo ^a   Bemporad, Alberto ^a  

^a IMT SCHOOL FOR ADVANCED STUDIES LUCCA   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

OPTIMIZATION;

COMPLEXITY ESTIMATES; COMPOSITE OPTIMIZATION; CONTINUOUSLY DIFFERENTIABLE; CONVERGENCE PROPERTIES; DOUGLAS-RACHFORD SPLITTING; NEW APPROACHES; STATIONARY POINTS; UNCONSTRAINED OPTIMIZATION;

GRADIENT METHODS;

EID: 84963844934     PISSN: 07431546     EISSN: 25762370     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2014.7040049     Document Type: Conference Paper

References (24)

1. R. T. Rockafellar, "Monotone operators and the proximal point algorithm," SIAM Journal on Control and Optimization, Vol. 14, no. 5, pp. 877-898, 1976.
2. P.-L. Lions and B. Mercier, "Splitting algorithms for the sum of two nonlinear operators," SIAM Journal on Numerical Analysis, Vol. 16, no. 6, pp. 964-979, 1979.
3. J. Eckstein, "Splitting methods for monotone operators with applications to parallel optimization," PhD Thesis, Massachusetts Institute of Technology, 1989.
4. J. Eckstein and D. P. Bertsekas, "On the Douglas-Rachford splitting method and the proximal point algorithm for maximal monotone operators," Mathematical Programming, Vol. 55, no. 1-3, pp. 293-318, Apr. 1992.
5. H. H. Bauschke and P. L. Combettes, Convex analysis and monotone operator theory in Hilbert spaces. Springer, 2011.
6. P. L. Combettes and J.-C. Pesquet, "Proximal splitting methods in signal processing," Fixed-Point Algorithms for Inverse Problems in Science and Engineering, pp. 185-212, 2011.
7. D. Gabay, "Applications of the method of multipliers to variational inequalities," in Augmented Lagrangian Methods: Applications to the Solution of Boundary-Value Problems, M. Fortin and R. Glowinski, Eds. North-Holland: Amsterdam, 1983.
8. S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein, "Distributed optimization and statistical learning via the alternating direction method of multipliers," Foundations and Trends in Machine Learning, Vol. 3, no. 1, pp. 1-122, 2011.
9. N. Parikh and S. Boyd, "Proximal algorithms," Foundations and Trends in Optimization, Vol. 1, no. 3, pp. 123-231, 2013.
10. B. He and X. Yuan, "On the O(1/n) convergence rate of the Douglas-Rachford alternating direction method," SIAM Journal on Numerical Analysis, Vol. 50, no. 2, pp. 700-709, Jan. 2012.
11. T. Goldstein, B. O'Donoghue, and S. Setzer, "Fast alternating direction optimization methods," CAM report, pp. 12-35, 2012. [Online]. Available: http://www.mia.uni-saarland.de/Publications/goldstein-cam12-35.pdf
12. W. Deng and W. Yin, "On the global and linear convergence of the generalized alternating direction method of multipliers," DTIC Document, Tech. Rep., 2012.
13. M. Hong and Z.-Q. Luo, "On the linear convergence of the alternating direction method of multipliers," arXiv:1208.3922 [math.OC], Aug. 2012.
14. E. Ghadimi, A. Teixeira, I. Shames, and M. Johansson, "Optimal parameter selection for the alternating direction method of multipliers (ADMM): quadratic problems," arXiv:1306.2454 [math.OC], 2013.
15. D. Davis and W. Yin, "Faster convergence rates of relaxed Peaceman-Rachford and ADMM under regularity assumptions," arXiv:1407.5210 [math.OC], 2014.
16. P. Patrinos and A. Bemporad, "Proximal Newton methods for convex composite optimization," in IEEE Conference on Decision and Control, 2013, pp. 2358-2363.
17. P. Patrinos, L. Stella, and A. Bemporad, "Forward-backward truncated Newton methods for convex composite optimization," arXiv:1402.6655v2 [math.OC], Feb. 2014.
18. 2)," Soviet Mathematics Doklady, Vol. 27, no. 2, pp. 372-376, 1983.
19. -, Introductory lectures on convex optimization: A basic course. Springer, 2003, vol. 87.
20. C. Lemaréchal and C. Sagastizábal, "Practical aspects of the Moreau-Yosida regularization: Theoretical preliminaries," SIAM Journal on Optimization, Vol. 7, no. 2, pp. 367-385, 1997.
21. P. Patrinos, L. Stella, and A. Bemporad, "Douglas-Rachford splitting: complexity estimates and accelerated variants," arXiv:1407.6723 [math.OC], 2014.
22. D. P. Bertsekas, Convex Optimization Theory. Athena Scientific, 2009.
23. C. C. Gonzaga, E. W. Karas, and D. R. Rossetto, "An optimal algorithm for constrained differentiable convex optimization," SIAM Journal on Optimization, Vol. 23, no. 4, pp. 1939-1955, 2013.
24. D. Lorenz, "Constructing test instances for basis pursuit denoising," IEEE Transactions on Signal Processing, Vol. 61, no. 5, pp. 1210-1214, 2013.