Diagonal scaling in Douglas-Rachford splitting and ADMM

Proceedings of the IEEE Conference on Decision and Control

Volumn 2015-February, Issue February, 2014, Pages 5033-5039

  Giselsson, Pontus ^a   Boyd, Stephen ^a  

^a Stanford University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALTERNATING DIRECTION METHOD OF MULTIPLIER (ADMM); DIAGONAL SCALING; DOUGLAS-RACHFORD SPLITTING; DUAL PROBLEM; LINEAR CONVERGENCE; LINEAR RATE OF CONVERGENCES; PRECONDITIONING METHOD; PROBLEM DATUM;

CONTROL ENGINEERING;

EID: 84988273334     PISSN: 07431546     EISSN: 25762370     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2014.7040175     Document Type: Conference Paper

References (26)

1. K. J. Arrow, L. Hurwicz, and H. Uzawa. Studies in Linear and Nonlinear Programming. Stanford University Press, 1958.
2. H. H. Bauschke and P. L. Combettes. Convex Analysis and Monotone Operator Theory in Hilbert Spaces. Springer, 2011.
3. A. Beck and M. Teboulle. A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM J. Imaging Sciences, 2(1):183-202, 2009.
4. A. Bemporad, A. Casavola, and E. Mosca. Nonlinear control of constrained linear systems via predictive reference management. IEEE Transactions on Automatic Control, 42(3):340-349, 1997.
5. S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein. Distributed optimization and statistical learning via the alternating direction method of multipliers. Foundations and Trends in Machine Learning, 3(1):1-122, 2011.
6. E. J. Candes, J. Romberg, and T. Tao. Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information. IEEE Transactions on Information Theory, 52(2):489-509, Feb 2006.
7. A. Chambolle and T. Pock. A first-order primal-dual algorithm for convex problems withapplications to imaging. Journal of Mathematical Imaging and Vision, 40(1):120-145, 2011.
8. P. L. Combettes and V. R. Wajs. Signal recovery by proximal forward-backward splitting. SIAM journal on Multiscale Modeling and Simulation, 4(4):1168-1200, 2005.
9. W. Deng and W. Yin. On the global and linear convergence of the generalized alternating direction method of multipliers. Technical Report CAAM 12-14, Rice University, 2012.
10. J. Douglas and H. H. Rachford. On the numerical solution of heat conduction problems in two and three space variables. Trans. Amer. Math. Soc., 82:421-439, 1956.
11. J. Eckstein. Splitting methods for monotone operators with applications to parallel optimization. PhD thesis, MIT, 1989.
12. D. Gabay. Applications of the method of multipliers to variational inequalities. In M. Fortin and R. Glowinski, editors, Augmented Lagrangian Methods: Applications to the Solution of Boundary-Value Problems. North-Holland: Amsterdam, 1983.
13. D. Gabay and B. Mercier. A dual algorithm for the solution of nonlinear variational problems via finite element approximation. Computers and Mathematics with Applications, 2(1):17-40, 1976.
14. E. Ghadimi, A. Teixeira, I. Shames, and M. Johansson. Optimal parameter selection for the alternating direction method of multipliers (ADMM): Quadratic problems. 2013. Submitted. Available: http://arxiv.org/abs/1306.2454.
15. P. Giselsson and S. Boyd. Metric selection in fast dual forward backward splitting. Automatica, 2014. Submitted.
16. R. Glowinski and A. Marroco. Sur l'approximation, par éléments finis d'ordre un, et la résolution, par pénalisation-dualité d'une classe de problémes de dirichlet non linéaires. ESAIM: Mathematical Modelling and Numerical Analysis - Modélisation Mathématique et Analyse Numérique, 9:41-76, 1975.
17. T. Hastie, R. Tibshirani, and J. Friedman. The elements of statistical learning: data mining, inference and prediction. Springer, 2nd edition, 2009.
18. P. Kapasouris, M. Athans, and G. Stein. Design of feedback control systems for unstable plants with saturating actuators. In Proceedings of the IFAC Symposium on Nonlinear Control System Design, pages 302-307. Pergamon Press, 1990.
19. P. L. Lions and B. Mercier. Splitting algorithms for the sum of two nonlinear operators. SIAM Journal on Numerical Analysis, 16(6):964-979, 1979.
20. Y. Nesterov. Introductory Lectures on Convex Optimization: A Basic Course. Springer Netherlands, 1st edition, 2003.
21. B. O'Donoghue, G. Stathopoulos, and S. Boyd. A splitting method for optimal control. IEEE Transactions on Control Systems Technology, 21(6):2432-2442, 2013.
22. N. Parikh and S. Boyd. Proximal algorithms. Foundations and Trends in Optimization, 1(3):123-231, 2014.
23. D. W. Peaceman and H. H. Rachford. The numerical solution of parabolic and elliptic differential equations. Journal of the Society for Industrial and Applied Mathematics, 3(1):28-41, 1955.
24. J. B. Rawlings and D. Q. Mayne. Model Predictive Control: Theory and Design. Nob Hill Publishing, Madison, WI, 2009.
25. R. T. Rockafellar. Convex Analysis, volume 28. Princeton Univercity Press, Princeton, NJ, 1970.
26. R. T. Rockafellar and R. J-B. Wets. Variational Analysis. Springer, Berlin, 1998.