Bregman alternating direction method of multipliers

Advances in Neural Information Processing Systems

Volumn 4, Issue January, 2014, Pages 2816-2824

  Wang, Huahua ^a   Banerjee, Arindam ^a  

^a University of Minnesota   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; INFORMATION SCIENCE; LINEAR PROGRAMMING; MASS TRANSPORTATION;

ALTERNATING DIRECTION METHOD OF MULTIPLIERS; BREGMAN DIVERGENCES; COMMERCIAL SOFTWARE; GLOBAL CONVER-GENCE; MASSIVE PARALLELISM; SQUARED EUCLIDEAN DISTANCE; TRANSPORTATION PROBLEM; UNIFIED FRAMEWORK;

ITERATIVE METHODS;

EID: 84937821944     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. A. Banerjee, S. Merugu, I. Dhillon, and J. Ghosh. Clustering with Bregman divergences. JMLR, 6: 1705-1749, 2005.
2. A. Beck and M. Teboulle. Mirror descent and nonlinear projected subgradient methods for convex optimization. Operations Research Letters, 31: 167-175, 2003.
3. A. Ben-Tal, T. Margalit, and A. Nemirovski. The ordered subsets mirror descent optimization method with applications to tomography. SIAM Journal on Optimization, 12: 79-108, 2001.
4. S. Boyd, E. Chu N. Parikh, B. Peleato, and J. Eckstein. Distributed optimization and statistical learning via the alternating direction method of multipliers. Foundation and Trends Machine Learning, 3(1): 1-122, 2011.
5. Y. Censor and S. Zenios. Parallel Optimization: Theory, Algorithms, and Applications. Oxford University Press, 1998.
6. G. Chen and M. Teboulle. Convergence analysis of a proximal-like minimization algorithm using bremgan functions. SIAM Journal on Optimization, 3: 538-543, 1993.
7. P. Combettes and J. Pesquet. Proximal splitting methods in signal processsing. Fixed-Point Algorithms for Inverse Problems in Science and Engineering Springer (Ed.), pages 185-212, 2011.
8. W. Deng and W. Yin. On the global and linear convergence of the generalized alternating direction method of multipliers. ArXiv, 2012.
9. J. Duchi, S. Shalev-Shwartz, Y. Singer, and T. Chandra. Efficient projections onto the l1-ball for learning in high dimensions. In ICML, pages 272-279, 2008.
10. J. Duchi, S. Shalev-Shwartz, Y. Singer, and A. Tewari. Composite objective mirror descent. In COLT, 2010.
11. M. A. T. Figueiredo and J. M. Bioucas-Dias. Restoration of Poissonian images using alternating direction optimization. IEEE Transactions on Image Processing, 19: 3133-3145, 2010.
12. Q. Fu, H. Wang, and A. Banerjee. Bethe-ADMM for tree decomposition based parallel MAP inference. In UAI, 2013.
13. D. Gabay. Applications of the method of multipliers to variational inequalities. In Augmented Lagrangian Methods: Applications to the Solution of Boundary-Value Problems. M. Fortin and R. Glowinski, eds., North-Holland: Amsterdam, 1983.
14. T. Goldstein, X. Bresson, and S. Osher. Geometric applications of the split Bregman method: segmentation and surface reconstruction. Journal of Scientific Computing, 45(1): 272-293, 2010.
15. T. Goldstein, B. Donoghue, and S. Setzer. Fast alternating direction optimization methods. CAM report 12-35, UCLA, 2012.
16. T. Hastie, R. Tibshirani, and J. Friedman. The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer, 2009.
17. B. He and X. Yuan. On the O(1/n) convergence rate of the Douglas-Rachford alternating direction method. SIAM Journal on Numerical Analysis, 50: 700-709, 2012.
18. F. L. Hitchcock. The distribution of a product from several sources to numerous localities. Journal of Mathematical Physics, 20: 224-230, 1941.
19. M. Hong and Z. Luo. On the linear convergence of the alternating direction method of multipliers. ArXiv, 2012.
20. K. C. Kiwiel. Proximal minimization methods with generalized Bregman functions. SIAM Journal on Control and Optimization, 35: 1142-1168, 1995.
21. A. Nemirovski and D. Yudin. Problem Complexity and Method Efficiency in Optimization. Wiley, 1983.
22. Y. Nesterov. Gradient methods for minimizing composite objective function. Technical Report 76, Center for Operation Research and Economics (CORE), Catholic University of Louvain (UCL), 2007.
23. M. Telgarsky and S. Dasgupta. Agglomerative Bregman clustering. In ICML, 2012.
24. M. J. Wainwright and M. I. Jordan. Graphical models, exponential families, and variational inference. Foundations and Trends in Machine Learning, 1: 1-305, 2008.
25. H. Wang and A. Banerjee. Online alternating direction method. In ICML, 2012.
26. J. Yang and Y. Zhang. Alternating direction algorithms for L1-problems in compressive sensing. ArXiv, 2009.