An asynchronous distributed proximal gradient method for composite convex optimization

32nd International Conference on Machine Learning, ICML 2015

Volumn 3, Issue , 2015, Pages 2444-2452

  Aybat, N S ^a   Wang, Z ^a   Iyengar, G ^b  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

^b Howard Hughes Medical Institute   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84970028395     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. Aybat, N. S. and Iyengar, G. A first-order augmented lagrangian method for compressed sensing. SIAM Journal on Optimization, 22(2):429-459, 2012.
2. Aybat, Necdet Serhat and Iyengar, Garud. An augmented lagrangian method for conic convex programming. arXiv preprint arXiv:1302.6322, 2013.
3. Aybat, Necdet Serhat and Iyengar, Garud. A unified approach for minimizing composite norms. Mathematical Programming, 144(1-2): 181-226, 2014.
4. Beck, A. and Teboulle, M. A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM J. Img. Sci., 2(1): 183-202, March 2009. ISSN 1936-4954.
5. Blatt, D., Hero, A., and Gauchman, H. A convergent incremental gradient method with a constant step size. SIAM Journal on Optimization, 18(1):29-51, 2007.
6. Chen, Annie I and Ozdaglar, Asuman. A fast distributed proximal-gradient method. In Communication, Control, and Computing (Allerton), 2012 50th Annual Allerton Conference on, pp. 601-608. IEEE, 2012.
7. Duchi, J. C., Agarwal, A., and Wainwright, M. J. Dual averaging for distributed optimization: Convergence analysis and network scaling. IEEE Trans. Automat. Contr., 57(3):592-606, 2012.
8. Fercoq, Olivier and Richtárik, Peter. Accelerated, parallel and proximal coordinate descent. arXiv preprint arXiv: 1312.5799, 2013.
9. Grone, R. and Merris, R. The laplacian spectrum of a graph, ii. SIAM J. Discrete Math., 7(2):221-229, 1994.
10. Jakovetic, Dusan, Xavier, Joao, and Moura, J. Fast distributed gradient methods. 2011.
11. Lesser, Victor, Ortiz Jr, Charles L, and Tambe, Milind. Distributed sensor networks: A multiagent perspective, volume 9. Springer, 2003.
12. Makhdoumi, Ali and Ozdaglar, Asuman. Broadcast-based distributed alternating direction method of multipliers. In Communication, Control, and Computing (Allerton), 2014 52nd Annual Allerton Conference on, pp. 270-277. IEEE, 2014.
13. Mateos, Gonzalo, Bazerque, Juan Andrés, and Giannakis, Georgios B. Distributed sparse linear regression. Signal Processing, IEEE Transactions on, 58(10):5262-5276, 2010.
14. McDonald, Ryan, Hall, Keith, and Mann, Gideon. Distributed training strategies for the structured perceptron. In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pp. 456-464. Association for Computational Linguistics, 2010.
15. Necoara, Ion and Suykens, Johan AK. Application of a smoothing technique to decomposition in convex optimization. Automatic Control, IEEE Transactions on, 53 (11):2674-2679, 2008.
16. Nedic, Angelia and Ozdaglar, Asuman. Distributed subgra-dient methods for multi-agent optimization. Automatic Control, IEEE Transactions on, 54(1):48-61, 2009.
17. Nesterov, Y. Efficiency of coordinate descent methods on huge-scale optimization problems. SIAM Journal on Optimization, 22(2):341-362, 2012.
18. Qu, Zheng and Richtárik, Peter. Coordinate descent with arbitrary sampling i: Algorithms and complexity. arXiv preprint arXiv: 1412.8060, 2014.
19. Richtárik, P. and Takáč, M. Iteration complexity of randomized block-coordinate descent methods for minimizing a composite function, forthcoming, Mathematical Programming, Series A, 2012. DOI: 10.1007/sl0107-012-0614-z.
20. Tseng, Paul. On accelerated proximal gradient methods for convex-concave optimization, submitted to SIAM Journal on Optimization, 2008.
21. Wei, Ermin and Ozdaglar, Asuman. Distributed alternating direction method of multipliers. 2012.
22. Wei, Ermin and Ozdaglar, Asuman. On the o (1/k) convergence of asynchronous distributed alternating direction method of multipliers. arXiv preprint arXiv: 1307.8254, 2013.