A fast distributed proximal-gradient method

2012 50th Annual Allerton Conference on Communication, Control, and Computing, Allerton 2012

Volumn , Issue , 2012, Pages 601-608

  Chen, Annie I ^a   Ozdaglar, Asuman ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCELERATION TECHNIQUE; COMMUNICATION ROUNDS; CONVERGENCE RATES; CONVEX FUNCTIONS; DISTRIBUTED METHODS; NON-DIFFERENTIABLE; NUMERICAL EXPERIMENTS; OBJECTIVE FUNCTIONS;

COMMUNICATION; GRADIENT METHODS; OPTIMIZATION; TIME VARYING NETWORKS;

CONVERGENCE OF NUMERICAL METHODS;

EID: 84875742744     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/Allerton.2012.6483273     Document Type: Conference Paper

References (24)

1. A. Nedic and A. Ozdaglar, "Distributed subgradient methods for multi-agent optimization," in LIDS report 2755, IEEE Transactions on Automatic Control, vol. 54, no. 1, 2009, pp. 48-61.
2. J. Duchi, A. Agarwal, and M. Wainwright, "Dual averaging for distributed optimization: Convergence and network scaling," IEEE Transactions on Automatic Control, 2012.
3. D. Jakovetic, J. Xavier, and J. M. F. Moura, "Fast distributed gradient methods," arXiv:1112.2972v1, 2011.
4. M. Schmidt, N. L. Roux, and F. Bach, "Convergence rates of inexact proximal-gradient methods for convex optimization," CoRR, vol. abs/1109.2415, 2011.
5. J. N. Tsitsiklis, "Problems in decentralized decision making and computation," Ph.D. dissertation, Department of EECS, MIT, 1984.
6. J. N. Tsitsiklis, D. P. Bertsekas, and M. Athans, "Distributed asynchronous deterministic and stochastic gradient optimization algorithms," IEEE Transactions on Automatic Control, vol. 31, no. 9, pp. 803-812, 1986. (Pubitemid 16629805)
7. A. Jadbabaie, J. Lin, and S. Morse, "Coordination of groups of mobile autonomous agents using nearest neighbor rules," IEEE Transactions on Automatic Control, vol. 48, no. 6, pp. 988-1001, 2003.
8. R. Olfati-Saber and R. Murray, "Consensus problems in networks of agents with switching topology and time-delays," IEEE Transactions on Automatic Control, vol. 49, no. 9, pp. 1520-1533, 2004.
9. S. Boyd, A. Ghosh, B. Prabhakar, and D. Shah, "Gossip algorithms: Design, analysis, and applications," Proceedings of IEEE INFOCOM, 2005.
10. A. Olshevsky and J. Tsitsiklis, "Convergence rates in distributed consensus and averaging," Proceedings of the 45th IEEE Conference on Decision and Control, 2006.
11. B. Johansson, T. Keviczky, M. Johansson, and K. Johansson, "Subgradient methods and consensus algorithms for solving convex optimization problems," Proceedings of the 47th IEEE Conference on Decision and Control, p. 41854190, 2008.
12. S. S. Ram, A. Nedic, and V. V. Veeravalli, "Asynchronous gossip algorithms for stochastic optimization," Proceedings of the 48th IEEE Conference on Decision and Control, pp. 3581-3586, 2009.
13. A. Nedic, A. Ozdaglar, and P. A. Parrilo, "Constrained consensus and optimization in multi-agent networks," IEEE Transactions on Automatic Control, vol. 55, no. 4, 2010.
14. I. Lobel and A. Ozdaglar, "Distributed subgradient methods for convex optimization over random networks," IEEE Transactions on Automatic Control, vol. 56, no. 6, pp. 1291-1306, 2011.
15. M. Zhu and S. Martínez, "On distributed constrained formation control in operator-vehicle adversarial networks," Automatica, submitted, 2012.
16. S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein, "Distributed optimization and statistical learning via the alternating direction method of multipliers," Foundations and Trends in Machine Learning, vol. 3, no. 1, 2011.
17. E. Wei and A. Ozdaglar, "Distributed alternating direction method of multipliers."
18. R. T. Rockafellar, "Monotone operators and the proximal point algorithm," SIAM Journal on Control and Optimization, vol. 14, no. 5, pp. 877-898, 1976.
19. A. Beck and M. Teboulle, "A fast iterative shrinkage-thresholding algorithm for linear inverse problems," SIAM Journal on Imaging Sciences, vol. 2, pp. 183-202, March 2009.
20. - "Gradient-based algorithms with applications in signal recovery problems," in Convex Optimization in Signal Processing and Communications, D. P. Palomar and Y. C. Eldar, Eds. Cambridge University Press, 2010.
21. V. D. Blondel, J. M. Hendrickx, A. Olshevsky, and J. N. Tsitsiklis, "Convergence in multiagent coordination, consensus, and flocking," Proceedings of the Joint 44th IEEE Conference on Decision and Control and European Control Conference (CDC-ECC'05), 2005.
22. R. M. Corless, G. H. Gonnet, D. E. G. Hare, D. J. Jeffrey, and D. E. Knuth, "On the lambert w function," in Advances in Computational Mathematics, 1996, pp. 329-359. (Pubitemid 126729167)
23. K. Lang, "Newsweeder: Learning to filter netnews," in Proceedings of the Twelfth International Conference on Machine Learning, 1995, pp. 331-339.
24. J. Rennie, "20 newsgroups," http://people.csail.mit.edu/ jrennie/20Newsgroups/.