Distributed subgradient methods for convex optimization over random networks

IEEE Transactions on Automatic Control

Volumn 56, Issue 6, 2011, Pages 1291-1306

  Lobel, Ilan ^a   Ozdaglar, Asuman ^b  

^a NEW YORK UNIVERSITY   (United States)

^b USA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALMOST SURE CONVERGENCE; CONVEX FUNCTIONS; LINK FAILURES; MULTI-AGENT; OBJECTIVE FUNCTIONS; RANDOM NETWORK; SHARING INFORMATION; STOCHASTIC PROCESS; SUB-GRADIENT ALGORITHM; SUBGRADIENT METHODS;

ALGORITHMS; CONVERGENCE OF NUMERICAL METHODS; CONVEX OPTIMIZATION; ELECTRIC NETWORK TOPOLOGY; RANDOM PROCESSES; TIME VARYING NETWORKS;

OPTIMIZATION;

EID: 79958296696     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAC.2010.2091295     Document Type: Article

References (25)

1. D. P. Bertsekas, A. Nedić, and A. E. Ozdaglar, Convex Analysis and Optimization. Cambridge, MA: Athena Scientific, 2003.
2. D. P. Bertsekas and J. N. Tsitsiklis, Parallel and Distributed Computation: Numerical Methods. Belmont, MA: Athena Scientific, 1997.
3. D. Bertsimas and J. N. Tsitsiklis, Linear Optimization. Belmont, MA: Athena Scientific, 1985.
4. V. D. Blondel, J. M. Hendrickx, A. Olshevsky, and J. N. Tsitsiklis, "Convergence in multiagent coordination, consensus, and flocking", presented at the IEEE CDC, 2005.
5. S. Boyd, A. Ghosh, B. Prabhakar, and D. Shah, "Gossip algorithms: Design, analysis, and applications", presented at the IEEE INFOCOM, 2005.
6. M. Cao, D. A. Spielman, and A. S. Morse, "A lower bound on convergence of a distributed network consensus algorithm", presented at the IEEE CDC, 2005.
7. R. Carli, F. Fagnani, A. Speranzon, and S. Zampieri, "Communication constraints in coordinated consensus problems", presented at the IEEE ACC, 2006.
8. M. Chiang, S. H. Low, A. R. Calderbank, and J. C. Doyle, "Layering as optimization decomposition: A mathematical theory of network architectures", Proc. IEEE, vol. 95, pp. 255-312, 2007.
9. Y. Hatano and M. Mesbahi, "Agreement over random networks", IEEE Trans. Autom. Control, vol. 50, no. 11, pp. 1867-1872, Nov. 2005. (Pubitemid 41748891)
10. A. Jadbabaie, J. Lin, and S. Morse, "Coordination of groups of mobile autonomous agents using nearest neighbor rules", IEEE Trans. Autom. Control, vol. 48, no. 9, pp. 988-1001, Sep. 2003.
11. F. P. Kelly, A. K. Maulloo, and D. K. Tan, "Rate control for communication networks: Shadow prices, proportional fairness, and stability", J. Oper. Res. Soc., vol. 49, pp. 237-252, 1998. (Pubitemid 128610018)
12. S. Low and D. E. Lapsley, "Optimization flow control, I: Basic algorithm and convergence", IEEE/ACM Trans. Netw., vol. 7, no. 6, pp. 861-874, Dec. 1999. (Pubitemid 30553383)
13. A. Nedić, A. Olshevsky, A. Ozdaglar, and J. N. Tsitsiklis, "On distributed averaging algorithms and quantization effects", IEEE Trans. Autom. Control, vol. 54, no. 1, pp. 2506-2517, Nov. 2009.
14. A. Nedić and A. Ozdaglar, "Distributed subgradient methods for multiagent optimization", IEEE Trans. Autom. Control, vol. 54, no. 1, pp. 48-61, Jan. 2009.
15. A. Nedić, A. Ozdaglar, and P. A. Parrilo, "Constrained consensus and optimization in multi-agent networks", IEEE Trans. Autom. Control, 2008, LIDS Rep. 2779, to be published.
16. R. Olfati-Saber and R. M. Murray, "Consensus problems innetworks of agents with switching topology and time-delays", IEEE Trans. Autom. Control, vol. 49, no. 9, pp. 1520-1533, Sep. 2004.
17. A. Olshevsky and J. N. Tsitsiklis, "Convergence rates in distributed consensus averaging", presented at the IEEE CDC, 2006.
18. A. Olshevsky and J. N. Tsitsiklis, "Convergence speed in distributed consensus and averaging", SIAM J. Control Optim., vol. 48, no. 1, pp. 33-55, 2009.
19. S. S. Ram, A. Nedić, and V. V. Veeravalli, "Stochastic incremental gradient descent for estimation in sensor networks", presented at the Asilomar Conf., 2007.
20. R. Srikant, Mathematics of Internet Congestion Control. New York: Birkhauser, 2004.
21. A. Tahbaz-Salehi and A. Jadbabaie, "A necessary and sufficient condition for consensus over random networks", IEEE Trans. Autom. Control, vol. 53, no. 3, pp. 791-795, Mar. 2008. (Pubitemid 351597186)
22. J. N. Tsitsiklis, "Problems in Decentralized Decision Making and Computation", Ph. D. dissertation, Dept. Elect. Eng. Comput. Sci., Mass. Inst. Technol., Cambridge, MA, 1984.
23. J. N. Tsitsiklis, D. P. Bertsekas, and M. Athans, "Distributed asynchronous deterministic and stochastic gradient optimization algorithms", IEEE Trans. Autom. Control, vol. AC-31, no. 9, pp. 803-812, Sep. 1986. (Pubitemid 16629805)
24. T. Vicsek, A. Czirok, E. Ben-Jacob, I. Cohen, and O. Schochet, "Novel type of phase transitionsin a system of self-driven particles", Phys. Rev. Lett., vol. 75, no. 6, pp. 1226-1229, 1995.
25. C. W. Wu, "Syncronization and convergence of linear dynamics in random directed networks", IEEE Trans. Autom. Control, vol. 51, no. 7, pp. 1207-1210, Jul. 2006. (Pubitemid 44080987)