Gossip algorithms for convex consensus optimization over networks

IEEE Transactions on Automatic Control

Volumn 56, Issue 12, 2011, Pages 2917-2923

  Lu, Jie ^a   Tang, Choon Yik ^a   Regier, Paul R ^a   Bow, Travis D ^b  

^a University of Oklahoma   (United States)

^b Stanford University   (United States)

Author keywords

Distributed consensus; Distributed convex optimization; Gossip algorithms; Networked dynamical systems

Indexed keywords

COMMON LYAPUNOV FUNCTIONS; DISTRIBUTED CONSENSUS; GOSSIP ALGORITHMS; NETWORKED DYNAMICAL SYSTEMS; OPTIMIZATION PROBLEMS; PAIRWISE AVERAGING; RANDOMIZED GOSSIP ALGORITHMS; SUB-GRADIENT ALGORITHM; TECHNICAL NOTES; TIME VARYING; UNDIRECTED NETWORK;

ALGORITHMS; DYNAMICAL SYSTEMS; LYAPUNOV FUNCTIONS; OPTIMIZATION; SIGNAL RECONSTRUCTION; TIME VARYING NETWORKS;

CONVEX OPTIMIZATION;

EID: 83255176354     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAC.2011.2160020     Document Type: Article

References (21)

1. S.-H. Son, M. Chiang, S. R. Kulkarni, and S. C. Schwartz, "The value of clustering in distributed estimation for sensor networks," in Proc. Int. Conf. Wireless Netw., Commun. Mobile Comp., Maui, HI, 2005, pp. 969-974. (Pubitemid 44822442)
2. M. G. Rabbat and R. D. Nowak, "Distributed optimization in sensor networks," in Proc. Int. Symp. Inform. Processing Sens. Netw., Berkeley, CA, 2004, pp. 20-27.
3. R. Olfati-Saber, J. A. Fax, and R. M. Murray, "Consensus and cooperation in networked multi-agent systems," Proc. IEEE, vol. 95, no. 1, pp. 215-233, Jan. 2007.
4. A. Nedić and D. P. Bertsekas, "Incremental subgradient methods for nondifferentiable optimization," SIAM J. Optim., vol. 12, no. 1, pp. 109-138, 2001.
5. A. Nedić, D. P. Bertsekas, and V. S. Borkar, "Distributed asynchronous incremental subgradient methods," in Inherently Parallel Algorithms in Feasibility and Optimization and Their Applications, D. Butnariu, Y. Censor, and S. Reich, Eds. Amsterdam, The Netherlands: Elsevier, 2001, pp. 381-407.
6. A. Nedić and D. P. Bertsekas, "Convergence rate of incremental subgradient algorithms," in Stochastic Optimization: Algorithms and Applications, S. P. Uryasev and P. M. Pardalos, Eds. Norwell, MA: Kluwer Academic Publishers, 2001, pp. 223-264.
7. M. G. Rabbat and R. D. Nowak, "Quantized incremental algorithms for distributed optimization," IEEE J. Selected Areas Commun., vol. 23, no. 4, pp. 798-808, Apr. 2005. (Pubitemid 40519634)
8. B. Johansson, M. Rabi, and M. Johansson, "A simple peer-to-peer algorithm for distributed optimization in sensor networks," in Proc. IEEE Conf. Decision Control, New Orleans, LA, 2007, pp. 4705-4710. (Pubitemid 351277886)
9. A. Nedić and A. Ozdaglar, "On the rate of convergence of distributed subgradient methods for multi-agent optimization," in Proc. IEEE Conf. Decision Control, New Orleans, LA, 2007, pp. 4711-4716. (Pubitemid 351277887)
10. S. S. Ram, A. Nedić, and V. V. Veeravalli, "Stochastic incremental gradient descent for estimation in sensor networks," in Proc. Asilomar Conf. Signals, Syst., Comp., Pacific Grove, CA, 2007, pp. 582-586.
11. B. Johansson, T. Keviczky, M. Johansson, and K. H. Johansson, "Subgradient methods and consensus algorithms for solving convex optimization problems," in Proc. IEEE Conf. Decision Control, Cancun, Mexico, 2008, pp. 4185-4190.
12. I. Lobel and A. Ozdaglar, "Convergence analysis of distributed subgradient methods over random networks," in Proc. Allerton Conf. Commun., Control, Comp., Monticello, IL, 2008, pp. 353-360.
13. A. Nedić, A. Olshevsky, A. Ozdaglar, and J. N. Tsitsiklis, "Distributed subgradient methods and quantization effects," in Proc. IEEE Conf. Decision Control, Cancun, Mexico, 2008, pp. 4177-4184.
14. A. Nedić and A. Ozdaglar, "Distributed subgradient methods for multiagent optimization," IEEE Trans. Autom. Control, vol. 54, no. 1, pp. 48-61, Jan. 2009.
15. S. S. Ram, A. Nedić, and V. V. Veeravalli, "Incremental stochastic subgradient algorithms for convex optimization," SIAM J. Optim., vol. 20, no. 2, pp. 691-717, 2009.
16. S. S. Ram, A. Nedić, and V. V. Veeravalli, "Asynchronous gossip algorithms for stochastic optimization," in Proc. IEEE Conf. Decision Control, Shanghai, China, 2009, pp. 3581-3586.
17. S. S. Ram, A. Nedić, and V. V. Veeravalli, "Distributed stochastic subgradient projection algorithms for convex optimization," J. Optim. Theory Appl., vol. 147, no. 3, pp. 516-545, 2010.
18. J. N. Tsitsiklis, "Problems in Decentralized Decision Making and Computation," Ph.D. dissertation, Massachusetts Inst. Technol., Cambridge, MA, 1984.
19. S. Boyd, A. Ghosh, B. Prabhakar, and D. Shah, "Randomized gossip algorithms," IEEE Trans. Inform. Theory, vol. 52, no. 6, pp. 2508-2530 Jun. 2006. (Pubitemid 43898906)
20. J. Lu, C. Y. Tang, P. R. Regier, and T. D. Bow, "A gossip algorithm for convex consensus optimization over networks," in Proc. Amer. Control Conf., Baltimore, MD, 2010, pp. 301-308.
21. J. Lu, P. R. Regier, and C. Y. Tang, "Control of distributed convex optimization," in Proc. IEEE Conf. Decision Control, Atlanta, GA, 2010, pp. 489-495.