A gossip algorithm for convex consensus optimization over networks

Proceedings of the 2010 American Control Conference, ACC 2010

Volumn , Issue , 2010, Pages 301-308

  Lu, Jie ^a   Tang, Choon Yik ^a   Regier, Paul R ^a   Bow, Travis D ^b  

^a USA   (United States)

^b OKLAHOMA CHRISTIAN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ASYNCHRONOUS ITERATIVE ALGORITHMS; COMMON LYAPUNOV FUNCTIONS; GOSSIP ALGORITHMS; GRADIENT BASED ALGORITHM; NETWORKED DYNAMICAL SYSTEMS; PAIRWISE AVERAGING; RANDOMIZED GOSSIP ALGORITHMS; SUB-GRADIENT ALGORITHM; TIME VARYING; UNDIRECTED NETWORK;

CONVEX OPTIMIZATION; DYNAMICAL SYSTEMS; LYAPUNOV FUNCTIONS; OPTIMIZATION; SIGNAL RECONSTRUCTION; TIME VARYING NETWORKS;

ALGORITHMS;

EID: 77957771508     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (39)

1. S.-H. Son, M. Chiang, S. R. Kulkarni, and S. C. Schwartz, "The value of clustering in distributed estimation for sensor networks," in Proc. International Conference on Wireless Networks, Communications and Mobile Computing, Maui, HI, 2005, pp. 969-974.
2. M. G. Rabbat and R. D. Nowak, "Distributed optimization in sensor networks," in Proc. International Symposium on Information Processing in Sensor Networks, Berkeley, CA, 2004, pp. 20-27.
3. M. H. DeGroot, "Reaching a consensus," Journal of the American Statistical Association, vol. 69, no. 345, pp. 118-121, 1974.
4. J. N. Tsitsiklis and M. Athans, "Convergence and asymptotic agreement in distributed decision problems," IEEE Transactions on Automatic Control, vol. 29, no. 1, pp. 42-50, 1984.
5. D. P. Bertsekas and J. N. Tsitsiklis, Parallel and Distributed Computation: Numerical Methods. Englewood Cliffs, NJ: Prentice-Hall, 1989.
6. -, "Some aspects of parallel and distributed iterative algorithms-a survey," Automatica, vol. 27, no. 1, pp. 3-21, 1991.
7. N. A. Lynch, Distributed Algorithms. San Francisco, CA: Morgan Kaufmann Publishers, 1996.
8. A. Jadbabaie, J. Lin, and A. S. Morse, "Coordination of groups of mobile autonomous agents using nearest neighbor rules," IEEE Transactions on Automatic Control, vol. 48, no. 6, pp. 988-1001, 2003.
9. R. Olfati-Saber and R. M. Murray, "Consensus problems in networks of agents with switching topology and time-delays," IEEE Transactions on Automatic Control, vol. 49, no. 9, pp. 1520-1533, 2004.
10. Y. Hatano and M. Mesbahi, "Agreement over random networks," IEEE Transactions on Automatic Control, vol. 50, no. 11, pp. 1867-1872, 2005.
11. L. Moreau, "Stability of multiagent systems with time-dependent communication links," IEEE Transactions on Automatic Control, vol. 50, no. 2, pp. 169-182, 2005.
12. W. Ren and R. W. Beard, "Consensus seeking in multiagent systems under dynamically changing interaction topologies," IEEE Transactions on Automatic Control, vol. 50, no. 5, pp. 655-661, 2005.
13. J. Cortés, "Finite-time convergent gradient flows with applications to network consensus," Automatica, vol. 42, no. 11, pp. 1993-2000, 2006.
14. L. Fang and P. J. Antsaklis, "On communication requirements for multi-agent consensus seeking," in Networked Embedded Sensing and Control, ser. Lecture Notes in Control and Information Sciences, P. J. Antsaklis and P. Tabuada, Eds. Berlin, Germany: Springer-Verlag, 2006, vol. 331, pp. 53-67.
15. R. Olfati-Saber, J. A. Fax, and R. M. Murray, "Consensus and cooperation in networked multi-agent systems," Proceedings of the IEEE, vol. 95, no. 1, pp. 215-233, 2007.
16. S. Sundaram and C. N. Hadjicostis, "Finite-time distributed consensus in graphs with time-invariant topologies," in Proc. American Control Conference, New York, NY, 2007, pp. 711-716.
17. A. Nedić and D. P. Bertsekas, "Incremental subgradient methods for nondifferentiable optimization," SIAM Journal on Optimization, vol. 12, no. 1, pp. 109-138, 2001.
18. A. Nedić, D. P. Bertsekas, and V. S. Borkar, "Distributed asynchronous incremental subgradient methods," in Inherently Parallel Algorithms in Feasibility and Optimization and Their Applications, D. Butnariu, Y. Censor, and S. Reich, Eds. Amsterdam, Holland: Elsevier, 2001, pp. 381-407.
19. A. Nedić and D. P. Bertsekas, "Convergence rate of incremental subgradient algorithms," in Stochastic Optimization: Algorithms and Applications, S. P. Uryasev and P. M. Pardalos, Eds. Norwell, MA: Kluwer Academic Publishers, 2001, pp. 223-264.
20. M. G. Rabbat and R. D. Nowak, "Quantized incremental algorithms for distributed optimization," IEEE Journal on Selected Areas in Communications, vol. 23, no. 4, pp. 798-808, 2005.
21. B. Johansson, M. Rabi, and M. Johansson, "A simple peer-to-peer algorithm for distributed optimization in sensor networks," in Proc. IEEE Conference on Decision and Control, New Orleans, LA, 2007, pp. 4705-4710.
22. A. Nedić and A. Ozdaglar, "On the rate of convergence of distributed subgradient methods for multi-agent optimization," in Proc. IEEE Conference on Decision and Control, New Orleans, LA, 2007, pp. 4711-4716.
23. S. S. Ram, A. Nedić, and V. V. Veeravalli, "Stochastic incremental gradient descent for estimation in sensor networks," in Proc. Asilomar Conference on Signals, Systems, and Computers, Pacific Grove, CA, 2007, pp. 582-586.
24. B. Johansson, T. Keviczky, M. Johansson, and K. H. Johansson, "Subgradient methods and consensus algorithms for solving convex optimization problems," in Proc. IEEE Conference on Decision and Control, Cancun, Mexico, 2008, pp. 4185-4190.
25. I. Lobel and A. Ozdaglar, "Convergence analysis of distributed subgradient methods over random networks," in Proc. Allerton Conference on Communication, Control, and Computing, Monticello, IL, 2008, pp. 353-360.
26. A. Nedić, A. Olshevsky, A. Ozdaglar, and J. N. Tsitsiklis, "Distributed subgradient methods and quantization effects," in Proc. IEEE Confer- ence on Decision and Control, Cancun, Mexico, 2008, pp. 4177-4184.
27. A. Nedić and A. Ozdaglar, "Distributed subgradient methods for multiagent optimization," IEEE Transactions on Automatic Control, vol. 54, no. 1, pp. 48-61, 2009.
28. S. S. Ram, A. Nedić, and V. V. Veeravalli, "Incremental stochastic subgradient algorithms for convex optimization," SIAM Journal on Optimization, vol. 20, no. 2, pp. 691-717, 2009.
29. M. R. Garey and D. S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness. New York, NY: W. H. Freeman, 1979.
30. S. Boyd and L. Vandenberghe, Convex Optimization. New York, NY: Cambridge University Press, 2004.
31. J. N. Tsitsiklis, "Problems in decentralized decision making and computation," Ph.D. Thesis, Massachusetts Institute of Technology, Cambridge, MA, 1984.
32. S. Boyd, A. Ghosh, B. Prabhakar, and D. Shah, "Randomized gossip algorithms," IEEE Transactions on Information Theory, vol. 52, no. 6, pp. 2508-2530, 2006.
33. M. Jelasity and A. Montresor, "Epidemic-style proactive aggregation in large overlay networks," in Proc. IEEE International Conference on Distributed Computing Systems, Tokyo, Japan, 2004, pp. 102-109.
34. A. Montresor, M. Jelasity, and O. Babaoglu, "Robust aggregation protocols for large-scale overlay networks," in Proc. IEEE/IFIP Inter- national Conference on Dependable Systems and Networks, Florence, Italy, 2004, pp. 19-28.
35. J. Lu, C. Y. Tang, P. R. Regier, and T. D. Bow, "A gossip algorithm for convex consensus optimization over networks," submitted for publication in IEEE Transactions on Automatic Control, 2010.
36. L. Xiao and S. Boyd, "Fast linear iterations for distributed averaging," Systems & Control Letters, vol. 53, no. 1, pp. 65-78, 2004.
37. J.-Y. Chen, G. Pandurangan, and D. Xu, "Robust computation of aggregates in wireless sensor networks: Distributed randomized algorithms and analysis," IEEE Transactions on Parallel and Distributed Systems, vol. 17, no. 9, pp. 987-1000, 2006.
38. M. Mehyar, D. Spanos, J. Pongsajapan, S. H. Low, and R. M. Murray, "Asynchronous distributed averaging on communication networks," IEEE/ACM Transactions on Networking, vol. 15, no. 3, pp. 512-520, 2007.
39. C. Y. Tang and J. Lu, "Controlled hopwise averaging: Bandwidth/energy-efficient asynchronous distributed averaging for wireless networks," in Proc. American Control Conference, St. Louis, MO, 2009, pp. 1561-1568.