Convergence speed in distributed consensus and averaging

SIAM Review

Volumn 53, Issue 4, 2011, Pages 747-772

  Olshevsky, Alex ^a   Tsitsiklis, John N ^b  

^a Princeton University   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Consensus algorithms; Cooper ative control; Distributed averaging

Indexed keywords

COMMUNICATION TOPOLOGIES; CONSENSUS ALGORITHMS; CONVERGENCE SPEED; CONVERGENCE TIME; DISTRIBUTED AVERAGING; DISTRIBUTED CONSENSUS; ITERATIVE ALGORITHM; LOWER BOUNDS; POLYNOMIAL-TIME; TIME INVARIANTS; TIME VARYING;

TOPOLOGY;

ALGORITHMS;

EID: 84856716627     PISSN: 00361445     EISSN: None     Source Type: Journal    
DOI: 10.1137/110837462     Document Type: Review

References (60)

1. D. ACEMOGLU, A. OZDAGLAR, AND A. PARANDEHGHEIBI, Spread of (mis) information in social networks, Games Econom. Behav., 70(2010), pp. 194-227.
2. D. ANGELI AND P.-A. BLIMAN, Tight estimates for convergence of some non-stationaryconsensus algorithms, Systems Control Lett., 57(2008), pp. 996-1004.
3. D. ANGELI AND P.-A. BLIMAN, Convergence speed of unsteadydistributed consensus: Decay estimate along the settling spanning-trees, SIAM J. Control Optim., 48(2009), pp. 1-32.
4. P. BAROAH, Estimation and Control with Relative Measurements: Algorithms and Scaling Laws, Ph. D. Thesis, University of California at Santa Barbara, 2007.
5. D. P. BERTSEKAS AND J. N. TSITSIKLIS, Parallel and Distributed Computation: Numerical Methods, Prentice-Hall, Englewood Cliffs, NJ, 1989.
6. V. D. BLONDEL, J. M. HENDRICKX, A. OLSHEVSKY, AND J. N. TSITSIKLIS, Convergence in multiagent coordination, consensus, and flocking, in Proceedings of the Joint 44th IEEE Conference on Decision and Control and European Control Conference (CDC-ECC'05), Seville, Spain, 2005, pp. 2996-3000. (Pubitemid 46297429)
7. S. BOYD, A. GHOSH, B. PRABHAKAR, AND D. SHAH, Randomized gossip algorithms, IEEE Trans. Inform. Theory, 52(2006), pp. 2508-2530. (Pubitemid 43898906)
8. M. CAO, Personal communication.
9. M. CAO, A. S. MORSE, AND B. D. O. ANDERSON, Coordination of an asynchronous, multi-agent system via averaging, in Proceedings of the 16th International Federation of Automatic Control World Congress (IFAC), Prague, Czech Republic, 2005.
10. M. CAO, A. S. MORSE, AND B. D. O. ANDERSON, Reaching a consensus in a dynamically changing environment: A graphical approach, SIAM J. Control Optim., 47(2008), pp. 575-600.
11. M. CAO, A. S. MORSE, AND B. D. O. ANDERSON, Reaching a consensus in a dynamically changing environment: Convergence rates, measurement delays, and asynchronous events, SIAM J. Control Optim., 47(2008), pp. 601-623.
12. M. CAO, D. A. SPIELMAN, AND A. S. MORSE, A lower bound on convergence of a distributed network consensus algorithm, in Proceedings of the Joint 44th IEEE Conference on Decision and Control and European Control Conference (CDC-ECC'05), Seville, Spain, 2005, pp. 2356-2361. (Pubitemid 46297323)
13. R. CARLI, F. BULLO, AND S. ZAMPIERI, Quantized average consensus via dynamic coding/decoding schemes, Internat. J. Robust Nonlinear Control, 20(2010), pp. 156-175.
14. R. CARLI, F. FAGNANI, P. FRASCA, T. TAYLOR, AND S. ZAMPIERI, Average consensus on networks with transmission noise or quantization, in Proceedings of the European Control Conference, Kos, Greece, 2007, pp. 1852-1857.
15. B. CHAZELLE, Natural algorithms, in Proceedings of the 20th ACM-SIAM Symposium on Discrete Algorithms (SODA), 2009, pp. 422-431.
16. B. CHAZELLE, The geometryof flocking, in Proceedings of the 27th Annual Symposium on Computational Geometry (SOCG), 2010, pp. 19-28.
17. B. CHAZELLE, Analytical tools for natural algorithms, in Proceedings of the First Conference on Innovations in Computer Science (ICS), 2010, pp. 32-41.
18. J. CORTES, Finite-time convergent gradient flows with applications to network consensus, Automatica, 42(2006), pp. 1993-2000. (Pubitemid 44436061)
19. G. CYBENKO, Dynamic load balancing for distributed memory multiprocessors, J. Parallel Distrib. Comput., 7(1989), pp. 279-301.
20. M. H. DEGROOT, Reaching a consensus, J. Amer. Statist. Assoc., 69(1974), pp. 118-121.
21. J.-C DELVENNE, R. CARLI, AND S. ZAMPIERI, Optimal strategies in the average consensus problem, Systems Control Lett., 58(2009), pp. 759-765.
22. P. M. DEMARZO, D. VAYANOS, AND J. ZWIEBEL, Persuasion bias, social influence, and unidimensional opinions, Quart. J. Econom., 118(2003), pp. 909-968. (Pubitemid 37052879)
23. A. G. DIMAKIS, A. D. SARWATE, AND M. J. WAINWRIGHT, Geographic gossip: Efficient aggregation for sensor networks, in Proceedings of the 5th International Conference on Information Processing in Sensor Networks (IPSN), Nashville, TN, 2006, pp. 69-76.
24. J. DUCHI, A. AGARWAL, AND M. J. WAINWRIGHT, Dual averaging for distributed optimization: Convergence analysis and network scaling, IEEE Trans. Automat. Control, to appear.
25. P. ERDÖS AND A. RENYI, On the evolution of random graphs, Magyar Tud. Akad. Mat. Kutató Int. Közl., 5(1960), pp. 17-61.
26. L. FANG AND P. ANTSAKLIS, On communication requirements for multi-agent consensus seeking, in Proceedings of the Workshop on Networked Embedded Sensing and Control, Lecture Notes in Control and Inform. Sci. 331, Springer, Berlin, 2006, pp. 53-67.
27. N. M. FRERIS AND P. R. KUMAR, Fundamental limits on synchronization of affine clocks in networks, in Proceedings of the 46th IEEE Conference on Decision and Control, New Orleans, 2007, pp. 921-926. (Pubitemid 351277271)
28. A. GANGULI, S. SUSCA, S. MARTINEZ, F. BULLO, AND J. CORTES, On collective motion in sensor networks: Sample problems and distributed algorithms, in Proceedings of the Joint 44th IEEE Conference on Decision and Control and European Control Conference (CDC-ECC'05), Seville, Spain, 2005, pp. 4239-4244.
29. C. GAO, J. CORTÉS, AND F. BULLO, Notes on averaging over acyclic digraphs and discrete coverage control, Automatica, 44(2008), pp. 2120-2127.
30. B. GOLUB AND M. J. JACKSON, Naive learning in social networks and the wisdom of crowds, Amer. Econom. J. Microeconom., 2(2010), pp. 112-149.
31. R. HEGSELMANN AND U. KRAUSE, Opinion dynamics and bounded confidence: Models, analysis and simulation, J. Artificial Soc. Social Simul., 5(2002).
32. J. M. HENDRICKX AND V. D. BLONDEL, Convergence of linear and non-linear versions of Vicsek's model, in Proceedings of the 17th International Symposium on Mathematical Theory of Networks and Systems (MTNS'06), Kyoto, Japan, pp. 1229-1240. Available online from http://www-ics.acs.i.kyoto-u.ac.jp/mtns06/ papers/0156.pdf.
33. N. J. HIGHAM, Accuracyand Stability of Numerical Algorithms, 2nd ed., SIAM, Philadelphia, 2002.
34. R. HORN AND C. R. JOHNSON, Matrix Analysis, Cambridge University Press, Cambridge, UK, 1990.
35. A. JADBABAIE, J. LIN, AND A. S. MORSE, Coordination of groups of mobile autonomous agents using nearest neighbor rules, IEEE Trans. Automat. Control, 48(2003), pp. 988-1001.
36. H. J. LANDAU AND A. M. ODLYZKO, Bounds for eigenvalues of certain stochastic matrices, Linear Algebra Appl., 38(1981), pp. 5-15.
37. F. LEKIEN AND N. E. LEONARD, Nonuniform coverage and cartograms, SIAM J. Control Optim., 48(2009), pp. 351-372.
38. Q. LI AND D. RUS, Global clock synchronization in sensor networks, in Proceedings of the 23rd Conference of the IEEE Comuter and Communications Societies (INFOCOM), 2004, pp. 564-574.
39. S. LI AND H. WANG, Multi-Agent Coordination Using Nearest-Neighbor Rules: Revisiting the Vicsek Model, preprint, 2004; available online from http://arxiv.org/abs/cs. MA/0407021.
40. J. LIU, S. MOU, A. S. MORSE, B. D. O. ANDERSON, AND C. YU, Request-Based Gossiping, preprint.
41. Y. LIU AND Y. R. YANG, Reputation propagation and agreement in mobile ad hoc networks, in Proceedings of the IEEE Wireless Communications and Networking Conference (WCNC), 2003, pp. 1510-1515.
42. J. LORENZ AND D. A. LORENZ, On conditions for convergence to consensus, IEEE Trans. Automat. Control, 55(2010), pp. 1651-1656.
43. L. LOVÁSZ, Random walks on graphs: A survey, in Combinatorics, Paul Erdös Is Eighty, Vol. 2, D. Miklós, V. T. Sós, and T. Szõnyi, eds., János Bolyai Mathematical Society, Budapest, 1996, pp. 353-398.
44. M. MEHYAR, D. SPANOS, J. PONGSAJAPAN, S. H. LOW, AND R. M. MURRAY, Distributed averaging on asynchronous communication networks, in Proceedings of the Joint 44th IEEE Conference on Decision and Control and European Control Conference (CDC-ECC'05), Seville, Spain, 2005, pp. 7446-7451.
45. C. MOALLEMI AND B. VAN ROY, Consensus propagation, IEEE Trans. Inform. Theory, 52(2006), pp. 4753-4766. (Pubitemid 44680572)
46. L. MOREAU, Consensus seeking in multi-agent systems using dynamically changing interaction topologies, IEEE Trans. Automat. Control, 50(2005), pp. 169-182.
47. A. NEDIC, A. OLSHEVSKY, A. OZDAGLAR, AND J. N. TSITSIKLIS, On distributed averaging algorithms and quantization effects, IEEE Trans. Automat. Control, 54(2009), pp. 2506-2517.
48. A. NEDIC AND A. OZDAGLAR, Distributed subgradient methods for multi-agent optimization, IEEE Trans. Automat. Control, 54(2009), pp. 48-61.
49. R. OLFATI-SABER, J. A. FAX, AND R. M. MURRAY, Consensus and cooperation in networked multi-agent systems, Proc. IEEE, 95(2007), pp. 215-233.
50. R. OLFATI-SABER AND R. M. MURRAY, Consensus problems in networks of agents with switching topologyand time-delays, IEEE Trans. Automat. Control, 49(2004), pp. 1520-1533.
51. A. OLSHEVSKY, Efficient Information Aggregation Strategies in Distributed Control and Signal Processing, Ph. D. Thesis, Department of EECS, MIT, Cambridge, MA, 2010.
52. A. OLSHEVSKY AND J. N. TSITSIKLIS, A lower bound on distributed averaging, IEEE Trans. Automat. Control, to appear.
53. A. OLSHEVSKY AND J. N. TSITSIKLIS, Degree Fluctuations and the Convergence Time of Consensus Algorithms, preprint, 2011.
54. S. S. RAM, A. NEDIC, AND V. V. VEERAVALLI, Distributed stochastic subgradient projection algorithms for convex optimization, J. Optim. Theory Appl., 147(2010), pp. 516-545.
55. L. SCHENATO AND G. GAMBA, A distributed consensus protocol for clock synchronization in wireless sensor network, in Proceedings of the 46th IEEE Conference on Decision and Control, New Orleans, 2007, pp. 2289-2294. (Pubitemid 351277496)
56. M. SCHWAGER, J.-J. SLOTINE, AND D. RUS, Consensus learning for distributed coverage control, in Proceedings of International Conference on Robotics and Automation (ICRA), Pasadena, CA, 2008, pp. 1042-1048.
57. J. N. TSITSIKLIS, Problems in Decentralized Decision Making and Computation, Ph. D. Thesis, Department of EECS, MIT, Cambridge, MA, 1984.
58. J. N. TSITSIKLIS, D. P. BERTSEKAS, AND M. ATHANS, Distributed asynchronous deterministic and stochastic gradient optimization algorithms, IEEE Trans. Automat. Control, 31(1986), pp. 803-812. (Pubitemid 16629805)
59. T. VICSEK, E. CZIROK, E. BEN-JACOB, I. COHEN, AND O. SHOCHET, Novel type of phase transitions in a system of self-driven particles, Phys. Rev. Lett., 75(1995), pp. 1226-1229.
60. L. XIAO AND S. BOYD, Fast linear iterations for distributed averaging, Systems Control Lett., 53(2004), pp. 65-78.