Consensus and cooperation in networked multi-agent systems

Proceedings of the IEEE

Volumn 95, Issue 1, 2007, Pages 215-233

  Olfati Saber, Reza ^a   Fax, J Alex ^b   Murray, Richard M ^c  

^a DARTMOUTH COLLEGE   (United States)

^b NORTHROP GRUMMAN CORPORATION   (United States)

^c CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Consensus algorithms; Cooperative control; Flocking; Graph Laplacians; Information fusion; Multi agent systems; Networked control systems; Synchronization of coupled oscillators

Indexed keywords

CONSENSUS ALGORITHMS; COOPERATIVE CONTROL; FLOCKING; GRAPH LAPLACIANS; NETWORKED CONTROL SYSTEMS;

ALGORITHMS; CONTROL SYSTEM ANALYSIS; CONVERGENCE OF NUMERICAL METHODS; ELECTRIC NETWORK TOPOLOGY; GRAPH THEORY; INFORMATION FUSION; MARKOV PROCESSES; OSCILLATORS (ELECTRONIC); OSCILLATORS (MECHANICAL); SENSOR NETWORKS; SENSORS; SPACE RENDEZVOUS; SYNCHRONIZATION;

MULTI AGENT SYSTEMS;

EID: 64149119332     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2006.887293     Document Type: Article

References (102)

1. N. A. Lynch, Distributed Algorithms. San Francisco, CA: Morgan Kaufmann, 1997.
2. M. H. DeGroot, "Reaching a consensus," J. Am. Statist. Assoc., vol. 69, no. 345, pp. 118-121, 1974.
3. J. A. Benediktsson and P. H. Swain, "Consensus theoretic classification methods," IEEE Trans. Sys., Man, Cybern., vol. 22, no. 4, pp. 688-704, Apr. 1992.
4. S. C. Weller and N. C. Mann, "Assessing rater performance without a 'gold standard' using consensus theory," Med. Decision Making, vol. 17, no. 1, pp. 71-79, 1997.
5. V. Borkar and P. Varaiya, "Asymptotic agreement in distributed estimation," IEEE Trans. Autom. Control, vol. AC-27, no. 3, pp. 650-655, Jun. 1982.
6. J. N. Tsitsiklis, "Problems in decentralized decision making and computation," Ph.D. dissertation, Dept. Electr. Eng. Comput. Sci., Lab. Inf. Decision Syst., Massachusetts Inst. Technol., Cambridge, MA, Nov. 1984.
7. J. N. Tsitsiklis, D. P. Bertsekas, and M. Athans, "Distributed asynchronous deterministic and stochastic gradient optimization algorithms," IEEE Trans. Automatic Control, vol. 31, no. 9, pp. 803-812, Sep. 1986.
8. D. P. Bertsekas and J. Tsitsiklis, Parallell and Distributed Computation. Upper Saddle River, NJ: Prentice-Hall, 1989.
9. R. O. Saber and R. M. Murray, "Consensus protocols for networks of dynamic agents," in Proc. 2003 Am. Control Conf., 2003, pp. 951-956.
10. R. Olfati-Saber and R. M. Murray, "Consensus problems in networks of agents with switching topology and time-delays," IEEE Trans. Autom. Control, vol. 49, no. 9, pp. 1520-1533, Sep. 2004.
11. J. A. Fax, "Optimal and cooperative control of vehicle formations," Ph.D. dissertation, Control Dynamical Syst., California Inst. Technol., Pasadena, CA, 2001.
12. J. A. Fax and R. M. Murray, "Information flow and cooperative control of vehicle formations," IEEE Trans. Autom. Control, vol. 49, no. 9, pp. 1465-1476, Sep. 2004.
13. A. Jadbabaie, J. Lin, and A. S. Morse, "Coordination of groups of mobile autonomous agents using nearest neighbor rules," IEEE Trans. Autom. Control, vol. 48,no. 6, pp. 988-1001, Jun. 2003.
14. L. Moreau, "Stability of multi-agent systems with time-dependent communication links," IEEE Trans. Autom. Control, vol. 50, no. 2, pp. 169-182, Feb. 2005.
15. W. Ren and R. W. Beard, "Consensus seeking in multi-agent systems under dynamically changing interaction topologies," IEEE Trans. Autom. Control, vol. 50, no. 5, pp. 655-661, May 2005.
16. T. Vicsek, A. Cziroók, E. Ben-Jacob, I. Cohen, and O. Shochet, "Novel type of phase transition in a system of self-deriven particles," Phys. Rev. Lett., vol. 75, no. 6, pp. 1226-1229, 1995.
17. H. Abelson, D. Allen, D. Coore, C. Hanson, G. Homsy, J. Knight, T. F. R. Nagpal, E. Rauch, G. J. Sussman, and R. Weiss, "Amorphous computing," Commun. ACM, vol. 43, no. 5, pp. 74-82, 2000.
18. R. Nagpal, "Programmable self-assembly using biologically-inpired multi-agent control," in Proc. 1st Int. Conf. Autonomous Agents and Multi-Agent Systems, 2002, pp. 418-425.
19. R. Olfati-Saber, "Flocking for multi-agent dynamic systems: Algorithms and theory," IEEE Trans. Autom. Control, vol. 51, no. 3, pp. 401-420, Mar. 2006.
20. M. Fiedler, "Algebraic connectivity of graphs," Czechoslovak Math. J., vol. 23, no. 98, pp. 298-305, 1973.
21. B. Mohar, The Laplacian spectrum of graphs," in Graph Theory, Combinatorics, and Applications, Y. Alavi, G. Chartrand, O. Ollermann, and A. Schwenk, Eds. New York: Wiley, 1991, pp. 871-898.
22. R. Merris, "Laplacian matrices of a graph: A survey," Linear Algebra its Appl., vol. 197, pp. 143-176, 1994.
23. C. Godsil and G. Royle, Algebraic Graph Theory, ser. Graduate Texts in Mathematics. "erlin, Germany: Springer-Verlag, 2001, vol. 207.
24. M. Sipser and D. A. Spielman, "Expander codes," IEEE Trans. Inf. Theory, vol. 42, no. 6, pp. 1710-1772, Nov. 1996.
25. A. Lubotzky, R. Phillips, and P. Sarnak, "Ramanujan graphs," Combinatorica, vol. 8, no. 3, pp. 261-277, 1988.
26. Z. Lin, M. Brouke, and B. Francis, "Local control strategies for groups of mobile autonomous agents," IEEE Trans. Autom. Control, vol. 49, no. 4, pp. 622-629, Apr. 2004.
27. V. Blondel, J. M. Hendrickx, A. Olshevsky, and J. N. Tsitsiklis, "Convergence in multi-agent coordination, consensus, and flocking," in Proc. 44th IEEE Conf. Decision and Control, 2005 and 2005 Eur. Control Conf. (CDC-ECC '05), Dec. 2005, pp. 2996-3000.
28. D. Bauso, L. Giarré, and R. Pesenti, "Nonlinear protocols for optimal distributed consensus in networks of dynamic agents," Systems and Control Letters, vol. 55, no. 11, pp. 918-928, 2006.
29. J. Cortés, "Achieving coordination tasks in finite time via nonsmooth gradient Olfati-Saber et al.: Consensus and Cooperation in Networked Multi-Agent Systems flows," in Proc. 44th IEEE Conf. Decision and Control, 2005 and 2005 Eur. Control Conf. (CDC-ECC '05), Dec. 2005, pp. 6376-6381.
30. M. Mehyar, D. Spanos, J. Pongsjapan, S. H. Low, and R. M. Murray, "Distributed averaging on asynchronous communication networks," in Proc. 44th IEEE Conf. Decision and Control, 2005 and 2005 Eur. Control Conf. (CDC-ECC '05), Dec. 2005, pp. 7446-7451.
31. P.-A. Bliman and G. Ferrari-Trecate, "Average consensus problems in networks of agents with delayed communications," in Proc. 44th IEEE Conf. Decision and Control, 2005 and 2005 Eur. Control Conf. (CDC-ECC'05), Dec. 2005, pp. 7066-7071.
32. J. Sandhu, M. Mesbahi, and T. Tsukamaki, "Relative sensing networks: Observability, estimation, and the control structure," in Proc. 44th IEEE Conf. Decision and Control, 2005 and 2005 Eur. Control Conf. (CDC-ECC '05), Dec. 2005, pp. 6400-6405.
33. A. V. Savkin, "Coordinated collective motion of groups of autonomous mobile robots: Analysis of Vicsek's model," IEEE Trans. Autom. Control, vol. 49, no. 6, pp. 981-982, Jun. 2004.
34. N. Moshtagh, A. Jadbabaie, and K. Daniilidis, "Distributed geodesic control laws for flocking of nonholonomic agents," in Proc. 44th IEEE Conf. Decision and Control, 2005 and 2005 Eur. Control Conf. (CDC-ECC '05), Dec. 2005, pp. 2835-2841.
35. W. Xi, X. Tan, and J. S. Baras, "A stochastic algorithm for self-organization of autonomous swarms," in Proc. 44th IEEE Conf. Decision and Control, 2005 and 2005 Eur. Control Conf. (CDC-ECC '05), Dec. 2005, pp. 765-770.
36. R. A. Freeman, P. Yang, and K. M. Lynch, "Distributed estimation and control of swarm formation statistics," in Proc. 2006 Am. Control Conf., pp. 749-755, Minneapolis, MN, Jun. 2006.
37. R. Olfati-Saber, "Swarms on sphere: A programmable swarm with synchronous "ehaviors like oscillator networks," in Proc. 45th IEEE Conf. Decision and Control, pp. 5060-5066, San Diego, CA, Dec. 2006.
38. -, "Distributed Kalman filter with embedded consensus filter," in 44th IEEE Conf. Decision and Control, 2005 and 2005 Eur. Control Conf. (CDC-ECC '05), Dec. 2005, pp. 8179-8184.
39. R. Olfati-Saber and J. S. Shamma, "Consensus filters for sensor networks and distributed sensor fusion," in 44th IEEE Conf. Decision and Control, 2005 and 2005 Eur. Control Conf. (CDC-ECC '05), Dec. 2005, pp. 6698-6703.
40. V. Gupta, V. Hassibi, and R. M. Murray, "On sensor fusion in the presence of packet-dropping communication channels," in 44th IEEE Conf. Decision and Control, 2005 and 2005 Eur. Control Conf. (CDC-ECC '05), Dec. 2005, pp. 3547-3552.
41. Y. Hatano and M. Mesbahi, "Agreement over random networks," IEEE Trans. Autom. Control, vol. 50, no. 11, pp. 1867-1872, Nov. 2005.
42. V. M. Preciado and G. C. Verghese, "Synchronization in generalized Erd os-Rénye networks of nonlinear oscillators," in 44th IEEE Conf. Decision and Control, 2005 and 2005 Eur. Control Conf. (CDC-ECC '05), Dec. 2005, pp. 4628-4633.
43. R. Sepulchre, D. Paley, and N. Leonard, "Collective motion and oscillator synchronization," in Proc. Block Island Workshop Cooperative Control, Block Island, RI, Jun. 2003.
44. A. Jadbabaie, N. Motee, and M. Barahona, "On the stability of the Kuramoto model of coupled nonlinear oscillators," in Proc. 2004 Am. Control Conf., vol. 5, pp. 4296-4301, Jun. 2004.
45. A. Papachristodoulou and A. Jadbabaie, "Synchronization in oscillator networks: Switching topologies and non-homogeneous delays," in 44th IEEE Conf. Decision and Control, 2005 and 2005 Eur. Control Conf. (CDC-ECC '05), Dec. 2005, pp. 5692-5697.
46. N. Chopra and M. W. Spong, "On synchronization of Kuramoto oscillators," in 44th IEEE Conf. Decision and Control, 2005 and 2005 Eur. Control Conf. (CDC-ECC '05), Dec. 2005, pp. 3916-3922.
47. R. Olfati-Saber, "Ultrafast consensus in small-world networks," in Proc. 2005 Am. Control Conf., Jun. 2005, pp. 2371-2378.
48. M. Cao, D. A. Spielman, and A. S. Morse, "A lower bound on convergence of a distributed network consensus algorithm," in 44th IEEE Conf. Decision and Control, 2005 and 2005 Eur. Control Conf. (CDC-ECC '05), Dec. 2005, pp. 2356-2361.
49. Y. Kim and M. Mesbahi, "On maximizing the second smallest eigenvalue of state-dependent graph Laplacian," IEEE Trans. Autom. Control, vol. 51, no. 1, pp. 116-120, Jan. 2006.
50. L. Fang, P. J. Antsaklis, and A. Tzimas, "Asynchronous consensus protocols: Preliminary results, simulations and open questions," in 44th IEEE Conf. Decision and Control, 2005 and 2005 Eur. Control Conf. (CDC-ECC '05), Dec. 2005, pp. 2194-2199.
51. M. Egerstedt and X. Hu, "Formation control with virtual leaders and reduced communications," IEEE Trans. Robot. Autom., vol. 17, no. 6, pp. 947-951, 2001.
52. R. Olfati-Saber and R. M. Murray, "Distributed cooperative control of multiple vehicle formations using structural potential functions," presented at the 15th IFAC World Congr., "arcelona, Spain, Jul. 2002.
53. -, "Graph rigidity and distributed formation stabilization of multivehicle systems," in Proc. 41st IEEE Conf. Decision and Control, 2002, pp. 2965-2971.
54. T. Eren, W. Whiteley, A. S. Morse, P. N. Belhumeur, and B. D. O. Anderson, "Sensor and network topologies of formations with direction, "earing and angle information between agents," in Proc. 42nd IEEE Conf. Decision and Control, Dec. 2003, pp. 3064-3069.
55. R. Teo, D. Stipanović, and C. J. Tomlin, "Decentralize spacing control of a string of multiple vehicles over lossy datalinks," in Proc. 42nd IEEE Conf. Decision and Control, Dec. 2003, pp. 682-687.
56. H. G. Tanner, G. J. Pappas, and V. Kumar, "Leader-to-formation stability," IEEE Trans. Robot. Autom., vol. 20, no. 3, pp. 443-455, Jun. 2004.
57. Z. Lin, ". Francis, and M. Maggiore, "Necessary and sufficient graphical conditions for formation control of unicyles," IEEE Trans. Autom. Control, vol. 50, no. 1, pp. 121-127, Jan. 2005.
58. X. Xi and E. H. Abed, "Formation control with virtual leaders and reduced communications," in 44th IEEE Conf. Decision and Control, 2005 and 2005 Eur. Control Conf. (CDC-ECC '05), Dec. 2005, pp. 1854-1860.
59. D. V. Dimarogonas and K. J. Kyriakopoulos, "Formation control and collision avoidance for multi-agent systems and a connection "etween formation infeasibility and flocking behavior," in 44th IEEE Conf. Decision and Control, 2005 and 2005 Eur. Control Conf. (CDC-ECC '05), Dec. 2005, pp. 84-89.
60. R. O. Saber, W. B. Dunbar, and R. M. Murray, "Cooperative control of multivehicle systems using cost graphs and optimization," in Proc. 2003 Am. Control Conf., Jun. 2003, pp. 2217-2222.
61. T. Keviczky, G. J. Borelli, and F. Balas, "A study on decentralized receding horizon control for decoupled systems," in Proc. 2004 American Control Conf., 2004, pp. 4921-4926.
62. J. Hu, M. Prandini, and C. Tomlin, "Interesting conjugate points in formation constrained multi-agent coordination," in Proc. 2005 Am. Control Conf., Jun. 2005, pp. 1871-1876.
63. M. Alighanbari and J. P. How, "Decentralized task assignment for unmanned aerial vehicles," in 44th IEEE Conf. Decision and Control, 2005 and 2005 Eur. Control Conf. (CDC-ECC '05), Dec. 2005, pp. 5668-5673.
64. M. Mesbahi, "On state-dependent dynamic graphs and their controllability properties," IEEE Trans. Autom. Control, vol. 50, no. 3, pp. 387-392, Mar. 2005.
65. A. Muhammad and M. Egerstedt, "Connectivity graphs as models of local interactions," J. Appl. Math. Computation, 2004, (preprint, submitted).
66. M. Ji and M. Egerstedt, "Connectedness preserving distributed coordination control over dynamic graphs," in Proc. 2005 Am. Control Conf., Jun. 2005, pp. 93-98.
67. M. M. Zavlanos and G. J. Pappas, "Controlling connectivity of dynamic graphs," in 44th IEEE Conf. Decision and Control, 2005 and 2005 Eur. Control Conf. (CDC-ECC '05), Dec. 2005, pp. 6388-6393.
68. D. Hristu and K. Morgansen, "Limited communication control," Syst. Control Lett., vol. 37, pp. 193-205, Jul. 1999.
69. E. Klavins, Communication complexity of multirobot systems," in Algorithmic Foundations of Robotics V, ser. Springer Tracts in Advanced Robotics, J.-D. Boissonnats, J. Burdik, K. Goldberg, and S. Huchinson, Eds. Budapest: Springer, 2003, vol. 7, pp. 275-292.
70. Martínez, F. Bullo, J. Cortés, and E. Frazzoli, "On synchronous robotic networks Part I: Models, tasks, and complexity notions," in Proc. 44th IEEE Conf. Decision and Control, 2005 and 2005 Eur. Control Conf. (CDC-ECC '05), Dec. 2005, pp. 2847-2852.
71. -, "On synchronous robotic networks Part II: Time complexity of the rendezvous and deployment algorithms," in Proc. 44th IEEE Conf. Decision and Control, 2005 and 2005 Eur. Control Conf. (CDC-ECC '05), Dec. 2005, pp. 8313-8318.
72. V. Saligrama, M. Alanyali, and O. Savas, Asynchronous distributed detection in sensor networks, 2005, Preprint.
73. R. Olfati-Saber, E. Franco, E. Frazzoli, and J. S. Shamma, "Belief consensus and distributed hypothesis testing in sensor networks," presented at the Workshop on Network Embedded Sensing and Control, Notre Dame, IN, Oct. 2005.
74. D. P. Spanos, R. Olfati-Saber, and R. M. Murray, "Approximate distributed Kalman filtering in sensor networks with quantifiable performance," in Proc. 4th Int. Symp. Information Processing in Sensor Networks, Apr. 2005, pp. 133-139.
75. L. Xiao, S. Boyd, and S. Lall, "A scheme for asynchronuous distributed sensor fusion based on average consensus," in Proc. 4th Int. Symp. Information Processing in Sensor Networks, pp. 63-70, Apr. 2005.
76. J.-Y. Chen, G. Pandurangan, and D. Xu, "Robust computation of aggregates in wireless sensor networks: Distributed randomized algorithms and analysis," in Proc. 4th Int. Symp. Information Processing in Sensor Networks, Apr. 2005, pp. 348-355.
77. D. Kempe, A. Dobra, and J. Gehrke, "Gossip-based computation of aggregate information," in Proc. 44th Annu. IEEE Symp. Foundations of Computer Science (FOCS '03), 2003, vol. 3, no. 3, pp. 482-491.
78. S. Boyd, A. Ghosh, D. Prabhakar, and ". Shah, "Gossip algorithms: Design, analysis and applications," in Proc. 24th Annu. Joint Conf. IEEE Computer and Communications Societies (INFOCOM '05), Mar. 2005, pp. 1653-1664.
79. D. Fudenberg and D. K. Levine, The Theory of Learning in Games. Cambridge, MA: MIT Press, 1998.
80. J. S. Shamma and G. Arslan, "Dynamic fictitious play, dynamic gradient play, and distributed convergence to Nash equilibria," IEEE Trans. Autom. Control, vol. 50, no. 3, pp. 312-327, Mar. 2005.
81. R. A. Horn and C. R. Johnson, Matrix Analysis. Cambridge, U.K.: Cambridge Univ. Press, 1987.
82. G. Cybenko, "Dynamic load balancing for distributed memory multiprocessors," J. Parallel and Distributed Computing, vol. 7, no. 2, pp. 279-301, Oct. 1989.
83. Y. Kuramoto, Chemical Oscillators, Waves, and Turbulance. Berlin, Germany: Springer-Verlag, 1984.
84. R. E. Mirollo and S. H. Strogatz, "Synchronization of pulse-coupled biological oscillators," SIAM J. Appl. Math., vol. 50, pp. 1645-1662, 1990.
85. S. H. Strogatz, "From Kuramoto to Crawford: Exploring the onset of synchronization in populations of coupled oscillators," Physica D, vol. 143, pp. 1-20, 2000.
86. G. B. Ermentrout and N. Kopell, "Frequency plateaus in a chain of weakly coupled oscillator," SIAM J. Math. Anal., vol. 15, pp. 215-237, 1984.
87. J. Cortés, S. Martínez, T. Karatas, and F. Bullo, "Coverage control for mobile sensing networks," IEEE Trans. Robot. Autom., vol. 20, no. 2, pp. 243-255, Apr. 2004.
88. L. Xiao and S. Boyd, "Fast linear iterations for distributed averaging," Systems & Control Letters, vol. 52, pp. 65-78, 2004.
89. D. J. Watts and S. H. Strogatz, "Collective dynamics of 'small-world' networks," Nature, vol. 393, pp. 440-442, Jun. 1998.
90. H. Ando, Y. Oasa, I. Suzuki, and M. Yamashita, "Distributed memoryless point convergence algorithm for mobile robots with limited visibility," IEEE Trans. Robot. Autom., vol. 15, no. 5, pp. 818-828, Oct. 1999.
91. J. Lin, A. S. Morse, and B. D. O. Anderson, "The multi-agent rendezvous problem," in Proc. 42nd IEEE Conf. Decision and Control, Dec. 2003, pp. 1508-1513.
92. J. Cortés, S. Martínez, and F. Bullo, "Robust rendezvous for mobile autonomous agents via proximity graphs in arbitrary dimensions," IEEE Trans. Autom. Control, vol. 51, no. 8, pp. 1289-1298, Aug. 2004.
93. D. Spanos, R. Olfati-Saber, and R. M. Murray, "Dynamic consensus on mobile networks," presented at the 16th IFAC World Congr., Prague, Czech, 2005.
94. T. Eren, P. N. Belhumeur, and A. S. Morse, "Closing ranks in vehicle formations "ased on rigidity," in Proc. 41st IEEE Conf. Decision and Control, Dec. 2002, pp. 2959-2964.
95. L. Lovász, Random walks on graphs: A survey," in Combinatorics, Paul Erdos is Eighty, D. Milos, V. T. Sos, and T. Szony, Eds. Budapest, Hungary: János "olyai Math. Soc., 1996, pp. 353-398.
96. A.-L. Barabási and R. Albert, "Emergence of scaling in random networks," Science, vol. 286, pp. 509-512, 1999.
97. P. Erdös and A. Rényi, "On the evolution of randomgraphs," Pub. Math. Inst. Hungarian Acad. Science, vol. 5, pp. 17-61, 1960.
98. B. Sinopoli, L. Schenato, M. Franceschetti, K. Poola, M. I. Jordan, and S. S. Sastry, "Kalman filtering with intermittent observations," IEEE Trans. Autom. Control, vol. 49, no. 9, pp. 1453-1464, Sep. 2004.
99. R. O. Saber and R. M. Murray, "Flocking with obstacle avoidance: Cooperation with limited communication in mobile networks," in Proc. 42nd IEEE Conf. Decision and Control, 2003, vol. 2, pp. 2022-2028.
100. J. Wolfowitz, "Products of indecomposable, aperiodic, stochastic matrices," in Proc. Am. Math. Soc., 1963, vol. 15, pp. 733-736.
101. K. Zhou and J. C. Doyle, Essentials of Robust Control. Upper Saddle River, NJ: Prentice Hall, 1997.
102. M. E. J. Newman, "The structure and function of complex networks," SIAM Rev., vol. 45, pp. 167-256, 2003.