Coordination and consensus of networked agents with noisy measurements: Stochastic algorithms and asymptotic behavior

SIAM Journal on Control and Optimization

Volumn 48, Issue 1, 2009, Pages 134-161

  Huang, Minyi ^a   Manton, Jonathan H ^b  

^a CARLETON UNIVERSITY   (Canada)

^b UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

Almost sure convergence; Consensus problems; Graphs; Mean square convergence; Measurement noise; Multiagent systems; Stochastic approximation

Indexed keywords

APPROXIMATION ALGORITHMS; APPROXIMATION THEORY; ECONOMIC AND SOCIAL EFFECTS; LYAPUNOV FUNCTIONS; MULTI AGENT SYSTEMS; STOCHASTIC CONTROL SYSTEMS; STOCHASTIC MODELS;

ALMOST SURE CONVERGENCE; CONSENSUS PROBLEMS; GRAPHS; MEAN SQUARE CONVERGENCES; MEASUREMENT NOISE; STOCHASTIC APPROXIMATIONS;

STOCHASTIC SYSTEMS;

EID: 60349124223     PISSN: 03630129     EISSN: None     Source Type: Journal    
DOI: 10.1137/06067359X     Document Type: Article

References (51)

1. S. ARANDA, S. MARTINEZ, AND F. BULLO, On optimal sensor placement and motion coordination for target tracking, in Proceedings of the IEEE International Conference on Robotics and Automation, Barcelona, Spain, 2005, pp. 4544-4549.
2. P. BAROOAH AND J. P. HESPANHA, Estimation on graphs from relative measurements: Distributed algorithms and fundamental limits, IEEE Control Syst. Mag., 27 (2007), pp. 57-74.
3. R. W. BEARD AND V. STEPANYAN, Synchronization of information in distributed multiple vehicle coordination control, in Proceedings of the 42nd IEEE Conference on Decision and Control, Maui, HI, 2003, pp. 2029-2034.
4. A. BENVENISTE, M. METIVIER, AND P. PRIOURET, Adaptive Algorithms and Stochastic Approximations, Springer-Verlag, New York, 1990.
5. P.-A. BLIMAN AND G. FERRARI-TRECATE, Average consensus problems in networks of agents with delayed communications, in Proceedings of the 44th IEEE Conference on Decision and Control and 2005 European Control Conference, Seville, Spain, 2005, pp. 7066-7071.
6. V. D. BLONDEL, J. M. HENDRICKX, A. OLSHEVSKY, AND J. N. TSITSIKLIS, Convergence in multiagent coordination, consensus, and flocking, in Proceedings of the 44th IEEE Conference on Decision and Control and 2005 European Control Conference, Seville, Spain, 2005, pp. 2996-3001.
7. V. BORKAR AND P. VARAIYA, Asymptotic agreement in distributed estimation, IEEE Trans. Automat. Control, 27 (1982), pp. 650-655.
8. A. BÖTTCHER AND S. M. GRUDSKY, Spectral Properties of Banded Toeplitz Matrices, SIAM, Philadelphia, 2005.
9. R. CARLI, F. FAGNANI, A. SPERANZON, AND S. ZAMPIERI, Communication constraints in coordinated consensus problems, in Proceedings of the American Control Conference, Minneapolis, MN, 2006, pp. 4189-4194.
10. S. CHATTERJEE AND E. SENETA, Towards consensus: Some convergence theorems on repeated averaging, J. Appl. Probab., 14 (1977), pp. 89-97.
11. H.-F. CHEN, Stochastic Approximation and Its Applications, Kluwer, Boston, MA, 2002.
12. Y. S. CHOW AND T. L. LIAI, Limiting behavior of weighted sums of independent random variables, Ann. Probab., 1 (1973), pp. 810-824.
13. Y. S. CHOW AND H. TEICHER, Probability Theory: Independence, Interchangeability, Martingales, Springer-Verlag, New York, 1978.
14. J. CORTES, S. MARTINEZ, AND F. BULLO, Robust rendezvous for mobile autonomous agents via proximity graphs in arbitrary dimensions, IEEE Trans. Automat. Control, 51 (2006), pp. 1289-1298.
15. G. A. DE CASTRO AND F. PAGANINI, Convex synthesis of controllers for consensus, in Proceedings of the American Control Conference, Boston, MA, 2004, pp. 4933-4938.
16. P. J. DAVIS, Circulant Matrices, John Wiley, New York, 1979.
17. J. P. DESAI, V. KUMAR, AND J. P. OSTROWSKI, Control of changes in formation for a team of mobile robots, in Proceedings of the IEEE International Conference on Robotics and Automation, Detroit, MI, 1999, pp. 1556-1561.
18. M. J. FISCHER, The consensus problem in unreliable distributed systems (a brief survey), in Foundations of Computation Theory, M. Karpinsky ed., Lecture Notes in Comput. Sci. 158, Springer-Verlag, New York, 1983, pp. 127-140.
19. C. GODSIL AND G. ROYLE, Algebraic Graph Theory, Springer-Verlag, New York, 2001.
20. M. H. DE GROOT, Reaching a consensus, J. Amer. Statist. Assoc, 69 (1974), pp. 118-121.
21. Y. HATANO AND M. MESBAHI, Agreement over random networks, IEEE Trans. Automat. Control, 50 (2005), pp. 1867-1872.
22. M. HUANG AND J. H. MANTON, Stochastic approximation for consensus seeking: Mean square and almost sure convergence, in Proceedings of the 46th IEEE Conference on Decision and Control, New Orleans, LA, 2007, pp. 306-311.
23. A. JADBABAIE, J. LIN, AND A. S. MORSE, Coordination of groups of mobile autonomous agents using nearest neighbor rules, IEEE Trans. Automat. Control, 48 (2003), pp. 988-1000.
24. H. J. KUSHNER AND G. G. YIN, Stochastic Approximation Algorithms and Applications, Springer-Verlag, New York, 1997.
25. N. E. LEONARD, D. A. PALEY, F. LEKIEN, R. SEPULCHRE, D. M. FRATANTONI, AND R. E. DAVIS, Collective motion, sensor networks and ocean sampling, in Proc. IEEE, 95 (2007), pp. 48-74.
26. Y. LIU AND Y. R. YANG, Reputation propagation and agreement in mobile ad hoc networks, in Proceedings of the IEEE Wireless Communications and Networking Conference, New Orleans, LA, 2003, pp. 1510-1515.
27. L. LJUNG, Analysis of recursive stochastic algorithms, IEEE Trans. Automat. Control, 22 (1977), pp. 551-575.
28. N. LYNCH, Distributed Algorithms, Morgan Kaufmann, San Mateo, CA, 1996.
29. J. A. MARSHALL AND M. E. BROUCKE, On invariance of cyclic group symmetries in multiagent formations, in Proceedings of the 44th IEEE Conference on Decision and Control and 2005 European Control Conference, Seville, Spain, 2005, pp. 746-751.
30. J. A. MARSHALL, M. E. BROUCKE, AND B. A. FRANCIS, Formations of vehicles in cyclic pursuit, IEEE Trans. Automat. Control, 49 (2004), pp. 1963-1974.
31. L. MOREAU, Stability of continuous-time distributed consensus algorithms, in Proceedings of the 43rd IEEE Conference on Decision and Control, Paradise Island, Bahamas, 2004, pp. 3998-4003.
32. L. MOREAU, Stability of multiagent systems with time-dependent communication links, IEEE Trans. Automat. Control, 50 (2005), pp. 169-182.
33. R. OLFATI-SABER, Flocking for multi-agent dynamic systems: Algorithms and theory, IEEE Trans. Automat. Control, 51 (2006), pp. 401-420.
34. R. OLFATI-SABER AND R. M. MURRAY, Consensus problems in networks of agents with switching topology and time-delays, IEEE Trans. Automat. Control, 49 (2004), pp. 1520-1533.
35. R. OLFATI-SABER, J. A. FAX, AND R. M. MURRAY, Consensus and cooperation in networked multi-agent systems, Proc. IEEE, 95 (2007), pp. 215-233.
36. A. V. OPPENHEIM AND R. W. SCHAFTER, Discrete-Time Signal Processing, Prentice-Hall, Englewood Cliffs, NJ, 1989.
37. J. G. PROAKIS AND D. G. MANOLAKIS, Digital Signal Processing: Principles, Algorithms, and Applications, Prentice-Hall, Upper Saddle River, NJ, 1996.
38. W. REN, R. W. BEARD, AND E. M. ATKINS, A survey of consensus problems in multi-agent coordination, in Proceedings of the American Control Conference, Portland, OR, 2005, pp. 1859-1864.
39. W. REN, R. W. BEARD, AND D. B. KINGSTON, Multi-agent Kalman consensus with relative uncertainty, in Proceedings of the American Control Conference, Portland, OR, 2005, pp. 1865-1870.
40. E. SENETA, Nonnegative Matrices and Markov Chains, 2nd ed., Springer-Verlag, New York, 1981.
41. I. D. SCHIZAS, A. RIBEIRO, AND G. B. GIANNAKIS, Consensus in ad hoc WSNs with noisy links-Part I: Distributed estimation of deterministic signals, IEEE Trans. Signal Process., 56 (2008), pp. 350-364.
42. A. TAHBAZ-SALEHI AND A. JADBABAIE, On consensus in random networks, in Proceedings of the 44th Annual Allerton Conference on Communication, Control and Computing, Monticello, IL, 2006, pp. 1315-1321.
43. H. G. TANNER, G. J. PAPPAS, AND V. KUMAR, Input-to-state stability on formation graphs, in Proceedings of the 41st IEEE Conference on Decision and Control, Las Vegas, NV, 2002, pp. 2439-2444.
44. H. G. TANNER, G. J. PAPPAS, AND V. KUMAR, Leader-to-formation stability, IEEE Trans. Robotics Automat., 20 (2004), pp. 443-455.
45. H. TEICHER, Almost certain convergence in double arrays, Z. Wahrsch. Verw. Gebiete, 69 (1985), pp. 331-345.
46. J. N. TSITSIKLIS AND M. ATHANS, Convergence and asymptotic agreement in distributed decision problems, IEEE Trans. Automat. Control, 29 (1984), pp. 42-50.
47. J. N. TSITSIKLIS, D. P. BERTSEKAS, AND M. ATHANS, Distributed asynchronous deterministic and stochastic gradient optimization algorithms, IEEE Trans. Automat. Control, 31 (1986), pp. 803-812.
48. P. K. VSSCHER, How self-organization evolves, Nature, 421 (2003), pp. 799-800.
49. R. L. WINKLER, The consensus of subjective probability distributions, Management Science, 15 (1968), pp. B61-B75.
50. L. XIAO AND S. BOYD, Fast linear iterations for distributed averaging, Systems Control Lett., 53 (2004), pp. 65-78.
51. L. XIAO, S. BOYD, AND S.-J. KIM, Distributed average consensus with least-mean-square deviation, J. Parallel Distrib. Comput., 67 (2007), pp. 33-46.