On ergodicity, infinite flow, and consensus in random models

IEEE Transactions on Automatic Control

Volumn 56, Issue 7, 2011, Pages 1593-1605

  Touri, Behrouz ^a   Nedić, Angelia ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Ergodicity; infinite flow; linear random model; product of random matrices; random consensus

Indexed keywords

ERGODICITY; INFINITE FLOW; PRODUCT OF RANDOM MATRICES; RANDOM CONSENSUS; RANDOM MODEL;

EQUIVALENCE CLASSES; MATRIX ALGEBRA; STATE FEEDBACK;

STOCHASTIC MODELS;

EID: 79960122105     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAC.2010.2091174     Document Type: Article

References (38)

1. M. Rosenblatt, "Products of independent identically distributed stochastic matrices," J. Math. Anal. Appl., vol. 11, no. 1, pp. 1-10, 1965.
2. K. Nawrotzki, "Discrete open systems on Markov chains in a random environment. I," Elektron. Inf. Kybernetik, vol. 17, pp. 569-599, 1981.
3. K. Nawrotzki, "Discrete open systems on markov chains in a random environment. II," Elektron. Inf. Kybernetik, vol. 18, pp. 83-98, 1982.
4. R. Cogburn, "On products of random stochastic matrices," in Random Matrices and Their Applications. Providence, RI: Amer. Math. Soc., 1986, pp. 199-213.
5. A. Tahbaz-Salehi and A. Jadbabaie, "A necessary and sufficient condition for consensus over random networks," IEEE Trans. Autom. Control, vol. 53, no. 3, pp. 791-795, Apr. 2008. (Pubitemid 351597186)
6. F. Fagnani and S. Zampieri, "Randomized consensus algorithms over large scale networks," IEEE J. Sel. Areas Commun., vol. 26, no. 4, pp. 634-649, May 2008. (Pubitemid 351658779)
7. A. Tahbaz-Salehi and A. Jadbabaie, "Consensus over ergodic stationary graph processes," IEEE Trans. Autom. Control, vol. 55, no. 1, pp. 225-230, Jan. 2010.
8. Y. Hatano, A. Das, and M. Mesbahi, "Agreement in presence of noise: Pseudogradients on random geometric networks," in Proc. 44th IEEE Conf. Decision Control & Eur. Control Conf., 2005, pp. 6382-6387.
9. I. Lobel and A. Ozdaglar, "Distributed subgradient methods over random networks," MIT, Cambridge, MA, Report 2800, 2008.
10. S. Patterson, B. Bamieh, and A. E. Abbadi, "Distributed average consensus with stochastic communication failures," in Proc. 46th IEEE Conf. Decision Control, 2007, pp. 4215-4220. (Pubitemid 351277806)
11. S. Boyd, A. Ghosh, B. Prabhakar, and D. Shah, "Randomized gossip algorithms," IEEE Trans. Inf. Theory, vol. 52, no. 6, pp. 2508-2530, Jun. 2006. (Pubitemid 43898906)
12. A. Dimakis, A. Sarwate, and M. Wainwright, "Geographic gossip: Efficient averaging for sensor networks," IEEE Trans. Signal Process., vol. 56, no. 3, pp. 1205-1216, Mar. 2008. (Pubitemid 351386279)
13. T. Aysal, M. Yildriz, A. Sarwate, and A. Scaglione, "Broadcast gossip algorithms for consensus," IEEE Trans. Signal Process., vol. 57, no. 7, pp. 2748-2761, Jul. 2009.
14. P. F. R. Carli, F. Fagnani, and S. Zampieri, "Gossip consensus algorithms via quantized communication," Automatica, vol. 46, no. 1, pp. 70-80, 2010.
15. M. Huang and J. Manton, "Stochastic approximation for consensus seeking: Mean square and almost sure convergence," in Proc. 46th IEEE Conf. Decision Control, 2007, pp. 306-311. (Pubitemid 351277170)
16. M. Huang and J. Manton, "Coordination and consensus of networked agents with noisy measurements: Stochastic algorithms and asymptotic behavior," SIAM J. Control Optimiz., vol. 48, no. 1, pp. 134-161, 2009.
17. S. Kar and J. Moura, "Distributed consensus algorithms in sensor networks: Link failures and channel noise," IEEE Trans. Signal Process., vol. 57, no. 1, pp. 355-369, Jan. 2009.
18. B. Touri and A. Nedić, "Distributed consensus over network with noisy links," in Proc. 12th Int. Conf. Inf. Fusion, 2009, pp. 146-154.
19. J. Tsitsiklis, "Problems in decentralized decision making and computation," Ph.D. dissertation, Dept. Elect. Eng. Comput. Sci., MIT, Cambridge, MA, 1984.
20. J. Tsitsiklis and M. Athans, "Convergence and asymptotic agreement in distributed decision problems," IEEE Trans. Autom. Control, vol. AC-29, no. 1, pp. 42-50, Jan. 1984. (Pubitemid 14529258)
21. J. Tsitsiklis, D. Bertsekas, and M. Athans, "Distributed asynchronous deterministic and stochastic gradient optimization algorithms," IEEE Trans. Autom. Control, vol. AC-31, no. 9, pp. 803-812, Sep. 1986. (Pubitemid 16629805)
22. D. Bertsekas and J. Tsitsiklis, Parallel and Distributed Computation: Numerical Methods. Upper Saddle River, NJ: Prentice-Hall, 1989.
23. S. Li and T. Basar, "Asymptotic agreement and convergence of asynchronous stochastic algorithms," IEEE Trans. Autom. Control, vol. AC-32, no. 7, pp. 612-618, Jul. 1987. (Pubitemid 17632335)
24. A. Jadbabaie, J. Lin, and S. Morse, "Coordination of groups of mobile autonomous agents using nearest neighbor rules," IEEE Trans. Autom. Control, vol. 48, no. 6, pp. 988-1001, Jun. 2003.
25. R. Olfati-Saber and R. Murray, "Consensus problems in networks of agents with switching topology and time-delays," IEEE Trans. Autom. Control, vol. 49, no. 9, pp. 1520-1533, Sep. 2004.
26. A. Olshevsky and J. Tsitsiklis, "Convergence speed in distributed consensus and averaging," SIAM J. Control Optimiz., vol. 48, no. 1, pp. 33-55, 2008.
27. W. Ren and R. Beard, "Consensus seeking in multiagent systems under dynamically changing interaction topologies," IEEE Trans. Autom. Control, vol. 50, no. 5, pp. 655-661, May 2005. (Pubitemid 40784437)
28. A. Kashyap, T. Basar, and R. Srikant, "Quantized consensus," Automatica, vol. 43, no. 7, pp. 1192-1203, 2007. (Pubitemid 46802442)
29. A. Nedić, A. Olshevsky, A. Ozdaglar, and J. Tsitsiklis, "On distributed averaging algorithms and quantization effects," IEEE Trans. Autom. Control, vol. 54, no. 11, pp. 2506-2517, Nov. 2009.
30. R. Carli, F. Fagnani, A. Speranzon, and S. Zampieri, "Communication constraints in the average consensus problem," Automatica, vol. 44, no. 3, pp. 671-684, 2008. (Pubitemid 351273696)
31. R. Carli, F. Fagnani, P. Frasca, T. Taylor, and S. Zampieri, "Average consensus on networks with transmission noise or quantization," in Proc. IEEE Amer. Control Conf., 2007, pp. 4189-4194.
32. P. Bliman, A. Nedić, and A. Ozdaglar, "Rate of convergence for consensus with delays," in Proc. 47th IEEE Conf. Decision Control, 2008, pp. 4849-4854.
33. S. Chatterjee and E. Seneta, "Towards consensus: Some convergence theorems on repeated averaging," J. Appl. Probab., vol. 14, no. 1, pp. 89-97, Mar. 1977.
34. R. Durrett, Probability: Theory and Examples, 3rd ed. Belmont, CA: Curt Hinrichs, 2005.
35. P. Billingsley, Probability and Measure. New York: Wiley, 1995.
36. S. Boyd, A. Ghosh, B. Prabhakar, and D. Shah, "Gossip algorithms: Design, analysis, and applications," in Proc. IEEE INFOCOM, 2005, pp. 1653-1664. (Pubitemid 41390681)
37. A. Nedić and A. Ozdaglar, "On the rate of convergence of distributed subgradient methods for multi-agent optimization," in Proc. IEEE CDC, 2007, pp. 4711-4716. (Pubitemid 351277887)
38. A. Nedić and A. Ozdaglar, "Distributed subgradient methods for multiagent optimization," IEEE Trans. Autom. Control, vol. 54, no. 1, pp. 48-61, Jan. 2009.