Exponentially fast parameter estimation in networks using distributed dual averaging

Proceedings of the IEEE Conference on Decision and Control

Volumn , Issue , 2013, Pages 6196-6201

  Shahrampour, Shahin ^a   Jadbabaiez, Ali ^a  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DISTRIBUTED PARAMETER CONTROL SYSTEMS; GRADIENT METHODS; OPTIMIZATION; PARAMETER ESTIMATION; STOCHASTIC SYSTEMS;

BAYESIAN LEARNING; DISTRIBUTED PARAMETER ESTIMATION; HIGH PROBABILITY; KULLBACK LEIBLER DIVERGENCE; LOCAL INFORMATION; RANDOMIZED GOSSIPS; SOCIAL LEARNING; STOCHASTIC GRADIENT DESCENT;

DISTRIBUTED PARAMETER NETWORKS;

EID: 84902335867     PISSN: 07431546     EISSN: 25762370     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2013.6760868     Document Type: Conference Paper

References (25)

1. V. Borkar and P. Varaiya, "Asymptotic agreement in distributed estimation, " IEEE Transactions on Automatic Control, vol. 27, no. 3, pp. 650-655, 1982.
2. J. N. Tsitsiklis, "Decentralized detection by a large number of sensors, " Mathematics of Control, Signals, and Systems, vol. 1, no. 2, pp. 167- 182, 1988.
3. J. N. Tsitsiklis et al., "Decentralized detection, " Advances in Statistical Signal Processing, vol. 2, pp. 297-344, 1993.
4. E. Mossel and O. Tamuz, "Efficient bayesian learning in social networks with gaussian estimators, " Arxiv preprint arXiv:1002.0747, 2010.
5. U.A.Khan, S. Kar, A. Jadbabaie, and J. Moura, "On connectivity, observability, and stability in distributed estimation, " in 49th IEEE Conference on Decision and Control (CDC). IEEE, 2010, pp. 6639- 6644.
6. S. Kar, J. Moura, and K. Ramanan, "Distributed parameter estimation in sensor networks: Nonlinear observation models and imperfect communication, " IEEE Transactions on Information Theory, vol. 58, no. 6, pp. 3575-3605, 2012.
7. K. Rad and A. Tahbaz-Salehi, "Distributed parameter estimation in networks, " in 49th IEEE Conference on Decision and Control (CDC). IEEE, 2010, pp. 5050-5055.
8. A. Jadbabaie, P. Molavi, A. Sandroni, and A. Tahbaz-Salehi, "Nonbayesian social learning, " Games and Economic Behavior, vol. 76, no. 1, pp. 210-225, 2012.
9. O. Dekel, R. Gilad-Bachrach, O. Shamir, and L. Xiao, "Optimal distributed online prediction using mini-batches, " The Journal of Machine Learning Research, vol. 13, pp. 165-202, 2012.
10. J. Tsitsiklis, "Problems in decentralized decision making and computation." DTIC Document, Tech. Rep., 1984.
11. A. Jadbabaie, J. Lin, and A. Morse, "Coordination of groups of mobile autonomous agents using nearest neighbor rules, " IEEE Transactions on Automatic Control, vol. 48, no. 6, pp. 988-1001, 2003.
12. M. Mesbahi and M. M. Egerstedt, Graph theoretic methods in multiagent networks. Princeton Univ Press, 2010.
13. F. Bullo, J. Cortes, and S. Martinez, Distributed control of robotic networks: A mathematical approach to motion coordination algorithms. Princeton Univ Pr, 2009.
14. R. Olfati-Saber and J. Shamma, "Consensus filters for sensor networks and distributed sensor fusion, " in 44th IEEE Conference on Decision and Control, Seville, Spain, Dec. 2005, pp. 6698 - 6703.
15. A. Nedic and A. Ozdaglar, "Distributed subgradient methods for multiagent optimization, " IEEE Transactions on Automatic Control, vol. 54, no. 1, pp. 48-61, 2009.
16. I. Lobel and A. Ozdaglar, "Distributed subgradient methods over random networks, " in Proc. Allerton Conf. Commun., Control, Comput, 2008.
17. S. Ram, A. Nedic, and V. Veeravalli, "Distributed stochastic subgradient projection algorithms for convex optimization, " Journal of optimization theory and applications, vol. 147, no. 3, pp. 516-545, 2010.
18. A. Nedic, A. Olshevsky, A. Ozdaglar, and J. Tsitsiklis, "On distributed averaging algorithms and quantization effects, " IEEE Transactions on Automatic Control, vol. 54, no. 11, pp. 2506-2517, 2009.
19. C. Lopes and A. Sayed, "Incremental adaptive strategies over distributed networks, " IEEE Transactions on Signal Processing, vol. 55, no. 8, pp. 4064-4077, 2007.
20. J. Duchi, A. Agarwal, and M. Wainwright, "Dual averaging for distributed optimization: convergence analysis and network scaling, " IEEE Transactions on Automatic Control, pp. 592-607, March 2012.
21. Y. Nesterov, "Primal-dual subgradient methods for convex problems, " Mathematical programming, vol. 120, no. 1, 2009.
22. S. Boyd, A. Ghosh, B. Prabhakar, and D. Shah, "Randomized gossip algorithms, " IEEE Transactions on Information Theory, vol. 52, no. 6, pp. 2508-2530, 2006.
23. T. M. Cover and J. A. Thomas, Elements of information theory. John Wiley & Sons, 2012.
24. D. Blackwell and L. Dubins, "Merging of opinions with increasing information, " The Annals of Mathematical Statistics, vol. 33, no. 3, pp. 882-886, 1962.
25. A. Tahbaz-Salehi and A. Jadbabaie, "Consensus over ergodic stationary graph processes, " IEEE Transactions on Automatic Control, vol. 55, no. 1, pp. 225-230, 2010.