Nash, social and centralized solutions to consensus problems via mean field control theory

IEEE Transactions on Automatic Control

Volumn 58, Issue 3, 2013, Pages 639-653

  Nourian, Mojtaba ^a,b   Caines, Peter E ^a,b   Malhame, Roland P ^b,c   Huang, Minyi ^d  

^a MCGILL UNIVERSITY   (Canada)

^b GERAD   (Canada)

^c ÉCOLE POLYTECHNIQUE DE MONTRÉAL   (Canada)

^d CARLETON UNIVERSITY   (Canada)

Author keywords

Consensus problems; cooperative and non cooperative systems; decentralized control; mean field (MF) control; Nash equilibria; optimal control; social optima

Indexed keywords

CONSENSUS PROBLEMS; COOPERATIVE AND NON-COOPERATIVE SYSTEMS; MEAN FIELD; NASH EQUILIBRIA; OPTIMAL CONTROLS; SOCIAL OPTIMA;

COST BENEFIT ANALYSIS; COST FUNCTIONS; DECENTRALIZED CONTROL; LINEAR CONTROL SYSTEMS; POPULATION STATISTICS; STOCHASTIC MODELS; STOCHASTIC SYSTEMS; TELECOMMUNICATION NETWORKS; TOPOLOGY;

CONTROL THEORY;

EID: 84874613599     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAC.2012.2215399     Document Type: Article

References (38)

1. J. Tsitsiklis, D. Bertsekas, and M. Athans, "Distributed asynchronous deterministic and stochastic gradient optimization algorithms," IEEE Trans. Autom. Control, vol. AC-31, no. 9, pp. 803-812, Sep. 1986. (Pubitemid 16629805)
2. A. Jadbabaie, J. Lin, and A. S. Morse, "Coordination of groups of mobile autonomous agents using nearest neighbor rules," IEEE Trans. Autom. Control, vol. 48, no. 6, pp. 988-1001, Jun. 2003.
3. R.Olfati-Saber and R.M.Murray, "Consensus problems in networks of agents with switching topology and time-delays," IEEE Trans. Autom. Control, vol. 49, no. 9, pp. 1520-1533, Sep. 2004.
4. W. Ren and R. W. Beard, "Consensus seeking in multiagent systems under dynamically changing interaction topologies," IEEE Trans. Autom. Control, vol. 50, no. 5, pp. 655-661, May 2005. (Pubitemid 40784437)
5. W. Ren, R.W. Beard, and E.M. Atkins, "A survey of consensus problems in multi-agent coordination," in Proc. ACC, Portland, OR, Jun. 2005, pp. 1859-1864. (Pubitemid 41189135)
6. R. Olfati-Saber, J. A. Fax, and R. M. Murray, "Consensus and cooperation in networked multi-agent systems," in Proc. IEEE, Jan. 2007, vol. 95, no. 1, pp. 215-233.
7. M. Porfiri and D. J. Stilwell, "Consensus seeking over random weighted directed graphs," IEEE Trans. Autom. Control, vol. 52, no. 9, pp. 1767-1773, Sep. 2007. (Pubitemid 47456096)
8. M. Huang and J. H. Manton, "Coordination and consensus of networked agents with noisy measurements: Stochastic algorithms and asymptotic behavior," SIAM J. Control Optim., vol. 48, no. 1, pp. 134-161, 2009.
9. M. Huang and J. H.Manton, "Stochastic consensus seeking with noisy and directed inter-agent communication: Fixed and randomly varying topologies," IEEE Trans. Autom. Control, vol. 55, no. 1, pp. 235-241, Jan. 2010.
10. T. Li and J. F. Zhang, "Consensus conditions of multi-agent systems with time-varying topologies and stochastic communication noises," IEEE Trans. Autom. Control, vol. 55, no. 9, pp. 2043-2057, Sep. 2010.
11. F. Garin and L. Schenato, "A survey on distributed estimation and control applications using linear consensus algorithms," in Netw. Cont. Sys., A. Bemporad,M. Heemels, andM. Johansson, Eds. Berlin, Germany: Springer, 2011, pp. 75-107.
12. Y. Cao and W. Ren, "Optimal linear-consensus algorithms: An LQR perspective," IEEE Trans. Syst., Man, Cybern., Part B: Cybern., vol. 40, no. 3, pp. 819-830, Mar. 2010.
13. E. Semsar and K. Khorasani, "Optimal control and game theoretic approaches to cooperative control of a team of multi-vehicle unmanned systems," in Proc. ICNSC, London, UK, Jun. 2007, pp. 628-633. (Pubitemid 47468864)
14. D. Bauso, L. Giarré, and R. Pesenti, "Non-linear protocols for optimal distributed consensus in networks of dynamic agents," Syst. Control Lett., vol. 55, no. 11, pp. 918-928, 2006. (Pubitemid 44344836)
15. M. Huang, P. E. Caines, and R. P. Malhamé, "Individual and mass behavior in large population stochastic wireless power control problems: Centralized andNash equilibriumsolutions," in Proc. 42nd IEEE CDC, Maui, HI, Dec. 2003, pp. 98-103.
16. M. Huang, P. E. Caines, and R. P. Malhamé, "Large-population costcoupled LQG problems with nonuniform agents: Individual-mass behavior and decentralized-Nash equilibria," IEEE Trans. Autom. Control, vol. 52, no. 9, pp. 1560-1571, Sep. 2007. (Pubitemid 47456068)
17. M. Huang, P. E. Caines, and R. P. Malhamé, "The NCE (mean field) principle with locality dependent cost interactions," IEEE Trans. Autom. Control, vol. 55, no. 12, pp. 2799-2805, Dec. 2010.
18. M. Huang, R. P. Malhamé, and P. E. Caines, "Large population stochastic dynamic games: Closed-loop Mckean-Vlasov systems and the Nash certainty equivalence principle," Commun. Inform. Syst., vol. 6, no. 3, pp. 221-252, 2006.
19. M. Huang, P. E. Caines, and R. P. Malhamé, "An invariance principle in large population stochastic dynamic games," J. Syst. Sci. Complex., vol. 20, no. 2, pp. 162-172, 2007. (Pubitemid 46800807)
20. P. E. Caines, "Bode lecture: Mean field stochastic control," in Proc. 48th IEEE CDC, Shanghai, China, Dec. 2009 [Online]. Available: http://www.ieeecss-oll.org/lectures/2009/mean-field-stochastic-control
21. J.-M. Lasry and P.-L. Lions, "Mean field games," Jap. J. Math., vol. 2, no. 1, pp. 229-260, 2007.
22. J.-M. Lasry and P.-L. Lions, "Jeux à champ moyen. I-Le cas stationnaire," C. Rendus Math., vol. 343, no. 9, pp. 619-625, 2006. (Pubitemid 44689282)
23. J.-M. Lasry and P.-L. Lions, "Jeux à champ moyen. II Horizon fini et contrôle optimal," C. RendusMath., vol. 343, no. 10, pp. 679-684, 2006. (Pubitemid 44762838)
24. G. Y. Weintraub, C. L. Benkard, and B. Van Roy, "Oblivious equilibrium: A mean field approximation for large-scale dynamic games," in Advances in Neural Inf.Proc. Sys. Cambridge,MA:MITPress, 2006.
25. T. Li and J.-F. Zhang, "Asymptotically optimal decentralized control for large population stochastic multiagent systems," IEEE Trans. Autom. Control, vol. 53, no. 7, pp. 1643-1660, Aug. 2008.
26. M. Huang, P. E. Caines, and R. P. Malhamé, "Social optima in mean field LQG control: Centralized and decentralized strategies," IEEE Trans. Autom. Control, vol. 57, no. 7, pp. 1736-1751, Jul. 2012.
27. M. Nourian, P. E. Caines, R. P. Malhamé, and M. Huang, "A solution to the consensus problem via stochastic mean field control," in Proc. 2nd IFAC NecSys Workshop, Annecy, France, Sep. 2010, pp. 323-328.
28. W. Ren and R. W. Beard, Distributed Consensus in Multi-Vehicle Cooperative Control: Theory and Applications. London, UK: Springer-Verlag, 2007.
29. Z. Qu, Cooperative Control of Dynamical Systems: Applications to Autonomous Vehicles. London, UK: Springer-Verlag, 2009.
30. H. Yin, P. G. Mehta, S. P. Meyn, and U. V. Shanbhag, " Synchronization of coupled oscillators is a game," IEEE Trans. Autom. Control, vol. 57, no. 4, pp. 920-935, Apr. 2012.
31. M. Nourian, P. E. Caines, R. P. Malhamé, and M. Huang, "Mean field LQG control in leader-follower stochastic multi-agent systems: Likelihood ratio based adaptation," IEEE Trans. Autom. Control, vol. 57, no. 11, Nov. 2012.
32. F. Cucker and S. Smale, "Emergent behavior in flocks," IEEE Trans. Autom. Control, vol. 52, no. 5, pp. 852-862, May 2007. (Pubitemid 46796070)
33. C. Dogbé, "Modeling crowd dynamics by the mean-field limit approach," Math. Comput. Model., vol. 52, no. 9-10, pp. 1506-1520, 2010.
34. J. Lorenz, "Continuous opinion dynamics under bounded confidence: A survey," Int. J. Modern Phy. C, vol. 18, no. 12, pp. 1819-1838, 2007.
35. W. A. Brock and A. Haurie, "On existence of overtaking optimal trajectories over an infinite time horizon," Math. Oper. Res., vol. 1, no. 4, pp. 337-346, 1976.
36. L. Schenato and S. Zampieri, "On rendezvous control with randomly switching communication graphs," Netw. Heterogeneous Media, vol. 2, no. 4, pp. 627-646, 2007.
37. M. Nourian, "Mean Field Game Theory: Consensus, Leader-Follower and Major-Minor Agent Systems," Ph.D. dissertation, McGill Univ., Montreal, QC, Canada, Sep. 2012.
38. K. L. Chung, A Course in Probability Theory. San Diego, CA: Harcourt, Brace and World Inc, 1968.