Mean field LQG control in leader-follower stochastic multi-agent systems: Likelihood ratio based adaptation

IEEE Transactions on Automatic Control

Volumn 57, Issue 11, 2012, Pages 2801-2816

  Nourian, Mojtaba ^a,b   Caines, Peter E ^a,b   Malhamé, Roland P ^b,c   Huang, Minyi ^d  

^a MCGILL UNIVERSITY   (Canada)

^b GERAD   (Canada)

^c ÉCOLE POLYTECHNIQUE DE MONTRÉAL   (Canada)

^d CARLETON UNIVERSITY   (Canada)

Author keywords

Adaptive control; leader follower collective behavior; likelihood ratio based adaptation; mean field (MF) stochastic control; Nash equilibria; stochastic optimal control

Indexed keywords

CONTROL THEORY; GAME THEORY; MULTI AGENT SYSTEMS; NAVIGATION; STOCHASTIC SYSTEMS; TELECOMMUNICATION NETWORKS;

ADAPTIVE CONTROL; COLLECTIVE BEHAVIOR; LIKELIHOOD RATIOS; NASH EQUILIBRIA; STOCHASTIC CONTROL; STOCHASTIC OPTIMAL CONTROL;

STOCHASTIC CONTROL SYSTEMS;

EID: 84869223716     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAC.2012.2195797     Document Type: Article

References (36)

1. Z. Lin, M. Broucke, and B. Francis, "Local control strategies for groups of mobile autonomous agents," IEEE Trans. Autom. Control, vol. 49, no. 4, pp. 622-629, Apr. 2004.
2. J. A. Fax and R. M. Murray, "Information flow and cooperative control of vehicle formations," IEEE Trans. Autom. Control, vol. 49, no. 9, pp. 1465-1476, Sep. 2004.
3. H. Yin, P. G. Mehta, S. P. Meyn, and U. V. Shanbhag, " Synchronization of coupled oscillators is a game," IEEE Trans. Autom. Control, vol. 57, no. 4, pp. 920-935, Apr. 2012.
4. L. Perea, G. Gómez, and P. Elosegui, "Extension of the Cucker-Smale control law to space flight formations," J. Guid., Control, Dyn., vol. 32, no. 2, pp. 527-537, 2009.
5. V. Lambson, "Self-enforcing collusion in large dynamic markets," J. Econ. Theory, vol. 34, no. 2, pp. 282-291, Dec. 1984.
6. M. Huang, P. E. Caines, and R. P. Malhamé, "Individual and mass behaviour in large population stochastic wireless power control problems: Centralized and Nash equilibrium solutions," in Proc. 42nd IEEE CDC, Maui, HI, Dec. 2003, pp. 98-103.
7. M. Huang, P. E. Caines, and R. P. Malhamé, "Large-population cost-coupled LQG problems with nonuniform agents: Individual-mass behavior and decentralized -Nash equilibria," IEEE Trans. Autom. Control, vol. 52, no. 9, pp. 1560-1571, Sep. 2007. (Pubitemid 47456068)
8. M. Huang, R. P. Malhamé, and P. E. Caines, "Large population stochastic dynamic games: Closed-loop Mckean-Vlasov systems and the Nash certainty equivalence principle," Commu. Inf. Syst., vol. 6, no. 3, pp. 221-252, 2006.
9. M. Huang, P. E. Caines, and R. P. Malhamé, "An invariance principle in large population stochastic dynamic games," J. Syst. Sci. Complex., vol. 20, no. 2, pp. 162-172, 2007. (Pubitemid 46800807)
10. P. E. Caines, "Bode lecture: Mean field stochastic control," in Proc. 48th IEEE CDC, Shanghai, China, Dec. 2009.
11. J.-M. Lasry and P.-L. Lions, "Mean field games," Jpn. J. Math., vol. 2, no. 1, pp. 229-260, 2007.
12. J.-M. Lasry and P.-L. Lions, "Jeux à champ moyen. I-Le cas station-naire," C. Rendus Math., vol. 343, no. 9, pp. 619-625, 2006. (Pubitemid 44689282)
13. J.-M. Lasry and P.-L. Lions, "Jeux à champ moyen. II-Horizon fini et contrle optimal," C. Rendus Math., vol. 343, no. 10, pp. 679-684, 2006. (Pubitemid 44762838)
14. G. Y. Weintraub, C. L. Benkard, and B. Van Roy, "Oblivious equilibrium: A mean field approximation for large-scale dynamic games," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2005.
15. T. Li and J.-F. Zhang, "Asymptotically optimal decentralized control for large population stochastic multiagent systems," IEEE Trans. Autom. Control, vol. 53, no. 7, pp. 1643-1660, Jul. 2008.
16. J. R. G. Dyer, A. Johansson, D. Helbing, I. D. Couzin, and J. Krause, "Leadership, consensus decision making and collective behaviour in humans," Phil. Tran. Royal Soc. B: Bio. Sci., vol. 364, no. 1518, pp. 781-789, 2009.
17. I. D. Couzin, J. Krause, N. R. Franks, and S. A. Levin, "Effective leadership and decision-making in animal groups on the move," Nature, vol. 433, no. 7025, pp. 513-516, Feb. 2005. (Pubitemid 40204306)
18. M. Nagy, Z. Ákos, D. Biro, and T. Vicsek, "Hierarchical group dynamics in pigeon flocks," Nature, vol. 464, no. 7290, pp. 890-893, 2010.
19. M. Simaan and J. B. Cruz, "On the Stackelberg strategy in nonzero-sum games," J. Opt. Theory Appl., vol. 11, no. 5, pp. 533-555, 1973.
20. W. Wang and J. E. Slotine, "A theoretical study of different leader roles in networks," IEEE Trans. Autom. Control, vol. 51, no. 7, pp. 1156-1161, Jul. 2006. (Pubitemid 44070132)
21. F. Aubé and R. Shield, "Modeling the effect of leadership on crowd flow dynamics," Cel. Aut., vol. 3305, pp. 601-611, 2004.
22. M. Nourian, R. P. Malhamé, M. Huang, and P. E. Caines, "Mean field (NCE) formulation of estimation based leader-follower collective dynamics," Int. J. Robot. Automat., vol. 26, no. 1, pp. 120-129, 2011.
23. M. Nourian, R. P. Malhamé, M. Huang, and P. E. Caines, "Optimality of adaptation based mean field control laws in leader-follower stochastic collective dynamics," in Proc. 49th IEEE CDC, Atlanta, GA, Dec. 2010, pp. 2270-2275.
24. W. Ren, R. W. Beard, and E. M. Atkins, "A survey of consensus problems in multi-agent coordination," in Proc. ACC, Portland, OR, Jun. 2005, pp. 1859-1864. (Pubitemid 41189135)
25. W. Ren, "Multi-vehicle consensus with a time-varying reference state," Syst. Control Lett., vol. 56, no. 7-8, pp. 474-483, 2007. (Pubitemid 46783052)
26. D. Acemoglu and M. Jensen, "Robust comparative statics in large static games," in Proc. 49th IEEE CDC, Atlanta, GA, Dec. 2010, pp. 3133-3139.
27. D. Gu and Z. Wang, "Leader-follower flocking: Algorithms and experiments," IEEE Trans. Control Syst. Technol., vol. 17, no. 5, pp. 1211-1219, 2009.
28. H. Liu, J. Shan, and D. Sun, "Adaptive synchronization control of multiple spacecraft formation flying," J. Dyn. Syst., Meas., Control, vol. 129, pp. 337-337, 2007.
29. B. Düring, P. Markowich, J. Pietschmann, and M. Wolfram, "Boltz-mann and Fokker-Planck equations modelling opinion formation in the presence of strong leaders," Proc. Royal Soc. A, vol. 465, no. 2112, pp. 3687-3707, 2009.
30. D. Delchamps, "Analytic feedback control and the algebraic Riccati equation," IEEE Trans. Autom. Control, vol. 29, no. 11, pp. 1031-1033, Nov. 1984. (Pubitemid 14669723)
31. P. E. Caines, Linear Stochastic Systems. New York: Wiley, 1987.
32. G. C. Goodwin and K. S. Sin, Adaptive Filtering Prediction and Control. Englewood Cliffs, NJ: Prentice-Hall, 1984.
33. P. E. Caines, "A note on the consistency of maximum likelihood estimates for finite families of stochastic processes," Annal. Stat., vol. 3, no. 2, pp. 539-546, 1975.
34. T. Duncan, "Evaluation of likelihood functions," Inform. Control, vol. 13, no. 1, pp. 62-74, Jul. 1968.
35. T. Duncan, "Likelihood functions for stochastic signals in white noise," Inform. Control, vol. 16, no. 4, pp. 303-310, 1970.
36. K. L. Chung, A Course in Probability Theory. San Diego, CA: Har-court, Brace and World, Inc., 1968.