Learning in mean-field games

IEEE Transactions on Automatic Control

Volumn 59, Issue 3, 2014, Pages 629-644

  Yin, Huibing ^a   Mehta, Prashant G ^a   Meyn, Sean P ^b   Shanbhag, Uday V ^c  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b University of Florida   (United States)

^c The Pennsylvania State University   (United States)

Author keywords

Mean field game; nonlinear systems; phase transition; stochastic learning; synchronization

Indexed keywords

APPROXIMATION ALGORITHMS; CONTROL; CONTROL THEORY; GALERKIN METHODS; NONLINEAR SYSTEMS; PHASE TRANSITIONS; SYNCHRONIZATION;

APPROXIMATE DYNAMIC PROGRAMMING; COUPLED OSCILLATORS; GALERKIN APPROXIMATIONS; MEAN FIELD MODELING; MEAN-FIELD GAMES; NUMERICAL EXPERIMENTS; STEEPEST DESCENT ALGORITHM; STOCHASTIC LEARNING;

OSCILLATORS (MECHANICAL);

EID: 84897679944     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAC.2013.2287733     Document Type: Article

References (42)

1. H. Yin, P. G. Mehta, S. P. Meyn, and U. V. Shanbhag, "Learning in mean-field oscillator games," in Proc. IEEE Conf. Decision and Control, Dec. 2010, pp. 3125-3132.
2. H. Yin, P. G. Mehta, S. P. Meyn, and U. V. Shanbhag, " Synchronization of coupled oscillators is a game," IEEE Trans. Autom. Control, vol. 57, no. 4, pp. 920-935, Apr. 2012.
3. M. Huang, R. P. Malhamé, and P. E. Caines, "Stochastic power control in wireless communication systems: Analysis, approximate control algorithms and state aggregation," in Proc. IEEE Conf. Decision and Control, 2003, pp. 4231-4236.
4. M. Huang, R. P.Malhamé, and P. E. Caines, "Nash equilibria for largepopulation linear stochastic systems of weakly coupled agents"," in Analysis, Control and Optimization of Complex Dynamic Systems, ser. GERAD 25th Anniv. Ser.. New York, NY, USA: Springer, 2005, vol. 4, pp. 215-252.
5. M. Huang, R. P. Malhamé, and P. E. Caines, "Large population stochastic dynamic games: Closed-loop Mckean-Vlasov systems and the Nash certainty equivalence principle," Commun. Inf. Syst., vol. 6, no. 3, pp. 221-251, 2006.
6. M. Huang, P. E. Caines, and R. P. Malhamé, "Large-population costcoupled LQG problems with nonuniform agents: Individual-mass behavior and decentralized-Nash equilibria," IEEE Trans. Autom. Control, vol. 52, no. 9, pp. 1560-1571, Sep. 2007. (Pubitemid 47456068)
7. T. Li and J.-F. Zhang, "Asymptotically optimal decentralized control for large population stochastic multiagent systems," IEEE Trans. Autom. Control, vol. 53, no. 7, pp. 1643-1660, Jul. 2008.
8. A. Bensoussan, K. C. J. Sung, S. C. P. Yam, and S. P. Yung, "Linearquadratic mean field games," , 2011, preprint.
9. R. Pesenti and D. Bauso, "Mean field linear quadratic games with set up costs," presented at the Int. Conf. Network Games, Control and Optimization (NetGCoop), 2011.
10. J. M. Lasry and P. L. Lions, "Mean field games," Jpn. J. Math., vol. 2, pp. 229-260, 2007.
11. G.Y.Weintraub, L. Benkard, and B.V. Roy, "Oblivious equilibrium:A mean field approximation for large-scale dynamic games," in Advances in Neural Information Processing Systems. Cambridge, MA, USA: MIT Press, 2006, vol. 18.
12. E. Altman, K. Avrachenkov, N. Bonneau, M. Debbah, R. El-Azouzi, and D. S. Menasche, "Constrained cost-coupled stochastic games with independent state processes," Oper. Res. Lett., vol. 36, no. 2, pp. 160-164, 2008. (Pubitemid 351265375)
13. H. Tembine, J.-Y. L. Boudec, R. El-Azouzi, and E. Altman, "Mean field asymptotics of Markov decision evolutionary games and teams," presented at the Int. Conf. Game Theory for Networks, 2009.
14. O. Gueant, J. M. Lasry, and P. L. Lions, "Mean field games and applications," in Paris-Princeton Lectures on Mathematical Finance, R. Carmona, Ed. New York, NY, USA: Springer, 2010, pp. 205-266.
15. M. Benaim and J.-Y. Le Boudec, "A class of mean field interaction models for computer and communication systems," Perf. Eval., vol. 65, no. 11-12, pp. 823-838, 2008.
16. N. Gast and B. Gaujal, "A mean field approach for optimization in particle systems and applications," in 4th Int. Conf. Performance Evaluation Methodologies and Tools, Valuetools, Pisa, 2009.
17. C. Dogbé, "Modeling crowd dynamics by the mean-field limit approach," Math. Comput. Model., vol. 52, no. 9-10, pp. 1506-1520, Nov. 2010.
18. A. Lachapelle and M.-T. Wolfram, "On a mean field game approach modeling congestion and aversion in pedestrian crowds," Transport. Res. Part B: Methodological, vol. 45, no. 10, pp. 1572-1589, 2011.
19. Z.Ma, D. Callaway, and I. A. Hiskens, "Decentralized charging control for large populations of plug-in electric vehicles," in Proc. 49th IEEE Conf. Decision Control, 2010, pp. 206-212.
20. R. Couillet, S. M. Perlaza, H. Tembine, and M. Debbah, "Electrical vehicles in the smart grid: A mean field game analysis," IEEE J. Sel. Areas Commun., vol. 30, no. 6, pp. 1086-1096, 2012.
21. D. Bauso, H. Tembine, and T. Basar, "Robust mean field games with application to production of exhaustible resource," in Proc. 7th IFAC Symp. Robust Control Design, 2012.
22. K. Deng, P. Barooah, and P. G. Mehta, "Mean-field control for energy efficient buildings," in Procs. Amer. Control Conf., Montreal, QC, Canada, Jun. 2012, pp. 3044-3049.
23. H. Tembine, P. Vilanova, and M. Debbah, Noisy mean feld stochastic games with network applications Ecole Superieure d Electricite, Gif-Sur-Yvette Cedex, France, 2010, Tech. Rep..
24. Z. Ma, R. P. Malhamé, and P. E. Caines, "Distributed control for radial loss network systems via the Nash certainty equivalence (mean field) principle," in Procs. IEEE Conf. Decision and Control, 2008, pp. 3829-3834.
25. A. Chaintreau, J.-Y. Le Boudec, and N. Ristanovic, "The age of gossip: Spatial mean field regime," in Proc. 11th ACM Int. Joint Conf. Measurement and Modeling of Computer Systems (SIGMETRICS '09), 2009, pp. 109-120.
26. M. Nourian, P. E. Caines, R. P. Malhamé, and M. Huang, "Leaderfollower Cucker-Smale type flocking synthesized via mean field stochastic control theory," in Brain, Body and Machine, ser. Advances in Soft Computing, J. Angeles, B. Boulet, J. Clark, J. Kvecses, and K. Siddiqi, Eds. Heidelberg, Germany: Springer, 2010, vol. 83, pp. 283-298.
27. M. Nourian, P. E. Caines, R. P.Malhamé, and M. Huang, "Nash, social and centralized solutions to consensus problems via mean field control theory," IEEE Trans. Autom. Control, vol. 58, no. 3, pp. 639-653,Mar. 2013.
28. D. Bertsekas and J. Tsitsiklis, Neuro-Dynamic Programming. Cambridge, MA, USA: Athena Scientific, 1996.
29. W. B. Powell, Approximate Dynamic Programming, ser. Wiley Series in Probability and Statistics, 2nd ed. Hoboken, NJ, USA: Wiley, 2011.
30. D. Vrabie, O. Pastravanu, M. Abu-Khalaf, and F. Lewis, "Adaptive optimal control for continuous-time linear systems based on policy iteration," Automatica, vol. 45, no. 2, pp. 477-484, 2009.
31. Y. Kuramoto, "Self-entrainment of a population of coupled non-linear oscillators," in International Symposium on . Mathematical Problems in Theoretical Physics, H. Araki, Ed. Berlin, Germany: Springer, 1975, vol. 39, Lecture Notes in Physics.
32. E. Brown, J. Moehlis, and P. Holmes, "On the phase reduction and response dynamics of neural oscillator populations," Neural Comput., vol. 16, no. 4, pp. 673-715, 2004. (Pubitemid 38318129)
33. M. Huang, P. E. Caines, and R. P. Malhamé, "Individual and mass behaviour in large population stochasticwireless power control problems: Centralized and nash equilibrium solutions," in Proc. 42nd IEEE Conf. Decision and Control, 2003, vol. 1, pp. 98-103.
34. G. Y. Weintraub, C. L. Benkard, and B. Van Roy, "Markov perfect industry dynamics with many firms," Econometrica, vol. 76, no. 6, pp. 1375-1411, 2008.
35. A. Destexhe and E. Marder, "Plasticity in single neuron and circuit computations," Nature, vol. 431, no. 7010, pp. 789-795, Oct. 2004. (Pubitemid 39434068)
36. D. Huang, W. Chen, P. G. Mehta, S. P. Meyn, and A. Surana, "Feature selection for neuro-dynamic programming," in Reinforcement Learning and Approximate Dynamic Programming for Feedback Control. Hoboken, NJ, USA: Wiley, 2011.
37. P. G. Mehta and S. P. Meyn, "Q-learning and Pontryagin's minimum principle," in Proc. 48th IEEE Conf. Decision and Control, Dec. 2009, pp. 3598-3605.
38. H. Tembine,"Mean field stochastic games: Convergence, Q/H-learning and optimality," in Proc. 2011 Amer. Control Conf., 2011, pp. 2423-2428.
39. C. J. C. H.Watkins and P. Dayan, "Learning," Mach. Learn., vol. 8, no. 3-4, pp. 279-292, 1992.
40. M. Steriade, Neuronal Substrates of Sleep and Epilepsy. Cambridge, U.K.: Cambridge Univ. Press, 2003.
41. R. Llinas and U. Ribary, "Consciousness and the brain. The thalamocortical dialogue in health and disease," Ann. New York Acad. Sci., vol. 929, pp. 166-175, 2001. (Pubitemid 32386058)
42. S. H. Strogatz and R. E.Mirollo, "Stability of incoherence in a population of coupled oscillators," J. Stat. Phys., vol. 63, pp. 613-635, May 1991.