Mean field stochastic adaptive control

IEEE Transactions on Automatic Control

Volumn 58, Issue 4, 2013, Pages 905-920

  Kizilkale, Arman C ^a   Caines, Peter E ^a  

^a MCGILL UNIVERSITY   (Canada)

Author keywords

Adaptive control; mean field stochastic systems; Nash equilibria; stochastic optimal control

Indexed keywords

ADAPTIVE CONTROL; DYNAMICAL PARAMETERS; FUNCTION PARAMETERS; MEAN FIELD; NASH EQUILIBRIA; NONCOOPERATIVE GAME; STOCHASTIC ADAPTIVE CONTROL; STOCHASTIC OPTIMAL CONTROL;

CONTROL SYSTEMS; MATHEMATICAL MODELS;

ADAPTIVE CONTROL SYSTEMS;

EID: 84875622062     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAC.2012.2228032     Document Type: Article

References (44)

1. M. Huang, P. E. Caines, and R. P. Malhamé, "Individual and mass behavior in large population stochastic wireless power control problems: Centralized and Nash equilibriumsolutions," in Proc. 42nd IEEE Conf. Decision Control, Maui, HI, Dec. 2003, pp. 98-103.
2. M. Huang, P. E. Caines, and R. P. Malhamé, "Large population costcoupled LQG problems with non-uniform agents: Individual-mass behavior and decentralized-Nash equilibria," IEEE Trans. Autom. Control, vol. 52, no. 9, pp. 1560-1571, Sep. 2007. (Pubitemid 47456068)
3. D. Helbing, I. Farkas, and T. Vicsek, "Simulating dynamic features of escape panic," Nature, vol. 407, pp. 487-490, Sep. 2000.
4. H. G. Tanner, A. Jadbabaie, and G. J. Pappas, "Stable flocking of mobile agents, part i: Fixed topology," in Proc. 42nd IEEE Conf. Decision Control, Maui, HI, 2003, pp. 2010-2015.
5. Y. Liu and K. M. Passino, "Stable social foraging swarms in a noisy environment," IEEE Trans. Autom. Control, vol. 49, no. 1, pp. 30-44, Jan. 2004.
6. D. J. Low, "Following the crowd," Nature, vol. 407, pp. 465-466, Sep. 2000.
7. Y. C. Ho, A. E. Bryson, Jr, and S. Baron, "Differential games and optimal pursuit-evasion strategies," IEEE Trans. Autom. Control, vol. 10, pp. 385-389, 1965.
8. P. P. Varaiya, "The existence of solutions to a differential game," SIAM J. Control, vol. 5, pp. 153-162, 1967.
9. H. S. Witsenhausen, "Alternatives to the tree model for extensive games," in The Theory and Applicat. of Differential Games. Amsterdam, The Netherlands: Reidel Publishing Company, 1975, pp. 77-84.
10. A. Bensoussan, Perturbation Methods in Optimal Control. New York: Wiley, 1988.
11. R. Srikant and T. Basar, "Iterative computation of noncooperative equilibria in nonzero-sum differential games with weakly coupled players," J. Optim. Theory Appl., vol. 71, no. 1, pp. 137-168, Oct. 1991. (Pubitemid 21706870)
12. R. J. Aumann, "Markets with a continuum of traders," Econometrica, vol. 32, pp. 39-50, 1964.
13. B. Jovanovic and R. W. Rosenthal, "Anonymous sequential games," J. Math. Economics, vol. 17, pp. 77-87, 1988.
14. P. E. Caines, "Mean field stochastic control," in Proc. 48th IEEE Conf. Decision Control and 28th Chin. Control Conf., Dec. 2009 [Online]. Available: http://www.cim.mcgill.ca/%7Earman/Shanghai2009/Shanghai2009.zip
15. M. Huang, R. P. Malhamé, and P. E. Caines, "Large population stochastic dynamic games: Closed loop McKean-Vlasov systems and the Nash certainty equivalence principle," Special Issue Honour 65th Birthday of Tyrone Duncan, Commun. Inform. Syst., vol. 6, pp. 221-252, Nov. 2006.
16. G. Y. Weintraub, C. L. Benkard, and B. V. Roy, "Markov perfect industry dynamics with many firms," Econometrica, vol. 76, no. 6, pp. 1375-1411, 2008.
17. S. Adlakha, R. Johari, G.Weintraub, and A. Goldsmith, "On oblivious equilibrium in large population stochastic games," in Proc. 49th IEEE Conf. Decision Control, 2010, pp. 3117-3124.
18. A. Bodoh-Creed, Approximation of Large Games. Ithaca, NY: Cornell Univ. Press, 2011.
19. J. M. Lasry and P.-L. Lions, "Mean field games," Jpn. J. Math., vol. 2, no. 1, pp. 229-260, 2007.
20. H. Tembine, J.-Y. L. Boudec, R. El-Azouzi, and E. Altman, "Mean field asymptotics of Markov decision evolutionary games and teams," in Proc. Int. Conf. Game Theory Networks (GameNets'09), Istanbul, Turkey, 2009, pp. 140-150.
21. G. C. Goodwin, P. J. Ramadge, and P. E. Caines, "Discrete time stochastic adaptive control," SIAM J. Control Optim., vol. 19, no. 6, pp. 829-853, Nov. 1981.
22. P. E. Caines and S. Lafortune, "Adaptive control with recursive identification for stochastic linear systems," IEEE Trans. Autom. Control, vol. 29, no. 4, pp. 312-321, Apr. 1984. (Pubitemid 14564125)
23. P. E. Caines, "Continuous time stochastic adaptive control: non-explosion-consistency and stability," Syst. Control Lett., vol. 19, pp. 169-176, 1992. (Pubitemid 23560000)
24. B. Bercu, "Weighted estimation and tracking for ARMAX models," SIAM J. Control Optim., vol. 33, pp. 89-106, 1995.
25. L. Guo, "Self-convergence of weighted least-squares with applications to stochastic adaptive control," IEEE Trans. Autom. Control, vol. 41, pp. 79-89, 1996. (Pubitemid 126768440)
26. T. E. Duncan, L. Guo, and B. Pasik-Duncan, "Adaptive continuoustime linear quadratic gaussian control," IEEE Trans. on Autom. Control, vol. 44, pp. 1653-1662, Sep. 1999.
27. H.-F. Chen and L. Guo, "Optimal stochastic adaptive control with quadratic index," Int. J. Control, vol. 43, no. 3, pp. 869-881, 1986. (Pubitemid 16501900)
28. H.-F. Chen and L. Guo, Identification and Stochastic Adaptive Control. Boston, MA: Birkhäuser, 1991.
29. A. J. Gao, "Self-convergence of weighted least squares for continuoustime armax model," Ulam Quart., vol. 3, no. 2, pp. 25-40, 1996.
30. A. J. Gao and B. Pasik-Duncan, "Stochastic linear quadratic adaptive control for continuous-time first-order systems," Syst. Control Lett., vol. 31, pp. 149-154, 1997. (Pubitemid 127451980)
31. A. C. Kizilkale and P. E. Caines, "Stochastic adaptive Nash certainty equivalence control: Self-identification case," in Proc. 19th Int. Symp. Math. Theory Networks Syst. (MTNS'10), Jul. 2010, pp. 2093-2099.
32. A. C. Kizilkale and P. E. Caines, "Stochastic adaptive Nash certainty equivalence control: Population parameter distribution estimation," in Proc. 49th IEEE Conf. Decision Control, Dec. 2010, pp. 6169-6176.
33. A. C. Kizilkale and P. E. Caines, "Stochastic adaptive Nash certainty equivalence control with population dynamical and cost parameter estimation," in Proc. 19th Latin Amer. Congr. Autom. Control (ACCA'10) Abstracts, Aug. 2010, p. 35.
34. V. Krishna, Auction Theory. Cambridge, U.K.: Academic Press, 2002.
35. A. Marcet and T. Sargent, "Convergence of least squares learning mechanisms in self-referential linear stochastic models," J. Econ. Theory, vol. 48, pp. 337-368, 1989.
36. P. Maskell and A. Malmberg, "Localised learning and industrial competitiveness," Cambridge J. Econ., vol. 23, pp. 167-185, 1999. (Pubitemid 29233730)
37. T. Li and J.-F. Zhang, "Asymptotically optimal decentralized control for large population stochastic multiagent systems," IEEE Trans. Autom. Control, vol. 53, no. 7, pp. 1643-1660, Aug. 2008.
38. A. Bensoussan, Stochastic Control of Partially Observable Systems. Cambridge, U.K.: Cambridge Univ. Press, 1992.
39. A. C. Kizilkale and P. E. Caines, "Mean field stochastic adaptive control," CoRR, vol. Abs/1210.5493, 2012.
40. M. Huang, P. E. Caines, and R. P. Malhamé, "The NCE (mean field) principle with locality dependent cost interactions," IEEE Trans. Autom. Control, vol. 55, no. 12, pp. 2799-2805, Dec. 2010.
41. M. Huang, P. E. Caines, and R. P. Malhamé, "Social dynamics in mean field LQG control: Egoistic and altruistic agents," in Proc. 49th IEEE Conf. Decision Control, 2010, pp. 3140-3145.
42. D. Delchamps, "Analytic feedback control and the algebraic Riccati equation," IEEE Trans. Autom. Control, vol. 29, no. 11, pp. 1031-1033, Nov. 1984. (Pubitemid 14669723)
43. P. E. Caines, Linear Stochastic Systems. NYC, NY: Wiley, 1988.
44. J. L. Kelley, General Topology, 3rd ed. New York: Van Nostrand, 1955.