Stochastic adaptive nash certainty equivalence control: Population parameter distribution estimation

Proceedings of the IEEE Conference on Decision and Control

Volumn , Issue , 2010, Pages 6169-6176

  Kizilkale, Arman C ^a   Caines, Peter E ^a  

^a MCGILL UNIVERSITY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE CONTROL SYSTEMS; CONTROL THEORY; COST BENEFIT ANALYSIS; DISTRIBUTION FUNCTIONS; DYNAMICAL SYSTEMS; GAME THEORY; MAXIMUM LIKELIHOOD ESTIMATION; POPULATION DISTRIBUTION; STOCHASTIC CONTROL SYSTEMS; STOCHASTIC SYSTEMS;

CERTAINTY EQUIVALENCE; DYNAMICAL PARAMETERS; LONG-RUN AVERAGE COST; NONCOOPERATIVE GAME; PARAMETER DISTRIBUTIONS; PRIORI INFORMATION; RECURSIVE WEIGHTED LEAST SQUARE; STOCHASTIC ADAPTIVE CONTROL;

PARAMETER ESTIMATION;

EID: 79953146784     PISSN: 07431546     EISSN: 25762370     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2010.5717543     Document Type: Conference Paper

References (30)

1. M. Huang, P. E. Caines, and R. P. Malhamé, "Large population cost-coupled LQG problems with non-uniform agents: Individual-mass behaviour and decentralized ε - Nash equilibria," IEEE Trans. on Automatic Control, vol. 52, no. 9, pp. 1560-1571, Sep 2007.
2. D. Helbing, I. Farkas, and T. Vicsek, "Simulating dynamic features of escape panic," Nature, vol. 407, pp. 487-490, September 2000.
3. H. G. Tanner, A. Jadbabaie, and G. J. Pappas, "Stable flocking of mobile agents, part i: Fixed topology," in Proc. the 42nd IEEE Conf. on Decision and Control, Maui, Hawaii, 2003, pp. 2010-2015.
4. Y. Liu and K. M. Passino, "Stable social foraging swarms in a noisy environment," IEEE Trans. on Automatic Control, vol. 49, pp. 30-44, Jan. 2004.
5. D. J. Low, "Following the crowd," Nature, vol. 407, pp. 465-466, Sept. 2000.
6. Y. C. Ho, A. E. B. Jr., and S. Baron, "Differential games and optimal pursuit-evasion strategies," IEEE Trans. on Automatic Control, vol. 10, pp. 385-389, 1965.
7. P. P. Varaiya, "The existence of solutions to a differential game," SIAM Journal on Control, vol. 5, pp. 153-162, 1967.
8. H. S. Witsenhausen, "Alternatives to the tree model for extensive games," in The Theory and Applications of Differential Games. The Netherlands: Reidel Publishing Company, 1975, pp. 77-84.
9. A. Bensoussan, Perturbation methods in optimal control. New York: Wiley, 1988.
10. R. Srikant and T. Basar, "Iterative computation of noncooperative equilibria in nonzero-sum differential games with weakly coupled players," J. Optimization Theory Appl., vol. 71, no. 1, pp. 137-168, Oct. 1991.
11. M. Huang, P. E. Caines, and R. P. Malhamé, "Individual and mass behaviour in large population stochastic wireless power control problems: Centralized and Nash equilibrum solutions," in Proc. of the 42nd IEEE Conf. on Decision and Control, Maui, Hawaii, December 2003, pp. 98-103.
12. M. Huang, R. P. Malhamé, and P. E. Caines, "Chapter 9 - Nash equilibria for large-population linear stochastic systems of weakly coupled agents," in Analysis, Control and Optimization of Complex Dynamic Systems, ser. GERAD 25th Annivesary Series, E. K. Boukas and R. P. Malhamé, Eds. Springer, New York, 2005, pp. 215-252.
13. -, "Nash certainty equivalence in large population stochastic dynamic games: connection with the physics of interacting particle systems," in Proc. of the 45th IEEE Conf. on Decision and Control, San Diego, CA, December 2006, pp. 4921-4926.
14. M. Huang, P. E. Caines, and R. P. Malhamé, "The Nash certainty equivalence principle and McKean-Vlasov systems: an invariance principle and entry adaptation," in Proc. of the 46th IEEE Conf. on Decision and Control, New Orleans, LA, December 2007, pp. 121-126.
15. P. E. Caines, Mean Field Stochastic Control. Bode Lecture at the 48th IEEE Conf. on Decision and Control and 28th Chinese Control Conf., Dec. 2009. [Online]. Available: http://www.cim.mcgill.ca/~arman/Shanghai2009/Shanghai2009. zip
16. M. Huang, P. E. Caines, and R. P. Malhamé, "An invariance principle in large population stochastic dynamic games," Jrl Syst Sci & Complexity, vol. 20, pp. 162-172, 2007.
17. G. Y. Weintraub, C. L. Benkard, and B. V. Roy, "Oblivious equilibrum: A mean field approximation for large-scale dynamic games," in Advances in Neural Information Processing Systems. MIT Press, 2005.
18. -, "Markov perfect industry dynamics with many firms," Econometrica, vol. 76, no. 6, pp. 1375-1411, 2008.
19. J. M. Lasry and P.-L. Lions, "Mean field games," Japan J. Math., vol. 2, no. 1, pp. 229-260, 2007.
20. H. Tembine, J.-Y. L. Boudec, R. El-Azouzi, and E. Altman, "Mean field asymptotics of Markov decision evolutionary games and teams," in Int. Conf. on Game Theory for Networks (GameNets 2009), Istanbul, 2009, pp. 140-150.
21. P. E. Caines, "Continuous time stochastic adaptive control: nonexplosion, o-consistency and stability," Syst. Contr. Lett., vol. 19, pp. 169-176, 1991.
22. B. Bercu, "Weighted estimation and tracking for ARMAX models," SIAM Journal on Control and Optimization, vol. 33, pp. 89-106, 1995.
23. L. Guo, "Self-convergence of weighted least-squares with applications to stochastic adaptive control," IEEE Trans. on Automatic Control, vol. 41, pp. 79-89, 1996.
24. T. E. Duncan, L. Guo, and B. Pasik-Duncan, "Adaptive continuoustime Linear Quadratic Gaussian control," IEEE Trans. on Automatic Control, vol. 44, pp. 1653-1662, September 1999.
25. M. Huang, R. P. Malhamé, and P. E. Caines, "Large population stochastic dynamic games: Closed loop McKean-Vlasov systems and the Nash certainty equivalence principle," Special issue in honour of the 65th birthday of Tyrone Duncan, Communications in Information and Systems, vol. 6, pp. 221-252, November 2006.
26. A. C. Kizilkale and P. E. Caines, "Stochastic adaptive Nash certainty equivalence control: Self-identification case," 2010, accepted for presentation at the 19th Intl. Symp. on Math. Theory of Networks and Systems (MTNS 2010).
27. A. Bensoussan, Stochastic Control of Partially Observable Systems. U. K.: Cambridge Univ. Press, 1992.
28. T. Li and J.-F. Zhang, "Asymptotically optimal decentralized control for large population stochastic multiagent systems," IEEE Trans. on Automatic Control, vol. 53, no. 7, pp. 1643-1660, August 2008.
29. H.-F. Chen and L. Guo, "Optimal stochastic adaptive control with quadratic index," Int. J. of Control, vol. 43, no. 3, pp. 869-881, 1986.
30. A. C. Kizilkale and P. E. Caines, "Nash certainty equivalence stochastic adaptive control systems," Department of Electrical and Computer Engineering, McGill University, Tech. Rep., August 2010.