Asymptotically optimal decentralized control for large population stochastic multiagent systems

IEEE Transactions on Automatic Control

Volumn 53, Issue 7, 2008, Pages 1643-1660

  Li, Tao ^a   Zhang, Ji Feng ^a  

^a INSTITUTE OF SYSTEMS SCIENCE   (China)

Author keywords

Asymptotic Nash equilibrium; Decentralized control; Multiagent systems; Stochastic cost function; Stochastic differential game

Indexed keywords

AGENTS; AGGLOMERATION; ASYMPTOTIC ANALYSIS; ASYMPTOTIC STABILITY; AUTOMATION; CONTROL SYSTEMS; CONTROL THEORY; COST FUNCTIONS; CYBERNETICS; DECENTRALIZED CONTROL; DECISION THEORY; ELECTRIC SHIP EQUIPMENT; GAME THEORY; POPULATION STATISTICS; PROBABILITY; STOCHASTIC PROGRAMMING; SYSTEM STABILITY; SYSTEM THEORY;

ASYMPTOTIC NASH EQUILIBRIUM; ASYMPTOTICALLY OPTIMAL; CLOSED-LOOP SYSTEMS; CONTROL LAWS; CONTROL PROBLEMS; CONVENTIONAL CONTROL; DECENTRALIZED CONTROL LAW; DECISION-MAKERS; DIFFERENTIAL GAMES; INDIVIDUAL BEHAVIOR; LIMIT THEORY; MULTIAGENT SYSTEMS; OPTIMALITY; QUADRATIC OPTIMAL CONTROL; SINGLE DECISION; STATE AGGREGATION; STOCHASTIC ADAPTIVE CONTROL; STOCHASTIC COST FUNCTION; STOCHASTIC DIFFERENTIAL GAME; TIME-AVERAGED;

STOCHASTIC MODELS;

EID: 52249090671     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAC.2008.929370     Document Type: Article

References (45)

1. C. Y. Chong, S. P. Kumar, and B. A. Hamilton, "Sensor networks: Evolution, opportunities, and challenges," Proc. IEEE, vol. 91, no. 8, pp. 1247-1256, 2003.
2. J. H. Reif and H. Y. Wang, "Social potential fields: A distributed behavioral control for autonomous robots," Robotics Autonomous Syst. vol. 27, pp. 171-194, 1999.
3. D. Grönbaum and A. Okubo, "Modeling social animal aggregations," in Frontiers in Theoretical Biology.. New York: Springer-Verlag, 1994, vol. 100, pp. 296-325, Lecture Notes in Biomathematics.
4. K. M. Passino, "Biomimicry of bacterial foraging: For distributed optimization and control," IEEE Control Syst. Mag., vol. 22, no. 3, pp. 52-67, Jun. 2002.
5. D. Helbing, I. Farkas, and T. Vicsek, "Simulating dynamic features of escape panic," Nature, vol. 407, no. 6803, pp. 487-490, 2000.
6. E. Altman, T. Boulogne, R. El-Azouzi, T. Jiménez, and L. Wynter, "A survey on networking games in telecommunications," Comput. Operations Res., vol. 33, no. 2, pp. 286-311, 2006.
7. V. Gazi and K. M. Passino, "Stability analysis of swarms," IEEE Trans. Autom. Control, vol. 48, no. 4, pp. 692-596, Apr. 2003.
8. Y. Liu and K. M. Passino, "Stable social foraging swarms in a noisy enviroment," IEEE Trans. Autom. Control, vol. 49, no. 1, pp. 30-44, Jan. 2004.
9. R. Olfati-Saber and R. M. Murray, "Consensus problem in networks of agents with switching topology and time-delays," IEEE Trans. Autom. Control, vol. 49, no. 9, pp. 1520-1533, Sep. 2004.
10. L. Moreau, "Stability of multiagent systems with time-dependent commmunication links," IEEE Trans. Autom. Control, vol. 50, no. 2, pp. 169-182, Feb. 2005.
11. J. A. Fax and R. M. Murray, "Information flow and cooperative control of vehicle formations," IEEE Trans. Autom. Control, vol. 49, no. 9, pp. 1465-1476, Sep. 2004.
12. R. Olfati-saber, "Flocking for multi-agent dynamic systems: Algorithms and theory," IEEE Trans. Autom. Control, vol. 51, no. 3, pp. 401-420, Mar. 2006.
13. Z. Liu and L. Guo, "Connectivity and sychronization of multi-agent systems," in Proc. 25th Chinese Control Conf., Harbin, China, Aug. 2006, pp. 373-378.
14. C. Q. Ma, T. Li, and J. F. Zhang, "Linear quadratic decentralized dynamic games for large population discrete-time multi-agent systems," J. Syst. Sci. Math. Sci., vol. 27, no. 3, pp. 464-480, 2007.
15. T. Li and J. F. Zhang, "Decentralized tracking-type games for multi-agent systems with coupled ARX models: Asymptotic Nash equilibria," Automatica, vol. 44, no. 3, pp. 713-725, 2008.
16. T. Basar and G. J. Olsder, Dynamic Noncooperative Game Theory.. London, U.K.: Academic, 1982.
17. Y. A. Korilis and A. Lazar, "On the existence of equilibria in noncooperative optimal flow control," J. ACM, vol. 42, no. 3, pp. 584-613, 1995.
18. E. Altman and T. Basar, "Multi-user rate-based flow control," IEEE Trans. Commun., vol. 46, no. 7, pp. 940-949, Jul. 1998.
19. E. Altman, T. Basar, and R. Srikant, "Nash equilibria for combined flow control and routing in networks: Asymptotic behavior for a large number of users," IEEE Trans. Autom. Control, vol. 47, no. 6, pp. 917-930, Jun. 2002.
20. K. Najim, A. S. Poznyak, and E. Gomez, "Adaptive policy for two finite Markov chains zero-sum stochastic game with unknown transition matrices and average payoffs," Automatica, vol. 37, no. 7, pp. 1007-1018, 2001.
21. A. S. Poznyak and K. Najim, "Learning through reinforcement for N person repeated contrained games," IEEE Trans. Systems, Man, Cybern. Part B. Cybern., vol. 32, no. 6, pp. 759-771, Dec. 2002.
22. G. Fagiolo, L. Marengo, and M. Valente, "Population learning in a model with random payoff landscapes and endogenous networks," Comput. Econ., vol. 24, no. 4, pp. 383-408, 2004.
23. M. Huang, R. P. Malhamé, and P. E. Caines, "On a class of large-scale cost coupled Maxkov games with applications to decentralized power control," in Proc. 43rd Conf. Decision Control, Nassau, Bahamas, 2004, pp. 2830-2835.
24. M. Huang, P. E. Caines, and R. P. Malhame, "Individual and mass behaviour in large population stochastic wireless power control problem: Centralized and Nash equilibrium solutions," in Proc. 42nd Conf. Decision Control, Maul, HI, 2003, pp. 98-103.
25. M. Huang, P. E. Caines, and R. P. Malhamé, "Large-population cost-coupled LQG problems: Generalizations to non-uniform individuals," in Proc. 43rd Conf. Decision Control, Nassau, Bahamas, 2004, pp. 3453-3458.
26. M. Huang, P. E. Caines, and R. P. Malhamé, "Large-population cost-coupled LQG problems with nonuniform agents: Individual-mass behavior and decentralized ε-Nash equilibria," IEEE Trans. Autom. Control, vol. 52, no. 9, pp. 1560-1571, Sep. 2007.
27. H. F. Chen and L. Guo, Identification and Stochastic Adaptive Control. Boston, MA: Birkhäuser, 1991.
28. Y. Kabanov and S. Pergamenshchikov, Two-Scale Stochastic Systems.. New York: Springer-Verlag, 2003.
29. D. W. K. Yeung and L. A. Petrosyan, Cooperative Stochastic Differential Games.. New York: Springer, 2006.
30. J. B. Rosen, "Existence and uniqueness of equilibrium points for concave n-person games," Econometrica, vol. 33, no. 3, pp. 520-534, 1965.
31. S. N. Simić and S. Sastry, "Distributed environmental monitoring using random sensor networks," Lecture Notes in Computer Science, vol. 2634, pp. 582-592, 2003.
32. Y. S. Chow and H. Teicher, Probability Theory: Independence, Interchangeability, Martingales., 3rd ed. New York: Springer-Verlag, 1997.
33. M. Huang, R. P. Malhamé, and P. E. Caines, "Nash cerntainty equivalence in large population stochastic dynamic games: Connections with the physics of interacting particle systems," in Proc. 45th IEEE Conf. Decision Control, San Diego, CA, 2006, pp. 4921-4926.
34. G. Birkhoff and G. C. Rota, Ordinary Differential Equations.. New York: Wiley, 1969.
35. D. W. Stroock and S. R. S. Varadhan, Multidimensional Diffusion Processes.. New York: Springer-Verlag, 1979.
36. M. Huang, P. E. Caines, and R. P. Malhamé, "Uplink power adjustment in wireless communication systems: A stochastic control analysis," IEEE Trans. Autom. Control, vol. 49, no. 10, pp. 1693-1708, Oct. 2004.
37. D. Bauso, L. Giarré, and R. Pesenti, "Non-linear protocols for optimal distributed consensus in networks of dynamics agents," Syst. Control Lett., vol. 55, no. 11, pp. 918-928, 2006.
38. M. Huang, R. P. Malhamé, and P. E. Caines, "Nash equilibria for large-population linear stochastic systems of weakly coupled agents," in In Analysis, Control and Optimization of Complex Dynamic Systems E. K. Boukas and R. P. Malhamé, Eds. New York: Springer, 2005, ch. 9, pp. 215-252.
39. E. Altman and L. Wynter, "Equilibrium, games and pricing in transportation and telecommunication networks," Networks and Spacial Issue on Crossovers Between Transportation and Telecommunication Modelling, vol. 4, no. 1, pp. 7-21, 2004.
40. S. P. Hoogendoorn, "Pedestrian flow modeling by adaptive control," Transportation Res. Rec., vol. 1878, pp. 5-103, 2004.
41. M. Huang, R. P. Malhamé, and P. E. Caines, "Nash strategies and adaptation for decentralized games involving weakly-coupled agents," in Proc. 44th IEEE Conf. Decision Control and Eur. Control Conf., Seville, Spain, 2005, pp. 1050-1055.
42. J. L. Doob, Stochastic Process.. New York: Wiley, 1953.
43. A. N. Michel and R. K. Miller, Qualitative Analysis of Large Scale Dynamical Systems.. New York: Academic, 1977.
44. B. D. O. Anderson and J. B. Moore, Linear Optimal Control.. Englewood Cliffs, N.J.: Prentice-Hall, 1971.
45. R. Bhatia, Matrix Analysis.. New York: Springer-Verlag, 1997, p. 311.