Nash equilibrium seeking in noncooperative games

IEEE Transactions on Automatic Control

Volumn 57, Issue 5, 2012, Pages 1192-1207

  Frihauf, Paul ^a   Krstic, Miroslav ^a   Basar, Tamer ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b University of Illinois at Urbana Champaign   (United States)

Author keywords

Extremum seeking; learning; Nash equilibria; noncooperative games

Indexed keywords

CLASSICAL GAME THEORY; CONVERGENCE CONDITIONS; EXTREMUM SEEKING; FUNCTIONAL FORMS; HIGHER DERIVATIVES; INPUT SIGNAL; LEARNING; LOCAL AVERAGING; LOCAL CONVERGENCE; NASH EQUILIBRIA; NONCOOPERATIVE GAME; NONLINEAR DIFFERENTIAL EQUATION; OUTPUT SIGNAL; PAYOFF FUNCTION; PERTURBATION AMPLITUDE; SEMI-GLOBAL; SINUSOIDAL PERTURBATIONS; STABLE CONVERGENCE; STANDARD OPTIMIZATION; STATIC GAMES; STEADY STATE; STEADY-STATE VALUES;

ALGORITHMS; CONTROL THEORY; DIFFERENTIAL EQUATIONS; TELECOMMUNICATION NETWORKS;

GAME THEORY;

EID: 84860441142     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAC.2011.2173412     Document Type: Article

References (51)

1. A. Cournot, Recherches sur les Principes Mathématiques de la Théorie des Richesses. Paris, France: Hachette, 1838.
2. G. W. Brown, "Iterative solutions of games by fictitious play," in Activity Analysis of Production and Allocation, T. C. Koopmans, Ed. New York: Wiley, 1951, pp. 374-376.
3. J. B. Rosen, "Existence and uniqueness of equilibrium points for concave N-person games," Econometrica, vol. 33, no. 3, pp. 520-534, 1965.
4. D. G. Luenberger, "Complete stability of noncooperative games," J. Optim. Theory Appl., vol. 25, no. 4, pp. 485-505, 1978.
5. S. Li and T. Basar, "Distributed algorithms for the computation of noncooperative equilibria," Automatica, vol. 23, no. 4, pp. 523-533, 1987.
6. J. S. Shamma and G. Arslan, "Dynamic fictitious play, dynamic gradient play, and distributed convergence to Nash equilibria," IEEE Trans. Autom. Control, vol. 53, no. 3, pp. 312-327, 2005.
7. M. Zhu and S. Martínez, "Distributed coverage games for mobile visual sensor networks," SIAM J. Control Optim., Jan. 2010 [Online]. Available: http://arxiv.org/abs/1002.0367, submitted for publication
8. M. Krstic, P. Frihauf, J. Krieger, and T. Basar, "Nash equilibrium seeking with finitely- and infinitely-many players," in Proc. 8th IFAC Symp. Nonlinear Control Syst., Bologna, Italy, Sep. 2010, pp. 1086-1091.
9. P. Frihauf, M. Krstic, and T. Başar, "Nash equilibrium seeking for games with non-quadratic payoffs," in Proc. IEEE Conf. Decision Control, Atlanta, GA, Dec. 2010, pp. 881-886.
10. M. S. Stanković, K. H. Johansson, and D. M. Stipanović, "Distributed seeking of Nash equilibria in mobile sensor networks," in Proc. IEEE Conf. Decision Control, Atlanta, GA, Dec. 2010, pp. 5598-5603.
11. A. Jafari, A. Greenwald, D. Gondek, and G. Ercal, "On no-regret learning, fictitious play, and Nash equilibrium," in Proc. 18th Int. Conf. Mach. Learn., 2001, pp. 226-233.
12. D. P. Foster and H. P. Young, "Regret testing: Learning to play Nash equilibrium without knowing you have an opponent," Theoret. Econ., vol. 1, no. 3, pp. 341-367, 2006.
13. R. Sharma and M. Gopal, "Synergizing reinforcement learning and game theory-A new direction for control," Applied Soft Comput., vol. 10, no. 3, pp. 675-688, 2010.
14. D. Fudenberg and D. K. Levine, The Theory of Learning in Games. Cambridge, MA: The MIT Press, 1998.
15. N. Cesa-Bianchi and G. Lugosi, Prediction, Learning, and Games. New York: Cambridge Univ. Press, 2006.
16. Q. Zhu, H. Tembine, and T. Başar, "Heterogeneous learning in zero-sum stochastic games with incomplete information," in Proc. IEEE Conf. Decision Control, Atlanta, GA, Dec. 2010, pp. 219-224.
17. A. B. MacKenzie and S. B. Wicker, "Game theory and the design of self-configuring, adaptive wireless networks," IEEE Commun. Mag., vol. 39, no. 11, pp. 126-131, 2001.
18. E. Altman, T. Başar, and R. Srikant, "Nash equilibria for combined flow control and routing in networks: Asymptotic behavior for a large number of users," IEEE Trans. Autom. Control, vol. 47, no. 6, pp. 917-930, 2002.
19. T. Başar, "Control and game-theoretic tools for communication networks (overview)," Appl. Comput. Math., vol. 6, no. 2, pp. 104-125, 2007.
20. G. Scutari, D. P. Palomar, and S. Barbarossa, "The MIMO iterative waterfilling algorithm," IEEE Trans. Signal Process., vol. 57, no. 5, pp. 1917-1935, May 2009.
21. S. S. Rao, V. B. Venkayya, and N. S. Khot, "Game theory approach for the integrated design of structures and controls," AIAA J., vol. 26, no. 4, pp. 463-469, 1988.
22. D. Bauso, L. Giarré, and R. Pesenti, "Consensus in noncooperative dynamic games: A multiretailer inventory application," IEEE Trans. Autom. Control, vol. 53, no. 4, pp. 998-1003, 2008.
23. J. R. Marden, G. Arslan, and J. S. Shamma, "Cooperative control and potential games," IEEE Trans. Syst., Man, Cybern.-Part B: Cybern., vol. 39, no. 6, pp. 1393-1407, Jun. 2009.
24. E. Semsar-Kazerooni and K. Khorasani, "Multi-agent team cooperation: A game theory approach," Automatica, vol. 45, no. 10, pp. 2205-2213, 2009.
25. T. Başar and G. J. Olsder, Dynamic Noncooperative Game Theory, 2nd ed. Philadelphia, PA: SIAM, 1999.
26. H.-H. Wang and M. Krstic, "Extremum seeking for limit cycle minimization," IEEE Trans. Autom. Control, vol. 45, no. 12, pp. 2432-2437, Dec. 2000.
27. J.-Y. Choi, M. Krstic, K. B. Ariyur, and J. S. Lee, "Extremum seeking control for discrete-time systems," IEEE Trans. Autom. Control, vol. 47, no. 2, pp. 318-323, Feb. 2002.
28. K. B. Ariyur and M. Krstic, Real-Time Optimization by Extremum- Seeking Control. Hoboken, NJ: Wiley-Interscience, 2003.
29. Y. Tan, D. Neŝić, and I. Mareels, "On non-local stability properties of extremum seeking control," Automatica, vol. 42, no. 6, pp. 889-903, 2006.
30. L. Luo and E. Schuster, "Mixing enhancement in 2D magnetohydrodynamic channel flow by extremum seeking boundary control," in Proc. Amer. Control Conf., St. Louis, MO, Jun. 2009, pp. 1530-1535.
31. W. H. Moase, C. Manzie, and M. J. Brear, "Newton-like extremum- seeking part I: Theory," in Proc. IEEE Conf. Decision Control, Shanghai, China, Dec. 2009, pp. 3839-3844.
32. M. S. Stanković and D. M. Stipanović, "Extremum seeking under stochastic noise and applications to mobile sensors," Automatica, vol. 46, pp. 1243-1251, 2010.
33. D. Neŝić, Y. Tan, W. H. Moase, and C. Manzie, "A unifying approach to extremum seeking: Adaptive schemes based on estimation of derivatives," in Proc. IEEE Conf. Decision Control, Atlanta, GA, Dec. 2010, pp. 4625-4630.
34. C. Zhang, D. Arnold, N. Ghods, A. Siranosian, and M. Krstic, "Source seeking with nonholonomic unicycle without position measurement and with tuning of forward velocity," Syst. Control Lett., vol. 56, pp. 245-252, 2007.
35. J. Cochran and M. Krstic, "Nonholonomic source seeking with tuning of angular velocity," IEEE Trans. Autom. Control, vol. 54, no. 4, pp. 717-731, Apr. 2009.
36. J. Cochran, E. Kanso, S. D. Kelly, H. Xiong, and M. Krstic, "Source seeking for two nonholonomic models of fish locomotion," IEEE Trans. Robot., vol. 25, no. 5, pp. 1166-1176, Oct. 2009.
37. N. J. Killingsworth, S. M. Aceves, D. L. Flowers, F. Espinosa-Loza, and M. Krstic, "HCCI engine combustion-timing control: Optimizing gains and fuel consumption via extremum seeking," IEEE Trans. Control Syst. Technol., vol. 17, no. 6, pp. 1350-1361, Nov. 2009.
38. M. Guay, M. Perrier, and D. Dochain, "Adaptive extremum seeking control of nonisothermal continuous stirred reactors," Chem. Eng. Sci., vol. 60, pp. 3671-3681, 2005.
39. K. Peterson and A. Stefanopoulou, "Extremum seeking control for soft landing of an electromechanical valve actuator," Automatica, vol. 29, pp. 1063-1069, 2004.
40. R. Becker, R. King, R. Petz, and W. Nitsche, "Adaptive closed-loop separation control on a high-lift configuration using extremum seeking," AIAA J., vol. 45, no. 6, pp. 1382-1392, 2007.
41. D. Carnevale, A. Astolfi, C. Centioli, S. Podda, V. Vitale, and L. Zaccarian, "A new extremum seeking technique and its application to maximize RF heating on FTU," Fusing Eng. Design, vol. 84, pp. 554-558, 2009.
42. A. R. Teel, J. Peuteman, and D. Aeyels, "Semi-global practical asymptotic stability and averaging," Syst. Control Lett., vol. 37, no. 5, pp. 329-334, 1999.
43. H. K. Khalil, Nonlinear Systems, 3rd ed. Upper Saddle River, NJ: Prentice Hall, 2002.
44. O. Taussky, "A recurring theorem on determinants," Amer. Math. Monthly, vol. 56, no. 10, pp. 672-676, 1949.
45. R. A. Horn and C. R. Johnson, Matrix Analysis. Cambridge, U.K.: Cambridge Univ. Press, 1985.
46. D. Monderer and L. S. Shapley, "Potential games," Games Econ. Behav., vol. 14, no. 1, pp. 124-143, 1996.
47. E. Hopkins, "A note on best response dynamics," Games Econ. Behav., vol. 29, no. 1-2, pp. 138-150, 1999.
48. J. Hofbauer, "Best response dynamics for continuous zero-sum games," Discrete Contin. Dynam. Syst.: Ser. B, vol. 6, no. 1, pp. 215-224, 2006.
49. T. M. Apostol, Mathematical Analysis, 2nd ed. Reading, MA: Addison- Wesley, 1974.
50. A. K. Naimzada and L. Sbragia, "Oligopoly games with nonlinear demand and cost functions: Two boundedly rational adjustment processes," Chaos, Solitons, Fractals, vol. 29, pp. 707-722, 2006.
51. M. Krstic, I. Kanellakopoulos, and P. Kokotović, Nonlinear and Adaptive Control Design. New York: Wiley-Interscience, 1995.