Distributed tracking of correlated equilibria in regime switching noncooperative games

IEEE Transactions on Automatic Control

Volumn 58, Issue 10, 2013, Pages 2435-2450

  Namvar Gharehshiran, Omid ^a   Krishnamurthy, Vikram ^a   Yin, George ^b  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^b WAYNE STATE UNIVERSITY   (United States)

Author keywords

Coordination in decision making; correlated equilibrium; Lyapunov stability; Markov chain; noncooperative game; regime switching differential inclusion; stochastic approximation; tracking

Indexed keywords

CORRELATED EQUILIBRIA; DIFFERENTIAL INCLUSIONS; LYAPUNOV STABILITY; NONCOOPERATIVE GAME; STOCHASTIC APPROXIMATIONS;

APPROXIMATION ALGORITHMS; APPROXIMATION THEORY; DIFFERENTIAL EQUATIONS; GAME THEORY; INFORMATION DISSEMINATION; SURFACE DISCHARGES;

MARKOV PROCESSES;

EID: 84884683635     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAC.2013.2256684     Document Type: Article

References (26)

1. S. Hart and A. Mas-Colell, "A simple adaptive procedure leading to correlated equilibrium," Econometrica, vol. 68, no. 5, pp. 1127-1150, Sept. 2000.
2. S. Hart and A. Mas-Colell, "A reinforcement procedure leading to correlated equilibrium," Economic Essays: A Festschrift for Werner Hildenbrand pp. 181-200.
3. S. Hart, "Adaptive heuristics," Econometrica, vol. 73, no. 5, pp. 1401-1430, 2005. (Pubitemid 41613449)
4. R. J. Aumann, "Correlated equilibrium as an expression of Bayesian rationality," Econometrica, vol. 55, no. 1, pp. 1-18, Jan. 1987.
5. R. Nau, S. G. Canovas, and P.Hansen, "On the geometry of nash equilibria and correlated equilibria," Int. J. Game Theory, vol. 32, no. 4, pp. 443-453, 2004. (Pubitemid 39129993)
6. H. J. Kushner and G. Yin, Stochastic Approximation Algorithms and Applications, 2nd ed. New York: Springer-Verlag, 2003.
7. A. Benveniste, M. Metivier, and P. Prioret, Adaptive Algorithms and Stochastic Approximations. New York, NY, USA: Springer-Verlag, 1990.
8. V. Krishnamurthy, M. Maskery, and G. Yin, "Decentralized adaptive filtering algorithms for sensor activation in an unattended ground sensor network," IEEE Trans. Signal Process., vol. 56, no. 12, pp. 6086-6101, Dec. 2008.
9. O. N. Gharehshiran and V. Krishnamurthy, "Coalition formation for bearings-only localization in sensor networks-a cooperative game approach," IEEE Trans. Signal Process., vol. 58, no. 8, pp. 4322-4338, Aug. 2010.
10. M. Maskery, V. Krishnamurthy, and Q. Zhao, "Decentralized dynamic spectrum access for cognitive radios: Cooperative design of a noncooperative game," IEEE Trans. Commun., vol. 57, no. 2, pp. 459-469, Feb. 2009.
11. O. N. Gharehshiran, A. Attar, and V. Krishnamurthy, "Collaborative subchannel allocation in cognitive LTE femto-cells: A cooperative gametheoretic approach," IEEE Trans. Commun., vol. 61, no. 1, pp. 325-334, Jan. 2013.
12. M. Benaïm, J. Hofbauer, and S. Sorin, "Stochastic approximations and differential inclusions; Part II: Applications," Math. Oper. Res., vol. 31, no. 3, pp. 673-695, 2006.
13. G. Yin and Q. Zhang, Continuous-Time Markov Chains and Applications: A Singular Perturbation Approach. NewYork,NY,USA: Springer-Verlag, 1998.
14. G. Yin and C. Zhu, Hybrid Switching Diffusions: Properties and Applications. NewYork, NY, USA: Springer-Verlag, 2009, vol. 63.
15. D. Chatterjee and D. Liberzon, "Stability analysis of deterministic and stochastic switched systems via a comparison principle and multiple Lyapunov functions," SIAM J. Control Optim., vol. 45, no. 1, pp. 174-206, 2007.
16. D. Chatterjee and D. Liberzon, "On stability of randomly switched nonlinear systems," IEEE Trans. Autom. Control, vol. 52, no. 12, pp. 2390-2394, Dec. 2007.
17. D. Fudenberg and D. K. Levine, The Theory of Learning in Games. Cambridge, MA, USA: MIT Press, 1998, vol. 2.
18. S. Hart and A. Mas-Colell, "A general class of adaptive strategies," J. Econ. Theory, vol. 98, no. 1, pp. 26-54, May 2001. (Pubitemid 33658394)
19. P. Billingsley, Convergence of ProbabilityMeasures. NewYork,NY, USA: Wiley, 1968.
20. S. Boyd and L. Vandenberghe, Convex Optimization. NewYork,NY, USA: Cambridge Univ. Press, 2004.
21. J. P. Aubin, Dynamic Economic Theory: A Viability Approach. : Springer-Verlag, 1997, vol. 174.
22. D. Liberzon, Switching in Systems and Control. NewYork,NY,USA: Springer, 2003.
23. D. Fudenberg and D. K. Levine, "Conditional universal consistency," Games Econ. Behav., vol. 29, no. 1-2, pp. 104-130, Oct. 1999.
24. H. J. Kushner, Approximation and Weak Convergence Methods for Random Processes With Applications to Stochastic Systems Theory. Cambridge, MA, USA: MIT press, 1984, vol. 6.
25. H. Kushner and A. Shwartz, "An invariant measure approach to the convergence of stochastic approximations with state dependent noise," SIAM J. Control Optim., vol. 22, no. 1, pp. 13-27, 1984. (Pubitemid 14531613)
26. G. Yin, V. Krishnamurthy, and C. Ion, "Regime switching stochastic approximation algorithms with application to adaptive discrete stochastic optimization," SIAM J. Optim., vol. 14, no. 4, pp. 1187-1215, 2004.