Multi-agent Q-learning of channel selection in multi-user cognitive radio systems: A two by two case

Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics

Volumn , Issue , 2009, Pages 1893-1898

  Li, Husheng ^a  

^a University of Tennessee   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CHANNEL SELECTION; COGNITIVE RADIO; MULTI-AGENT; MULTI-AGENT REINFORCEMENT; MULTI-CHANNEL; MULTI-USER; NUMERICAL SIMULATION; Q-LEARNING; RAPID CHANGES; ROBINSON;

COGNITIVE SYSTEMS; COMPUTER SIMULATION; CONVERGENCE OF NUMERICAL METHODS; LEARNING ALGORITHMS; LYAPUNOV FUNCTIONS; ORDINARY DIFFERENTIAL EQUATIONS; RADIO; RADIO SYSTEMS; REINFORCEMENT;

MULTI AGENT SYSTEMS;

EID: 74949099926     PISSN: 1062922X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSMC.2009.5346172     Document Type: Conference Paper

References (17)

1. L. Buşoniu, R. Babuška and B. D. Schutter, "A comprehensive survey of multiagent reinforcement learning," IEEE Trans. Systems, Man and Cybernetics, Part C, vol.38, no.2, pp.156-172, March 2008.
2. D. Fudenberg and D. K. Levine, The Theory of Learning in Games. The MIT Press, Cambridge, MA, 1998.
3. A. Gahsemi and E. S. Sousa, "Collaborative spectrum sensing for opportunistic access in fading environment," in Proc. of IEEE International Symposium of New Frontiers in Dynamic Spectrum Access Networks (DySPAN), 2005.
4. E. Hossain, D. Niyato and Z. Han, Dynamic Spectrum Access in Cognitive Radio Networks. Cambridge University Press, UK, 2009.
5. K. Kim, I. A. Akbar, K. K. Bae, et al, "Cyclostationary approaches to signal detection and classificition in cognitive radio," in Proc. of IEEE International Symposium of New Frontiers in Dynamic Spectrum Access Networks (DySPAN), April 2007.
6. C. Kloeck, H. Jaekel and F. Jondral, "Multi-agent radio resource allocation," Mobile Networks and Applications, vol. 11, no. 6, Dec. 2006.
7. H. J. Kushner and G. G. Yin, Stochastic Approximation and Recursive Algorithms and Applications. Springer, 2003.
8. H. Li, C. Li and H. Dai, "Quickest spectrum sensing in cognitive radio," in Proc. of the 42nd Conference on Information Scicens and Systems (CISS), Princeton, NJ, 2008.
9. A. Metrick and B. Polak, "Fictitious play in 2 × 2 games: A geometric proof of convergence," Economic Theory, pp. 923-933, 1994.
10. J. Mitola, "Cognitive radio for flexible mobile multimedia communications," in Proc. IEEE Int. Workshop Mobile Multimedia Communications, pp. 3-10, 1999.
11. J. Mitola, "Cognitive Radio," Licentiate proposal, KTH, Stockholm, Sweden.
12. D. Niyato, E. Hossain and Z. Han, "Dynamics of multiple-seller and multiple-buyer spectrum trading in cognitive radio networks: A game theoretic modeling approach," to appear in IEEE Trans. Mobile Computing.
13. H. Robbins and S. Monro, "A stochastic approximation method," The Annals of Mathematical Statistics, vol. 2, pp. 400-407, 1951.
14. J. Robinson, "An iterative method of solving a game," The Annals of Mathematics, vol. 54, no. 2, pp. 296-301, 1969.
15. R. S. Sutton and A. G. Barto, Reinforcement Learning: A Introduction, The MIT Press, Cambridge, MA, 1998.
16. C. Watkins, Learning From Delayed Rewards, PhD Theis, The University of Cambridge, UK, 1989.
17. Q. Zhao and B. M. Sadler, "A survey of dynamic spectrum access," IEEE Signal Processing Magazine, vol. 24, pp. 79-89, May. 2007.