Distributed Reinforcement Learning based MAC protocols for autonomous cognitive secondary users

WOCC 2011 - 20th Annual Wireless and Optical Communications Conference

Volumn , Issue , 2011, Pages

  Bkassiny, Mario ^a   Jayaweera, Sudharman K ^a   Avery, Keith A ^b  

^a University of New Mexico   (United States)

^b AIR FORCE RESEARCH LABORATORY   (United States)

Author keywords

Cognitive radio; reinforcement learning

Indexed keywords

CHANNEL ACCESS; CHANNEL OCCUPANCY; COGNITIVE RADIO; COGNITIVE RADIO NETWORK; COLLISION PROBABILITY; DISTRIBUTED REINFORCEMENT LEARNING; IDLE CHANNEL; MAC PROTOCOL; MARKOVIAN; NUMERICAL RESULTS; PARTIALLY OBSERVABLE MARKOV DECISION PROCESS; SPECTRUM BANDS; SPECTRUM SENSING; SPECTRUM UTILIZATION;

MARKOV PROCESSES; OPTICAL COMMUNICATION; RADIO; RADIO SYSTEMS; REINFORCEMENT LEARNING; TRANSPORT PROPERTIES;

LEARNING ALGORITHMS;

EID: 79959863286     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/WOCC.2011.5872298     Document Type: Conference Paper

References (14)

1. Q. Xiao, Q. Gao, L. Xiao, S. Zhou, and J. Wang, "An optimal opportunistic spectrum access approach," in IEEE International Conference on Communications Workshops, 2009, Dresden, Germany, 14-18 2009, pp. 1-5.
2. Q. Zhao, L. Tong, A. Swami, and Y. Chen, "Decentralized cognitive MAC for opportunistic spectrum access in ad hoc networks: A POMDP framework," IEEE Journal on Selected Areas in Communications, vol. 25, no. 3, pp. 589-600, Apr. 2007.
3. H. Liu, B. Krishnamachari, and Q. Zhao, "Cooperation and learning in multiuser opportunistic spectrum access," in IEEE International Conference on Communications Workshops, 2008, Beijing, China, May. 2008, pp. 487-492.
4. J. Unnikrishnan and V. Veeravalli, "Algorithms for dynamic spectrum access with learning for cognitive radio," IEEE Transactions on Signal Processing, vol. 58, no. 2, pp. 750-760, Feb. 2010.
5. T. Zhang, Y. Wu, K. Lang, and D. H. K. Tsang, "Optimal scheduling of cooperative spectrum sensing in cognitive radio networks," IEEE Systems Journal, vol. 4, no. 4, pp. 535-549, Dec. 2010.
6. A. Galindo-Serrano and L. Giupponi, "Distributed Q-Learning for aggregated interference control in cognitive radio networks," IEEE Transactions on Vehicular Technology, vol. 59, no. 4, pp. 1823-1834, May 2010.
7. Y. Teng, Y. Zhang, F. Niu, C. Dai, and M. Song, "Reinforcement learning based auction algorithm for dynamic spectrum access in cognitive radio networks," in IEEE 72nd Vehicular Technology Conference Fall (VTC '10-Fall), Ottawa, ON, Sep. 2010, pp. 1-5.
8. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press, 1998.
9. D. S. Bernstein, R. Givan, N. Immerman, and S. Zilberstein, "The complexity of decentralized control of Markov Decision Processes," Mathematics of Operations Research, vol. 27, no. 4, pp. 819-840, Nov. 2002.
10. H. V. Poor, An Introduction to Signal Detection and Estimation, 2nd ed. New York: Springer, 1998.
11. M. L. Littman, A. R. Cassandra, and L. P. Kaelbling, "Learning policies for partially observable environments: Scaling up," Readings in agents, pp. 495-503, 1998.
12. F. F. Digham, M.-S. Alouini, and M. Simon, "On the energy detection of unknown signals over fading channels," in IEEE International Conference on Communications.(ICC '03), vol. 5, Anchorage, AK, May 2003, pp. 3575-3579 vol.5.
13. M. Bkassiny, S. K. Jayaweera, Y. Li, and K. A. Avery, "Optimal and low-complexity algorithms for dynamic spectrum access in centralized cognitive radio networks with fading channels," in IEEE 73rd Vehicular Technology Conference (VTC Spring 2011), Budapest, Hungary, May 2011, [Accepted].
14. Y. Li, S. K. Jayaweera, M. Bkassiny, and K. A. Avery, "Optimal myopic sensing and dynamic spectrum access in centralized secondary cognitive radio networks with low-complexity implementations," in IEEE 73rd Vehicular Technology Conference. (VTC Spring 2011), Budapest, Hungary, May 2011, [Accepted].