Decentralized Q-learning for aggregated interference control in completely and partially observable cognitive radio networks

2010 7th IEEE Consumer Communications and Networking Conference, CCNC 2010

Volumn , Issue , 2010, Pages

  Galindo Serrano, Ana ^a   Giupponi, L ^a  

^a CENTRE TECNOLÒGIC DE TELECOMUNICACIONS DE CATALUNYA CTTC   (Spain)

Author keywords

Aggregated interference; Cognitive radio; Decentralized Q learning; Multi agent system

Indexed keywords

COGNITIVE RADIO; COGNITIVE RADIO NETWORK; CR SYSTEM; IEEE 802.22; INTERFERENCE CONSTRAINTS; INTERFERENCE CONTROL; MULTI-AGENT REINFORCEMENT LEARNING; MULTIPLE AGENTS; OPTIMAL POLICIES; PARTIAL INFORMATION; Q-LEARNING; SECONDARY CELLS; SIMULATION RESULT; SURROUNDING ENVIRONMENT; WIRELESS REGIONAL AREA NETWORKS;

MULTI AGENT SYSTEMS; RADIO SYSTEMS; REINFORCEMENT; WIRELESS NETWORKS;

RADIO;

EID: 77951277958     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCNC.2010.5421826     Document Type: Conference Paper

References (15)

1. FCC, "Et docket no 03-222 notice of proposed rule making and order, december 2003." 2003.
2. M. Wellens, J. Wu, and P. Mhnen, "Evaluation of spectrum occupancy in indoor and outdoor scenarios in the context of cognitive radio," in Proc. of Second International Conference on Cognitive Radio Oriented Wireless Networks and Communications, Crowncom 2007, Jul. 31-Aug. 3, 2007.
3. S. Haykin, "Cognitive radio: brain-empowered wireless communications," IEEE J. Select. Areas Commun, vol.23, pp. 201-220, Feb. 2005.
4. C. Cordeiro, K. Challapali, and D. Birru, "IEEE 802.22: An introduction to the first wireless standard based on cognitive radios," Journal of Communications, vol.1, no.1, April 2006.
5. S. Shankar and C. Cordeiro, "Analysis of aggregated interference at DTV receivers in TV bands," in Proc. of International Conference on Cognitive Radio Oriented Wireless Networks and Communications, CROWNCOM 2008, May 15-17, 2008, Singapore.
6. M. Timmers, S. Pollin, A. Dejonghe, A. Bahai, L. Van der Perre, and F. Catthoor, "Accumulative interference modeling for cognitive radios with distributed channel access," in Proc. of International Conference on Cognitive Radio Oriented Wireless Networks and Communications, CROWNCOM 2008, May 15-17, 2008, Singapore.
7. K. P. Sycara, "Multiagent systems," AI Magazine, vol.19, no.2, pp. 79-92, 1998.
8. J. Nie and S. Haykin, "A Q-learning-based dynamic channel assignment technique for mobile communication systems," IEEE Transactions on Vehicular Technology, vol.48, no.5, pp. 1676-1687, Sept 1999.
9. Y. Chen, C. Chang, and F. Ren, "Q- learning-based multirate transmission control scheme for RRM in multimedia WCDMA systems," IEEE Transactions on Vehicular Technology, vol.53, no.1, Jan. 2004.
10. E. El-Alfy, Y. Yao, and H. Heffes, "Autonomous call admission control with prioritized handoff in cellular networks," in in Proc. of IEEE International Conference on Communications, IEEE ICC 2001, 11-14 June 2001.
11. S. Shellhammer, S. Shankar, R. Tandra, and J. Tomcik, "Performance of power detector sensors of DTV signals in IEEE 802.22 WRANs," in Proc. of First International Workshop on. Technology and Policy for Accessing Spectrum, IEEE ACM TAPAS, 5 Aug. 2006.
12. M. E. Harmon and S. S. Harmon, "Reinforcement learning: A tutorial," 2000. [Online]. Available: http://www.nbu.bg/cogs/events/2000/ Readings/Petrov/rltutorial.pdf
13. M. L. Littman, A. R. Cassandra, and L. P. Kaelbling, "Learning policies for partially observable environments: Scaling up," in Machine Learning: Proceedings of the Twelfth International Conference, A. Prieditis and S. Russell, Eds. Morgan Kaufmann Publishers, San Francisco, CA, 1995, pp. 362-370.
14. J. Watkins and P. Dayan, "Technical note: Q-learning," Machine Learning, vol.8, pp. 279-292, 1992.
15. (2009) The ITU website. [Online]. Available: http://www.itu.int/rec/RREC- P.1546-1-200304-S/en