Harmonized Q-Learning for radio resource management in LTE based networks

International Telecommunication Union - Proceedings of the 2013 ITU Kaleidoscope Academic Conference: Building Sustainable Communities, K 2013

Volumn , Issue , 2013, Pages 95-104

  Kumar, Dhananjay ^a   Kanagaraj, N N ^b   Srilakshmi, R ^a  

^a ANNA UNIVERSITY   (India)

^b NOKIA RESEARCH CENTER   (United States)

Author keywords

Cognitive radio; LTE; Q Learning

Indexed keywords

APPLICATION REQUIREMENTS; EFFICIENT MANAGEMENTS; HIGH SPEED WIRELESS NETWORKS; INFRASTRUCTURE NETWORKS; LTE; Q-LEARNING; RADIO RESOURCE MANAGEMENT; SYSTEM LEVEL SIMULATION;

COGNITIVE RADIO; LEARNING ALGORITHMS; STANDARDS;

WIRELESS TELECOMMUNICATION SYSTEMS;

EID: 84881277823     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. JayakrishnanUnnikrishnan, JayakrishnanUnnikrishnan, and Venugopal V. Veeravalli "Algorithms for Dynamic Spectrum Access with Learning for Cognitive Radio", IEEE Transaction on Signal Processing, Vol No. 2, PP. 750-760, Feb. 2010.
2. ITU-R M. 2242, "Cognitive radio systems specific for International Mobile Telecommunications systems", M Series Report ITU-R (11/2011).
3. 3GPP TR 36. 913, V. 9. 0. 0 "Technical Specification Group Radio Access Network; Requirements for further advancements for Evolved Universal Terrestrial Radio Access (LTE-Advanced) (Release 9)", December 2009.
4. Junfeng XIAO1, Feng YE, Tingjian TIAN, and Rose Qingyang HU, "CR Enabled TD-LTE within TV White Space: System Level Performance Analysis", Proceedings of IEEE Globecom 2011.
5. YuhuaXu, Jinlong Wang, Qihui Wu, Alagan Anpalagan, and Yu-Dong Yao, "Opportunistic Spectrum Access in Unknown Dynamic Environment: A Game-Theoretic Stochastic Learning Solution", IEEE Transaction on Wireless Communication, Vol 11, No. 4, PP. 1380-1390, April 2012.
6. Dhananjay Kumar, Kanagaraj N. N "Radio Resource management in OFDMA-CRN considering primary user activity and detection scenario", Proceedings of 4th ITU-T Kaleidoscope Event: The Fully Networked Human? Innovations for Future Networks and Services, Cape Town, South Africa, 2-14 Dec 2011.
7. Dhananjay Kumar, S. Mahalaxmi, J. Sharad Kumar, and R. Ramya, "Adaptive Resource Allocation for Real-time services in OFDMA Based Cognitive Radio Systems, " Proceedings of ITU-T Kaleidoscopic Event: Beyond the Internet?-Innovations for Future Networks and Services, Pune, India, 13-15 December 2010.
8. IoanSorinComsa, Mehmet Aydin, Sijing Zhang, Pierre Kuonen, Jean-Frederic Wagen, "Multi Objective Resource Reinforcement learning", International Journal of Distributed Systems and Technologies, 3(2), PP 39-57, April-June 2012.
9. Husheng Li, "Multi-agent Q-learning for Competitive Spectrum Access in Cognitive Radio Systems" Proceedings of fifth IEEE Workshop on Networking Technologies for Software Defined Radio Networks, 21 June, 2010.
10. Zhe Chen and Robert C. Qiu, "Q-learning Based Bidding Algorithm for Spectrum Auction in Cognitive Radio", Proceddings of IEEE South East Conference (SECON-2011), 17-20 March2011.
11. Mo Li, Youyun Xu, and Junquan Hu, "Q-learning Based Sensing Task Selection Scheme for Cognitive Radio Networks", IEEE International Conference on Wireless Communication and Signal Processing, 13-15 November, 2009.
12. Aggelos Saatsakis, Kostas Tsagkaris, Dirk von-Hugo, Matthias Siebert, Manfred Rosenberger, and Panagiotis Demestichas, "Cognitive Radio Resource Management for Improving the Efficiency of LTE Network Segments in the Wireless B3G World", IEEE Symposium on New Frontiers in Dynamic Spectrum Access Networks, October 2008.
13. Xinsheng Zhao, Zhiyi Guo, Qiang Guo, "A Cgnitive based Spectrum Sharing Scheme for LTE-Advanced Systems, Proceedings of International Congress on Ultra Modern Telecommunications and Control systems and Workshops (ICUMT), 2010.
14. Mehdi Bennis and Dusit Niyato, " A Q-learning Based Approach to Interference Avoidance in Self-Organized Femtocell Networks", Proceedings of IEEE Globecom Workshop on Femtocell Networks, 2010.
15. Sudharman K . Jayaweera, Mario Bkassiny, keith A. Avery, " Asymmetric Cooperative Communications based Spectrum Leasing via Auctions in Cognitive Radio Networks", IEEE Transactions on Wireless Communications, Vol. 10, No. 8. August 2011.
16. Xianfu Chen, Zhifeng Zhao and Honnanag Zhang, "Stochastic Power Adaptation with Multi agent Reinforcement Learning for Cognitive Wireless Mesh Networks", IEEE Transactions on Mobile Computing, Vol. x, No. x, 2012.
17. Richard S. Sutton and Andrew G. Barto, "Reinforcement Learning: An introduction", MIT press, Cambridge, England, 1998.
18. Christopher J. C. H. Watkins, and Peter Dayan, "Q-Learning A technical Note", Kluwer Academic Publishers, Boston, Vol No. 8, PP 279-292, Year 1992.
19. Junling Hu, and Michael P. Wellman, "Nash-Q-learning for General Stochastic Games, Journal of Machine Learning Research Vol No. 4, 2003.
20. J. C. Ikuno, M. Wrulich, and M. Ruppo, "System level simulation of LTE networks, " in Proc. 2010 IEEE 71st Vehicular Technology Conference, Taipei, Taiwan, May 2010. [Online] Available: http://publik. tuwien.ac.at/files/PubDat-184908.pdf.