Q-learning based heterogenous network self-optimization for reconfigurable network with CPC assistance

Science in China, Series F: Information Sciences

Volumn 52, Issue 12, 2009, Pages 2360-2368

  Feng, ZhiYong ^a   Liang, LiTao ^b   Tan, Li ^a   Zhang, Ping ^a  

^a BEIJING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

^b CHINA MOBILE COMMUNICATIONS CORPORATION   (China)

Author keywords

CPC; Q learning; Reconfigurable system; Self optimization

Indexed keywords

EID: 76149131002     PISSN: 10092757     EISSN: 18622836     Source Type: Journal    
DOI: 10.1007/s11432-009-0223-5     Document Type: Article

References (20)

1. Wysocki T A, Dadejand A Wysocki B J, et al. Advanced wired and wireless networks. Multimedia Syst Appl, 2004, 26: 39-56, 81-104.
2. Demestichas P, Dimitrakopoulos G, Tsagkaris K, et al. Reconfigurations selection in cognitive, beyond 3G, radio infrastructures. In: Proc Int Conf Cognitive Radio Oriented Wireless Networks and Commun, Mykonos Island, June 2006. 1-5.
3. Bogenfeld E, Gaspard I. Self-x in radio access networks. E3 White Paper v1. 0. 22 Dec, 2008.
4. Gandalf Homepage: http://www. celtic-gandalf. org/.
5. European Commission. The Future of the Internet. Belgium, 2008.
6. Next Generation Mobile Network. Next generation mobile networks beyond HSPA & EVDO. White Paper, Release 3. 0. December 2006. http://www. ngmn. org/.
7. IEEE. IEEE 802. 16m. IEEE 802. 16m, IEEE 802. 16m-07/002r8. 15th Jan, 2009.
8. IEEE. Draft IEEE 802. 16m system description document (SDD). IEEE 802. 16m, IEEE 802. 16m-08/003r7. 7th Feb, 2009.
9. 3GPP. Self-organizing networks (SON), concepts and requirements. 3GPP TS 32. 500 v8. 0. 0, 3GPP Telecommunication Management, Release 8. Dec 2008.
10. 3GPP. Self-configuring and self-optimizing network use cases and solutions. 3GPP TR 36. 902 v1. 0. 1, 3GPP TSG RAN and E-UTRAN, Release 8. Sep 2008.
11. Ghosh D, Sharman R, Rao H R, et al. Self-healing systemssurvey and synthesis. Decis Supp Syst, 2007, 42(4): 2164-2185.
12. Perez-Romero J, Sallent O, Agusti R, et al. A novel on-demand cognitive pilot channel enabling dynamic spectrum allocation. 2nd ed. In: IEEE International Symposium on New Frontiers in Dynamic Spectrum Access Networks, Dublin, April 2007. 46-54.
13. European Commission, the seventh Frame Programme (FP7). ICT-2007-216248 E3 (End-to-End Efficiency) Project. http://www. ict-e3. eu/.
14. European Commission, the sixth Frame Programme (FP6). IST-2003-507995 E2R (End-to-End Reconfigurability) Project. http://e2r. motlabs. com/.
15. European Commission, the sixth Frame Programme (FP6). Dynamic network planning and management. E2R White Paper. Aug, 2005.
16. Moessner K, Rodriguez V, Dimitrakopoulos G, et al. Dynamic radio resource allocation strategies and time scales. In: SDR Forum Technical Conf. Orange County, Nov, 2005.
17. Demestichas P, Dimitrakopoulos G, Bourse D, et al. Dynamic planning and management of reconfigurable systems. In: Proc IEEE Int Symp New Frontiers in Dynamic Spectrum Access Networks, Baltimore, Nov 2005. 568-572.
18. Zhang Y, Tang T, Chen J, et al. Autonomic joint session admission control using reinforcement learning. J Beijing Univ Posts Telecom, 2007, 30(4): 5-9.
19. Huang B, Cao G, Wang Z. Reinforcement learning theory, algorithms and application. J Hebei University Tech, 2006, 35(6): 34-38.
20. Gao Y, Chen S, Lu X. A review of reinforcement learning. Acta Automa Sin, 2004, 30(1): 86-100.