Q-learning cell selection for femtocell networks: Single- and multi-user case

Proceedings - IEEE Global Communications Conference, GLOBECOM

Volumn , Issue , 2012, Pages 4975-4980

  Dhahri, Chaima ^a   Ohtsuki, Tomoaki ^a  

^a KEIO UNIVERSITY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

CELLS; CHANNEL CAPACITY; CYTOLOGY; DECISION MAKING; FEMTOCELL; REINFORCEMENT LEARNING;

CELL SELECTION; FEMTOCELL NETWORKS; HAND OVER; LEARNING CELLS; MULTIUSERS; NONSTATIONARY; Q-LEARNING; SINGLE USERS; TARGET CELLS; USER-CENTRED;

LEARNING ALGORITHMS;

EID: 84877672085     PISSN: 23340983     EISSN: 25766813     Source Type: Conference Proceeding    
DOI: 10.1109/GLOCOM.2012.6503908     Document Type: Conference Paper

References (11)

1. V. Chandrasekhar, J. Andrews, and A. Gatherer, "Femtocell networks: a survey," IEEE Commun. Mag., vol. 46, no. 9, pp. 59-67, Sept. 2008.
2. E. Frech and C. Mesquida, "Cellular Models and Hand-Off Criteria," in VETEC 1989, vol.1, pp. 128-135, May 1989.
3. J. Holtzman and A. Sampath, "Adaptive Averaging Methodology for Handoffs in Cellular Systems," IEEE Trans. Veh. Technol., vol. 44, no. 1, pp. 59-66, Feb. 1995.
4. K. Cornett and S. Wicker, "Bit Error Rate Estimation Techniques for Digital Land Mobile Radios," in VETEC 1991, pp. 543-548, May 1991.
5. H. Mahmoud, I. Gu andvenc, and F. Watanabe, "Performance of Open Access Femtocell Networks with Different Cell-Selection Methods," in VTC Spring 2010, pp. 1-5, May 2010.
6. L. Pack Kaelbling, M. Littman, and A. Moore, "Reinforcement Learning: A Survey," Journal of Artificial Intelligence Research, vol. 4, pp. 237-285, May 1996.
7. C. Dhahri and T. Ohtsuki, "Learning-based Cell Selection Method for Femtocell Networks," to be published in IEEE VTC Spring 2012.
8. H. Tabrizi, G. Farhadi, and J. Cioffi, "A learning-based network selection method in heterogeneous wireless systems," in Global Telecommunications Conference (GLOBECOM 2011), 2011 IEEE, dec. 2011, pp. 1 -5.
9. G. Durgin and T. Rappaport, "Theory of multipath shape factors for small-scale fading wireless channels," Antennas and Propagation, IEEE Transactions on, vol. 48, no. 5, pp. 682 -693, may 2000.
10. J. C. H. Watkins and P. Dayan, "Technical note: Q-learning," Machine Learning, vol. 8, no. 279-292, 1992.
11. FemtoForum, "Interference Management in OFDMA Femtocells," Mar. 2010. [Online]. Available: http://www.femtoforum.org