Adaptive Q-learning cell selection method for open-access femtocell networks: Multi-user case

IEICE Transactions on Communications

Volumn E97-B, Issue 8, 2014, Pages 1679-1688

  Dhahri, Chaima ^a   Ohtsuki, Tomoaki ^a  

^a KEIO UNIVERSITY   (Japan)

Author keywords

Fuzzy logic; Handover; Open access femtocell networks; Q learning; Reinforcement learning

Indexed keywords

CELLS; CHANNEL CAPACITY; CYTOLOGY; FUZZY LOGIC; LEARNING ALGORITHMS; REINFORCEMENT LEARNING;

CHANNEL CONDITIONS; CONVENTIONAL APPROACH; FEMTOCELL NETWORKS; FUZZY INFERENCE SYSTEMS; HANDOVER; PROPAGATION EFFECT; Q-LEARNING; Q-LEARNING ALGORITHMS;

FEMTOCELL;

EID: 84905390889     PISSN: 09168516     EISSN: 17451345     Source Type: Journal    
DOI: 10.1587/transcom.E97.B.1679     Document Type: Article

References (17)

1. V. Chandrasekhar, J. Andrews, and A. Gatherer, "Femtocell networks: A survey," IEEE Commun. Mag., vol.46, no.9, pp.59-67, Sept. 2008.
2. E. Frech and C. Mesquida, "Cellular models and hand-off criteria," VETEC 1989, vol.1, pp.128-135, May 1989.
3. J. Holtzman and A. Sampath, "Adaptive averaging methodology for handoffs in cellular systems," IEEE Trans. Veh. Technol, vol.44, no.1, pp.59-66, Feb. 1995.
4. K. Cornett and S. Wicker, "Bit error rate estimation techniques for digital land mobile radios," VETEC 1991, pp.543-548, May 1991.
5. H. Mahmoud, I. Gu andvenc, and F. Watanabe, "Performance of open access femtocell networks with different cell-selection methods," VTC Spring 2010, pp.1-5, May 2010.
6. L. Pack Kaelbling, M. Littman, and A. Moore, "Reinforcement learning: A survey," J. Artificial Intelligence Research, vol.4, pp.237-285, May 1996.
7. C. Dhahri and T. Ohtsuki, "Learning-based cell selection method for femtocell networks," VTC Spring 2012, pp.1-5, May 2012.
8. C. Dhahri and T. Ohtsuki, "Q-learning cell selection for femtocell networks: Single-and multi-user case," GLOBECOM 2012, pp.4975-4980, Dec. 2012.
9. H. Tabrizi, G. Farhadi, and J. Cioffi, "A learning-based network selection method in heterogeneous wireless systems," GLOBECOM 2011, pp.1-5, Dec. 2011.
10. J. Zhang and G. de la Roche, "A learning-based network selection method in heterogeneous wireless systems," GLOBECOM 2011, pp.1-5, Dec. 2011.
11. M. Noh, Y. Lee, and H. Park, "Low complexity LMMSE channel estimation for OFDM," IEE Proc. Commun., vol.153, no.5, pp.645-650, Oct. 2006.
12. R.S. Sutton and A.G. Barto, Introduction to Reinforcement Learning, MIT Press/Bradford Books, Cambridge, MA, 1998.
13. J.C.H. Watkins and P. Dayan, "Technical note: Q-learning," J. Machine Learning, vol.8, no.279-292, 1992.
14. T. Takagi and M. Sugeno, "Fuzzy identification of systems and its applications to modeling and control," IEEE Trans. Syst. Man. Cybern., vol.SMC-15, no.1, pp.116-132, 1985.
15. W. Pedrycz, "Why triangular membership functions?," J. Fuzzy Sets and Systems, vol.64, no.1, pp.21-30, 1994.
16. FemtoForum, "Interference management in OFDMA femtocells," March 2010. [Online]. Available: http://www.femtoforum.org [Online]. Available: http://www.femtoforum.org
17. D. Prez-Lopez and X. Chu, "Inter-cell interference coordination for expanded region picocells in heterogeneous networks," Proc. 20th International Conference on IEEE Computer Communications and Networks, ICCCN, pp.1-6, 2011.