Cell selection for open-access femtocell networks: Learning in changing environment

Physical Communication

Volumn 13, Issue PB, 2014, Pages 42-52

  Dhahri, Chaima ^a   Ohtsuki, Tomoaki ^a  

^a KEIO UNIVERSITY   (Japan)

Author keywords

Cell selection; Femtocell networks; Learning in dynamic environment; Meta bandit; Multi armed bandit (MAB)

Indexed keywords

ALGORITHMS; CHAINS; FEMTOCELL; MARKOV PROCESSES;

CELL SELECTION; DYNAMIC ENVIRONMENTS; FEMTOCELL NETWORKS; META-BANDIT; MULTI ARMED BANDIT;

PROBLEM SOLVING;

EID: 84909944447     PISSN: 18744907     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.phycom.2014.04.008     Document Type: Article

References (21)

1. Chandrasekhar V., Andrews J., Gatherer A. Femtocell networks: a survey. IEEE Commun. Mag. 2008, 46(9):59-67.
2. E. Frech, C. Mesquida, Cellular models and hand-off criteria, in: VTC 1989, vol. 1, May 1989, pp. 128-135.
3. Holtzman J., Sampath A. Adaptive averaging methodology for handoffs in cellular systems. IEEE Trans. Veh. Technol. 1995, 44(1):59-66.
4. K. Cornett, S. Wicker, Bit error rate estimation techniques for digital land mobile radios, in: VTC 1991, May 1991, pp. 543-548.
5. H. Mahmoud, I. Guandvenc, F. Watanabe, Performance of open access femtocell networks with different cell-selection methods, in: VTC Spring 2010, May 2010, pp. 1-5.
6. Pack Kaelbling L., Littman M., Moore A. Reinforcement learning: a survey. J. Artificial Intelligence Res. 1996, 4:237-285.
7. C. Dhahri, T. Ohtsuki, Learning-based cell selection method for femtocell networks, in: VTC Spring 2012, May 2012, pp. 1-5.
8. C. Dhahri, T. Ohtsuki, Q-learning cell selection for femtocell networks: single- and multi-user case, in: GLOBECOM 2012, Dec. 2012, pp. 4975-4980.
9. H. Tabrizi, G. Farhadi, J. Cioffi, A learning-based network selection method in heterogeneous wireless systems, in: GLOBECOM 2011, Dec. 2011, pp. 1-5.
10. H. Liu, K. Liu, Q. Zhao, Decentralized restless bandit with multiple players and unknown dynamics. [Online]. Available: , 2011, vol. abs/1102.2975, 2011. http://dblp.unitrier.de/db/journals/corr/corr1102.html#abs-1102-2975.
11. Page E.S. Continuous inspection schemes. Biometrika 1954, 41(1):100-115.
12. Hartland C., Baskiotis N., Gelly S., Sebag M., Teytaud O. Change Point Detection and Meta-Bandits for Online Learning in Dynamic Environments 2007, 237-250. [Online]. Available: http://hal.inria.fr/inria-00164033/PDF/cap07.pdf.
13. Auer P., Cesa-Bianchi N., Fischer P. Finite-time analysis of the multiarmed bandit problem. J. Mach. Learn. 2002, 47(2-3):235-256.
14. Tekin C., Liu Mingyan Online algorithms for the multi-armed bandit problem with Markovian rewards. Comm. Control Comput. (Allerton) 2010.
15. Liu Keqin, Zhao Qing Distributed learning in multi-armed bandit with multiple players. IEEE Trans. Signal Process. 2010, 58(11):5667-5681.
16. H. Liu, K. Liu, Q. Zhao, Logarithmic weak regret of non-Bayesian restless multi-armed bandit, in: Conference on Acoustics, Speech and Signal Processing, ICASSP, 2011.
17. Ricardo V., Youssef D. A perspective view and survey of meta-learning. Artif. Intell. Rev. 2002, 18:77-95.
18. Schweighofer N., Doya K. Meta-learning in reinforcement learning. Neural Netw. 2003, 16:5-9.
19. C. Hartland, N. Baskiotis, S. Gelly, O. Teytaud, M. Sebag, Multi-armed bandit, dynamic environments and meta-bandits, in: Online Trading of Exploration and Exploitation Workshop, NIPS, Dec. 2006.
20. P. Auer, Z. Hussain, N. Cesa-Bianchi, L. Newnham, J. Shawe-Taylor, [Online]. Available: , 2006. http://pascallin.ecs.soton.ac.uk/Challenges/EEC/.
21. FemtoForum, Interference Management in OFDMA Femtocells, Mar. 2010. [Online]. Available: . http://www.femtoforum.org.