Fuzzy rule-based reinforcement learning for load balancing techniques in enterprise LTE femtocells

IEEE Transactions on Vehicular Technology

Volumn 62, Issue 5, 2013, Pages 1962-1973

  Munoz, Pablo ^a   Barco, Raquel ^a   Ruiz Aviles, Jose Maria ^a   De La Bandera, Isabel ^a   Aguilar, Alejandro ^a  

^a UNIVERSITY OF MÁLAGA   (Spain)

Author keywords

Femtocell; fuzzy logic controller (FLC); Fuzzy Q Learning; handover (HO); load balancing; self optimization

Indexed keywords

BENCHMARKING; FEMTOCELL; FUZZY LOGIC; FUZZY RULES; INDUSTRY; PARALLEL ARCHITECTURES; RESOURCE ALLOCATION;

FUZZY LOGIC CONTROLLERS; FUZZY-Q-LEARNING; HANDOVER; LOAD BALANCING TECHNIQUE; PERFORMANCE ASSESSMENT; PERFORMANCE INDICATORS; SELF-OPTIMIZATION; SYSTEM LEVEL SIMULATOR;

REINFORCEMENT LEARNING;

EID: 84879208413     PISSN: 00189545     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVT.2012.2234156     Document Type: Article

References (40)

1. V. Chandrasekhar, J. Andrews, and A. Gatherer, "Femtocell networks: A survey," IEEE Commun. Mag., vol. 46, no. 9, pp. 59-67, Sep. 2008.
2. "Informative List of SON Use Cases, Project 12," Frankfurt, Germany, 2007, ver. 1.53.
3. M. Döttling and I. Viering, "Challenges in mobile network operation: Towards self-optimizing networks," in Proc. IEEE ICASSP, 2009, pp. 3609-3612.
4. "Use Cases for Self-Organising Networks," Karlsruhe, Germany, Deliverable D2.1, ver. 1.0, 2008.
5. "Self-Configuring and Self-Optimizing Network use Cases and Solutions," France, TR 36.902, Sep. 2009, ver. 9.0.0.
6. "Feasibility study for Further Advancements for E-UTRA (LTEAdvanced)," France, TR 36.912, Mar. 2011, ver. 10.0.0.
7. Z. Altman, C. Balageas, P. Beltran, Y. Ben Ezra, E. Formet, J. Hämäläinen, O. Marce, E. Mutafungwa, S. Perales,M. Ran, and Z. Zheng, "Femtocells: The HOMESNET vision," in Proc. IEEE 21st Int. Symp. PIMRC, 2010, pp. 139-144.
8. A. G. Serrano, L. Giupponi, and M. Dohler, "BeFEMTO's self-organized and docitive femtocells," in Proc. Future Network Mobile Summit, 2010, pp. 1-8.
9. G. Vivier, M. Kamoun, Z. Becvar, E. de Marinis, Y. Lostanlen, and A. Widiawan, "Femtocells for next-G wireless systems: The FREEDOM approach," in Proc. Future Network Mobile Summit, 2010, pp. 1-9.
10. D. López-Pérez, A. Valcarce, G. de la Roche, and J. Zhang, "OFDMA femtocells: A roadmap on interference avoidance," IEEE Commun. Mag., vol. 47, no. 9, pp. 41-48, Sep. 2009.
11. S. Barbarossa, S. Sardelliti, A. Carfagna, and P. Vecchiarelli, "Decentralized interference management in femtocells: A game-theoretic approach," in Proc. 5th Int. Conf. CROWNCOM, 2010, pp. 1-5.
12. M. Bennis, S. Guruacharya, and D. Niyato, "Distributed learning strategies for interference mitigation in femtocell networks," in Proc. IEEE GLOBECOM, 2011, pp. 1-5.
13. A. Tyrrell, F. Zdarsky, E. Mino, and M. López, "Use cases, enablers and requirements for evolved femtocells," in Proc. IEEE 73rd VTC Spring, 2011, pp. 1-5.
14. J. Kojima and K. Mizoe, "Radio mobile communication system wherein probability of loss of calls is reduced without a surplus of base station equipment," U.S. Patent 4 435 840, Mar. 6, 1984.
15. C. Saraydar and A. Yener, "Adaptive cell sectorization for CDMA systems," IEEE J. Sel. Areas Commun., vol. 19, no. 6, pp. 1041-1051, Jun. 2001.
16. M. Toril and V. Wille, "Optimization of Handover parameters for traffic sharing in GERAN,"Wireless Pers. Commun., vol. 47, no. 3, pp. 315-336, Nov. 2008.
17. S. Luna-Ramírez, M. Toril, M. Fernández-Navarro, and V. Wille, "Optimal traffic sharing in GERAN," Wireless Pers. Commun., vol. 57, no. 4, pp. 553-574, Apr. 2011.
18. J. Li, C. Fan, D. Yang, and J. Gu, "UMTS soft Handover algorithm with adaptive thresholds for load balancing," in Proc. IEEE 62nd VTC, 2005, pp. 2508-2512.
19. A. Lobinger, S. Stefanski, T. Jansen, and I. Balan, "Load balancing in downlink LTE self-optimizing networks," in Proc. IEEE 71st VTC, 2010, pp. 1-5.
20. H. Zhang, X. Qiu, L. Meng, and X. Zhang, "Design of distributed and autonomic load balancing for self-organization LTE," in Proc. IEEE 72nd VTC, 2010, pp. 1-5.
21. I. Ashraf, H. Claussen, and L. T. W. Ho, "Distributed radio coverage optimization in enterprise femtocell networks," in Proc. IEEE ICC, 2010, pp. 1-6.
22. J. Ruiz-Avilés, S. Luna-Ramirez, M. Toril, F. Ruiz, I. de la Bandera-Cascales, and P. Munoz-Luengo, "Analysis of load sharing techniques in enterprise LTE femtocells," in Proc. WiAd, 2011, pp. 195-200.
23. J. M. Ruiz-Avilés, S. Luna-Ramírez, M. Toril, and F. Ruiz, "Traffic steering by self-tuning controllers in enterprise LTE femtocells," EURASIP J. Wireless Commun. Networking, vol. 337, Nov. 2012.
24. S. Luna-Ramírez, M. Toril, F. Ruiz, and M. Fernández- Navarro, "Adjustment of a fuzzy logic controller for IS-HO parameters in a heterogeneous scenario," in Proc. IEEE 14th MELECON, 2008, pp. 29-34.
25. C. Werner, J. Voigt, S. Khattak, and G. Fettweis, "Handover parameter optimization in WCDMA using fuzzy controlling," in Proc. IEEE 18th Int. Symp. PIMRC, 2007, pp. 1-5.
26. J. Rodríguez, I. de la Bandera, P. Muñoz, and R. Barco, "Load balancing in a realistic urban scenario for LTE networks," in Proc. IEEE 73rd VTC, 2011, pp. 1-5.
27. A. Çalhan and C. Çeken, "An optimum vertical handoff decision algorithm based on adaptive fuzzy logic and genetic algorithm,"Wireless Pers. Commun., vol. 64, no. 4, pp. 647-664, Jun. 2012.
28. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press, 1998.
29. Y. H. Chen, C. J. Chang, and C. Y. Huang, "Fuzzy Q-learning admission control for WCDMA/WLAN heterogeneous networks with multimedia traffic," IEEE Trans. Mobile Comput., vol. 8, no. 11, pp. 1469-1479, Nov. 2009.
30. J. Nie and S. Haykin, "A dynamic channel assignment policy through Q-learning," IEEE Trans. Neural Netw., vol. 10, no. 6, pp. 1443-1455, Nov. 1999.
31. M. E.-A. El-Sayed and Y. Yu-Dong, "Comparing a class of dynamic model-based reinforcement learning schemes for handoff prioritization in mobile communication networks," Exp. Syst. Appl., vol. 38, no. 7, pp. 8730-8737, Jul. 2011.
32. R. Nasri, A. Samhat, and Z. Altman, "A new approach of UMTS-WLAN load balancing; algorithm and its dynamic optimization," in Proc. IEEE Int. Symp. World Wireless, Mobile Multimedia Netw., 2007, pp. 1-6.
33. P. Muñoz, R. Barco, I. de la Bandera,M. Toril, and S. Luna-Ramírez, "Optimization of a fuzzy logic controller for handover-based load balancing," in Proc. IEEE 73rd VTC, 2011, pp. 1-5.
34. "Evolved Universal Terrestrial Radio Access (E-UTRA) Radio Resource Control (RRC); Protocol Specification," France, TS 36.331, Sep. 2009, ver. 9.0.0.
35. T. Ross, Fuzzy Logic With Engineering Applications. Hoboken, NJ: Wiley, 2010.
36. C. Mehlführer, M. Wrulich, J. Colom Ikuno, D. Bosanska, and M. Rupp, "Simulating the long term evolution physical layer," in Proc. 17th EUSIPCO, 2009, pp. 1471-1478.
37. P. Y. Glorennec and L. Jouffe, "Load balancing and call admission control in UMTS-RNC, using fuzzy logic," in Proc. IEEE 6th Int. Conf. Fuzzy Syst., 1997, vol. 2, pp. 659-662.
38. "WINNER II. Channel Models. Part II. Radio Channel Measurement and Analysis Results," Munich, Germany, 2007, D1.1.2. ver. 1.0.
39. T. Sorensen, P. Mogensen, and F. Frederiksen, "Extension of the ITU channel models for wideband (OFDM) systems," in Proc. IEEE 62nd VTC, 2005, pp. 392-396.
40. L. Kaelbling, M. Littman, and A. Moore, "Reinforcement learning: A survey," J. Artif. Intell. Res., vol. 4, no. 1, pp. 237-285, Jan. 1996.