A Non-Stochastic Learning Approach to Energy Efficient Mobility Management

IEEE Journal on Selected Areas in Communications

Volumn 34, Issue 12, 2016, Pages 3854-3868

  Shen, Cong ^a   Tekin, Cem ^b   Van Der Schaar, Mihaela ^c  

^a UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA   (China)

^b BILKENT UNIVERSITY   (Turkey)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Energy efficient mobility management; frequent handover (FHO); non stochastic learning; ultra dense networks (UDN)

Indexed keywords

COMPLEX NETWORKS; ENERGY UTILIZATION; OPTIMIZATION; STOCHASTIC SYSTEMS; WIRELESS NETWORKS;

DENSE NETWORK; DENSE WIRELESS NETWORKS; EXPONENTIAL WEIGHTING; HANDOVER; MOBILITY MANAGEMENT; NON-STOCHASTIC; STATISTICAL BEHAVIOR; SYSTEM ENERGY CONSUMPTION;

ENERGY EFFICIENCY;

EID: 85009739654     PISSN: 07338716     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSAC.2016.2612038     Document Type: Article

References (29)

1. T. Q. S. Quek, G. de la Roche, I. Guvenc, and M. Kountouris, Small Cell Networks: Deployment, PHY Techniques, and Resource Allocation. Cambridge, U.K.: Cambridge University Press, 2013.
2. S. Sesia, I. Toufik, and M. Baker, LTE-The UMTS Long Term Evolution: From Theory to Practice, 2nd ed. Hoboken, NJ, USA: Wiley, 2011.
3. J. Andrews, S. Singh, Q. Ye, X. Lin, and H. Dhillon, "An overview of load balancing in HetNets: Old myths and open problems, " IEEE Wireless. Commun., vol. 21, no. 2, pp. 18-25, Apr. 2014.
4. D. Xenakis, N. Passas, L. Merakos, and C. Verikoukis, "Energy-efficient and interference-Aware handover decision for the LTE-Advanced femtocell network, " in Proc. IEEE Int. Conf. Commun. (ICC), Jun. 2013, pp. 2464-2468.
5. Q. Ye, B. Rong, Y. Chen, M. Al-Shalash, C. Caramanis, and J. G. Andrews, "User association for load balancing in heterogeneous cellular networks, " IEEE Trans. Wireless Commun., vol. 12, no. 6, pp. 2706-2716, Jun. 2013.
6. A. Mesodiakaki, F. Adelantado, L. Alonso, and C. Verikoukis, "Energyefficient context-Aware user association for outdoor small cell heterogeneous networks, " in Proc. IEEE Int. Conf. Commun. (ICC), Jun. 2014, pp. 1614-1619.
7. S. Althunibat, K. Kontovasilis, and F. Granelli, "A handover policy for energy efficient network connectivity through proportionally fair access, " in Proc. Eur. Wireless Conf., May 2014, pp. 1-6.
8. C. Bottai, C. Cicconetti, A. Morelli, M. Rosellini, and C. Vitale, "Energy-efficient user association in extremely dense small cell networks, " in Proc. Eur. Conf. Netw. Commun. (EuCNC), Jun. 2014, pp. 1-5.
9. Evolved Universal Terrestrial Radio Access; Mobility Enhancements in Heterogeneous Networks, document TR 36.839, 3GPP, 2012.
10. M. Simsek, M. Bennis, and I. Gövenç, "Context-Aware mobility management in HetNets: A reinforcement learning approach, " in Proc. IEEE Wireless Commun. Netw. Conf. (WCNC), Mar. 2015, pp. 1536-1541.
11. V. Capdevielle, A. Feki, and E. Sorsy, "Joint interference management and handover optimization in LTE small cells network, " in Proc. IEEE Int. Conf. Commun. (ICC), Jun. 2012, pp. 6769-6773.
12. T. Lai and H. Robbins, "Asymptotically efficient adaptive allocation rules, " Adv. Appl. Math., vol. 6, no. 1, pp. 4-22, 1985.
13. P. Auer, N. Cesa-Bianchi, and P. Fischer, "Finite-Time analysis of the multiarmed bandit problem, " Mach. Learn., vol. 47, no. 2, pp. 235-256, 2002.
14. C. Tekin and M. Liu, "Online learning of rested and restless bandits, " IEEE Trans. Inf. Theory, vol. 58, no. 8, pp. 5588-5611, Aug. 2012.
15. In Building Solutions, White Paper, Nokia Siemens Netw., Espoo, Finland, 2001.
16. F. Boccardi, R. W. Heath, A. Lozano, T. L. Marzetta, and P. Popovski, "Five disruptive technology directions for 5G, " IEEE Commun. Mag., vol. 52, no. 2, pp. 74-80, Feb. 2014.
17. Evolved Universal Terrestrial Radio Access; S1 Application Protocol (S1AP), document TR 36.413, 3GPP, 2012.
18. P. Auer, N. Cesa-Bianchi, Y. Freund, and R. E. Schapire, "The nonstochastic multiarmed bandit problem, " SIAM J. Comput., vol. 32, no. 1, pp. 48-77, 2002.
19. S. Bubeck, "Jeux de bandits et fondations du clustering, " Ph.D. dissertation, Dept. Math, Univ. Lille 1, Villeneuve-dAscq, France, 2010.
20. N. Merhav, E. Ordentlich, G. Seroussi, and M. J. Weinberger, "On sequential strategies for loss functions with memory, " IEEE Trans. Inf. Theory, vol. 48, no. 7, pp. 1947-1958, Jul. 2002.
21. S. Bubeck and N. Cesa-Bianchi, "Regret analysis of stochastic and nonstochastic multi-Armed bandit problems, " Found. Trends Mach. Learn., vol. 5, no. 1, pp. 1-122, 2012.
22. O. Dekel, J. Ding, T. Koren, and Y. Peres, "Bandits with switching costs: T2/3 regret, " in Proc. 46th Annu. ACM Symp. Theory Comput., 2014, pp. 459-467.
23. D. Chakrabarti, R. Kumar, F. Radlinski, and E. Upfal, "Mortal multi-Armed bandits, " in Proc. Adv. Neural Inf. Process. Syst., 2008, pp. 273-280.
24. Z. Bnaya, R. Puzis, R. Stern, and A. Felner, "Volatile multi-Armed bandits for guaranteed targeted social crawling, " in Proc. Workshops 27th AAAI Conf. Artif. Intell., 2013, pp. 8-10.
25. N. Cesa-Bianchi and G. Lugosi, Prediction, Learning, and Games. Cambridge, U.K.: Cambridge University Press, 2006.
26. R. Kleinberg, A. Niculescu-Mizil, and Y. Sharma, "Regret bounds for sleeping experts and bandits, " Mach. Learn., vol. 80, nos. 2-3, pp. 245-272, 2010.
27. Evolved Universal Terrestrial Radio Access; Further Advancements for E-UTRA Physical Layer Aspects, document TR 36.814, 3GPP, 2010.
28. T. Camp, J. Boleng, and V. Davies, "A survey of mobility models for ad hoc network research, " Wireless Commun. Mobile Comput., vol. 2, no. 5, pp. 483-502, Sep. 2002.
29. R. Arora, O. Dekel, and A. Tewari, "Online bandit learning against an adaptive adversary: From regret to policy regret, " in Proc. 29th Int. Conf. Mach. Learn., 2012, pp. 1503-1510.