Distributed Q-learning for energy harvesting Heterogeneous Networks

2015 IEEE International Conference on Communication Workshop, ICCW 2015

Volumn , Issue , 2015, Pages 2006-2011

  Miozzo, Marco ^a   Giupponi, Lorenza ^a   Rossi, Michele ^b   Dini, Paolo ^a  

^a CENTRE TECNOLÒGIC DE TELECOMUNICACIONS DE CATALUNYA CTTC   (Spain)

^b UNIVERSITY OF PADOVA   (Italy)

Author keywords

Energy Efficiency; HetNet; Mobile Networks; Q Learning; Renewable Energy; Sustainability

Indexed keywords

ENERGY EFFICIENCY; ENERGY HARVESTING; HETEROGENEOUS NETWORKS; LEARNING ALGORITHMS; LEARNING SYSTEMS; MULTI AGENT SYSTEMS; SUSTAINABLE DEVELOPMENT; WIRELESS NETWORKS;

DISTRIBUTED Q-LEARNING; ENVIRONMENTAL CONDITIONS; HETNET; MULTI-AGENT Q-LEARNING; PERFORMANCE OBJECTIVE; Q-LEARNING; REINFORCEMENT LEARNING TECHNIQUES; RENEWABLE ENERGIES;

REINFORCEMENT LEARNING;

EID: 84947811281     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCW.2015.7247475     Document Type: Conference Paper

References (12)

1. Cisco Systems Inc., "Cisco visual networking index global mobile data traffic forecast update 2013-2018," White Paper, http://www. cisco. com/, Feb. 2013.
2. G. Piro, M. Miozzo, G. Forte, N. Baldo, L. A. Grieco, G. Boggia, and P. Dini, "HetNets Powered by Renewable Energy Sources," IEEE Internet Computing, vol. 17, no. 1, pp. 32-39, 2013.
3. 3GPP, "TS 36. 927 v12. 0. 0; LTE; E-UTRAN; potential solutions for energy saving for E-UTRAN," 2014.
4. H. Al Haj Hassan, L. Nuaymi, and A. Pelov, "Renewable energy in cellular networks: A survey," in IEEE Online Conference on Green Communications (GreenCom), Oct. 2013.
5. H. Dhillon, Y. Li, P. Nuggehalli, Z. Pi, and J. Andrews, "Fundamentals of Heterogeneous Cellular Networks with Energy Harvesting," IEEE Transactions on Wireless Communications, vol. 13, no. 5, pp. 2782-2797, May 2014.
6. D. Valerdi, Q. Zhu, K. Exadaktylos, S. Xia, M. Arranz, R. Liu, and D. Xu, "Intelligent energy managed service for green base stations," in IEEE Global Communications Conference (GLOBECOM), Miami, FL, US, Dec. 2010.
7. M. Marsan, G. Bucalo, A. Di Caro, M. Meo, and Y. Zhang, "Towards zero grid electricity networking: Powering BSs with renewable energy sources," in IEEE International Conference on Communications (ICC), Budapest, Hungary, Jun. 2013.
8. EU EARTH: Energy Aware Radio and neTwork tecHnologies, "D2. 3: Energy efficiency analysis of the reference systems, areas of improvements and target breakdown," Deliverable D2. 3, www. ict-earth. eu, 2010.
9. M. Mezzavilla, M. Miozzo, M. Rossi, N. Baldo, and M. Zorzi, "A Lightweight and Accurate Link Abstraction Model for System-Level Simulation of LTE Networks in ns-3," in ACM MSWIM, Paphos, Cyprus Island, Oct. 2012.
10. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press, 1998.
11. C. J. Watkins and P. Dayan, "Technical note: Q-learning," Machine Learning, vol. 8, pp. 279-292, 1992.
12. M. Miozzo, D. Zordan, P. Dini, and M. Rossi, "SolarStat: Modeling Photovoltaic Sources through Stochastic Markov Processes," in IEEE Energy Conference (ENERGYCON), Dubrovnik, Croatia, May 2014.