Battery Management in a Green Fog-Computing Node: A Reinforcement-Learning Approach

IEEE Access

Volumn 5, Issue , 2017, Pages 21126-21138

  Conti, Stefania ^a   Faraci, Giuseppe ^a   Nicolosi, Rosario ^a   Rizzo, Santi Agatino ^a   Schembra, Giovanni ^a  

^a UNIVERSITY OF CATANIA   (Italy)

Author keywords

battery management; Fog computing; Markov model; reinforcement learning; renewable energy

Indexed keywords

BATTERY MANAGEMENT SYSTEMS; DISTRIBUTED COMPUTER SYSTEMS; ELECTRIC BATTERIES; EMPLOYMENT; ENERGY MANAGEMENT SYSTEMS; ENERGY STORAGE; FOG; MARKOV PROCESSES; REINFORCEMENT LEARNING;

BATTERY MANAGEMENT; ENERGY STORAGE SYSTEMS; ENVIRONMENTAL-FRIENDLY; MARKOV MODEL; PERFORMANCE ANALYSIS; REINFORCEMENT LEARNING APPROACH; RENEWABLE ENERGIES; RENEWABLE ENERGY GENERATORS;

GREEN COMPUTING;

EID: 85030644084     PISSN: None     EISSN: 21693536     Source Type: Journal    
DOI: 10.1109/ACCESS.2017.2755588     Document Type: Article

References (28)

1. B. McMillin, T. Zhang, Fog computing for smart living, Computer, vol. 50, no. 2, p. 5, Feb. 2017.
2. F. Bonomi, R. Milito, J. Zhu, S. Addepalli, Fog computing, its role in the Internet of Things, in Proc. ACM MCC, Helsinki, Finland, Aug. 2012, pp. 13-16.
3. F. Bonomi, R. Milito, P. Natarajan, J. Zhu, Fog computing: A platform for Internet of Things, analytics, in Big Data, Internet of Things: A Roadmap for Smart Environments, N. Bessis, C. Dobre, Eds. Cham, Switzerland: Springer, 2014.
4. J. D. Glover, M. S. Sarma, T. J. Overbye, Power System Analysis and Design, 5th ed. Boston, MA, USA: Cengage Learning, 2011.
5. F. Jalali, K. Hinton, R. Ayre, T. Alpcan, R. S. Tucker, Fog computing may help to save energy in cloud computing, IEEE J. Sel. Areas Commun., vol. 34, no. 5, pp. 1728-1739, May 2016.
6. G. Faraci, G. Schembra, An analytical model to design, manage a green SDN/NFV CPE node, IEEE Trans. Netw. Service Manage., vol. 12, no. 3, pp. 435-450, Sep. 2015.
7. G. Faraci, G. Schembra, An analytical model for electricityprice-A ware resource allocation in virtualized data centers, in Proc. IEEE ICC, London, U.K., Jun. 2015, pp. 5839-5845.
8. M. Shojafar, N. Cordeschi, E. Baccarelli, Energy-efficient adaptive resource management for real-time vehicular cloud services, IEEE Trans. Cloud Comput., to be published, doi: 10.1109/TCC.2016.2551747.
9. S.Wang, X. Huang, Y. Liu, R.Yu, CachinMobile: An energy-efficient users caching scheme for fog computing, in Proc. IEEE/CIC Int. Conf. Commun. China (ICCC), Chengdu, China, Jul. 2016, pp. 1-6.
10. M. A. Al Faruque, K. Vatanparvar, Energy management-as-a-service over fog computing platform, IEEE Internet Things J., vol. 3, no. 2, pp. 161-169, Apr. 2016.
11. F. Jalali, A. Vishwanath, J. de Hoog, F. Suits, Interconnecting Fog computing, microgrids for greening IoT, in Proc. IEEE Innov. Smart Grid Technol.-Asia (ISGT-Asia), Melbourne, VIC, Australia, Nov./Dec. 2016, pp. 693-698.
12. C. Rametta, G. Schembra, Designing a softwarized network deployed on a-eet of drones for rural zone monitoring, Future Internet J., vol. 9, no. 1, p. 8, Mar. 2017.
13. K. Zhou, T. Liu, L. Zhou, Industry 4.0: Towards future industrial opportunities, challenges, in Proc. 12th Int. Conf. Fuzzy Syst. Knowl. Discovery (FSKD), Zhangjiajie, China, Aug. 2015, pp. 2147-2152.
14. F. Shrouf, J. Ordieres, G. Miragliotta, Smart factories in Industry 4.0: A review of the concept, of energy management approached in production based on the Internet of Things paradigm, in Proc. IEEE Int. Conf. Ind. Eng. Eng. Manage., Bandar Sunway, Malaysia, Dec. 2014, pp. 697-701.
15. M. C. Dwarkani, R. R. Ganesh, S. Jagannathan, R. Priyatharshini, Smart farming system using sensors for agricultural task automation, in Proc. IEEE Technol. Innov. ICT Agricult. Rural Develop. (TIAR), Chennai, India, Jul. 2015, pp. 49-53.
16. H. Cruickshank, E. Bovim, A. Donner, J. Sesena, R. Mort, Reference scenarios for the deployment of emergency communications for earthquakes, mass transport accidents, in Proc. 7th Adv. Satel-lite Multimedia Syst. Conf., 13th Signal Process. Space Commun. Workshop (ASMS/SPSC), Livorno, Italy, Sep. 2014, pp. 262-268.
17. P. Yang, A. Nehorai, Joint optimization of hybrid energy storage and generation capacity with renewable energy, IEEE Trans. Smart Grid, vol. 5, no. 4, pp. 1566-1574, Jul. 2014.
18. S. Singh, M. Singh, S. C. Kaushik, Optimal power scheduling of renewable energy systems in microgrids using distributed energy storage system, IET Renew. Power Generat., vol. 10, no. 9, pp. 1328-1339, Oct. 2016.
19. V. Kalkhambkar, R. Kumar, R. Bhakar, Joint optimal allocation methodology for renewable distributed generation, energy storage for economic benefits, IET Renew. Power Generat., vol. 10, no. 9, pp. 1422-1429, 2016.
20. H. Khani, M. R. D. Zadeh, A. H. Hajimiragha, Transmission congestion relief using privately owned large-scale energy storage systems in a competitive electricity market, IEEE Trans. Power Syst., vol. 31, no. 2, pp. 1449-1458, Mar. 2016.
21. P. Zou, Q. Chen, Q. Xia, G. He, C. Kang, Evaluating the contribution of energy storages to support large-scale renewable generation in joint energy, ancillary service markets, IEEE Trans. Sustain. Energy, vol. 7, no. 2, pp. 808-818, Apr. 2016.
22. C. Yu, J.Wang, J. Shan, M. Xin, Multi-UAVUWA video surveillance system, in Proc. 14th Int. Conf. Control, Autom., Robot. Vis. (ICARCV), Phuket, Thailand, Nov. 2016, pp. 1-6.
23. O. Hashida, Y. Takahashi, S. Shimogawa, Switched bath Bernoulli process (SBBP), the discrete-time SBBP/G/1 queue with application to statistical multiplexer performance, IEEE J. Sel. Areas Commun., vol. 9, no. 3, pp. 394-401, Apr. 1991.
24. A. Lombardo, G. Morabito, G. Schembra, Modeling intramedia and intermedia relationships in multimedia network analysis through multiple timescale statistics, IEEE Trans. Multimedia, vol. 6, no. 1, pp. 142-157, Feb. 2004.
25. R. S. Sutton, A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA, USA: MIT Press, 2012.
26. V. François-Lavet, R. Fonteneau, D. Ernst, How to discount deep reinforcement learning: Towards new dynamic strategies, in Proc. NIPS Workshop Deep Reinforcement Learn., Montreal, QC, Canada, Dec. 2015, pp. 7-12.
27. A. Lombardo, G. Schembra, Performance evaluation of an adaptiverate MPEG encoder matching IntServ traffic constraints, IEEE/ACM Trans. Netw., vol. 11, no. 1, pp. 47-65, Feb. 2003.
28. J. D. C. Little, A proof for the queuing formula: L D-W, Oper. Res., vol. 9, no. 3, pp. 383-387, 1961.