Adaptive power management in solar energy harvesting sensor node using reinforcement learning

ACM Transactions on Embedded Computing Systems

Volumn 16, Issue 5s, 2017, Pages

  Shresthamali, Shaswot ^a   Kondo, Masaaki ^a   Nakamura, Hiroshi ^a  

^a UNIVERSITY OF TOKYO   (Japan)

Author keywords

IoT; Power management; Reinforcement learning; Wireless sensor nodes

Indexed keywords

ELECTRIC BATTERIES; ENERGY HARVESTING; ENERGY MANAGEMENT; MANAGERS; POWER MANAGEMENT; SECONDARY BATTERIES; SENSOR NODES; SOLAR ENERGY; WEATHER FORECASTING;

ADAPTIVE POWER MANAGEMENT; BATTERY DEGRADATION; DEVICE PARAMETERS; HISTORICAL DATA; NEAR-OPTIMAL PERFORMANCE; REWARD FUNCTION; ROOT MEAN SQUARE DEVIATIONS; WIRELESS SENSOR NODE;

REINFORCEMENT LEARNING;

EID: 85030676791     PISSN: 15399087     EISSN: 15583465     Source Type: Journal    
DOI: 10.1145/3126495     Document Type: Conference Paper

References (23)

1. Luca Benini, Giuliano Castelli, Alberto Macii, and Riccardo Scarsi. 2001. Battery-driven dynamic power management. IEEE Design & Test of Computers 18, 2 (2001), 53-60.
2. Pol Blasco et al. 2013. A learning theoretic approach to energy harvesting communication system optimization. IEEE Tr. on Wireless Communications 12, 4 (2013), 1872-1882.
3. Wai Hong Ronald Chan et al. 2015. Adaptive duty cycling in sensor networks with energy harvesting using continuous-time Markov chain and fluid models. IEEE Journal on Selected Areas in Communications 33, 12 (2015), 2687-2700.
4. Deniz Gunduz, Kostas Stamatiou, Nicolo Michelusi, and Michele Zorzi. 2014. Designing intelligent energy harvesting communication systems. IEEE Communications Magazine 52, 1 (2014), 210-216.
5. Jason Hsu et al. 2006. Adaptive duty cycling for energy harvesting systems. In Proc. of the 2006 ISLPED. 180-185.
6. Roy Chaoming Hsu et al. 2014. A Reinforcement Learning-Based ToD Provisioning Dynamic Power Management for Sustainable Operation of Energy Harvesting Wireless Sensor Node. IEEE Tr. on Emerging Topics in Computing 2, 2 (2014), 181-191.
7. Roy Chaoming Hsu et al. 2015. Dynamic energy management of energy harvesting wireless sensor nodes using fuzzy inference system with reinforcement learning. In IEEE 13th INDIN. 116-120.
8. Xiaofan Jiang, Joseph Polastre, and David Culler. 2005. Perpetual environmentally powered sensor networks. In Proceedings of the 4th International Symposium on Information Processing in Sensor Networks. IEEE Press, 65.
9. Aman Kansal et al. 2007. Powermanagement in energy harvesting sensor networks. ACMTr. on Embedded Computing Systems 6, 4 (2007), 32.
10. Aman Kansal, Dunny Potter, and Mani B. Srivastava. 2004. Performance aware tasking for environmentally powered sensor networks. ACM SIGMETRICS Performance Evaluation Review 32, 1 (2004), 223-234.
11. Junaid Ahmed Khan et al. 2015. Energy management in wireless sensor networks: a survey. Computers & Electrical Engineering 41 (2015), 159-176.
12. Cheng-Ting Liu and Roy Chaoming Hsu. 2011. Dynamic power management utilizing reinforcement learning with fuzzy reward for energy harvesting wireless sensor nodes. In 37th Annual Conference on IEEE Industrial Electronics Society. 2365-2369.
13. S. Danish Maqbool et al. 2011. Analysis of adaptability of Reinforcement Learning approach. In IEEE 14th INMIC. 45-49.
14. Nicolo Michelusi et al. 2013. Energy management policies for harvesting-based wireless sensor devices with battery degradation. IEEE Tr. on Communications 61, 12 (2013), 4934-4947.
15. Andrea Ortiz et al. 2016. Reinforcement learning for energy harvesting point-to-point communications. In 2016 IEEE International Conference on Communications. 1-6.
16. Vijay Raghunathan, Aman Kansal, Jason Hsu, Jonathan Friedman, and Mani Srivastava. 2005. Design considerations for solar energy harvesting wireless embedded systems. In Proceedings of the 4th International Symposium on Information Processing in Sensor Networks. IEEE Press, 64.
17. Luigi Rucco et al. 2013. A bird's eye view on reinforcement learning approaches for power management in WSNs. In 6th WMNC. 1-8.
18. Navin Sharma et al. 2010. Cloudy computing: Leveraging weather forecasts in energy harvesting sensor systems. In 7th IEEE SECON. 1-9.
19. Sujesha Sudevalayam and Purushottam Kulkarni. 2011. Energy harvesting sensor nodes: Survey and implications. IEEE Communications Surveys & Tutorials 13, 3 (2011), 443-461.
20. Srikanth Sundaresan et al. 2009. Event-driven adaptive duty-cycling in sensor networks. International Journal of Sensor Networks 6, 2 (2009), 89-100.
21. Richard S. Sutton et al. 1992. Reinforcement learning is direct adaptive optimal control. IEEE Control Systems 12, 2 (1992), 19-22.
22. Emre Unsal, Taner Akkan, L. Ozlem Akkan, and Yalcin Cebi. 2016. Power management for Wireless Sensor Networks in underground mining. In Signal Processing and Communication Application Conference (SIU), 2016 24th. IEEE, 1053-1056.
23. Christopher M. Vigorito et al. 2007. Adaptive control of duty cycling in energy-harvesting wireless sensor networks. In 4th IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks. 21-30.