A New Energy Prediction Algorithm for Energy-Harvesting Wireless Sensor Networks With Q-Learning

IEEE Access

Volumn 4, Issue , 2016, Pages 5755-5763

  Kosunalp, Selahattin ^a  

^a BAYBURT UNIVERSITY   (Turkey)

Author keywords

Energy harvesting; prediction algorithms; solar energy; wireless sensor networks

Indexed keywords

ELECTRIC BATTERIES; ENERGY HARVESTING; FORECASTING; LEARNING ALGORITHMS; SOLAR ENERGY;

CONTINUOUS ENERGY; ENERGY DEPLETION; ENERGY INTENSITY; ENERGY PREDICTION; ENVIRONMENTAL ENERGY; LIMITED ENERGIES; PREDICTION ALGORITHMS; WIRELESS SENSOR NETWORK (WSNS);

WIRELESS SENSOR NETWORKS;

EID: 85027046574     PISSN: None     EISSN: 21693536     Source Type: Journal    
DOI: 10.1109/ACCESS.2016.2606541     Document Type: Article

References (22)

1. I. F. Akyildiz, W. Su, Y. Sankarasubramaniam, and E. Cayirci, "A survey on sensor networks," IEEE Commun. Mag., vol. 40, no. 8, pp. 102-114, Aug. 2002.
2. S. Kosunalp, P. D. Mitchell, D. Grace, and T. Clarke, "Experimental study of capture effect for medium access control with ALOHA," ETRI J., vol. 37, no. 2, pp. 359-368, 2015.
3. I. Demirkol, C. Ersoy, and F. Alagoz, "MAC protocols for wireless sensor networks: A survey," IEEE Commun. Mag., vol. 44, no. 4, pp. 115-121, Apr. 2006.
4. M. A. Yigitel, O. D. Incel, and C. Ersoy, "QoS-aware MAC protocols for wireless sensor networks: A survey," Comput. Netw., vol. 55, no. 4, pp. 1982-2004, Jun. 2011.
5. P. Huang, L. Xiao, S. Soltani, M. W. Mutka, and N. Xi, "The evolution of MAC protocols in wireless sensor networks: A survey," IEEE Commun. Surveys Tut., vol. 15, no. 1, pp. 101-120, 1st Quart., 2013.
6. S. Sudevalayam and P. Kulkarni, "Energy harvesting sensor nodes: Sur-vey and implications," IEEE Commun. Surveys Tut., vol. 13, no. 3, pp. 443-461, Sep. 2011.
7. S. Kosunalp, "MAC protocols for energy harvesting wireless sensor net-works: Survey," ETRI J., vol. 37, no. 4, pp. 804-812, 2015.
8. C. Bergonzini, D. Brunelli, and L. Benini, "Algorithms for harvested energy prediction in batteryless wireless sensor networks," in Proc. IEEE Int. Workshop Adv. Sensors Int., Jun. 2009, pp. 144-149.
9. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction, vol. 1. Cambridge, MA, USA: MIT Press, 1998.
10. (2016). NREL: Measurement and Instrumentation Data Center. [Online]. Available: http://www.nrel.gov/midc/
11. W. Ye, J. Heidemann, and D. Estrin, "An energy-efficient MAC protocol for wireless sensor networks," in Proc. IEEE INFOCOM, Jun. 2002, pp. 1567-1576.
12. N. Tadayon, S. Khoshroo, E. Askari, H. Wang, and H. Michel, "Power management in SMAC-based energy-harvesting wireless sensor net-works using queuing analysis," J. Netw. Comput. Appl., vol. 36, no. 3, pp. 1008-1017, May 2013.
13. H. Yoo, M. Shim, and D. Kim, "Dynamic duty-cycle scheduling schemes for energy-harvesting wireless sensor networks," IEEE Commun. Lett., vol. 16, no. 2, pp. 202-204, Feb. 2012.
14. X. Fafoutis and N. Dragoni, "ODMAC: An on-demand MAC protocol for energy harvesting-Wireless sensor networks," in Proc. ACM Symp. Perform. Eval. Wireless Ad Hoc, Sensor Ubiquitous Netw., Nov. 2011, pp. 49-56.
15. Z. A. Eu and H.-P. Tan, "Probabilistic polling for multi-hop energy harvesting wireless sensor networks," in Proc. IEEE Int. Symp. Ad-Hoc Sensor Netw., Ottawa, ON, Canada, Jun. 2012, pp. 271-275.
16. K. Nguyen, V.-H. Nguyen, D.-D. Le, Y. Ji, D. A. Duong, and S. Yamada, "ERI-MAC: An energy-harvested receiver-initiated MAC protocol for wireless sensor networks," Int. J. Distrib. Sensor Netw., vol. 10, no. 5, p. 514169, 2014.
17. F. M. Mulder, "Implications of diurnal and seasonal variations in renewable energy generation for large scale energy storage," J. Renew. Sustain. Energy, vol. 6, no. 3, p. 033105, 2014.
18. A. Kansal, J. Hsu, S. Zahedi, and M. B. Srivastava, "Power management in energy harvesting sensor networks," ACM Trans. Embedded Comput. Syst., vol. 6, no. 4, Sep. 2007, Art. no. 32.
19. D. K. Noh and K. Kang, "Balanced energy allocation scheme for a solar-powered sensor system and its effects on network-wide performance," J. Comput. Syst. Sci., vol. 77, no. 5, pp. 917-932, Sep. 2011.
20. J. R. Piorno, C. Bergonzini, D. Atienza, and T. S. Rosing, "Prediction and management in energy harvested wireless sensor nodes," in Proc. IEEE Wireless VITAE, May 2009, pp. 6-10.
21. A. Cammarano, C. Petrioli, and D. Spenza, "Pro-energy: A novel energy prediction model for solar and wind energy-harvesting wireless sensor net-works," in Proc. IEEE Int. Conf. Mobile Ad-Hoc Sensor Syst., Oct. 2012, pp. 75-83.
22. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA, USA: MIT Press, 1998.