Adaptive Duty Cycling in Sensor Networks with Energy Harvesting Using Continuous-Time Markov Chain and Fluid Models

IEEE Journal on Selected Areas in Communications

Volumn 33, Issue 12, 2015, Pages 2687-2700

  Chan, Wai Hong Ronald ^a   Zhang, Pengfei ^b   Nevat, Ido ^b   Nagarajan, Sai Ganesh ^b   Valera, Alvin C ^c   Tan, Hwee Xian ^c   Gautam, Natarajan ^d  

^a Stanford University   (United States)

^b INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

^c SINGAPORE MANAGEMENT UNIVERSITY   (Singapore)

^d TEXAS A AND M UNIVERSITY   (United States)

Author keywords

Adaptive systems; Batteries; Energy harvesting; Green communications; Measurement; Power demand; Quality of service; Wireless sensor networks

Indexed keywords

ADAPTIVE SYSTEMS; CHAINS; CONTINUOUS TIME SYSTEMS; ECONOMICS; ELECTRIC BATTERIES; ELECTRIC POWER UTILIZATION; ENERGY HARVESTING; MARKOV PROCESSES; MEASUREMENTS; QUALITY OF SERVICE; REINFORCEMENT LEARNING; SECONDARY BATTERIES; SOLAR CELLS; WIRELESS SENSOR NETWORKS;

ADAPTIVE DUTY-CYCLING; CONTINUOUS TIME MARKOV CHAIN; DYNAMIC ENVIRONMENTS; EXTENSIVE SIMULATIONS; GREEN COMMUNICATIONS; MARKOV DECISION PROCESSES; PACKET TRANSMISSIONS; POWER DEMANDS;

SENSOR NODES;

EID: 84960421930     PISSN: 07338716     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSAC.2015.2478717     Document Type: Article

References (44)

1. A. Kottas, Z. Wang, and A. Rodrguez, "Spatial modeling for risk assessment of extreme values from environmental time series: A Bayesian nonparametric approach, " Environmetrics, vol. 23, no. 8, pp. 649-662, 2012.
2. C. Fonseca and H. Ferreira, "Stability and contagion measures for spatial extreme value analyses, " arXiv preprint arXiv:1206.1228, 2012.
3. J. P. French and S. R. Sain, "Spatio-Temporal exceedance locations and confidence regions, " Ann. Appl. Statist., vol. 7, no. 3, pp. 1421-1449, 2013.
4. I. Akyildiz, W. Su, Y. Sankarasubramaniam, and E. Cayirci, "Wireless sensor networks: A survey, " Comput. Netw., vol. 38, no. 4, pp. 393-422, 2002.
5. W. K. Seah, Z. A. Eu, and H.-P. Tan, "Wireless sensor networks powered by ambient energy harvesting (WSN-HEAP)-survey and challenges, " in Proc. 1st Int. Conf. Wireless Commun. Veh. Technol. Inf. Theory Aerosp. Electron. Syst. Technol., 2009, pp. 1-5.
6. V. Raghunathan, A. Kansal, J. Hsu, J. Friedman, and M. Srivastava, "Design considerations for solar energy harvesting wireless embedded systems, " in Proc. 4th Int. Symp. Inf. Process. Sensor Netw., Apr. 2005, pp. 457-462.
7. M. Gorlatova, P. Kinget, I. Kymissis, D. Rubenstein, X. Wang, and G. Zussman, "Challenge: Ultra-low-power energy-harvesting active networked tags (EnHANTs), " in Proc. 15th Annu. Int. Conf .Mobile Comput. Netw., 2009, pp. 253-260.
8. C. Bergonzini, D. Brunelli, and L. Benini, "Algorithms for harvested energy prediction in batteryless wireless sensor networks, " in Proc. 3rd Int. Workshop Adv. Sensors Interfaces, Jun. 2009, pp. 144-149.
9. D. Hasenfratz, A. Meier, C. Moser, J.-J. Chen, and L. Thiele, "Analysis, comparison, and optimization of routing protocols for energy harvesting wireless sensor networks, " in Proc. IEEE Int. Conf. Sensor Netw. Ubiquitous Trustworthy Comput. (SUTC), Jun. 2010, pp. 19-26.
10. S. Sudevalayam and P. Kulkarni, "Energy harvesting sensor nodes: Survey and implications, " IEEE Commun. Surv. Tuts., vol. 13, no. 3, pp. 443-461, Third Quart. 2011.
11. A. Kansal, J. Hsu, S. Zahedi, and M. B. Srivastava, "Power management in energy harvesting sensor networks, " ACM Trans. Embedded Comput. Syst., vol. 6, pp. 1-38, Sep. 2007.
12. J. Hsu, S. Zahedi, A. Kansal, M. Srivastava, and V. Raghunathan, "Adaptive duty cycling for energy harvesting systems, " in Proc. Int. Symp. Low Power Electron. Des., 2006, pp. 180-185.
13. C. Vigorito, D. Ganesan, and A. Barto, "Adaptive control of duty cycling in energy-harvesting wireless sensor networks, " in Proc. IEEE Sensor Mesh Ad Hoc Commun. Netw. (SECON), 2007, pp. 21-30.
14. Y. Gu, T. Zhu, and T. He, "ESC: Energy synchronized communication in sustainable sensor networks, " in Proc. IEEE Int. Conf. Netw. Protocols (ICNP), 2009, pp. 52-62.
15. T. Zhu, Z. Zhong, Y. Gu, T. He, and Z.-L. Zhang, "Leakage-Aware energy synchronization for wireless sensor networks, " in Proc. 7th Int. Conf. Mobile Syst. Appl. Serv. (MobiSys), 2009, pp. 319-332.
16. V. Sharma, U. Mukherji, V. Joseph, and S. Gupta, "Optimal energy management policies for energy harvesting sensor nodes, " IEEE Trans. Wireless Commun., vol. 9, no. 4, pp. 1326-1336, Apr. 2010.
17. C. Moser, J.-J. Chen, and L. Thiele, "An energy management framework for energy harvesting embedded systems, " ACM J. Emerg. Technol. Comput. Syst. (JETC), vol. 6, no. 2, p. 7, 2010.
18. A. Sinha and A. Chandrakasan, "Dynamic power management in wireless sensor networks, " IEEE Design Test Comput., vol. 18, no. 2, pp. 62-74, Mar./Apr. 2001.
19. M. Gorlatova, A. Wallwater, and G. Zussman, "Networking low-power energy harvesting devices: Measurements and algorithms, " IEEE Trans. Mobile Comput., vol. 12, no. 9, pp. 1853-1865, Sep. 2013.
20. K. Sohrabi, J. Gao, V. Ailawadhi, and G. J. Pottie, "Protocols for selforganization of a wireless sensor network, " IEEE Pers. Commun., vol. 7, no. 5, pp. 16-27, Oct. 2000.
21. W. B. Heinzelman, A. L. Murphy, H. S. Carvalho, and M. A. Perillo, "Middleware to support sensor network applications, " IEEE Netw., vol. 18, no. 1, pp. 6-14, Jan./Feb. 2004.
22. J. Yick, B. Mukherjee, and D. Ghosal, "Wireless sensor network survey, " Comput. Netw., vol. 52, no. 12, pp. 2292-2330, 2008.
23. J. Lei, R. Yates, and L. Greenstein, "A generic model for optimizing single-hop transmission policy of replenishable sensors, " IEEE Trans. Wireless Commun., vol. 8, no. 2, pp. 547-551, Feb. 2009.
24. A. Seyedi and B. Sikdar, "Energy efficient transmission strategies for body sensor networks with energy harvesting, " IEEE Trans. Commun., vol. 58, no. 7, pp. 2116-2126, Jul. 2010.
25. H. Li, N. Jaggi, and B. Sikdar, "Relay scheduling for cooperative communications in sensor networks with energy harvesting, " IEEE Trans. Wireless Commun., vol. 10, no. 9, pp. 2918-2928, Sep. 2011.
26. A. Sultan, "Sensing and transmit energy optimization for an energy harvesting cognitive radio, " IEEE Wireless Commun. Lett., vol. 1, no. 5, pp. 500-503, Oct. 2012.
27. P. Blasco, D. Gunduz, and M. Dohler, "A learning theoretic approach to energy harvesting communication system optimization, " IEEE Trans. Wireless Commun., vol. 12, no. 4, pp. 1872-1882, Apr. 2013.
28. R. Chan et al., "Adaptive duty cycling in sensor networks via continuous time Markov chain modeling, " in Proc. IEEE Int. Conf. Commun. (ICC15), Jun. 2015, pp. 6669-6674.
29. V. G. Kulkarni, "Fluid models for single buffer systems, " in Frontiers in Queueing: Models and Applications in Science and Engineering. Boca Raton, FL, USA: CRC Press, 1997, pp. 321-338.
30. G. L. Jones, P. G. Harrison, U. Harder, and T. Field, "Fluid queue models of battery life, " in Proc. IEEE 19th Int. Symp. Model. Anal. Simul. Comput. Telecommun. Syst. (MASCOTS). 2011, pp. 278-285.
31. N. Gautam and A. Mohapatra, "Efficiently operating wireless nodes powered by renewable energy sources, " IEEE J. Sel. Areas Commun., vol. 33, no. 8, pp. 1706-1716, Aug. 2015.
32. A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA, USA: MIT Press, 1998.
33. L. P. Kaelbling, M. L. Littman, and A. W. Moore, "Reinforcement learning: A survey, " J. Artif. Intell. Res., vol. 4, pp. 237-285, 1996.
34. E. N. Gilbert, "Capacity of a burst-noise channel, " Bell Syst. Tech. J., vol. 39, no. 5, pp. 1253-1265, 1960.
35. E. O. Elliot, "Estimates of error rates for codes on burst-noise channels, " Bell Syst. Tech. J., vol. 42, no. 5, pp. 1977-1997, 1963.
36. P. Poggi, G. Notton, M. Muselli, and A. Louche, "Stochastic study of hourly total solar radiation in corsica using a Markov model, " Int. J. Climatol., vol. 20, no. 14, pp. 1843-1860, 2000.
37. O. Kwon, Y.-J. Yoon, S. K. Moon, H.-J. Choi, and J. H. Shim, "Estimation of Singapores hourly solar radiation using Hybrid-Markov transition matrices method, " Int. J. Precis. Eng. Manuf., vol. 14, no. 2, pp. 323-327, 2013.
38. R. Jayaraman and D. L. Maskell, "Temporal and spatial variations of the solar radiation observed in Singapore, " Energy Procedia, vol. 25, pp. 108-117, 2012.
39. Z. Liu and I. Elhanany, "Rl-MAC: A QOS-Aware reinforcement learning based MAC protocol for wireless sensor networks, " in Proc. IEEE Int. Conf. Netw. Sens. Control., 2006, pp. 768-773.
40. Z. Liu and I. Elhanany, "Rl-MAC: A reinforcement learning based MAC protocol for wireless sensor networks, " Int. J. Sensor Netw., vol. 1, no. 3, pp. 117-124, 2006.
41. G. Ghidini and S. K. Das, "An energy-efficient Markov chain-based randomized duty cycling scheme for wireless sensor networks, " in Proc. 31st Int. Conf. Distrib. Comput. Syst. (ICDCS11), 2011, pp. 67-76.
42. M. Bkassiny, S. K. Jayaweera, and K. A. Avery, "Distributed reinforcement learning based mac protocols for autonomous cognitive secondary users, " in Proc. IEEE 20th Annu. Wireless Opt. Commun. Conf. (WOCC11), 2011, pp. 1-6.
43. G. Ghidini and S. K. Das, "Energy-efficient Markov chain-based duty cycling schemes for greener wireless sensor networks, " ACM J. Emerg. Technol. Comput. Syst. (JETC), vol. 8, no. 4, p. 29, 2012.
44. C. J. Watkins and P. Dayan, "Q-learning, " Mach. Learn., vol. 8, no. 3-4, pp. 279-292, 1992.