A Self-Adaptive Sleep/Wake-Up Scheduling Approach for Wireless Sensor Networks

IEEE Transactions on Cybernetics

Volumn 48, Issue 3, 2018, Pages 979-992

  Ye, Dayong ^a,b   Au, Minjie Zhang ^c  

^a WUHAN UNIVERSITY   (China)

^b SWINBURNE UNIVERSITY OF TECHNOLOGY   (Australia)

^c UNIVERSITY OF WOLLONGONG   (Australia)

Author keywords

Self adaptation; sleep wake up scheduling; wireless sensor networks (WSNs)

Indexed keywords

ENERGY CONSERVATION; REINFORCEMENT LEARNING; SCHEDULING; SLEEP RESEARCH; WIRELESS SENSOR NETWORKS;

DUTY-CYCLING; OPERATION MODE; PACKET DELIVERY; PACKET DELIVERY EFFICIENCY; REINFORCEMENT LEARNING TECHNIQUES; SLEEP MODE; TIME SLOTS;

SENSOR NODES;

ALGORITHM; COMPUTER SIMULATION; ENERGY CONSERVATION; SIGNAL PROCESSING; THEORETICAL MODEL; WIRELESS COMMUNICATION;

ALGORITHMS; COMPUTER SIMULATION; CONSERVATION OF ENERGY RESOURCES; MODELS, THEORETICAL; SIGNAL PROCESSING, COMPUTER-ASSISTED; WIRELESS TECHNOLOGY;

EID: 85014834135     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2017.2669996     Document Type: Article

References (52)

1. Y. Xiao, et al., "Tight performance bounds of multihop fair access for MAC protocols in wireless sensor networks and underwater sensor networks, " IEEE Trans. Mobile Comput., vol. 11, no. 10, pp. 1538-1554, Oct. 2012.
2. S. Zhu, C. Chen, W. Li, B. Yang, X. Guan, "Distributed optimal consensus filter for target tracking in heterogeneous sensor networks, " IEEE Trans. Cybern., vol. 43, no. 6, pp. 1963-1976, Dec. 2013.
3. G. Acampora, D. J. Cook, P. Rashidi, A. V. Vasilakos, "A survey on ambient intelligence in healthcare, " Proc. IEEE, vol. 101, no. 12, pp. 2470-2494, Dec. 2013.
4. Y. Yao, Q. Cao, A. V. Vasilakos, "EDAL: An energy-efficient, delay-aware, lifetime-balancing data collection protocol for heterogeneous wireless sensor networks, " IEEE/ACM Trans. Netw., vol. 23, no. 3, pp. 810-823, Jun. 2015, doi: 10.1109/TNET.2014.2306592.
5. S. H. Semnani and O. A. Basir, "Semi-flocking algorithm for motion control of mobile sensors in large-scale surveillance systems, " IEEE Trans. Cybern., vol. 45, no. 1, pp. 129-137, Jan. 2015.
6. B. Fu, Y. Xiao, X. Liang, C. L. P. Chen, "Bio-inspired group modeling and analysis for intruder detection in mobile sensor/robotic networks, " IEEE Trans. Cybern., vol. 45, no. 1, pp. 103-115, Jan. 2015.
7. Y. Zhao, Y. Liu, Z. Duan, G. Wen, "Distributed average computation for multiple time-varying signals with output measurements, " Int. J. Robust Nonlin. Control, vol. 26, no. 13, pp. 2899-2915, 2016.
8. Y. Zhao, Z. Duan, G. Wen, G. Chen, "Distributed finite-time tracking of multiple non-identical second-order nonlinear systems with settling time estimation, " Automatica, vol. 64, pp. 86-93, Feb. 2016.
9. M. Li, Z. Li, A. V. Vasilakos, "A survey on topology control in wireless sensor networks: Taxonomy, comparative study, open issues, " Proc. IEEE, vol. 101, no. 12, pp. 2538-2557, Dec. 2013.
10. W. Ye, J. Heidemann, D. Estrin, "An energy-efficient MAC protocol for wireless sensor networks, "Proc. IEEE INFOCOM, New York, NY, USA, Jun. 2002, pp. 1567-1576.
11. W. Ye, F. Silva, J. Heidemann, "Ultra-low duty cycle MAC with scheduled channel polling, "Proc. ACM SenSys, Boulder, CO, USA, USA, Nov. 2006, pp. 321-334.
12. X. Liu, "A deployment strategy for multiple types of requirements in wireless sensor networks, " IEEE Trans. Cybern., vol. 45, no. 10, pp. 2364-2376, Oct. 2015.
13. C.-P. Chen, et al., "A hybrid memetic framework for coverage optimization in wireless sensor networks, " IEEE Trans. Cybern., vol. 45, no. 10, pp. 2309-2322, Oct. 2015.
14. P. Guo, T. Jiang, Q. Zhang, K. Zhang, "Sleep scheduling for critical event monitoring in wireless sensor networks, " IEEE Trans. Parallel Distrib. Syst., vol. 23, no. 2, pp. 345-352, Feb. 2012.
15. G. Wei, Y. Ling, B. Guo, B. Xiao, A. V. Vasilakos, "Prediction-based data aggregation in wireless sensor networks: Combining grey model and Kalman filter, " Comput. Commun., vol. 34, no. 6, pp. 793-802, 2011.
16. W. Ye, J. Heidemann, D. Estrin, "Medium access control with coordinated adaptive sleeping for wireless sensor networks, " IEEE/ACM Trans. Netw., vol. 12, no. 3, pp. 493-506, Jun. 2004.
17. Y. Sun, O. Gurewitz, D. B. Johnson, "RI-MAC: A receiver-initiated asynchronous duty cycle MAC protocol for dynamic traffic loads in wireless sensor networks, "Proc. ACM SenSys, Raleigh, NC, USA, Nov. 2008, pp. 1-14.
18. S. Lai, B. Ravindran, H. Cho, "Heterogenous quorum-based wakeup scheduling in wireless sensor networks, " IEEE Trans. Comput., vol. 59, no. 11, pp. 1562-1575, Nov. 2010.
19. L. Gu and J. A. Stankovic, "Radio-triggered wake-up capability for sensor networks, "Proc. 10th IEEE Real Time Embedded Technol. Appl. Symp., Toronto, ON, Canada, 2004, pp. 27-37.
20. M. J. Miller and N. H. Vaidya, "A MAC protocol to reduce sensor network energy consumption using a wakeup radio, " IEEE Trans. Mobile Comput., vol. 4, no. 3, pp. 228-242, May/Jun. 2005.
21. Q. Cao, T. Abdelzaher, T. He, J. Stankovic, "Towards optimal sleep scheduling in sensor networks for rare-event detection, "Proc. 4th Int. Symp. Inf. Process. Sensor Netw. (IPSN), Boise, ID, USA, 2005, pp. 20-27.
22. A. Keshavarzian, H. Lee, L. Venkatraman, "Wakeup scheduling in wireless sensor networks, "Proc. 7th ACM MobiHoc, Florence, Italy, 2006, pp. 322-333.
23. R. Zheng, J. C. Hou, L. Sha, "Asynchronous wakeup for ad hoc networks, "Proc. ACM MobiHoc, Annapolis, MD, USA, 2003, pp. 35-45.
24. J. Polastre, J. Hill, D. Culler, "Versatile low power media access for wireless sensor networks, "Proc. ACM SenSys, Baltimore, MD, USA, 2004, pp. 95-107.
25. P. Sommer and R. Wattenhofer, "Gradient clock synchronization in wireless sensor networks, "Proc. 9th ACM/IEEE Int. Conf. Inf. Process. Sensor Netw. (IPSN), San Francisco, CA, USA, 2009, pp. 37-48.
26. B. Jang, J. B. Lim, M. L. Sichitiu, "An asynchronous scheduled MAC protocol for wireless sensor networks, " Comput. Netw., vol. 57, no. 1, pp. 85-98, 2013.
27. J. Kim, X. Lin, N. B. Shroff, P. Sinha, "Minimizing delay and maximizing lifetime for wireless sensor networks with anycast, " IEEE/ACM Trans. Netw., vol. 18, no. 2, pp. 515-528, Apr. 2010.
28. T. V. Dam and K. Langendoen, "An adaptive energy-efficient MAC protocol for wireless sensor networks, "Proc. ACM SenSys, Los Angeles, CA, USA, 2003, pp. 171-180.
29. L. Tang, Y. Sun, O. Gurewitz, D. B. Johnson, "PW-MAC: An energy-efficient predictive-wakeup MAC protocol for wireless sensor networks, "Proc. IEEE INFOCOM, Shanghai, China, 2011, pp. 1305-1313.
30. L. Tang, Y. Sun, O. Gurewitz, D. B. Johnson, "EM-MAC: A dynamic multichannel energy-efficient MAC protocol for wireless sensor networks, "Proc. ACM MobiHoc, Paris, France, 2011, pp. 1-11.
31. D. Niyato, E. Hossain, M. M. Rashid, V. K. Bhargava, "Wireless sensor networks with energy harvesting technologies: A game-theoretic approach to optimal energy management, " IEEE Wireless Commun., vol. 14, no. 4, pp. 90-96, Aug. 2007.
32. D. E. Moriarty, A. C. Schultz, J. J. Grefenstette, "Evolutionary algorithms for reinforcement learning, " J. Artif. Intell. Res., vol. 11, no. 1, pp. 241-276, 1999.
33. L. P. Kaelbling, M. L. Littman, A. W. Moore, "Reinforcement learning: A survey, " J. Artif. Intell. Res., vol. 4, no. 1, pp. 237-285, 1996.
34. Y. Gong, et al., "Distributed evolutionary algorithms and their models: A survey of the state-of-the-art, " Appl. Soft Comput., vol. 34, pp. 286-300, Sep. 2015.
35. C. J. C. H. Watkins and P. Dayan, "Q-learning, " Mach. Learn., vol. 8, no. 3, pp. 279-292, 1992.
36. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA, USA: MIT Press, 1998.
37. S. Abdallah and V. Lesser, "Learning the task allocation game, "Proc. AAMAS, Hakodate, Japan, 2006, pp. 850-857.
38. S. Abdallah and V. Lesser, "Multiagent reinforcement learning and selforganization in a network of agents, "Proc. AAMAS, Honolulu, HI, USA, May 2007, pp. 172-179.
39. C. Zhang, V. Lesser, P. Shenoy, "A multi-agent learning approach to online distributed resource allocation, "Proc. IJCAI, Pasadena, CA, USA, Jul. 2009, pp. 361-366.
40. M. Bowling and M. Veloso, "Multiagent learning using a variable learning rate, " Artif. Intell., vol. 136, no. 2, pp. 215-250, 2002.
41. E. R. Gomes and R. Kowalczyk, "Dynamic analysis of multiagent Q-learning with e-greedy exploration, "Proc. ICML, Montreal, QC, Canada, 2009, pp. 369-376.
42. A. Galstyan, K. Czajkowski, K. Lerman, "Resource allocation in the grid using reinforcement learning, "Proc. AAMAS, New York, NY, USA, Aug. 2004, pp. 1314-1315.
43. E. R. Gomes and R. Kowalczyk, "Learning the IPA market with individual and social rewards, "Proc. Int. Conf. Intell. Agent Technol. (IAT), Fremont, CA, USA, 2007, pp. 328-334.
44. N. P. Ziogos, A. C. Tellidou, V. P. Gountis, A. G. Bakirtzis, "A reinforcement learning algorithm for market participants in FTR auctions, "Proc. 7th IEEE Power Tech. Conf., Lausanne, Switzerland, 2007, pp. 943-948.
45. S. P. Singh, T. Jaakkola, M. L. Littman, C. Szepesvári, "Convergence results for single-step on-policy reinforcement-learning algorithms, " Mach. Learn., vol. 38, no. 3, pp. 287-308, 2000.
46. S. P. Singh, M. J. Kearns, Y. Mansour, "Nash convergence of gradient dynamics in general-sum games, "Proc. UAI, Stanford, CA, USA, 2000, pp. 541-548.
47. D. Koller and N. Friedman, Probabilistic Graphical Models. Cambridge, MA, USA: MIT Press, 2009.
48. Y. Sun, D. Shu, O. Gurewitz, D. B. Johnson, "DW-MAC: A low latency, energy efficient demand-wakeup MAC protocol for wireless sensor networks, "Proc. ACM MobiHoc, Hong Kong, 2008, pp. 53-62.
49. C.-C. Hsu, M.-S. Kuo, S.-C. Wang, C.-F. Chou, "Joint design of asynchronous sleep-wake scheduling and opportunistic routing in wireless sensor networks, " IEEE Trans. Comput., vol. 63, no. 7, pp. 1840-1846, Jul. 2014.
50. D. E. Knuth, "The linear congruential method, "The Art of Computer Programming, vol. 2, 3rd ed. Reading, MA, USA: Addison-Wesley, 1997.
51. S. M. Hedetniemi, S. T. Hedetniemiand, A. L. Liestman, "A survey of gossiping and broadcasting in communication networks, " Networks, vol. 18, no. 4, pp. 319-349, 1988.
52. M. Mihaylov, Y.-A. L. Borgne, K. Tuyls, A. Nowe, "Decentralised reinforcement learning for energy-efficient scheduling in wireless sensor networks, " Int. J. Commun. Netw. Distrib. Syst., vol. 9, nos. 3-4, pp. 207-224, 2012.