Decentralised reinforcement learning for energy-efficient scheduling in wireless sensor networks

International Journal of Communication Networks and Distributed Systems

Volumn 9, Issue 3-4, 2012, Pages 207-224

  Mihaylov, Mihail ^a   Borgne, Yann Ael Le ^a   Tuyls, Karl ^b   Nowé, Ann ^a  

^a VRIJE UNIVERSITEIT BRUSSEL   (Belgium)

^b MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

Decentralised; Desynchronisation; Duty cycle; Energy efficiency; Latency; Radio interference; Reinforcement learning; RL; Routing tree; Self organisation; Synchronisation; Wake up scheduling; Wireless sensor networks; WSN

Indexed keywords

ENERGY EFFICIENCY; ENERGY UTILIZATION; FORESTRY; MACHINE LEARNING; NETWORK ROUTING; RADIO INTERFERENCE; REINFORCEMENT LEARNING; SCHEDULING; SYNCHRONIZATION; WAKES; WIRELESS SENSOR NETWORKS;

DECENTRALISED; DESYNCHRONISATION; DUTY-CYCLE; LATENCY; ROUTING TREES; SELF ORGANISATION; WAKE-UP SCHEDULING;

SENSOR NODES;

EFFICIENCY; ENERGY; ENERGY CONSUMPTION; FORESTRY; SCHEDULING;

EID: 84875545682     PISSN: 17543916     EISSN: 17543924     Source Type: Journal    
DOI: 10.1504/IJCNDS.2012.048871     Document Type: Article

References (18)

1. Agarwal Y. Gupta R. and Schurgers C. (2005) 'Dynamic power management using on demand paging for networked embedded systems' in Proceedings of the Asia and South Pacific Design Automation Conference Vol. 2 pp.755-759.
2. Akyildiz I.F. Su W. Sankarasubramaniam Y. and Cayirci E. (2002) 'A survey on sensor networks' IEEE Communications Magazine Vol. 40 No. 8 pp.102-114.
3. Al-Karaki J.N. and Kamal A.E. (2004) 'Routing techniques in wireless sensor networks: a survey' IEEE Wireless Communications Vol. 11 No. 6 pp.6-28.
4. Couto D.S.J.D. Aguayo D. Bicket J. and Morris R. (2005) 'A high-throughput path metric for multi-hop wireless routing' Wireless Networks Vol. 11 No. 4 pp.419-434. (Pubitemid 41067729)
5. El-Hoiydi A. (2002) 'Aloha with preamble sampling for sporadic traffic in ad hoc wireless sensor networks' in IEEE International Conference on Communications Vol. 5 pp.3418-3423. (Pubitemid 34632452)
6. Goel S. (2005) 'Etiquette protocol for ultra low power operation in energy constrained sensor networks' PhD thesis New Brunswick NJ USA.
7. Guo C. Zhong L.C. and Rabaey J.M. (2001) 'Low power distributed MAC for ad hoc sensor radio networks' GLOBECOM Vol. 5 pp.2944-2948. (Pubitemid 34059132)
8. Hill J.L. and Culler D.E. (2002) 'Mica: A wireless platform for deeply embedded networks' IEEE Micro Vol. 22 No. 6 pp.12-24.
9. http://www.omnetpp.org/ - a C++ simulation library and framework. Ilyas M. and Mahgoub I. (2005) Handbook of Sensor Networks: Compact Wireless and Wired Sensing Systems CRC.
10. Leng J. (2008) 'Reinforcement learning and convergence analysis with applications to agent-based systems' PhD thesis University of South Australia.
11. Liu Z. and Elhanany I. (2006) 'RL-MAC: a reinforcement learning based MAC protocol for wireless sensor networks' Int. J. Sen. Netw. Vol. 1 Nos. 3/4 pp.117-124 ISSN 1748-1279.
12. Shih E. Bahl P. and Sinclair M.J. (2002) 'Wake on wireless: an event driven energy saving strategy for battery operated devices' in Proceedings of the 8th Annual International Conference on Mobile Computing and Networking pp.160-171.
13. Sutton R.S. and Barto A.G. (1998) Reinforcement Learning: An Introduction MIT Press Cambridge MA USA.
14. van Dam T. and Langendoen K. (2003) 'An adaptive energy-efficient MAC protocol for wireless sensor networks' in Proceedings of the First International Conference on Embedded Networked Sensor Systems Los Angeles California USA pp.171-180. (Pubitemid 40682344)
15. Watkins C.J.C.H. (1989) 'Learning from delayed rewards' PhD thesis University of Cambridge England.
16. Woo A. Tong T. and Culler D. (2003) 'Taming the underlying challenges of reliable multihop routing in sensor networks' in Proceedings of the 1st International Conference on Embedded Networked Sensor Systems ACM pp.14-27. (Pubitemid 40682331)
17. Schurgers C. (2008) 'Chapter wakeup strategies in wireless sensor networks' in Li Y. Thai M.T. and Wu W. (Eds.): Wireless Sensor Networks and Applications pp.195-217 Springer.
18. Ye W. Heidemann J. and Estrin D. (2004) 'Medium access control with coordinated adaptive sleeping for wireless sensor networks' IEEE/ACM Trans. Netw. Vol. 12 No. 3 pp.493-506 ISSN 1063-6692 doi: http://dx.doi.org/10.1109/ TNET.2004.828953.