Reinforcement Learning for Self-organizing Wake-Up Scheduling in Wireless Sensor Networks

Communications in Computer and Information Science

Volumn 271, Issue , 2013, Pages 382-396

  Mihaylov, Mihail ^a   Le Borgne, Yann Aël ^a   Tuyls, Karl ^b   Nowé, Ann ^a  

^a VRIJE UNIVERSITEIT BRUSSEL   (Belgium)

^b MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

Reinforcement learning; Synchronicity and desynchronicity; Wake up scheduling; Wireless sensor networks

Indexed keywords

ARTIFICIAL INTELLIGENCE; DISTRIBUTED COMPUTER SYSTEMS; ELECTRIC NETWORK TOPOLOGY; EXPERIMENTS; REINFORCEMENT LEARNING; SCHEDULING; WAKES; WIRELESS SENSOR NETWORKS;

GLOBAL SYSTEMS; GRID TOPOLOGY; LOCAL INTERACTIONS; LOW DUTY-CYCLES; NETWORK SIMULATORS; NETWORK TOPOLOGY; SYNCHRONICITY AND DESYNCHRONICITY; WAKE-UP SCHEDULING;

SENSOR NODES;

EID: 84880494850     PISSN: 18650929     EISSN: None     Source Type: Book Series    
DOI: 10.1007/978-3-642-29966-7_25     Document Type: Conference Paper

References (17)

1. CC2420: Data sheet, http://focus.ti.com/docs/prod/folders/print/cc2420.html
2. Cohen, R., Kapchits, B.: An optimal wake-up scheduling algorithm for minimizing energy consumption while limiting maximum delay in a mesh sensor network. IEEE/ACM Trans. Netw. 17(2), 570-581 (2009)
3. Gutierrez, J., Naeve, M., Callaway, E., Bourgeois, M., Mitter, V., Heile, B.: IEEE 802.15. 4: a developing standard for low-power low-cost wireless personal area networks. IEEE Network 15(5), 12-19 (2002)
4. Ilyas, M., Mahgoub, I.: Handbook of sensor networks: compact wireless and wired sensing systems. CRC (2005)
5. Langendoen, K.: Medium access control in wireless sensor networks. Medium Access Control in Wireless Networks 2, 535-560 (2008)
6. Leng, J.: Reinforcement learning and convergence analysis with applications to agent-based systems. Ph.D. thesis, University of South Australia (2008)
7. Liang, S., Tang, Y., Zhu, Q.: Passive wake-up scheme for wireless sensor networks. In: Proceedings of the 2nd ICICIC, p. 507. IEEE Computer Society, Washington, DC, USA (2007)
8. Liu, Z., Elhanany, I.: Rl-mac: a reinforcement learning based mac protocol for wireless sensor networks. Int. J. Sen. Netw. 1(3/4), 117-124 (2006)
9. Mihaylov, M., Le Borgne, Y.A., Tuyls, K., Nowé, A.: Distributed cooperation in wireless sensor networks. In: Yolum, Tumer, K., Stone, P., Sonenberg (eds.) Proceedings of the 10th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2011), Taipei, Taiwan (May 2011)
10. Mihaylov, M., Le Borgne, Y.A., Tuyls, K., Nowé, A.: Self-organizing synchronicity and desynchronicity using reinforcement learning. In: Filipe, J., Fred, A. (eds.) Proceedings of the 3rd International Conference on Agents and Artificial Intelligence (ICAART), Rome, Italy, pp. 94-103 (January 2011)
11. OMNET++: Project, http://www.omnetpp.org/ - a C++ simulation library and framework
12. Paruchuri, V., Basavaraju, S., Durresi, A., Kannan, R., Iyengar, S.S.: Random asynchronous wakeup protocol for sensor networks. In: Proceedings of the 1st BROADNETS, pp. 710-717. IEEE Computer Society, Washington, DC, USA (2004)
13. Posch, M.: Win-Stay, Lose-Shift Strategies for Repeated Games-Memory Length, Aspiration Levels and Noise. Journal of Theoretical Biology 198(2), 183-195 (1999)
14. Schurgers, C.: Wakeup Strategies in Wireless Sensor Networks. In: Wireless Sensor Networks and Applications, p. 26. Springer, Heidelberg (2007)
15. Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press (1998)
16. Watkins, C.: Learning from delayed rewards. Ph.D. thesis, University of Cambridge, England (1989)
17. Ye, W., Heidemann, J., Estrin, D.: Medium access control with coordinated adaptive sleeping for wireless sensor networks. IEEE/ACM Trans. Netw. 12(3), 493-506 (2004)