Self-organizing synchronicity and desynchronicity using reinforcement learning

ICAART 2011 - Proceedings of the 3rd International Conference on Agents and Artificial Intelligence

Volumn 2, Issue , 2011, Pages 94-103

  Mihaylov, Mihail ^a   Le Borgne, Yann Aël ^a   Nowé, Ann ^a   Tuyls, Karl ^b  

^a VRIJE UNIVERSITEIT BRUSSEL   (Belgium)

^b MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

Reinforcement learning; Synchronicity and desynchronicity; Wake up scheduling; Wireless sensor networks

Indexed keywords

BEHAVIOR-BASED; COMMUNICATION INTERFERENCES; GLOBAL SYSTEMS; LOCAL INTERACTIONS; NEIGHBORING NODES; SELF ORGANIZING; SELF-ADAPT; SYNCHRONICITY AND DESYNCHRONICITY; WAKE-UP SCHEDULING; WIRELESS SENSOR; WIRELESS SENSOR NODE;

ARTIFICIAL INTELLIGENCE; DISTRIBUTED COMPUTER SYSTEMS; ELECTRIC NETWORK SYNTHESIS; REINFORCEMENT LEARNING; SENSORS; TELECOMMUNICATION EQUIPMENT; WAKES; WIRELESS NETWORKS;

SENSOR NODES;

EID: 79960141448     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. Cohen, R. and Kapchits, B. (2009). An optimal wake-up scheduling algorithm for minimizing energy consumption while limiting maximum delay in a mesh sensor network. IEEE/ACM Trans. Netw., 17(2):570-581.
2. Degesys, J., Rose, I., Patel, A., and Nagpal, R. (2007). Desync: self-organizing desynchronization and tdma on wireless sensor networks. In Proceedings of the 6th IPSN, pages 11-20, New York, NY, USA. ACM.
3. http://www.omnetpp.org/ - a C++ simulation library and framework.
4. Ilyas, M. and Mahgoub, I. (2005). Handbook of sensor networks: compact wireless and wired sensing systems. CRC.
5. Knoester, D. B. and McKinley, P. K. (2009). Evolving virtual fireflies. In Proceedings of the 10th ECAL, Budapest, Hungary.
6. Langendoen, K. (2008). Medium access control in wireless sensor networks. Medium access control in wireless networks, 2:535-560.
7. Leng, J. (2008). Reinforcement learning and convergence analysis with applications to agent-based systems. PhD thesis, University of South Australia.
8. Liang, S., Tang, Y., and Zhu, Q. (2007). Passive wake-up scheme for wireless sensor networks. In Proceedings of the 2nd ICICIC, page 507, Washington, DC, USA. IEEE Computer Society.
9. Liu, Z. and Elhanany, I. (2006). Rl-mac: a reinforcement learning based mac protocol for wireless sensor networks. Int. J. Sen. Netw., 1(3/4):117-124.
10. Lucarelli, D. and Wang, I.-J. (2004). Decentralized synchronization protocols with nearest neighbor communication. In Proceedings of the 2nd SenSys, pages 62-68, New York, NY, USA. ACM.
11. Mirollo, R. E. and Strogatz, S. H. (1990). Synchronization of pulse-coupled biological oscillators. SIAM J. Appl. Math., 50(6):1645-1662.
12. Paruchuri, V., Basavaraju, S., Durresi, A., Kannan, R., and Iyengar, S. S. (2004). Random asynchronous wakeup protocol for sensor networks. In Proceedings of the 1st BROADNETS, pages 710-717, Washington, DC, USA. IEEE Computer Society.
13. Patel, A., Degesys, J., and Nagpal, R. (2007). Desynchronization: The theory of self-organizing algorithms for round-robin scheduling. In Proceedings of the 1st SASO, pages 87-96, Washington, DC, USA. IEEE Computer Society.
14. Schurgers, C. (2007). Wireless Sensor Networks and Applications, chapter Wakeup Strategies in Wireless Sensor Networks, page 26. Springer.
15. Sutton, R. S. and Barto, A. G. (1998). Reinforcement Learning: An Introduction. MIT Press.
16. Watkins, C. (1989). Learning from delayed rewards. PhD thesis, University of Cambridge, England.
17. Werner-Allen, G., Tewari, G., Patel, A., Welsh, M., and Nagpal, R. (2005). Firefly-inspired sensor network synchronicity with realistic radio effects. In Proceedings of the 3rd SenSys, pages 142-153, New York, NY, USA. ACM.
18. Wolpert, D. H. and Turner, K. (2008). An introduction to collective intelligence. Technical Report NASA-ARC-IC-99-63, NASA Ames Research Center.
19. Ye, W., Heidemann, J., and Estrin, D. (2004). Medium access control with coordinated adaptive sleeping for wireless sensor networks. IEEE/ACM Trans. Netw., 12(3):493-506.
20. Zheng, R., Hou, J. C., and Sha, L. (2003). Asynchronous wakeup for ad hoc networks. In Proceedings of the 4th MobiHoc, pages 35-45, New York, NY, USA. ACM.