A bird's eye view on reinforcement learning approaches for power management in WSNs

Proceedings of 2013 6th Joint IFIP Wireless and Mobile Networking Conference, WMNC 2013

Volumn , Issue , 2013, Pages

  Rucco, Luigi ^a   Bonarini, Andrea ^a   Brandolese, Carlo ^a   Fornaciari, William ^a  

^a POLITECNICO DI MILANO   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

BIRD'S EYE VIEW; DYNAMIC POWER MANAGEMENT; ENERGY EFFICIENT ROUTING PROTOCOL; POWER MANAGEMENTS; REINFORCEMENT LEARNING APPROACH; SELF-LEARNING; WIRELESS SENSOR NETWORK (WSNS);

ENERGY EFFICIENCY; ENERGY MANAGEMENT; MIDDLEWARE; REINFORCEMENT LEARNING; SURVEYS;

WIRELESS SENSOR NETWORKS;

EID: 84881415659     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/WMNC.2013.6548988     Document Type: Conference Paper

References (25)

1. G. Anastasi, M. Conti, M. Di Francesco, and A. Passarella. Energy conservation in wireless sensor networks: A survey. Ad Hoc Netw. , 7(3):537-568, May 2009.
2. R. Chaoming Hsu, C.-T. Liu, and W.-M. Lee. Reinforcement learningbased dynamic power management for energy harvesting wireless sensor network. In B.-C. Chien, T.-P. Hong, S.-M. Chen, and M. Ali, editors, Next-Generation Applied Intelligence, volume 5579 of Lecture Notes in Computer Science, pages 399-408. Springer Berlin Heidelberg, 2009.
3. S. Dong, P. Agrawal, and K. Sivalingam. Reinforcement learning based geographic routing protocol for uwb wireless sensor network. In Proceedings of IEEE GLOBECOM'07, pages 652-656, 2007.
4. A. Forster, A. Murphy, J. Schiller, and K. Terfloth. An efficient implementation of reinforcement learning based routing on real wsn hardware. In Networking and Communications, 2008. WIMOB '08. IEEE International Conference on Wireless and Mobile Computing, pages 247-252, oct. 2008.
5. A. Förster and A. L. Murphy. Froms: Feedback routing for optimizing multiple sinks. In Proc. of the 3rd Int. Conf. on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP), 2007.
6. A. Förster and A. L. Murphy. Balancing Energy Expenditure in WSNs through Reinforcement Learning: A Study. In Proceedings of the 1st International Workshop on Energy in Wireless Sensor Networks (WEWSN), Santorini Island, Greece, 2008.
7. A. Förster and A. L. Murphy. Froms: A failure tolerant and mobility enabled multicast routing paradigm with reinforcement learning for wsns. Ad Hoc Netw. , 9(5):940-965, July 2011.
8. R. Hsu, C.-T. Liu, K.-C. Wang, and W.-M. Lee. Qos-aware power management for energy harvesting wireless sensor network utilizing reinforcement learning. In Computational Science and Engineering, 2009. CSE '09. International Conference on, volume 2, pages 537-542, aug. 2009.
9. L. P. Kaelbling, M. L. Littman, and A. W. Moore. Reinforcement learning: a survey. Journal of Artificial Intelligence Research, 4:237-285, 1996.
10. M. Khan and B. Rinner. Resource coordination in wireless sensor networks by cooperative reinforcement learning. In Pervasive Computing and Communications Workshops (PERCOM Workshops), 2012 IEEE International Conference on, pages 895-900, march 2012.
11. R. Kulkarni, A. Forster, and G. Venayagamoorthy. Computational intelligence in wireless sensor networks: A survey. Communications Surveys Tutorials, IEEE, 13(1):68-96, quarter 2011.
12. C.-T. Liu and R. C. Hsu. Adaptive power management based on reinforcement learning for embedded system. In Proceedings of the 21st international conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems: New Frontiers in Applied Artificial Intelligence, IEA/AIE '08, pages 513-522, Berlin, Heidelberg, 2008. Springer-Verlag.
13. Z. Liu and I. Elhanany. Rl-mac: a qos-aware reinforcement learning based mac protocol for wireless sensor networks. In Networking, Sensing and Control, 2006. ICNSC '06. Proceedings of the 2006 IEEE International Conference on, pages 768-773, 0-0 2006.
14. Z. Liu and I. Elhanany. Rl-mac: a reinforcement learning based mac protocol for wireless sensor networks. Int. J. Sen. Netw. , 1(3/4):117-124, Jan. 2006.
15. M. Mihaylov, Y.-A. L. Borgne, A. Now, and K. Tuyls. Self-organizing synchronicity and desynchronicity using reinforcement learning. In J. Filipe and A. L. N. Fred, editors, ICAART (2), pages 94-103. SciTePress, 2011.
16. M. Mihaylov, Y.-A. L. Borgne, K. Tuyls, and A. Nowé. Decentralised reinforcement learning for energy-efficient scheduling in wireless sensor networks. Int. J. Commun. Netw. Distrib. Syst. , 9(3/4):207-224, Aug. 2012.
17. M. Mihaylov, Y.-A. Le Borgne, K. Tuyls, and A. Nowé. Reinforcement learning for self-organizing wake-up scheduling in wireless sensor networks. Communications in Computer and Information Science, 271:382-397, 2012.
18. J. Niu. Self-learning scheduling approach for wireless sensor network. In Future Computer and Communication (ICFCC), 2010 2nd International Conference on, volume 3, pages V3-253-V3-257, may 2010.
19. C. Schurgers. Wakeup strategies in wireless sensor networks. In Y. Li, M. Thai, and W. Wu, editors, Wireless Sensor Networks and Applications, Signals and Communication Technology, pages 195-217. Springer US, 2008.
20. K. Shah. Reinforcement Learning Based Strategies for Adaptive Wireless Sensor Network Management. ProQuest, UMI Dissertation Publishing, 2011.
21. K. Shah and M. Kumar. Distributed independent reinforcement learning (dirl) approach to resource management in wireless sensor networks. In Mobile Adhoc and Sensor Systems, 2007. MASS 2007. IEEE Internatonal Conference on, pages 1-9, oct. 2007.
22. R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction (Adaptive Computation and Machine Learning). A Bradford Book, Mar. 1998.
23. P. Wang and T. Wang. Adaptive routing for sensor networks using reinforcement learning. In Computer and Information Technology, 2006. CIT '06. The Sixth IEEE International Conference on, page 219, sept. 2006.
24. D. H. Wolpert and K. Tumer. Collective intelligence, data routing and braess' paradox. J. Artif. Int. Res. , 16(1):359-387, June 2002.
25. K.-L. A. Yau, P. Komisarczuk, and P. D. Teal. Reinforcement learning for context awareness and intelligence in wireless networks: Review, new features and open issues. J. Netw. Comput. Appl. , 35(1):253-267, Jan. 2012.