Froms: A failure tolerant and mobility enabled multicast routing paradigm with reinforcement learning for WSNs

Ad Hoc Networks

Volumn 9, Issue 5, 2011, Pages 940-965

  Förster, Anna ^a   Murphy, Amy L ^b  

^a UNIVERSITY OF APPLIED SCIENCES AND ARTS OF SOUTHERN SWITZERLAND   (Switzerland)

^b ITC IRST   (Italy)

Author keywords

Energy aware; Mobile sinks; Multicast; Node failures; Reinforcement learning; Routing; Sensor networks

Indexed keywords

ENERGY AWARE; MOBILE SINKS; MULTICASTS; NODE FAILURES; ROUTING;

BASE STATIONS; COMPUTER SIMULATION; MULTICASTING; REINFORCEMENT LEARNING; ROUTING ALGORITHMS; SENSOR NODES; SENSORS;

WIRELESS SENSOR NETWORKS;

EID: 79952574688     PISSN: 15708705     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.adhoc.2010.11.006     Document Type: Article

References (53)

1. J.M. Kahn, R.H. Katz, K.S.J. Pister, Next century challenges: mobile networking for "Smart Dust", in: Proceedings of the 5th Annual ACM/IEEE International Conference on Mobile Computing and Networking (MobiCom), Seattle, WA, USA, 1999, pp. 271-278.
2. G. Werner-Allen, K. Lorincz, M. Ruiz, O. Marcillo, J. Johnson, J. Lees, and M. Welsh Deploying a wireless sensor network on an active volcano IEEE Internet Computing 10 2 2006 18 25
3. K. Martinez, P. Padhy, A. Riddoch, R. Ong, J. Hart, Glacial environment monitoring using sensor networks, in: Proceedings of the 1st Workshop on Real-World Wireless Sensor Networks (REALWSN), Stockholm, Sweden, 2005, p. 5.
4. K. Langendoen, A. Baggio, O. Visser, Murphy loves potatoes: experiences from a pilot sensor network deployment in precision agriculture, in: Proceedings of the 20th International Symposium on Parallel and Distributed Processing Symposium (IPDPS), Rhodes Island, Greece, 2006, p. 8.
5. G. Barrenetxea, F. Ingelrest, G. Schaefer, M. Vetterli, The hitchhiker's guide to successful wireless sensor network deployments, in: Proceedings of the 6th ACM Conference on Embedded Network Sensor Systems (SenSys), New York, NY, USA, 2008, pp. 43-56.
6. E.A. Basha, S. Ravela, D. Rus, Model-based monitoring for early warning flood detection, in: Proceedings of the 6th ACM Conference on Embedded Network Sensor Systems (SenSys), New York, NY, USA, 2008, pp. 295-308.
7. J. McCulloch, P. McCarthy, S.M. Guru, W. Peng, D. Hugo, A. Terhorst, Wireless sensor network deployment for water use efficiency in irrigation, in: Proceedings of the Workshop on Real-world Wireless Sensor Networks (REALWSN), Glasgow, Scotland, 2008, pp. 46-50.
8. I.F. Akyildiz, W. Su, Y. Sankarasubramaniam, and E. Cayirci Wireless sensor networks: a survey Computer Networks 38 4 2002 393 422 (Pubitemid 34181630)
9. E. Cayirci, and T. Coplu SENDROM: sensor networks for disaster relief operations management Wireless Networks 13 3 2007 409 423 (Pubitemid 46686159)
10. I.F. Akyildiz, O.A. Akan, C. Chen, J. Fang, and W. Su Interplanetary internet: state-of-the-art and research challenges Computer Networks 43 2 2003 75 112
11. B. Malakooti, H. Kim, K. Bhasin, Human and robotics technology space exploration communication scenarios: characteristics, challenges and scenarios for developing intelligent internet protocols, in: Proceedings of the 2nd IEEE International Conference on Space Mission Challenges for Information Technology (SMC-IT), Pasadena, CA, USA, 2006, pp. 322-329. (Pubitemid 46604006)
12. B. Raman, and K. Chebrolu Censor networks: a critique of "sensor networks" from a systems perspective ACM SIGCOMM Computer Communication Review 38 3 2008 75 78
13. H. Frey, F. Ingelrest, D. Simplot-Ryl, Localized minimum spanning tree based multicast routing with energy-efficient guaranteed delivery in ad hoc and sensor networks, in: Proceedings of the 9th IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks (WOWMOM), Newport Beach, CA, USA, 2008, pp. 1-8.
14. F. Silva, J. Heidemann, R. Govindan, and D. Estrin Frontiers in Distributed Sensor Networks 2003 CRC Press, Inc. chapter Directed Diffusion, p. 25
15. A. Förster, A.L. Murphy, FROMS: feedback routing for optimizing multiple-sinks in WSN with reinforcement learning, in: Proceedings 3rd International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP), Melbourne, Australia, 2007, pp. 371-376.
16. A. Förster, A.L. Murphy, Balancing energy expenditure in WSNs through reinforcement learning: a study, in: Proceedings of the 1st International Workshop on Energy in Wireless Sensor Networks (WEWSN), Santorini Island, Greece, 2008, p. 7.
17. G. Wittenburg, K. Terfloth, F. López Villafuerte, T. Naumowicz, H. Ritter, J. Schiller, Fence monitoring - experimental evaluation of a use case for wireless sensor networks, in: Proceedings of the 4th European Conference on Wireless Sensor Networks (EWSN), Delft, The Netherlands, 2007, pp. 163-178.
18. M. Ali, U. Saif, A. Dunkels, T. Voigt, K. Römer, K. Langendoen, J. Polastre, and Z. Uzmi Medium access control issues in sensor networks SIGCOMM Computation and Communication Review 36 2 2006 33 36 (Pubitemid 43780948)
19. K. Langendoen Medium access control in wireless sensor networks H. Wu, Y. Pan, Medium Access Control in Wireless Networks Practice and Standards vol. II 2007 Nova Science Publishers, Inc. 22
20. A. Woo, T. Tong, D. Culler, Taming the underlying challenges of reliable multihop routing in sensor networks, in: Proceedings of the 1st International Conference on Embedded Networked Sensor Systems (SenSys), Los Angeles, CA, USA, 2003, pp. 14-27. (Pubitemid 40682331)
21. G. Werner-Allen, K. Lorincz, J. Johnson, J. Lees, and M. Welsh Fidelity and yield in a volcano monitoring sensor network Proceedings of the 7th USENIX Symposium on Operating Systems Design and Implementation 2006 USENIX Association Berkeley, CA, USA 27
22. O. Gnawali, R. Fonseca, K. Jamieson, D. Moss, and P. Levis Collection tree protocol Proceedings of the 7th ACM Conference on Embedded Networked Sensor Systems (SenSys) 2009 ACM Berkeley, California 1 14
23. C.E. Perkins, E.M. Royer, Ad-hoc on-demand distance vector routing, in: Proceedings of the 2nd IEEE Workshop on Mobile Computer Systems and Applications (WMCSA), New Orleans, USA, 1999, pp. 90-100.
24. R. Vaishampayan, J.J. Garcia-Luna-Aceves, Efficient and robust multicast routing in mobile ad hoc networks, in: Proceedings of the IEEE International Conference on Mobile Ad-hoc and Sensor Systems (MASS), Fort Lauderdale, FL, USA, 2004, pp. 304-313. (Pubitemid 40789358)
25. B.-R. Chen, K.-K. Muniswamy-Reddy, M. Welsh, Ad-hoc multicast routing on resource-limited sensor nodes, in: Proceedings of the 2nd International Workshop on Multi-hop Ad hoc Networks: From Theory to Reality (REALMAN), Florence, Italy, 2006, pp. 87-94. (Pubitemid 44060030)
26. B. Karp, H.T. Kung, GPSR: greedy perimeter stateless routing for wireless networks, in: Proceedings of the 6th Annual International Conference on Mobile Computing and Networking (MobiCom), Boston, MA, USA, 2000, pp. 243-254. (Pubitemid 32024699)
27. J.A. Sanchez, P.M. Ruiz, and I. Stojmenovic Energy-efficient geographic multicast routing for sensor and actuator networks Computer Communications 30 13 2007 2519 2531 (Pubitemid 47368645)
28. M. Zamalloa, K. Seada, B. Krishnamachari, and A. Helmy Efficient geographic routing over lossy links in wireless sensor networks ACM Transactions on Sensor Networks 4 3 2008 1 33
29. P. Ciciriello, L. Mottola, G. Picco, Efficient routing from multiple sources to multiple sinks in wireless sensor networks, in: Proceedings of the 4th European Conference on Wireless Sensor Networks (EWSN), Delft, The Netherlands, 2007, pp. 34-50.
30. Y. Chen, S. Ann, Y. Lin, Ve-mobicast: A variant-egg-based mobicast routing protocol for sensornets, in: Proceedings of the IEEE International Conference on Communications (ICC), Vol. 5, Seoul, Korea, 2005, pp. 3020-3024. (Pubitemid 41240817)
31. B. Kusy, H. Lee, M. Wicke, N. Milosavljevic, L. Guibas, Predictive qos routing to mobile sinks in wireless sensor networks, in: Proceedings of the International Conference on Information Processing in Sensor Networks (IPSN), San Francisco, CA, USA, 2009, pp. 109-120.
32. H. Luo, F. Ye, J. Cheng, S. Lu, and L. Zhang TTDD: two-tier data dissemination in large-scale wireless sensor networks Wireless Networks 11 1-2 2005 161 175 (Pubitemid 40536383)
33. H. Kim, T. Abdelzaher, W. Kwon, Minimum-energy asynchronous dissemination to mobile sinks in wireless sensor networks, in: Proceedings of the 1st International Conference on Embedded Networked Sensor Systems (SenSys), Los Angeles, CA, USA, 2003, pp. 193-204. (Pubitemid 40682346)
34. H. Kim, T. Abdelzaher, and W. Kwon Dynamic delay-constrained minimum-energy dissemination in wireless sensor networks Transactions on Embedded Computing Systems 4 3 2005 679 706
35. R. Flury, R. Wattenhofer, Routing, anycast, and multicast for mesh and sensor networks, in: Proceedings of the 26th IEEE International Conference on Computer Communications (INFOCOM), 2007, pp. 946-954. (Pubitemid 47334315)
36. S. Kulkarni, A. Förster, and G. Venayagamoorthy A survey on applications of computational intelligence for wireless sensor networks IEEE Communications Surveys & Tutorials 13 1 2011 25
37. R. Arroyo-Valles, R. Alaiz-Rodrigues, A. Guerrero-Curieses, J. Cid-Suiero, Q-probabilistic routing in wireless sensor networks, in: Proceedings of the 3rd International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP), Melbourne, Australia, 2007, pp. 1-6.
38. J.A. Boyan, and M.L. Littman Packet routing in dynamically changing networks: a reinforcement learning approach Advances in Neural Information Processing Systems 6 1994 671 678
39. P. Beyens, M. Peeters, K. Steenhaut, A. Nowe, Routing with compression in wireless sensor networks: a Q-learning approach, in: Proceedings of the 5th European Workshop on Adaptive Agents and Multi-Agent Systems (AAMAS), Paris, France, 2005, p. 12.
40. R.S. Sutton, and A.G. Barto Reinforcement Learning: An Introduction 1998 The MIT Press
41. C. Watkins, Learning from delayed rewards, Ph.D. thesis, Cambridge University, Cambridge, England, 1989.
42. U. Brandes, and T. Erlebach Network Analysis - Methodological Foundations 2005 Springer-Verlag Berlin, Germany
43. L. Sang, A. Arora, and H. Zhang On link asymmetry and one-way estimation in wireless sensor networks ACM Transactions on Sensor Networks 6 2 2010 1 25
44. A. Egorova-Förster, A.L. Murphy, A feedback enhanced learning approach for routing in WSN, in: Proceedings of the 4th Workshop on Mobile Ad-Hoc Networks (WMAN), Springer-Verlag, Berlin, Switzerland, 2007, pp. 12.
45. A. Förster, A.L. Murphy, J. Schiller, K. Terfloth, An efficient implementation of reinforcement learning-based routing on real WSN hardware, in: Proceedings of the 4th IEEE International Conference on Wireless and Mobile Computing, Networking and Communications (WiMOB), Avignon, France, 2008, p. 8.
46. A. Förster, A.L. Murphy, FROMS: A failure tolerant and mobility enabled multicast routing paradigm with reinforcement learning for WSNs, Tech. Rep. TR 2009/04, University of Lugano, June 2009.
47. D. Puccinelli, and M. Haenggi Reliable data delivery in large-scale low-power sensor networks ACM Transactions on Sensor Networks 6 4 2010 41
48. A. Kuntz, F. Schmidt-Eisenlohr, O. Graute, H. Hartenstein, M. Zitterbart, Introducing probabilistic radio propagation models in OMNeT++ mobility framework and cross validation check with NS-2, in: Proceedings of the 1st International Workshop on OMNeT++, Marseille, France, 2008, p. 7.
49. J. Polastre, J. Hill, D. Culler, Versatile low power media access for wireless sensor networks, in: Proceedings of the 2nd ACM Conference on Embedded Networked Sensor Systems (SenSys), Baltimore, MD, USA, 2004, pp. 95-107. (Pubitemid 41563352)
50. L. van Hoesel, P. Havinga, A lightweight medium access protocol (LMAC) for wireless sensor networks, in: Proceedings of the 1st International Conference on Networked Sensing Systems (INSS), Tokyo, Japan, 2004, pp. 946-953.
51. Scatterweb Inc. < http://www.scatterweb.de/ >.
52. G. Werner-Allen, P. Swieskowski, M. Welsh, Motelab: a wireless sensor network testbed, in: Proceedings of the 4th International Symposium on Information Processing in Sensor Networks (IPSN), 2005, pp. 483-488. (Pubitemid 43841274)
53. K. Zawadzki, A. Förster, Simulating routing protocols for wireless sensor networks, bachelor thesis at the University of Lugano, 2008.