Reinforcement learning-based best path to best gateway scheme for wireless mesh networks

International Conference on Wireless and Mobile Computing, Networking and Communications

Volumn , Issue , 2011, Pages 373-379

  Boushaba, Mustapha ^a   Hafid, Abdelhakim ^a   Belbekkouche, Abdeltouab ^a  

^a UNIVERSITÉ DE MONTRÉAL   (Canada)

Author keywords

ETX; interferences; Reinforcement Learning; Routing; WMN

Indexed keywords

ADAPTIVE ROUTING; CHANNEL SWITCHING; ETX; EXPECTED TRANSMISSION COUNTS; HOP COUNT; INTERFERENCE RATIO; INTERFERENCES; LOSS RATIO; MESH ROUTERS; OPTIMAL ROUTING; OPTIMAL ROUTING POLICIES; PATH ROUTING; PATH SELECTION; RADIO INTERFACE; ROUTING; ROUTING PROBLEMS; ROUTING SCHEME; SHORTEST PATH; WMN;

COMPUTER SIMULATION; MESH NETWORKING; MOBILE COMPUTING; NETWORK PERFORMANCE; OPTIMIZATION; REINFORCEMENT; REINFORCEMENT LEARNING; ROUTERS; ROUTING PROTOCOLS; TELECOMMUNICATION SYSTEMS; WIRELESS MESH NETWORKS (WMN);

GATEWAYS (COMPUTER NETWORKS);

EID: 84255167786     PISSN: 21619646     EISSN: 21619654     Source Type: Conference Proceeding    
DOI: 10.1109/WiMOB.2011.6085373     Document Type: Conference Paper

References (25)

1. I.F. Akyildiz, X. Wang and W. Wang, "Wireless mesh networks: a survey," Computer Networks Journal 445-487, 2005.
2. J. Jun and M. Sichitiu "The nominal capacity of wireless mesh networks", IEEE Wireless Commun., vol. 10, p.8, 2003
3. M. E. M. Campista, P. M. Esposito, I. M. Moraes, L. H. M. K. Costa, O. C. M. B. Duarte, D. G. Passos, C. V. N. D. Albuquerque, D. C. M. Saade, and M. G. Rubinstein, "Routing metrics and protocols for wireless mesh networks," IEEE Network, 2008
4. A. Boukerche, "Performance evaluation of routing protocols for ad hoc wireless networks," Mobile Networks and Applications, vol.9 no.4, p.333-342, 2004
5. T. Clausen, P. Jacquet, A. Laouiti et al., "Optimized Link State Routing Protocol (OLSR)," In Proc. of IETF RFC 3626, 2003
6. C.E. Perkins and E.B. Royer, "Ad hoc On-demand Distance Vector Routing," In Proc. IEEE Workshop on Mobile Computing and Systems and Applications, 1999
7. TORA V. Park and M. S. Corson, "A Highly Adaptive Distributed Routing Algorithm for Mobile Wireless Networks," In Proc. of IEEE INFOCOM, 1997
8. Abdeltouab Belbekkouche, Abdelhakim Hafid, Michel Gendreau. "Novel reinforcement learning-based approaches to reduce loss probability in buffer-less OBS networks," Computer Networks, 2091-2105, 2009
9. C. Wu, K. Kumekawa, and T. Kato, "Distributed Reinforcement Learning Approach for Vehicular Ad Hoc Networks," presented at IEICE Transactions, 1431-1442, 2010
10. K. S. P. Beyens, M. Peeters and A. Nowe. "Routing with compression in wireless sensor networks: a q-learning approach," In Fifth European Workshop on Adaptive Agents and Multi-Agent Systems (AAMAS), 2005
11. A. Forster, "Machine Learning Techniques Applied to Wireless Ad-Hoc Networks: Guide and Survey," in Proceedings of the 3rd International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP), 2007
12. Kaelbling, L. P., Littman, M. L. and Moore, A. W., "Reinforcement learning: A survey," J. Artificial Intelligence Res., v4, pp. 237-285, 1996
13. M. Boushaba, A. Hafid, "Best Path to Best Gateway Scheme for Multichannel Multi-interface Wireless Mesh Networks," IEEE WCNC, 2011
14. Iima, H.; Kuroe, Y.; Matsuda, S.;, "Swarm reinforcement learning method based on ant colony optimization," Systems Man and Cybernetics (SMC), 2010 IEEE International Conference on, vol., no., pp.1726-1733, 10-13 Oct, 2010
15. Jing Xu; Wei Liu; Zongkai Yang; Jun Chen; Xiaohui Chen, "A Delay-Aware Routing Metric for Multi-Radio Multi-Channel Wireless Mesh Networks," Wireless Communications Networking and Mobile Computing (WiCOM), 2010
16. A. Subramanian, M. Buddhikot, S. Miller, "Interference aware routing in multiradio wireless mesh networks," in: 2nd IEEE Workshop on Wireless Mesh Networks, WiMesh 2006
17. Ramon Aguero Calvo, Jesus Perez Campo, "Adding Multiple Interface Support in NS-2," http://personales.unican.es/aguerocr/, 2007
18. A. Beljadid, A. Hafid, M. Gendreau, "Optimal Design of Broadband Wireless Mesh Networks," IEEE Globecom, 2007
19. Intersil HFA3861B Chip Specification, http://www.chipdocs.com/pndecoder/ datasheets/INTRS/HFA3861B.html
20. S. M. Das, Y. Wu, R. Chandra, and Y. C. Hu. "Context based routing: Technique, applications and experience," In USENIX NSDI, 2008
21. P.D. Christopher and J.C.H. Watkins, "Q-Learning, Machine Learning," 8, pp. 279-292, 1992
22. R.S. Sutton and A.G. Barto, "Reinforcement Learning: An Introduction," The MIT Press, Cambridge, Massachusetts, 1998
23. D. De Couto, D. Aguayo, J. Bicket, and R. Morris. "High-throughput path metric for multi-hop wireless routing," In Proc. of ACM MOBICOM, 2003
24. R. Draves, J. Padhye, and B. Zill, "Routing in Multi-Radio, Multi-Hop Wireless Mesh Networks," In Proc. of ACM MOBICOM, pp.114-128, 2004
25. J. Boyan and M. Littman. "Packet routing in dynamically changing networks: A reinforcement learning approach," In Proc. of NIPS, 1994