Reinforcement learning based spectrum-aware routing in multi-hop cognitive radio networks

Proceedings of the 2009 4th International Conference on Cognitive Radio Oriented Wireless Networks and Communications, CROWNCOM 2009

Volumn , Issue , 2009, Pages

  Xia, Bing ^a   Wahab, Muhammad Husni ^a   Yang, Yang ^a   Fan, Zhong ^b   Sooriyabandara, Mahesh ^b  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b TOSHIBA CORPORATION   (Japan)

Author keywords

Cognitive radio network; Reinforcement learning; Routing

Indexed keywords

ADAPTIVE REINFORCEMENT; COGNITIVE RADIO NETWORK; DYNAMIC ROUTING; LOCAL INFORMATION; MULTIHOP; NETWORK LOAD; ON-DEMAND PROTOCOLS; OPTIMAL ROUTING POLICIES; Q-LEARNING; Q-ROUTING; Q-VALUES; ROUTING; ROUTING POLICIES; SHORTEST PATH; SPECTRUM-AWARE ROUTING;

EDUCATION; RADIO; RADIO SYSTEMS; REINFORCEMENT; REINFORCEMENT LEARNING; WIRELESS NETWORKS;

ROUTING PROTOCOLS;

EID: 70449347889     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CROWNCOM.2009.5189189     Document Type: Conference Paper

References (10)

1. J. Mitola III, "Cognitive Radio: An Integrated Agent Architecture for Software Defined Radio," Doctoral Dissertation, KTH, Stockholm, Sweden, May 2000.
2. C. Xin, B. Xie, and Shen, "A Novel Layered Graph Model for Topology Formation and Routing in Dynamic Spectrum Access Networks," 1st IEEE International Symposium on New Frontiers in Dynamic Spectrum Access Networks (DySPAN 2005), pp. 308-317, Novermber 2005, Baltimore, USA.
3. A. Sampath, L. Yang, L. Cao, H. Zheng, and B. Y. Zhao, "High Throughput Spectrum-aware Routing for Cognitive Radio Networks," 3rd International Conference on Cognitive Radio Oriented Wireless Networks and Communications (CrownCom 2008), May, 2008, Singapore.
4. H. Ma, L. Zheng, X. Ma and, Y. Luo, "Spectrum Aware Routing for Multi-Hop Cognitive Radio Networks with a Single Transceiver," 3rd International Conference on Cognitive Radio Oriented Wireless Networks and Communications (CrownCom 2008), May, 2008, Singapore.
5. G. Cheng, W. Liu, Y. Li, and W. Cheng, "Joint On-demand Routing and Spectrum Assignment in Cognitive Radio Networks," IEEE International Conference on Communications (ICC 2007), pp. 6499- 6503, June 2007, Glasgow. Scotland.
6. G Cheng, W Liu, Y Li, and W Cheng, "Spectrum Aware On-demand Routing in Cognitive Radio Networks," 2nd IEEE International Symposium on New Frontiers in Dynamic Spectrum Access Networks (DySPAN 2007), pp. 571-574, April 2007, Dublin, Ireland.
7. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. The MIT Press, March 1998.
8. L. P. Kaelbling, M. L. Littman, and A. P. Moore, "Reinforcement learning: A survey," Journal of Artificial Intelligence Research, vol. 4, pp. 237-285, 1996.
9. J. A. Boyan and M. L. Littman, "Packet routing in dynamically changing networks: A reinforcement learning approach," In Advances in Neural Information Processing Systems, vol. 6, pp. 671-678, 1994.
10. S. Kumar and R. Miikkulainen, "Dual reinforcement q-routing: An online adaptive routing algorithm," in Proc. of the Artificial Neural Networks in Engineering Conf., 1997.