Efficient exploration in reinforcement learning-based cognitive radio spectrum sharing

IET Communications

Volumn 5, Issue 10, 2011, Pages 1309-1317

  Jiang, T ^a   Grace, D ^a   Mitchell, P D ^a  

^a UNIVERSITY OF YORK   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION SELECTION; ACTION SPACES; COGNITIVE RADIO; EFFICIENT LEARNING; EXPLORATION AND EXPLOITATION; EXPLORATION PHASE; LEARNING EFFICIENCY; RADIO ENVIRONMENT;

EFFICIENCY; RADIO SYSTEMS; REINFORCEMENT; REINFORCEMENT LEARNING;

RADIO;

EID: 80053224177     PISSN: 17518628     EISSN: None     Source Type: Journal    
DOI: 10.1049/iet-com.2010.0258     Document Type: Article

References (30)

1. Akyildiz, I.F., Lee, W.-Y., Vuran, M.C., and Mohanty, S.: 'Next generation/dynamic spectrum access/cognitive radio wireless networks: a survey', Comput. Netw., 2006, 50, (13), p. 2127-215910.1016/j.comnet.2006.05.001
2. FCC: 'Notice of proposed rule making and order'. ET Docket No 03-222, December 2003
3. 'Cognitive radio technology: a study for Ofcom'. Summary Report, QinetiQ Ltd, Febreary 2007
4. Mitola, J., and Maguire, G.: 'Cognitive radio: making software radios more personal', IEEE Pers. Commun., 1999, 6, (4), p. 13-1810.1109/98.788210 1070-9916
5. Haykin, S.: 'Cognitive radio: brain-empowered wireless communications', IEEE J. Sel. Areas Commun., 2005, 23, (2), p. 201-22010.1109/JSAC.2004.839380 0733-8716
6. Fette, B.: 'Cognitive radio technology', (Newnes 2006)
7. Dasilva, L., and Mackenzie, A.: 'Cognitive networks: tutorial', (CrownCom Orlando, Florida, USA 2007)
8. Sutton, R.S., and Barto, A.G.: 'Reinforcement learning: an introduction', (The MIT Press 1998)
9. Kaelbling, L.P., Littman, M.L., and Moore, A.W.: 'Reinforcement learning: a survey', J. Artif. Intell. Res., 1996, 4, p. 237-2851076-9757
10. Tan, C.K., Sim, M.L., and Chuah, T.C.: 'Game theoretic approach for channel assignment and power control with no-internal-regret learning in wireless ad hoc networks', IEE Commun., 2008, 2, (9), p. 1159-1169
11. Ji, Z., and Liu, K.J.R.: 'Dynamic spectrum sharing: a game theoretical overview', IEEE Commun. Mag., 2007, 45, (5), p. 88-9410.1109/MCOM.2007.358854 0163-6804
12. Chen, T., Zhang, H., Katz, M., and Zhou, Z.: 'Swarm intelligence based dynamic control channel assignment in CogMesh', IEEE ICC (IEEE CoCoNet Workshop), Beijing, China, May 2008
13. Tsagkaris, K., Katidiotis, A., and Demestichas, P.: 'Neural network-based learning schemes for cognitive radio systems', Comput. Commun., 2008, 31, (14), p. 3394-340410.1016/j.comcom.2008.05.040
14. Neel, J.O.: 'Game theory in the analysis and design of cognitive radio networks', (DySPAN 2007)
15. Bublin, M., Pan, J., Kambourov, I., and Slanina, P.: 'Distributed spectrum sharing by reinforcement and game theory', Fifth Karlsruhe Workshop on Software Radio, Karlsruhe, Germany, March 2008
16. Clancy, C., Hecker, J., Stuntebeck, E., and O'Shea, T.: 'Applications of machine learning to cognitive radio networks', IEEE Wirel. Commun., 2007, 14, (4), p. 1536-128410.1109/MWC.2007.4300983 1536-1284
17. Neel, J.O., and Reed, J.: 'Game models for cognitive radio algorithm analysis', Software Define Radio Forum Technical Conf., 2004
18. Nie, J., and Haykin, S.: 'A dynamic channel assignment policy through Q-learning', IEEE Trans. Neural Netw., 1999, 10, (6), p. 1443-145510.1109/72.809089 1045-9227
19. Nie, N., and Comaniciu, C.: 'Adaptive channel allocation spectrum etiquette for cognitive radio networks', Mob. Netw. Appl., 2006, 11, (6), p. 779-79710.1007/s11036-006-0049-y
20. Čabrić, D., Mishra, S.M., Willkomm, D., Brodersen, R., and Wolisz, A.: 'A cognitive radio approach for usage of virtual unlicensed spectrum', Fourteenth IST Mobile Wireless Communications Summit, Dresden, Germany, June 2005
21. Jiang, T., Grace, D., and Mitchell, P.D.: 'Improvement of Pre-partitioning on reinforcement learning based spectrum sharing', IET Int. Communication Conf. on Wireless Mobile and Computing (CCWMC), 2009
22. Jiang, T., Grace, D., and Liu, Y.: 'Cognitive radio spectrum sharing schemes with reduced spectrum sensing requirements', The IET Seminar on Cognitive Radio and Software Defined Radios: Technologies and Techniques London, September 2008
23. Jiang, T., Grace, D., and Liu, Y.: 'Performance of cognitive radio reinforcement spectrum sharing using different weighting factors', Int. Workshop on Cognitive Networks and Communications (COGCOM) in conjunction with CHINACOM Hangzhou, China, August 2008
24. 'Efficient exploration in reinforcement learning', Technical, CS-92-102, 1992 School of Computer Science, Carnegie-Mellon University
25. Jiang, T., Grace, D., and Liu, Y.: 'Two stage reinforcement learning based cognitive radio with exploration control', IET Commun., 2011, 5, (5), p. 644-65110.1049/iet-com.2009.0803
26. Mitola, J.: 'Cognitive radio: an integrated agent architecture for software defined radio', (Royal Institute of Technology (KTH) 2000)
27. Grace, D., Tozer, T.C., and Burr, A.G.: 'Reducing call dropping in distributed dynamic channel assignment algorithms by incorporating power control in wireless ad hoc networks', IEEE J. Sel. Areas Commun. (Wireless Communication Series), 2000, 18, (22), p. 2417-242810.1109/49.895046
28. Kleinrock, L.: 'Queueing systems volume i: theory', (John Wiley & Sons 1975)
29. Cordeiro, C., Challapali, K., Birru, D., and Shankar, N.S.: 'IEEE 802.22: the first worldwide wireless standard based on cognitive radios', (Dynamic Spectrum Access Networks (DySPAN) 2005)
30. Saunders, S.: 'Antennas and propagation for wireless communication systems', (Wiley 1999)