Two-stage reinforcement-learning-based cognitive radio with exploration control

IET Communications

Volumn 5, Issue 5, 2011, Pages 644-651

  Jiang, T ^a   Grace, D ^a   Liu, Y ^a  

^a UNIVERSITY OF YORK   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COGNITIVE RADIO; EXPLORATION AND EXPLOITATION; EXPLORATION PHASE; LEARNING PROCESS; SPECTRUM SENSING; SPECTRUM SHARING; TWO STAGE; WIRELESS COMMUNICATIONS;

RADIO; REINFORCEMENT; WIRELESS TELECOMMUNICATION SYSTEMS;

REINFORCEMENT LEARNING;

EID: 80053288058     PISSN: 17518628     EISSN: None     Source Type: Journal    
DOI: 10.1049/iet-com.2009.0803     Document Type: Article

References (22)

1. FCC: 'Notice of proposed rule making and order', December 2003, ET Docket No. 03-222
2. Akyildiz, I.F., Lee, W.Y., Vuran, M.C., and Mohanty, S.: 'Next generation/dynamic spectrum access/cognitive radio wireless networks: a survey', Comput. Netw., 2006, p. 2127-215910.1016/j.comnet.2006.05.001
3. Mitola, J., and Maguire, G.: 'Cognitive radio: making software radios more personal', IEEE Pers. Commun., 1999, 6, (4), p. 13-1810.1109/98.788210 1070-9916
4. Haykin, S.: 'Cognitive radio: brain-empowered wireless communications', IEEE J. Sel. Areas Commun., 2005, 23, p. 201-22010.1109/JSAC.2004.839380 0733-8716
5. Fette, B.: 'Cognitive radio technology', (Newnes 2006)
6. Jiang, T., Grace, D., and Liu, Y.: 'Performance of cognitive radio reinforcement spectrum sharing using different weighting factors', Int. Workshop on Cognitive Networks and Communications (COGCOM2008) in conjunction with CHINACOM'08, Hangzhou, China, August 2008
7. Clancy, C., Hecker, J., Stuntebeck, E., and O'Shea, T.: 'Applications of machine learning to cognitive radio networks', IEEE Wirel. Commun., 2007, 14, (4), p. 1536-128410.1109/MWC.2007.4300983 1536-1284
8. Neel, J.O., and Reed, J.: 'Game models for cognitive radio algorithm analysis', Software Define Radio Forum Technical Conf., 2004
9. Neel, J.O., Buehrer, R.M., Reed, B.H., and Gilles, R.P.: 'Game theoretic analysis of a network of cognitive radios', 45th Midwest Symp. on Circuits and Systems, August 2002
10. Tsagkaris, K., Katidiotis, A., and Demestichas, P.: 'Neural network-based learning schemes for cognitive radio systems', Comput. Commun., 2008, 31, (14), p. 3394-340410.1016/j.comcom.2008.05.040
11. Sutton, R.S., and Barto, A.G.: 'Reinforcement learning: an introduction', (The MIT Press 1998)
12. Kaelbling, L.P., Littman, M.L., and Moore, A.W.: 'Reinforcement learning: a survey', J. Artif. Intell. Res., 1996, 4, p. 237-2851076-9757
13. Mitchell, T.M.: 'Machine learning', 1997), (McGraw Hill
14. Bublin, M., Pan, J., Kambourov, I., and Slanina, P.: 'Distributed spectrum sharing by reinforcement and game theory', Fifth Karlsruhe Workshop on Software Radio, Karlsruhe, Germany, March 2008
15. Nie, J., and Haykin, S.: 'A dynamic channel assignment policy through Q-learning', IEEE Trans. Neural Netw., 1999, 10, (6), p. 1443-14551045-9227
16. Senouci, S.-M., and Pujolle, G.: 'Dynamic channel assignment in cellular networks: a reinforcement learning solution', Int. Conf. Telecommunications, February 2003
17. Nie, N., and Comaniciu, C.: 'Adaptive channel allocation spectrum etiquette for cognitive radio networks', Mobile Netw. Appl., 2006, 11, (6), p. 779-79710.1007/s11036-006-0049-y 1383-469X
18. Jiang, T., Grace, D., and Liu, Y.: 'Cognitive radio spectrum sharing schemes with reduced spectrum sensing requirements', The IET Seminar on Cognitive Radio and Software Defined Radios: Technologies and Techniques, London, September 2008
19. Cordeiro, C., Challapali, K., Birru, D., and Sai Shankar, N.: 'IEEE 802.22: the first worldwide wireless standard based on cognitive radios', Dynamic Spectrum Access Networks, 2005, DySPAN 2005
20. Saunders, S.R.: 'Antennas and propagation for wireless communication systems', (Wiley 1999)
21. Chouinard, G.: 'FCC R&O 08-260 proposed text for antenna height', (CRC Press 2009 January)
22. Leith, D.J., and Clifford, P.: 'Convergence of distributed learning algorithms for optimal wireless channel allocation', 45th IEEE Conf. Decision and Control, San Diego 2006