An efficient transmission mode selection based on reinforcement learning for cooperative cognitive radio networks

Human-centric Computing and Information Sciences

Volumn 6, Issue 1, 2016, Pages

  Rahman, Md Arifur ^a   Lee, Young Doo ^a   Koo, Insoo ^a  

^a University of Ulsan   (South Korea)

Author keywords

Cognitive radio networks; Cooperative communication; Q learning; Relay selection; Transmission mode

Indexed keywords

COGNITIVE RADIO; ENERGY EFFICIENCY; LEARNING ALGORITHMS; RADIO SYSTEMS; RADIO TRANSMISSION; REINFORCEMENT LEARNING;

COGNITIVE RADIO NETWORK; CONVENTIONAL SCHEMES; COOPERATIVE COGNITIVE RADIO NETWORKS; Q-LEARNING; Q-LEARNING ALGORITHMS; RELAY SELECTION; TRANSMISSION MODE; TRANSMISSION MODE SELECTIONS;

COOPERATIVE COMMUNICATION;

EID: 84962853141     PISSN: None     EISSN: 21921962     Source Type: Journal    
DOI: 10.1186/s13673-016-0057-2     Document Type: Article

References (30)

1. Haykin S (2005) Cognitive radio: brain-empowered wireless communications. IEEE J Sel Areas Commun 23(2):201–220
2. Goldsmith A, Jafar SA, Maric´ I, Srinivasa S (2009) Breaking spectrum gridlock with cognitive radios: an information theoretic prospective. Proc IEEE 97(5):894–914
3. Gastpar M (2007) On capacity under receive and spatial spectrum-sharing constraints. IEEE Trans Inf Theory 53(2):471–487
4. EI-Mahdy A, Tarek N (2013) Relay selection algorithm for wireless cooperative network. Conference on signal processing: algorithms, architectures, arrangements, and applications (SPA). IEEE, Poznan, pp 274–278
5. Ju M, Kim IM (2010) Joint Relay Selection and opportunistic source selection in bidirectional cooperative diversity networks. IEEE Trans Veh Technol 59(6):2885–2897
6. Cui H, Ma M, Song L (2014) Relay selection for two-way full duplex relay networks with amplify-and-forward protocol. IEEE Trans Wireless Commun 13(7):3768–3777
7. Yuan J, Li Y, Chu L (2010) Differential modulation and relay selection with detect-and-forward cooperative relaying. IEEE Trans Veh Technol 59(1):261–268
8. Wu D, Zhu G, Sun L, Zhao D (2012) Joint mode/route selection and power allocation in cellular networks with cooperative relay. In: IEEE international conference on communication, Ottawa, IEEE, pp 4144–4149. doi: 10.1109/ICC.2012.6363807
9. Xu Y, Bai Z, Wang B, Gong P, Kwak K (2014) Energy-efficient power allocation scheme for multi-relay cooperative communication. In: 16th international conference on advance communication technology (ICACT), GIRI, Korea (South)
10. Chen X, Zhao Z, Zhang H (2013) Stochastic power adaptation with multiagent reinforcement learning for cognitive wireless mesh network. IEEE Trans Mob Comput 12(11):2155–2166
11. Tang Y, Grace D, Clarke T, Wei J (2011) Multichannel non persistent CSMA MAC schemes with reinforcement learning for cognitive radio networks. In: 11th international symposium on communications and information technologies (ISCIT), IEEE, Hangzhou, pp 502–506. doi: 10.1109/ISCIT.2011.6092159
12. Li H (2009) Multi-agent Q-learning of channel selection in multiuser cognitive radio systems: a two by two case. In: international conference on systems, man and cybernetics (CSMC), USA, IEEE. pp 1893–1898. doi: 10.1109/ICSMC.2009.5346172
13. Lo BF, Akyildiz IF (2010) Reinforcement learning-based cooperative sensing in cognitive radio ad hoc networks. In: 21st international symposium on personal indoor and mobile radio communication (PIMRC). Turkey, IEEE, pp. 2244–2249. doi: 10.1109/PIMRC.2010.5671686
14. Zheng K, Li H (2010) Achieving energy efficiency via drowsy transmission in cognitive radio. In: 2010 global telecommunications conference (GLOBECOM). USA, IEEE. pp 1–6, doi: 10.1109/GLOCOM.2010.5683355
15. Peng J, Li J, Li S, Li J (2011) Multi-relay cooperative mechanism with Q-learning in cognitive radio multimedia sensor networks. In: international joint conference on IEEE TrustCom, China, IEEE. pp 1624–1629. doi: 10.1109/TrustCom.2011.225
16. Yoon M, Kim YK, Chang JW (2013) An energy-efficient routing protocol using message success rate in wireless sensor network. J Converg 4(1):15–22
17. Bae SK (2014) Power consumption analysis of prominent time synchronization protocols for wireless sensor networks. J Inf Processing Syst 10(2):300–313
18. Carvalho GH, Woungang I, Anpalagan A, Dhurandher SK (2012) Energy-efficient radio resource management scheme for heterogeneous wireless networks: a queueing theory perspective. J Converg 3(4):15–22
19. Chong JH, Ng CK, Noordin NK, Ali BM (2013) Dynamic transmit antenna shuffling scheme for mimo wireless communication systems. J Converg 4(1):7–14
20. Kwon YM, Choo H, Lee TJ, Chung MY, Kim M (2014) Femtocell subband selection method for managing cross- and co-tier interference in a femtocell overlaid cellular network. J Inf Processing Syst 10(3):384–394
21. Tishita TA, Akhter S, Islam MI, Amin MR (2014) Spectrum sensing and data transmission in a cognitive relay network considering spatial false alarms. J Inf Processing Syst 10(3):459–470
22. Sinha A, Lobiyal DK (2013) Performance evaluation of data aggregation for cluster-based wireless sensor network. Human-centric Comput Inf Sci 3(13). doi:10.1186/2192-1962-3-13
23. Singh R, Singh P, Duhan M (2014) An effective implementation of security based algorithmic approach in mobile Adhoc networks. Human -centric Comput Inf Sci 4(7). doi:10.1186/s13673-014-0007-9
24. Pughat A, Sharma V (2015) A review on stochastic approach for dynamic power management in wireless sensor network. Human-centric Comput Inf Sci 5(4). doi:10.1186/s13673-015-0021-6
25. Jung H, Kim K, Kim J, Shin OS, Shin Y (2012) A relay selection scheme using Q-learning algorithm in cooperative wireless communications. In: 18th Asia-Pacific conference on communications (APCC), Jeju Island, KICS. pp 7–11. doi: 10.1109/APCC.2012.6388091
26. Watkins CJCH, Dayan P (1992) Technical note Q-learning. J Mach Learn 8(3-4):279–292
27. F.S. Melo, Convergence of Q-learning: A simple proof, Institute of Systems and Robotics, Tech Rep
28. Sutton RS, Barto AG (1998) Reinforcement learning: an introduction. MIT Press, Cambridge
29. Sadek AK, Wei Y, Liu KJR (2006) When does cooperation have better performance in sensor network?. In: 3rd annual IEEE communication society on sensor and adhoc communications and networks (SECON), Reston, IEEE. pp 188–197. doi: 10.1109/SAHCN.2006.288423
30. Miao G, Himayat N, Li YG, Bormann D (2008) Energy efficient design in wireless OFDMA, Communications. In: IEEE international conference on communications, (ICC), Beijing, IEEE. pp 3307–3312. doi: 10.1109/ICC.2008.622