Reinforcement learning for cooperative sensing gain in cognitive radio ad hoc networks

Wireless Networks

Volumn 19, Issue 6, 2013, Pages 1237-1250

  Lo, Brandon F ^a   Akyildiz, Ian F ^a,b  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

^b KING ABDULAZIZ UNIVERSITY   (Saudi Arabia)

Author keywords

Ad hoc networks; Cognitive radio; Control channel; Cooperative gain; Cooperative spectrum sensing; Reinforcement learning

Indexed keywords

CO-OPERATIVE SPECTRUM SENSING; COGNITIVE RADIO AD-HOC NETWORKS; COGNITIVE RADIO NETWORK; CONTROL CHANNELS; COOPERATIVE GAIN; DETECTION PERFORMANCE; ENVIRONMENTAL CHANGE; PRIMARY USER ACTIVITIES;

AD HOC NETWORKS; COGNITIVE RADIO; FADING CHANNELS; REINFORCEMENT LEARNING;

RADIO SYSTEMS;

EID: 84880306616     PISSN: 10220038     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11276-012-0530-4     Document Type: Article

References (34)

1. Lo, B. F., & Akyildiz, I. F. (2010). Reinforcement learning-based cooperative sensing in cognitive radio ad hoc networks. In Proceedings of IEEE PIMRC, pp. 2244-2249.
2. Akyildiz, I. F., Lee, W. Y., & Chowdhury, K. R. (2009). CRAHNs: Cognitive radio ad hoc networks. Ad Hoc Networks Journal (Elsevier), 7, 810.
3. Akyildiz, I. F., Lee, W. Y., Vuran, M. C., & Mohanty, S. (2006). NeXt generation/dynamic spectrum access/cognitive radio wireless networks: A survey. Computer Networks Journal (Elsevier), 50, 2127.
4. Akyildiz, I. F., Lo, B. F., & Balakrishnan, R. (2011). Cooperative spectrum sensing in cognitive radio networks: A survey. Physical Communication (Elseviar) Journal, 4(1), 40.
5. Cabric, D., Mishra, S. M., & Brodersen, R. W. (2004). Implementation issues in spectrum sensing for cognitive radios. In Proceedings of 38th Asilomar Conference on Signals, Systems, and Computers, pp. 772-776.
6. Ghasemi, A., & Sousa, E. S. (2005). Collaborative spectrum sensing for opportunistic access in fading environments. In Proceedings of IEEE DySPAN, pp. 131-136.
7. Lo, B. F., Akyildiz, I. F., & Al-Dhelaan, A. M. (2010). Efficient recovery control channel design in cognitive radio ad hoc networks. IEEE Transactions on Vehicular Technology, 59(9), 4513.
8. Lo, B. F. (2011). A survey on common control channel design for cognitive radio networks. Physical Communication (Elseviar) Journal, 4(1), 26.
9. Chen, R., Park, J. M., & Bian, K. (2008). Robust distributed spectrum sensing in cognitive radio networks. In Proceedings of IEEE INFOCOM, pp. 1876 -1884.
10. Varshney, P. K. (1997). Distributed detection and data fusion. New York: Springer.
11. Unnikrishnan, J., & Veeravalli, V. V. (2008). Cooperative sensing for primary detection in cognitive radio. IEEE Journal of Selected Topics in Signal Processing, 2(1), 18.
12. Selen, Y., Tullberg, H., & Kronander, J. (2008). Sensor selection for cooperative spectrum sensing. In Proceedings of IEEE DySPAN, pp. 1-11.
13. Visotsky, E., Kuffner, S., & Peterson, R. (2005). On collaborative detection of TV transmissions in support of dynamic spectrum sharing. In Proceedings of IEEE DySPAN, pp. 338-345.
14. Ma, J., Zhao, G., & Li, Y. (2008). Soft combination and detection for cooperative spectrum sensing in cognitive radio networks. IEEE Transactions on Wireless Communications, 7(11), 4502.
15. Visser, F. E., Janssen, G. J., & Pawelczak, P. (2008). Multinode spectrum sensing based on energy detection for dynamic spectrum access. In Proceedings of IEEE VTC-Spring 2008, pp. 1394-1398.
16. Zhou, X., Ma, J., Li, G., Kwon, Y., & Soong, A. (2010). Probability-based combination for cooperative spectrum sensing. IEEE Transactions on Communications, 58(2), 463.
17. Sun, C., Zhang, W., & Letaief, K. (2007). Cooperative spectrum sensing for cognitive radios under bandwidth constraints. In Proceedings of IEEE WCNC 2007 (pp. 1-5).
18. Zhang, X., Qiu, Z., & Mu, D. (2008). Asynchronous cooperative spectrum sensing in cognitive radio. In Proceedings of IEEE ICSP, pp. 2020-2023.
19. Song, C., & Zhang, Q. (2008). Sliding-window algorithm for asynchronous cooperative sensing in wireless cognitive networks. In Proceedings of IEEE ICC, pp. 3432-3436.
20. Sutton, R., & Barto, A. (1988). Reinforcement learning: An introduction. Cambridge, MA: The MIT Press.
21. Berthold, U., Fu, F., van der Schaar, M., & Jondral, F. K. (2008). Detection of spectral resources in cognitive radios using reinforcement learning. In Proceedings of IEEE DySPAN.
22. Di Felice, M., Chowdhury, K. R., Meleis, W. & Bononi, L. (2010). To sense or to transmit: A learning-based spectrum management scheme for cognitive radiomesh networks. In Proceedings of IEEE Workshop on Wireless Mesh Networks (WIMESH), pp. 1-6.
23. Vucevic, N., Akyildiz, I. F., & Perez-Romero, J. (2011). Dynamic cooperator selection in cognitive radio networks. Ad Hoc Networks (Elsevier) Journal (to appear).
24. Oksanen, J., Lundén, J., & Koivunen, V. (2010). Reinforcement learning-based multiband sensing policy for cognitive radios. In Proceedings of 2nd Int'l Workshop on Cognitive Information Processing (CIP), pp. 316-321.
25. Oksanen, J., Lundén, J., & Koivunen, V. (2010). Reinforcement learning method for energy efficient cooperative multiband spectrum sensing. In Proceedings of IEEE Int'l Workshop on Machine Learning for Signal Processing (MLSP), pp. 59-64.
26. Lee, W. Y., & Akyildiz, I. F. (2008). Optimal spectrum sensing framework for cognitive radio networks. IEEE Transactions on Wireless Communications, 7(10), 3845.
27. Gudmundson, M. (1991). Correlation model for shadow fading in mobile radio systems. Electronics Letters, 27(23), 2145.
28. Wang, H. S., & Moayeri, N. (1995). Finite-state markov channel-A useful model for radio communication channels. IEEE Transactions on Vehicular Technology, 44(1), 163.
29. Singh, S., Jaakkola, T., Littman, M. L., & Szepesvári, C. (2000). Convergence results for single-step on-policy reinforcement learning algorithms. Machine Learning, 38(3), 287.
30. Watkins, C. J. C. H. & Dayan, P. (1992). Q-learning. Machine Learning, 8, 279.
31. Breiman, L. (1968). Probability. Boston, MA: Addison-Wesley.
32. Puterman, M. L. (1994). Markov decision processes: Discrete stochastic dynamic programming. New York, NY: Wiley.
33. Shiryayev, A. N. (1978). Optimal stopping rules. New York, NY: Springer.
34. Poor, H. V., & Hadjiliadis, O. (2009). Quickest Detection. Cambridge, UK: Cambridge University Press.