Opportunistic bandwidth sharing through reinforcement learning

IEEE Transactions on Vehicular Technology

Volumn 59, Issue 6, 2010, Pages 3148-3153

  Venkatraman, Pavithra ^a   Hamdaoui, Bechir ^a   Guizani, Mohsen ^b  

^a Oregon State University   (United States)

^b Western Michigan University   (United States)

Author keywords

Markov decision process; opportunistic spectrum access; reinforcement learning

Indexed keywords

BANDWIDTH SHARING; COGNITIVE RADIO; ENABLING TECHNOLOGIES; FEDERAL COMMUNICATIONS COMMISSION; LEARNING TECHNIQUES; LICENSED USERS; MACHINE-LEARNING; MARKOV DECISION PROCESSES; OPPORTUNISTIC SPECTRUM ACCESS; PRIOR KNOWLEDGE; SPECTRUM UTILIZATION; TECHNOLOGICAL ADVANCES;

LEARNING ALGORITHMS; MARKOV PROCESSES; RADIO; RADIO SYSTEMS; REINFORCEMENT LEARNING; SPECTROSCOPY; WIRELESS TELECOMMUNICATION SYSTEMS;

REINFORCEMENT;

EID: 77954606199     PISSN: 00189545     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVT.2010.2048766     Document Type: Article

References (27)

1. Spectrum Policy Task Force (SPTF), Report of the Spectrum Efficiency WG, Rep. ET Docket no. 02-135, FCC, Washington, DC, Nov. 2002.
2. M. Vilimpoc and M. McHenry, Dupont circle spectrum utilization during peak hours, 2006. [Online]. Available: www.newamerica.net/files/archive/Doc- File-183-1.pdf
3. A. Ghasemi and E. S. Sousa, "Interference aggregation in spectrumsensing cognitive wireless networks," IEEE J. Sel. Topics Signal Process., vol.2, no.1, pp. 41-56, Feb. 2008.
4. Z. Quan, S. Cui, and A. H. Sayed, "Optimal linear cooperation for spectrum sensing in cognitive radio networks," IEEE J. Sel. Topics Signal Process., vol.2, no.1, pp. 28-40, Feb. 2008. (Pubitemid 351392286)
5. H. Su and X. Zhang, "Cross-layer based opportunistic MAC protocols for QoS provisionings over cognitive radio wireless networks," IEEE J. Sel. Areas Commun., vol.26, no.1, pp. 118-129, Jan. 2008.
6. C.-T. Chou, S. Shankar, H. Kim, and K. G. Shin, "What and how much to gain by spectrum agility," IEEE J. Sel. Areas Commun., vol.25, no.3, pp. 576-588, Apr. 2007.
7. S. Srinivasa and S. A. Jafar, "Cognitive radio networks: How much spectrum sharing is optimal?" in Proc. IEEE GLOBECOM, Nov. 2007, pp. 3149-3153.
8. Z. Ji and K. J. R. Liu, "Belief-assisted pricing for dynamic spectrum allocation in wireless networks with selfish users," in Proc. IEEE SECON, Sep. 2006, vol.1, pp. 119-127.
9. Z. Ji and K. J. R. Liu, "Multi-stage pricing game for collusion-resistant dynamic spectrum allocation," IEEE J. Sel. Areas Commun., vol.26, no.1, pp. 182-191, Jan. 2008.
10. S. Delaere and P. Ballon, "Flexible spectrum management and the need for controlling entities for reconfigurable wireless systems," in Proc. IEEE DySPAN, Apr. 2007, pp. 347-362.
11. Y. T. Hou, Y. Shi, and H. D. Sherali, "Spectrum sharing for multi-hop networking with cognitive radios," IEEE J. Sel. Areas Commun., vol.26, no.1, pp. 146-155, Jan. 2008.
12. A. Ginsberg, J. D. Poston, and W. D. Horne, "Toward a cognitive radio architecture: Integrating knowledge representation with software defined radio technologies," in Proc. IEEE MILCOM, Oct. 2006, pp. 1-7.
13. S. Yarkan and H. Arslan, "Exploiting location awareness toward improved wireless system design in cognitive radio," IEEE Commun. Mag., vol.46, no.1, pp. 128-136, Jan. 2008.
14. Z. Han, C. Pandana, and K. J. R. Liu, "Distributive opportunistic spectrum access for cognitive radio using correlated equilibrium and no-regret learning," in Proc. IEEE WCNC, Mar. 2007, pp. 11-15.
15. K. E. Nolan, P. Sutton, and L. E. Doyle, "An encapsulation for reasoning, learning, knowledge representation, and reconfiguration cognitive radio elements," in Proc. Int. Conf. Cogn. Radio Oriented Wireless Netw. Commun., Jun. 2006, pp. 1-5.
16. H. Kim and K. G. Shin, "Fast discovery of spectrum opportunities in cognitive radio networks," in Proc. IEEE DySPAN, Oct. 2008, pp. 1-12.
17. H. Kim and K. G. Shin, "Efficient discovery of spectrum opportunities with MAC-layer sensing in cognitive radio networks," IEEE Trans. Mobile Comput., vol.7, no.5, pp. 533-545, May 2008.
18. U. Berthold, M. Van Der Schaar, and F. K. Jondral, "Detection of spectral resources in cognitive radios using reinforcement learning," in Proc. IEEE DySPAN, Oct. 2008, pp. 1-5.
19. M. Maskery, V. Krishnamurthy, and Q. Zhao, "Decentralized dynamic spectrum access for cognitive radios: Cooperative design of a noncooperative game," IEEE Trans. Commun., vol.57, no.2, pp. 459-469, Feb. 2009.
20. J. Unnikrishnan and V. V. Veeravalli, "Dynamic spectrum access with learning for cognitive radio," in Proc. Asilomar Conf. Signals Syst. Comput., Oct. 2008, pp. 103-107.
21. J. Unnikrishnan and V. V. Veeravalli, "Cooperative sensing for primary detection in cognitive radio," IEEE J. Sel. Topics Signal Process., vol.2, no.1, pp. 18-27, Feb. 2008.
22. H. Liu, B. Krishnamachari, and Q. Zhao, "Cooperation and learning in multiuser opportunistic spectrum access," in Proc. IEEE ICC, 2008, pp. 487-492.
23. K. Liu and Q. Zhao, "Distributed learning in cognitive radio networks: Multi-armed bandit with distributed multiple players," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2010.
24. Y. Chen, Q. Zhao, and S. Ananthram, "Joint design and separation principle for opportunistic spectrum access in the presence of sensing errors," IEEE Trans. Inf. Theory, vol.54, no.5, pp. 2053-2071, May 2008.
25. Y. Chen, Q. Zhao, and A. Swami, "Joint design and separation principle for opportunistic spectrum access in the presence of sensing errors," IEEE Trans. Inf. Theory, vol.54, no.5, pp. 2053-2071, May 2008.
26. Q. Zhao, S. Geirhofer, L. Tong, and B. M. Sadler, "Opportunistic spectrum access via periodic channel sensing," IEEE Trans. Signal Process., vol.56, no.2, pp. 785-796, Feb. 2008.
27. R. S. Sutton and A. G. Barto, Reinforcement Learning. Cambridge,MA: MIT Press, 1998.