Q-learning based bidding algorithm for spectrum auction in cognitive radio

Conference Proceedings - IEEE SOUTHEASTCON

Volumn , Issue , 2011, Pages 409-412

  Chen, Zhe ^a   Qiu, Robert C ^a  

^a Tennessee Technological University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

LEARNING ALGORITHMS;

BIDDING ALGORITHMS; COGNITIVE RADIO NETWORK; LEARN+; NETWORK TESTBEDS; Q-LEARNING; RADIO FREQUENCY SPECTRUM; SECONDARY USER; SENSING ALGORITHMS; SPECTRUM AUCTIONS; SPECTRUM SENSING;

COGNITIVE RADIO;

EID: 79956078142     PISSN: 10910050     EISSN: 1558058X     Source Type: Conference Proceeding    
DOI: 10.1109/SECON.2011.5752976     Document Type: Conference Paper

References (22)

1. J. Huang, R. A. Berry, and M. L. Honig, "Auction-based spectrum sharing," Mobile Networks and Applications, vol. 11, no. 3, p. 418, 2006.
2. S. Gandhi, C. Buragohain, L. Cao, H. Zheng, and S. Suri, "Towards realtime dynamic spectrum auctions," Computer Networks, vol. 52, no. 4, pp. 879-897, 2008.
3. D. Niyato, E. Hossain, and Z. Han, "Dynamic spectrum access in IEEE 802.22-based cognitive wireless networks: a game theoretic model for competitive spectrum bidding and pricing," IEEE Wireless Communications, vol. 16, no. 2, pp. 16-23, 2009.
4. H.-B. Chang and K.-C. Chen, "Auction-based spectrum management of cognitive radio networks," IEEE Transactions on Vehicular Technology, vol. 59, no. 4, pp. 1923-1935, 2010.
5. S. H. Chun and R. J. La, "Auction mechanism for spectrum allocation and profit sharing," in Proceedings of International Conference on Game Theory for Networks, 2009, pp. 498-507.
6. G. S. Kasbekar and S. Sarkar, "Spectrum auction framework for access allocation in cognitive radio networks," in Proceedings of the Tenth ACM International Symposium on Mobile Ad Hoc Networking and Computing, 2009, pp. 13-22.
7. H. Xu, J. Jin, and B. Li, "A secondary market for spectrum," in Proceedings of IEEE INFOCOM, 2010, pp. 1-5.
8. X. Wang, Z. Li, P. Xu, Y. Xu, X. Gao, and H.-H. Chen, "Spectrum sharing in cognitive radio networks - an auction based approach," IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 40, no. 3, pp. 587-596, 2010.
9. Y. Wu, B. Wang, K. Liu, and T. C. Clancy, "A multi-winner cognitive spectrum auction framework with collusion-resistant mechanisms," in Proceedings of 3rd IEEE Symposium on New Frontiers in Dynamic Spectrum Access Networks, 2008, pp. 1-9.
10. Y. Wu, B. Wang, K. J. R. Liu, and T. C. Clancy, "Collusion-resistant multi-winner spectrum auction for cognitive radio networks," in Proceedings of IEEE Global Telecommunications Conference, 2008, pp. 1-5.
11. -, "A scalable collusion-resistant multi-winner cognitive spectrum auction game," IEEE Transactions on Communications, vol. 57, no. 12, pp. 3805-3816, 2009.
12. L. P. Kaelbling, M. L. Littman, and A. W. Moore, "Reinforcement learning: a survey," Journal of Artificial Intelligence Research, vol. 4, pp. 237-285, 1996.
13. R. Dearden, N. Friedman, and S. Russell, "Bayesian Q-learning," in Proceedings of the National Conference on Artificial Intelligence, 1998, pp. 761-768.
14. L. Bixio, G. Oliveri, M. Ottonello, M. Raffetto, and C. S. Regazzoni, "A reinforcement learning approach to cognitive radio," in Proceedings of Software Defined Radio Technical Conference, 2007.
15. H. Li, "Multi-agent Q-learning of channel selection in multi-user cognitive radio systems: a two by two case," in Proceedings of the 2009 IEEE international conference on Systems, Man and Cybernetics, 2009, pp. 1893-1898.
16. -, "Multi-agent Q-learning for aloha-like spectrum access in cognitive radio systems," EURASIP Journal on Wireless Communications and Networking, vol. 2010, p. 15, 2010, article ID 876216.
17. J. W. Huang and V. Krishnamurthy, "Game theoretic issues in cognitive radio systems," Journal of Communications, vol. 4, no. 10, pp. 790-802, 2009.
18. A. Galindo-Serrano and L. Giupponi, "Distributed Q-learning for aggregated interference control in cognitive radio networks," IEEE Transactions on Vehicular Technology, vol. 59, no. 4, pp. 1823-1834, 2010.
19. O. Alsaleh, B. Hamdaoui, and A. Fern, "Q-learning for opportunistic spectrum access," in Proceedings of the 6th International Wireless Communications and Mobile Computing Conference, 2010, pp. 220-224.
20. C.Wu, K. Chowdhury, and M. D. Felice, "Spectrum management of cognitive radio using multi-agent reinforcement learning," in Proceedings of the International Conference on Autonomous Agents and Multiagent Systems, 2010.
21. R. C. Qiu, Z. Chen, N. Guo, Y. Song, P. Zhang, H. Li, and L. Lai, "Towards a real-time cognitive radio network testbed: architecture, hardware platform, and application to smart grid," in Proceedings of the fifth IEEE Workshop on Networking Technologies for Software-Defined Radio and White Space, June 2010.
22. R. Qiu, N. Guo, H. Li, Z. Wu, V. Chakravarthy, Y. Song, Z. Hu, P. Zhang, , and Z. Chen, "A unified multi-functional dynamic spectrum access framework: tutorial, theory and multi-GHz wideband testbed," Sensors, vol. 9, no. 8, pp. 6530-6603, August 2009.