Opportunistic spectrum access in unknown dynamic environment: A game-theoretic stochastic learning solution

IEEE Transactions on Wireless Communications

Volumn 11, Issue 4, 2012, Pages 1380-1391

  Xu, Yuhua ^a   Wang, Jinlong ^a   Wu, Qihui ^a   Anpalagan, Alagan ^b   Yao, Yu Dong ^c  

^a PLA UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b RYERSON UNIVERSITY   (Canada)

^c Stevens Institute of Technology   (United States)

Author keywords

Cognitive radio networks; distributed channel selection; exact potential game; opportunistic spectrum access; stochastic learning automata

Indexed keywords

COGNITIVE RADIO NETWORK; DISTRIBUTED CHANNELS; EXACT POTENTIAL GAME; OPPORTUNISTIC SPECTRUM ACCESS; STOCHASTIC LEARNING AUTOMATA;

COGNITIVE RADIO; GAME THEORY; LEARNING ALGORITHMS; STOCHASTIC SYSTEMS; TESTBEDS;

SPECTROSCOPY;

EID: 84862804804     PISSN: 15361276     EISSN: None     Source Type: Journal    
DOI: 10.1109/TWC.2012.020812.110025     Document Type: Article

References (35)

1. J. Mitola and G. Q. Maguire, "Cognitive radio: making software radios more personal", IEEE Personal Commun., vol. 6, no. 4, pp. 13-18, Aug. 1999.
2. S. Haykin, "Cognitive radio: brain-empowered wireless communications", IEEE J. Sel. Areas Commun., vol. 23, no. 2, pp. 201-220, 2005.
3. C. T. Chou, N. S. Shankar, H. Kim, et al., "What and how much to gain by spectrum agility?" IEEE J. Sel. Areas Commun., vol. 25, no. 3, pp. 576-588, 2007.
4. S. Srinivasa and S. Jafar, "How much spectrum sharing is optimal in cognitive radio networks?" IEEE Trans. Wireless Commun., vol. 7, no. 10, pp. 4010-4018, 2008.
5. N. Nie and C. Comaniciu, "Adaptive channel allocation spectrum etiquette for cognitive radio networks", Mobile Networks & Applications, vol. 11, no. 6, pp. 779-797, 2006.
6. M. Felegyhazi, M. Cagalj, and J. P. Hubaux, "Efficient MAC in cognitive radio systems: a game-theoretic approach", IEEE Trans. Wireless Commun., vol. 8, no. 4, pp. 1984-1995, 2009.
7. M. Maskery, V. Krishnamurthy, and Q. Zhao, "Decentralized dynamic spectrum access for cognitive radios: cooperative design of a noncooperative game", IEEE Trans. Commun., vol. 57, no. 2, pp. 459-469, 2009.
8. P. Sastry, V. Phansalkar, and M. Thathachar, "Decentralized learning of Nash equilibria in multi-person stochastic games with incomplete information", IEEE Trans. Syst., Man, Cybern. B, vol. 24, no. 5, pp. 769-777, 1994.
9. Q. Zhao, L. Tong, A. Swami, et al., "Decentralized cognitive MAC for opportunistic spectrum access in ad hoc networks: a POMDP framework", IEEE J. Sel. Areas Commun., vol. 25, no. 3, pp. 589-600, 2007.
10. S. Ahmad, M. Liu, T. Javidi, et al., "Optimality of myopic sensing in multichannel opportunistic access", IEEE Trans. Inf. Theory, vol. 55, no. 9, pp. 4040-4050, 2009.
11. Y. Chen, Q. Zhao, and A. Swami, "Distributed spectrum sensing and access in cognitive radio networks with energy constraint", IEEE Trans. Signal Process., vol. 57, no. 2, pp. 783-797, 2009.
12. Y. Chen, Q. Zhao, and A. Swami, "Joint design and separation principle for opportunistic spectrum access in the presence of sensing errors", IEEE Trans. Inf. Theory, vol. 54, no. 5, pp. 2053-2071, May 2008.
13. K. Liu and Q. Zhao, "Decentralized multi-armed bandit with multiple distributed players", in Proc. 2010 Information Theory and Applications Workshop, pp. 1-10.
14. Y. Gai, B. Krishnamachari, and R. Jain, "Learning multiuser channel allocations in cognitive radio networks: a combinatorial multi-armed bandit formulation", in Proc. IEEE DySPAN 2010, pp. 1-9.
15. K. Liu and Q. Zhao, "Distributed learning in multi-armed bandit with multiple players", IEEE Trans. Signal Process., vol. 58, no. 11, pp. 5667-5681, 2010.
16. A. Anandkumar, N. Michael, and A. Tang, "Opportunistic spectrum access with multiple users: learning under competition", in Proc. 2010 IEEE INFOCOM, pp. 1-9.
17. H. Li, "Multi-agent Q-learning of channel selection in multi-user cognitive radio systems: a two by two case", in Proc. 2009 IEEE International Conference on Systems, Man and Cybernetics, pp. 1893-1898.
18. Y. Xu, Q. Wu, and J. Wang, "Game theoretic channel selection for opportunistic spectrum access with unknown prior information", in Proc. IEEE ICC 2011, pp. 1-5.
19. T. Joshi, D. Ahuja, D. Singh, et al., "SARA: stochastic automata rate adaptation for IEEE 802.11 networks", IEEE Trans. Parallel Distrib. Syst., vol. 19, no. 11, pp. 1579-1590, 2008.
20. Y. Xing and R. Chandramouli, "Stochastic learning solution for distributed discrete power control game in wireless data networks", IEEE/ACM Trans. Netw., vol. 16, no. 4, pp. 932-944, 2008.
21. W. Zhong, Y. Xu, M. Tao, et al., "Game theoretic multimode precoding strategy selection for MIMO multiple access channels", IEEE Signal Process. Lett., vol. 17, no. 6, pp. 563-566, 2010.
22. Y. Xu, J. Wang, Q. Wu, et al., "Opportunistic spectrum access in cognitive radio networks: global optimization using local interaction games", IEEE J. Sel. Topics Signal Process. doi: 10.1109/JSTSP.2011. 2176916.
23. IEEE 802.16e-2005 and IEEE Std 802.16-2004/Cor1-2005, http://www.ieee802.org/16/.
24. T. Cui, L. Chen, and S. H. Low, "A game-theoretic framework for medium access control", IEEE J. Sel. Areas Commun., vol. 26, no. 7, pp. 1116-1127, 2008.
25. D. Zheng, W. Ge, and J. Zhang, "Distributed opportunistic scheduling for ad hoc networks with random access: an optimal stopping approach", IEEE Trans. Inf. Theory, vol. 55, no. 1, pp. 205-222, 2009.
26. B. Vcking and R. Aachen, "Congestion games: optimization in competition", in Proc. 2006 Algorithms and Complexity in Durham Workshop, pp. 9-20.
27. D. Monderer and L. S. Shapley, "Potential games", Games and Economic Behavior, vol. 14, pp. 124-143, 1996.
28. R. Jain, D. Chiu, and W. Haws, "A quantitative measure of fairness and discrimination for resource allocation in shared computer system", Technical Report, 1984.
29. Y. Xu, Q. Wu, J. Wang, et al., "Social welfare maximization for SRSNs using bio-inspired community cooperation mechanism", Chinese Sci. Bull., vol. 57, no. 1, pp. 125-131, 2012.
30. J. Marden, G. Arslan, and J. Shamma, "Joint strategy fictitious play with inertia for potential games", IEEE Trans. Automatic Control, vol. 54, no. 2, pp. 208-220, 2009.
31. L. Law, J. Huang, M. Liu, and S. R. Li, "Price of anarchy for cognitive MAC games", in Proc. IEEE GLOBECOM 2009, pp. 1-6.
32. P. Chaporkar, A. Proutiere, and B. Radunoviac, "Rate adaptation games in wireless LANs: Nash equilibrium and price of anarchy", in Proc. IEEE INFOCOM 2010, pp. 1-9.
33. U. Ayesta, O. Brun, and B. J. Prabhu, "Price of anarchy in noncooperative load balancing", in Proc. IEEE INFOCOM 2010, pp. 1-5.
34. L. Jiao, V. Pla, and F. Li, "Analysis on channel bonding/aggregation for multi-channel cognitive radio networks", in Proc. 2010 European Wireless Conference, pp. 468-474.
35. Y. Lu, H. He, J. Wang, and S. Li, "Opportunistic spectrum access with channel bonding", in Proc. 2009 International Conference on Communications and Networking in China, pp. 1-5, 2009.