Cognitive medium access: Exploration, exploitation, and competition

IEEE Transactions on Mobile Computing

Volumn 10, Issue 2, 2011, Pages 239-253

  Lai, Lifeng ^a   El Gamal, Hesham ^b   Jiang, Hai ^c   Poor, H Vincent ^d  

^a University of Arkansas   (United States)

^b Ohio State University   (United States)

^c UNIVERSITY OF ALBERTA   (Canada)

^d Princeton University   (United States)

Author keywords

Bandit problem; Cognitive radio; Exploitation; Exploration; Medium access

Indexed keywords

ASYMPTOTICALLY OPTIMAL; BANDIT PROBLEMS; COMPETITIVE ENVIRONMENT; EXPLOITATION; EXPLORATION AND EXPLOITATION; GAME-THEORETIC MODEL; MEDIUM ACCESS; MEDIUM ACCESS PROTOCOL;

COGNITIVE RADIO; FREQUENCY BANDS; NATURAL RESOURCES EXPLORATION; OPTIMIZATION;

PROBABILITY;

EID: 84890916209     PISSN: 15361233     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMC.2010.65     Document Type: Article

References (23)

1. J. Mitola, "Cognitive Radio: Making Software Radios More Personal," IEEE Personal Comm., vol. 6, no. 4, pp. 13-18, Aug. 1999.
2. S. Haykin, "Cognitive Radio: Brain-Empowered Wireless Communications," IEEE J. Selected Areas in Comm., vol. 23, no. 2, pp. 201-220, Feb. 2005.
3. Q. Zhao, S. Geirhofer, L. Tong, and B.M. Sadler, "Opportunistic Spectrum Access via Periodic Channel Sensing," IEEE Trans. Signal Processing, vol. 56, no. 2, pp. 785-796, Feb. 2008.
4. S. Geirhofer, L. Tong, and B.M. Sadler, "Dynamic Spectrum Access in the Time Domain: Modeling and Exploiting White Space," IEEE Comm. Magazine, vol. 45, no. 5, pp. 66-72, May 2007.
5. Z. Sahinoglu and S. Tekinay, "On Multimedia Networks: Self-Similar Traffic and Network Performance," IEEE Comm. Magazine, vol. 37, no. 1, pp. 48-52, Jan. 1999.
6. D.A. Berry and B. Fristedt, Bandit Problems: Sequential Allocation of Experiments. Chapman and Hall, 1985.
7. R. Sutton and A. Barto, Reinforcement Learning: An Introduction. MIT Press, 1998.
8. A. Motamedi and A. Bahai, "Dynamic Channel Selection for Spectrum Sharing in Unlicensed Bands," European Trans. Telecomm. and Related Technologies, submitted, 2007.
9. Q. Zhao, L. Tong, A. Swami, and Y. Chen, "Decentralized Cognitive MAC for Opportunistic Spectrum Access in Ad Hoc Networks: A POMDP Framework," IEEE J. Selected Areas in Comm., vol. 25, no. 3, pp. 589-600, Apr. 2007.
10. Q. Zhao and B. Krishnamachari, "Structure and Optimality of Myopic Sensing for Opportunistic Spectrum Access," Proc. IEEE Int'l Conf. Comm., pp. 6476-6481, June 2007.
11. H. Jiang, L. Lai, R. Fan, and H.V. Poor, "Optimal Selection of Channel Sensing Order in Cognitive Radios," IEEE Trans. Wireless Comm., vol. 8, no. 1, pp. 297-307, Jan. 2009.
12. R. Fan and H. Jiang, "Channel Sensing-Order Setting in Cognitive Radio Networks: A Two-User Case," IEEE Trans. Vehicular Technology, vol. 58, no. 9, pp. 4997-5008, Nov. 2009.
13. T.L. Lai and H. Robbins, "Asymptotically Efficient Adaptive Allocation Rules," Advances in Applied Math., vol. 6, no. 1, pp. 4-22, 1985.
14. P.R. Kumar, "A Survey of Some Results in Stochastic Adaptive Control," SIAM J. Control and Optimization, vol. 23, pp. 329-380, May 1985.
15. P. Auer, N. Cesa-Bianchi, and P. Fischer, "Finite-Time Analysis of the Multiarmed Bandit Problem," Machine Learning, vol. 47, pp. 235-256, 2002.
16. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge Univ. Press, 2004.
17. P. Whittle, "Restless Bandits: Activity Allocation in a Changing World," J. Applied Probability, vol. 25A, pp. 287-298, 1988.
18. C.H. Papadimitriou and J.N. Tsitsiklis, "The Complexity of Optimal Queueing Network Control," Math. of Operations Research, vol. 24, no. 2, pp. 293-305, 1999.
19. S.H.A. Ahmad, M. Liu, T. Javidi, Q. Zhao, and B. Krishnamachari, "Optimality of Myopic Sensing in Multichannel Opportunistic Access," IEEE Trans. Information Theory, vol. 55, pp. 4040-4050, Sept. 2009.
20. L. Lai, H. Jiang, and H.V. Poor, "Medium Access in Cognitive Radio Networks: A Competitive Multi-Armed Bandit Framework," Proc. Asilomar Conf. Signals, Systems and Computers, Oct. 2008.
21. H.V. Poor, An Introduction to Signal Detection and Estimation. Springer-Verlag, 1994.
22. H. Kim and K.G. Shin, "Efficient Discovery of Spectrum Opportunities with MAC-Layer Sensing in Cognitive Radio Networks," IEEE Trans. Mobile Computing, vol. 7, no. 5, pp. 533-545, May 2008.
23. V. Anantharam, P. Varaiya, and J. Walrand, "Asymptotically Efficient Allocation Rules for the Multiarmed Bandit Problem with Multiple Plays-Part I: I.I.D Rewards," IEEE Trans. Automatic Control, vol. 32, no. 1, pp. 968-976, Nov. 1987.