Distributed stochastic online learning policies for opportunistic spectrum access

IEEE Transactions on Signal Processing

Volumn 62, Issue 23, 2014, Pages 6184-6193

  Gai, Yi ^a   Krishnamachari, Bhaskar ^b  

^a INTEL CORPORATION   (United States)

^b University of Southern California   (United States)

Author keywords

decentralized multi armed bandit; dynamic spectrum access; Online learning

Indexed keywords

COGNITIVE RADIO; SOCIAL NETWORKING (ONLINE); SPECTROSCOPY; STOCHASTIC SYSTEMS;

COGNITIVE RADIO NETWORK; DISTRIBUTED POLICIES; DYNAMIC SPECTRUM ACCESS; MULTI ARMED BANDIT; MULTI-ARMED BANDIT PROBLEM; ONLINE LEARNING; OPPORTUNISTIC SPECTRUM ACCESS; PROBLEM FORMULATION;

E-LEARNING;

EID: 84910126790     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2014.2360821     Document Type: Article

References (18)

1. Y. Gai and B. Krishnamachari, "Decentralized online learning algorithms for opportunistic spectrum access," in Proc. IEEE Global Commun. Conf. (GLOBECOM), Dec. 2011, pp. 1-6.
2. T. Yucek and H. Arslan, "A survey of spectrum sensing algorithms for cognitive radio applications," Commun. Surveys Tuts., vol. 11, pp. 116-130, 2009.
3. T. Lai and H. Robbins, "Asymptotically efficient adaptive allocation rules," Adv. Appl. Math., vol. 6, pp. 4-22, 1985.
4. V. Anantharam, P. Varaiya, and J. Walrand, "Asymptotically efficient allocation rules for the multiarmed bandit problem with multiple plays-Part I: I.I.D. rewards," IEEE Trans. Autom. Control, vol. 32, pp. 968-976, 1987.
5. V. Anantharam, P. Varaiya, and J. Walrand, "Asymptotically efficient allocation rules for the multiarmed bandit problem with multiple plays-Part II: Markovian rewards," IEEE Trans. Autom. Control, vol. 32, pp. 977-982, 1987.
6. P. Auer, N. Cesa-Bianchi, and P. Fischer, "Finite-time analysis of the multiarmed bandit problem," Mach. Learn., vol. 47, pp. 235-256, 2002.
7. Y. Gai, B. Krishnamachari, and R. Jain, "Learning multiuser channel allocations in cognitive radio networks: A combinatorial multi-armed bandit formulation," in Proc. IEEE Int. Dynam. Spectrum Access Netw. (DySPAN) Symp., Apr. 2010, pp. 1-9.
8. K. Liu and Q. Zhao, "Distributed learning in multi-armed bandit with multiple players," IEEE Trans. Signal Process., vol. 58, pp. 5667-5681, Nov. 2010.
9. K. Liu and Q. Zhao, "Distributed learning in cognitive radio networks: Multi-armed bandit with distributed multiple players," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Mar. 2010, pp. 3010-3013.
10. A. Anandkumar, N.Michael, and A. K. Tang, "Opportunistic spectrum access with multiple users: Learning under competition," in Proc.IEEE Int. Conf. Comput. Commun. (INFOCOM), Mar. 2010, pp. 1-9.
11. A. Anandkumar, N. Michael, A. Tang, and A. Swami, "Distributed algorithms for learning and cognitive medium access with logarithmic regret," IEEE J. Sel. Areas Commun. on Advances in Cognitive Radio Networking for Communications, vol. 29, pp. 731-745, Mar. 2011.
12. S. H. A. Ahmad and M. Liu, "Multi-channel opportunistic access: A case of restless bandits with multiple plays," in Proc. 47th Annu. Allerton Conf. Commun., Control, Comput., Sep. 2009, pp. 1361-1368.
13. K. Liu and Q. Zhao, "Indexability of restless bandit problems and optimality ofWhittle index for dynamicmultichannel access," IEEE Trans. Inf. Theory, vol. 56, no. 11, pp. 5547-5567, Nov. 2010.
14. M. Lelarge, A. Proutiere, andM. S. Talebi, "Spectrum bandit optimization," in Proc. Inf. Theory Workshop (ITW), Sep. 2013, pp. 1-5.
15. M. Di Felice, K. R. Chowdhury, and L. Bononi, "Learning with the bandit: A cooperative spectrum selection scheme for cognitive radio networks," in Proc. IEEE Global Commun. Conf. (GLOBECOM), Dec. 2011, pp. 1-6.
16. P. Tehrani, Q. Zhao, and L. Tong, "Multi-channel opportunistic spectrum access in unslotted primary systems with unknown models," in Proc. IEEE Workshops CAMSAP, Dec. 2011, pp. 157-160.
17. P. Tehrani, K. Liu, and Q. Zhao, "Opportunistic spectrum access in unslotted primary systems," J. Franklin Inst., vol. 349, no. 3, pp. 985-1010, Apr. 2012.
18. D. Pollard, Convergence of Stochastic Processes. Berlin, Germany: Springer, 1984.