Multi-armed bandits with application to 5G small cells

IEEE Wireless Communications

Volumn 23, Issue 3, 2016, Pages 64-73

  Maghsudi, Setareh ^a   Hossain, Ekram ^a  

^a UNIVERSITY OF MANITOBA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ENERGY EFFICIENCY; MOBILE TELECOMMUNICATION SYSTEMS; WIRELESS NETWORKS;

DEVICE-TO-DEVICE COMMUNICATIONS; DISTRIBUTED IMPLEMENTATION; FUTURE RESEARCH DIRECTIONS; MULTI ARMED BANDIT; NEXT-GENERATION WIRELESS NETWORK; PERSONALIZED MOBILE SERVICES; RESOURCE ALLOCATION PROBLEM; WIRELESS RESOURCES;

NEXT GENERATION NETWORKS;

EID: 84977071217     PISSN: 15361284     EISSN: None     Source Type: Journal    
DOI: 10.1109/MWC.2016.7498076     Document Type: Article

References (19)

1. H. Robbins, "Some Aspects of the Sequential Design of Experiments," Bulletin of the American Mathematical Society, vol. 58, no. 5, 1952, pp. 527-35.
2. H. Liu, K. Liu, and Q. Zhao, "Learning in a Changing World: Restless Multiarmed Bandit with Unknown Dynamics," IEEE Trans. Info. Theory, vol. 59, no. 3, Mar. 2013., pp. 1902-16
3. J. Gittins, K. Glazebrook, and R. Weber, Multi-Armed Bandit Allocation Indices, Wiley, 2nd ed., 2011.
4. S. Guha, K. Munagala, and P. Shi, "Approximation Algorithms for Restless Bandit Problems," J. ACM, vol. 58, no. 1, 2010, pp. 3.
5. D. Bertsimas and J. Nino-Mora, "Restless Bandits, Linear Programming Relaxations, and a Primal-Dual Index Heuristic," Operations Research, vol. 48, no. 1, 2000, p. 2000.
6. S. Bubeck and N. Cesa-Bianchi, "Regret Analysis of Stochastic and Nonstochastic Multi-Armed Bandit Problems," Foundations and Trends in Machine Learning, vol. 5, no. 1, 2012, pp. 1-122.
7. D. Chakrabarti et al., "Mortal Multiarmed Bandits," Proc. Neural Info. Processing Sys. Conf., 2008, pp. 273-80.
8. R.D. Kleinberg, A. Niculescu-mizil, and Y. Sharma, "Regret Bounds for Sleeping Experts and Bandits," Proc. Conf. Learning Theory, 2008, pp. 425-36.
9. N. Cesa-Bianchi and G. Lugosi, Prediction, Learning, and Games, Cambridge Univ. Press, 2006.
10. S. Maghsudi and S. Stanczak, "Joint Channel Selection and Power Control in Infrastructureless Wireless Networks: A Multi-Player Multiarmed Bandit Framework," IEEE Trans. Vehic. Tech., vol. PP, 2014.
11. S. Maghsudi and S. Stanczak, "Channel Selection for Network-Assisted D2D Communication via No-Regret Bandit Learning with Calibrated Forecasting," IEEE Trans. Wireless Commun., vol. 14, no. 3, Mar. 2015, pp. 1309-22.
12. A.C. Chapman et al., "Convergent Learning Algorithms for Unknown Reward Games," SIAM J. Control and Optimization, vol. 51, no. 4, 2013, pp. 3154-80.
13. Y. Chen et al., "Transmission Scheduling for Sensor Network Lifetime Maximization: A Shortest Path Bandit Formulation," Proc. IEEE Int'l. Conf. Acoustics, Speech and Signal Processing, May 2006, vol. 4, pp. IV-IV.
14. S. Maghsudi and S. Stanczak, "Transmission Mode Selection for Network-Assisted Device to Device Communication: A Levy-Bandit Approach," Proc. IEEE Int'l. Conf. Acoustics, Speech and Signal Processing, May 2014, pp. 7009-13.
15. P. Blasco and D. Gunduz, "Multi-Access Communications with Energy Harvesting: A Multi-Armed Bandit Model and the Optimality of the Myopic Policy," IEEE JSAC, vol. 33, no. 3, March 2015, pp. 585-97.
16. R. Kleinberg and B. Awerbuch, "Online Linear Optimization and Adaptive Routing," Elsevier J. Computer and System Sciences, vol. 74, 2008, pp. 97-104.
17. Q. Wang et al., "Towards Optimal Adaptive UFH-Based Anti-Jamming Wireless Communication," IEEE JSAC, vol. 30, no. 1, Jan. 2012, pp. 16-30.
18. E. Hossain et al., "Evolution toward 5G Multi-Tier Cellular Wireless Networks: An Interference Management Perspective," IEEE Wireless Commun., vol. 21, no. 3, June 2014, pp. 118-27.
19. T. Uchiya, A. Nakamura, and M. Kudo, "Algorithms for Adversarial Bandit Problems with Multiple Plays," Algorithmic Learning Theory, Oct 2010, pp. 375-89.