Decentralized learning for multi-player multi-armed bandits

Proceedings of the IEEE Conference on Decision and Control

Volumn , Issue , 2012, Pages 3960-3965

  Kalathil, Dileep ^a   Nayyar, Naumaan ^a   Jain, Rahul ^a  

^a University of Southern California ^*  (United States)

Author keywords

Distributed adaptive control; multi agent systems; multiarmed bandits; online learning

Indexed keywords

ADAPTIVE CONTROL SYSTEMS; COGNITIVE RADIO; E-LEARNING; LEARNING SYSTEMS; ONLINE SYSTEMS; RADIO SYSTEMS;

COGNITIVE RADIO NETWORK; CONTROL CHANNELS; DECENTRALIZED LEARNING; DISTRIBUTED ADAPTIVE CONTROL; MULTI ARMED BANDIT; ONLINE LEARNING; OPPORTUNISTIC SPECTRUM ACCESS; WIRELESS CHANNEL;

MULTI AGENT SYSTEMS;

EID: 84874251645     PISSN: 07431546     EISSN: 25762370     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2012.6426587     Document Type: Conference Paper

References (10)

1. T. Lai and H. Robbins, "Asymptotically efficient adaptive allocation rules," Advances in Applied Mathematics, vol. 6, no. 1, pp. 4-22, 1985.
2. V. Anantharam, P. Varaiya, and J. Walrand, "Asymptotically efficient allocation rules for the multi-armed bandit problem with multiple plays - part ii: Markovian rewards," IEEE Transactions on Automatic Control, vol. 32, no. 11, pp. 977-982, 1987.
3. R. Agrawal, "Sample mean based index policies with (O(log n)) regret for the multi-armed bandit problem," Advances in Applied Probability, Vol. 27, No. 4, pp. 1054-1078, 1995.
4. P. Auer, N. Cesa-Bianchi, and P. Fischer, "Finite-time analysis of the multiarmed bandit problem," Machine Learning, vol. 47, no. 2, pp. 235-256, 2002.
5. Y. Gai, B. Krishnamachari, and R. Jain, "Combinatorial network optimization with unknown variables: Multi-armed bandits with linear rewards and individual observations," IEEE/ACM Trans. on Networking, to appear, 2012.
6. K. Liu and Q. Zhao, "Distributed learning in multi-armed bandit with multiple players," IEEE Transactions on Signal Processing, vol. 58, pp. 5667-5681, November, 2010.
7. A. Anandkumar, N. Michael, A. Tang, and A. Swami, "Distributed algorithms for learning and cognitive medium access with logarithmic regret," IEEE JSAC on Advances in Cognitive Radio Networking and Communications, April, 2011.
8. D. P. Bertsekas, "Auction algorithms for network flow problems: A tutorial introduction," Computational Optimization and Applications, vol. 1, pp. 7-66, 1992.
9. D. Pollard, "Convergence of stochastic processes," Springer, 1984.
10. D. Kalathil, N. Nayyar, and R. Jain, "Decentralized learning for multi-player multi-armed bandits," Submitted, available at : http://arxiv.org/abs/1206.3582, June, 2012.