Channel probing for opportunistic access with multi-channel sensing

Conference Record - Asilomar Conference on Signals, Systems and Computers

Volumn , Issue , 2008, Pages 93-97

  Liu, Keqin ^a   Zhao, Qing ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Indexability; Multi channel opportunistic access; Restless multi armed bandit; Whittle's index

Indexed keywords

APPROXIMATION FACTOR; AVERAGE REWARD CRITERIA; CHANNEL SELECTION; CLOSED FORM; INDEPENDENT CHANNELS; INDEX POLICIES; INDEXABILITY; MULTI-CHANNEL; MULTI-CHANNEL OPPORTUNISTIC ACCESS; MYOPIC POLICY; OPPORTUNISTIC ACCESS; OPPORTUNISTIC COMMUNICATIONS; OPTIMAL PERFORMANCE; OPTIMAL SEQUENTIAL; RESTLESS MULTI-ARMED BANDIT; SIMPLE ALGORITHM; SIMULATION EXAMPLE; TIME VARYING; UPPER BOUND; WHITTLE'S INDEX; WHITTLE'S INDEX POLICY;

COMMUNICATION SYSTEMS;

OPTIMIZATION;

EID: 69449087995     PISSN: 10586393     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ACSSC.2008.5074369     Document Type: Conference Paper

References (18)

1. E. N. Gilbert, "Capacity of burst-noise channels," Bell Syst. Tech. J., vol. 39, pp. 1253-1265, Sept. 1960.
2. P. Whittle, "Restless bandits: Activity allocation in a changing world", in Journal of Applied Probability, Vol. 25, 1988.
3. C. H. Papadimitriou and J. N. Tsitsiklis, "The Complexity of Optimal Queueing Network Control," in Mathematics of Operations Research, Vol. 24, No. 2, May 1999, pp. 293-305.
4. R. R. Weber and G. Weiss, "On an Index Policy for Restless Bandits," in Journal of Applied Probability, Vol.27, No.3, pp. 637-648, Sep 1990.
5. P. S. Ansell, K. D. Glazebrook, J.E. Nio-Mora, and M. O'Keeffe, "Whittle's index policy for a multi-class queueing system with convex holding costs," in Math. Meth. Operat. Res. 57, 21-39, 2003.
6. K. D. Glazebrook, D. Ruiz-Hernandez, and C. Kirkbride, "Some Indexable Families of Restless Bandit Problems ," in Advances in Applied Probability, 38:643-672, 2006.
7. K. Liu and Q. Zhao, "A Restless Bandit Formulation of Opportunistic Access: Indexablity and Index Policy," in Proc. of the 5th IEEE Conference on Sensor, Mesh and Ad Hoc Communications and Networks (SECON) Workshops, June, 2008.
8. Q. Zhao, L. Tong, A. Swami, and Y. Chen, "Decentralized Cognitive MAC for Opportunistic Spectrum Access in Ad Hoc Networks: A POMDP Framework," in IEEE Journal on Selected Areas in Communications (JSAC): Special Issue on Adaptive, Spectrum Agile and Cognitive Wireles Networks , April 2007.
9. Y. Chen, Q. Zhao, and A. Swami, "Joint design and separation principle for opportunistic spectrum access in the presence of sensing errors," in IEEE Transactions on Information Theory, vol. 54, no. 5, pp. 2053-2071, May, 2008
10. Q. Zhao, B. Krishnamachari, and K. Liu, "On Myopic Sensing for Multi-Channel Opportunistic Access: Structure, Optimality, and Performance," to appear in IEEE Trans. Wireless Communications, Dec., 2008.
11. S. H. Ahmad, M. Liu, T. Javadi, Q. Zhao and B. Krishnamachari, "Optimality of Myopic Sensing in Multi-Channel Opportunistic Access," submitted to IEEE Transactions on Information Theory, May, 2008, available at http://arxiv.org/abs/0811.0637
12. J. Le Ny, M. Dahleh, E. Feron, "Multi-UAV Dynamic Routing with Partial Observations using Restless Bandit Allocation Indices,", in Proceedings of the 2008 American Control Conference, Seattle, WA, June 2008.
13. J. E. Nio-Mora, "Restless bandits, partial conservation laws and indexability," in Advances in Applied Probability, 33:7698, 2001.
14. S. Guha and K. Munagala, "Approximation algorithms for partialinformation based stochastic control with Markovian rewards," in Proc. 48th IEEE Symposium on Foundations of Computer Science (FOCS), 2007.
15. S. Guha, K. Munagala, "Approximation Algorithms for Restless Bandit Problems," http://arxiv.org/abs/0711.3861.
16. E. J. Sondik, " The Optimal Control at Partially Observable Markov Processes Over the Infinite Horizon: Discounted Costs," in Operations Research, Vol.26, No.2 (Mar. - Apr,. 1978), 282 - 304.
17. P. K. Dutta, "What do discounted optima converge to? A theory of discount rate asymptotics in economic models," in Journal of Economic Theory 55, pp. 6494, 1991.
18. K. Liu and Q. Zhao, "Indexability of Restless Bandit Problems and Optimality of Whittle's Index for Dynamic Multichannel Access," submitted to IEEE Transactions on Information Theory, November, 2008. Available at http://arxiv.org/abs/0810.4658.