Dynamic multichannel access with imperfect channel state detection

IEEE Transactions on Signal Processing

Volumn 58, Issue 5, 2010, Pages 2795-2808

  Liu, Keqin ^a   Zhao, Qing ^a   Krishnamachari, Bhaskar ^b  

^a University of California   (United States)

^b University of Southern California ^*  (United States)

Author keywords

Cognitive radio; Dynamic multichannel access; Myopic policy; Restless multi armed bandit

Indexed keywords

APPROXIMATION FACTOR; CHANNEL STATE; CLOSED FORM; COGNITIVE RADIO; FALSE ALARM PROBABILITY; GILBERT-ELLIOT CHANNEL; LOWER AND UPPER BOUNDS; MARKOVIAN MODEL; MULTI-CHANNEL; MYOPIC POLICY; OPPORTUNISTIC COMMUNICATIONS; OPPORTUNISTIC SYSTEMS; OPTIMAL PERFORMANCE; OPTIMALITY; RESTLESS MULTI-ARMED BANDIT; SCALING BEHAVIOR; SIMPLE STRUCTURES; TWO CHANNEL; WORST-CASE PERFORMANCE;

DETECTORS; ERRORS; MARKOV PROCESSES; RADIO;

PACKET SWITCHING;

EID: 77951183517     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2010.2041600     Document Type: Article

References (28)

1. E. N. Gilbert, "Capacity of burst-noise channels," Bell Syst. Tech. J., vol.39, pp. 1253-1265, Sep. 1960.
2. M. Zorzi, R. Rao, and L. Milstein, "Error statistics in data transmission over fading channels," IEEE Trans. Commun., vol.46, pp. 1468-1477, Nov. 1998.
3. L. A. Johnston and V. Krishnamurthy, "Opportunistic file transfer over a fading channel: A POMDP search theory formulation with optimal threshold policies," IEEE Trans. Wireless Commun., vol.5, no.2, pp. 394-405, Feb. 2006.
4. Q. Zhao and B. Sadler, "A survey of dynamic spectrum access," IEEE Signal Process. Mag., vol.24, pp. 79-89, May 2007.
5. S. D. Jones, N. Merheb, and I.-J. Wang, "An experiment for sensing based opportunistic spectrum access in CSMA/CA networks," in Proc. 1st IEEE Int. Symp. New Frontiers Dynamic Spectrum Access Networks, Nov. 2005, pp. 593-596.
6. S. Geirhofer, L. Tong, and B. Sadler, "Dynamic spectrum access in the time domain: Modeling and exploiting white space," IEEE Commun. Mag., vol.45, no.5, pp. 66-72, May 2007.
7. D. Dalta, "Spectrum surveying for dynamic spectrum access networks," M.S. thesis, Univ. of Kansas, Lawrence, KS, Jan. 2007.
8. Q. Zhao, L. Tong, A. Swami, and Y. Chen, "Decentralized cognitive MAC for opportunistic spectrum access in Ad Hoc networks: A POMDP framework," IEEE J. Sel. Areas Commun., vol.25, no.3, pp. 589-600, Apr. 2007.
9. C. H. Papadimitriou and J. N. Tsitsiklis, "The complexity of optimal queueing network control," Math. Oper. Res., vol.24, no.2, pp. 293-305, May 1999.
10. Q. Zhao, B. Krishnamachari, and K. Liu, "On myopic sensing for multichannel opportunistic access: Structure, optimality, and performance," IEEE Trans. Wireless Commun., vol.7, no.12, pp. 5431-5440, Dec. 2008.
11. Y. Chen, Q. Zhao, and A. Swami, "Joint design and separation principle for opportunistic spectrum access in the presence of sensing errors," IEEE Trans. Inf. Theory, vol.54, no.5, pp. 2053-2071, May 2008.
12. R. Smallwood and E. Sondik, "The optimal control of partially ovservable Markov processes over a finite horizon," Oper. Res., pp. 1071-1088, 1971.
13. S. H. Ahmad, M. Liu, T. Javadi, Q. Zhao, and B. Krishnamachari, "Optimality of myopic sensing in multi-channel opportunistic access," IEEE Trans. Inf. Theory, vol.55, no.9, pp. 4040-4050, Sep. 2009.
14. Q. C. Zhao, S. Geirhofer, L. Tong, and B. M. Sadler, "Opportunistic spectrum access via periodic channel sensing," IEEE Trans. Signal Process., vol.56, no.2, pp. 785-796, Feb. 2008.
15. L. Gao and S. Cui, "Power and rate control in cognitive radio networks via dynamic programming," IEEE Trans. Veh. Technol., vol.58, no.9, pp. 4819-4827, Nov. 2009.
16. S. Filippi, O. Cappé, F. Clérot, and E. Moulines, "A near optimal policy for channel allocation in cognitive radio," Recent Adv. Reinforce. Learn., vol.5323, pp. 69-81, Nov. 27, 2008.
17. M. Hoyhtya, S. Pollin, and A. Mammela, "Performance improvement with predictive channel selection for cognitive radios," in Proc. 1st Int. Workshop Cognitive Radio Advanced Spectrum Management, Feb. 2008, pp. 1-5.
18. S. Huang, X. Liu, and Z. Ding, "Optimal transmission strategies for dynamic spectrum access in cognitive radio networks," IEEE Trans. Mobile Comput., vol.8, no.12, pp. 1636-1648, Dec. 2009.
19. J. Unnikrishnan and V. Veeravalli, "Algorithms for dynamic spectrum access with learning for cognitive radio," IEEE Trans. Signal Process., vol.58, no.2, pp. 750-760, Feb. 2010.
20. J. C. Gittins, "Bandit processes and dynamic allocation indices," J. Roy. Stat. Soc., ser. B, vol.41, pp. 148-177, 1979.
21. P. Whittle, "Restless bandits: Activity allocation in a changing world," J. Appl. Probab., vol.25, pp. 287-298, 1988.
22. R. R.Weber and G.Weiss, "On an index policy for restless bandits," J. Appl. Probab., vol.27, pp. 637-648, 1990.
23. J. E. Niño-Mora, "Restless bandits, partial conservation laws and indexability," Adv. Appl. Probab., vol.33, pp. 76-98, 2001.
24. K. Liu and Q. Zhao, "A restless bandit formulation of opportunistic access: Indexability and index policy," in Proc. 5th IEEE Conf. Sensor, Mesh Ad Hoc Communications Networks (SECON) Workshops, Jun. 2008.
25. K. Liu and Q. Zhao, "Channel probing for opportunistic access with multi-channel sensing," in Proc. IEEE Asilomar Conf. Signals, Systems, Computers, Oct. 2008.
26. K. Liu and Q. Zhao, "Indexability of restless bandit problems and optimality of Whittle's index for dynamic multichannel access," arXiv 2008 [Online]. Available: http://arxiv.org/abs/0810.4658
27. J. Le Ny, M. Dahleh, and E. Feron, "Multi-UAV dynamic routing with partial observations using restless bandit allocation indices," presented at the 2008 Amer. Control Conf. Seattle, WA, Jun. 2008.
28. X. Xiao, K. Liu, and Q. Zhao, "Opportunistic spectrum access in self similar primary traffic," EURASIP J. Adv. Signal Process. (Special Issue on Dynamic Spectrum Access for Wireless Networking).