Transmission control in cognitive radio as a Markovian dynamic game: Structural result on randomized threshold policies

IEEE Transactions on Communications

Volumn 58, Issue 1, 2010, Pages 301-310

  Huang, Jane Wei ^a   Krishnamurthy, Vikram ^a  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

Cognitive radio; General sum Markovian dynamic game; Nash equilibrium; Randomized threshold policies; Switching control game

Indexed keywords

COGNITIVE RADIO; MARKOVIAN DYNAMICS; NASH EQUILIBRIUM; SWITCHING CONTROL; THRESHOLD POLICIES;

AD HOC NETWORKS; APPROXIMATION ALGORITHMS; APPROXIMATION THEORY; FADING (RADIO); FADING CHANNELS; MARKOV PROCESSES; RADIO BROADCASTING; RADIO SYSTEMS; SWITCHING SYSTEMS; TIME DIVISION MULTIPLE ACCESS;

RADIO;

EID: 76649108247     PISSN: 00906778     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCOMM.2010.01.080157     Document Type: Article

References (26)

1. J. W. Huang and V. Krishnamurthy, "Transmission control in cognitive radio systems with latency constraints as a switching control dynamic game," in Proc. IEEE CDC, Dec. 2008, pp. 3823-3828.
2. J. Mitola III, "Cognitive radio for flexible mobile multimedia communications," in Proc. IEEE International Workshop Mobile Multimedia Commun., 1999, pp. 3-10.
3. S. Haykin, "Cognitive radio: brain-empowered wireless communications," IEEE J. Sel. Areas Commun., vol.23, no.2, pp. 201-220, Feb. 2005.
4. V. K. Bhargava and E. Hossain, Cognitive Wireless Communication Networks. New York: Springer-Verlag, 2007.
5. A. G. Marques, W. Xin, and G. B. Giannakis, "Optimal stochastic dual resource allocation for cognitive radios based on quantized CSI," in Proc. IEEE ICASSP, Apr. 2008, pp. 2801-2804.
6. Q. Shao, L. Tong, A. Swami, and Y. Chen, "Decentralized cognitive MAC for opportunistic spectrum acess in ad hoc networks: a POMDP framework," IEEE J. Sel. Areas Commun., vol.25, no.3, pp. 589-600, Apr. 2007.
7. N. Nie and C. Comaniciu, "Adaptive channel allocation spectrum etiquette for cognitive radio networks," in Proc. IEEE International Symp. DySPAN, Nov. 2005, pp. 269-278.
8. M. Felegyhazi, M. Cagalj, S. S. Bidokhti, and J. Hubaux, "Noncooperative multi-radio channel allocation in wireless networks," in Proc. IEEE INFOCOM, May 2007, pp. 1442-1450.
9. IEEE Standard for Local and Metropolitan Area Networks, Part 16: Air Interface for Fixed Broadband Wireless Access Systems, IEEE std 802.16-2004, 2004.
10. S. R. Mohan and T. E. S. Raghavan, "An algorithm for discounted switching control stochastic games," OR Spektrum, vol.55, no.10, pp. 5069-5083, Oct. 2007.
11. J. A. Filar and K. Vrieze, Competitive Markov Decision Processes. New York: Springer-Verlag, 1997.
12. O. J. Vrieze, S. H. Tijs, T. E. S. Raghavan, and J. A. Filar, "A finite algorithm for the switching control stochastic game," OR Spektrum, vol.5, no.1, pp. 15-24, Mar. 1983.
13. E. Altman, Constrained Markov Decision Processes. London: Chapman and Hall, 1999.
14. K. Kar and L. Tassiulas, "Layered multicast rate control based on Lagrangian relaxation and dynamic programming ," IEEE J. Sel. Areas Commun., vol.24, no.8, pp. 1464-1474, Aug. 2006.
15. A. Farrokh and V. Krishnamurthy, "Opportunistic scheduling for streaming users in HSDPA multimedia systems," IEEE Trans. Multimedia Syst., vol.8, no.4, pp. 844-855, Aug. 2006.
16. D. Djonin and V. Krishnamurthy, "MIMO transmission control in fading channels-a constrained Markov decision process formulation with monotone randomized policies," IEEE Trans. Signal Process., vol.55, no.10, pp. 5069-5083, Oct. 2007. (Pubitemid 47534670)
17. S. T. Chung and A. J. Goldsmith, "Degrees of freedom in adaptive modulation: a unified view," IEEE Trans. Commun., vol.49, no.9, pp. 1561-1571, Sep. 2001.
18. V. Krishnamurthy, F. Vazquez Abad, and K. Martin, "Implementation of gradient estimation to a constrained Markov decision problem," in Proc. 42nd IEEE Conf. Decision Control, pp. 4841-4846, 2003.
19. H. J. Kushner and D. S. Clark, Stochastic Approximation Methods for Constrained and Unconstrained Systems. New York: Springer-Verlag, 1978.
20. J. C. Spall, Introduction to Stochastic Search and Optimization: Estimation, Simulation and Control. Wiley-Interscience, 2003.
21. H. J. Kushner and G. Yin, Stochastic Approximation and Recursive Algorithms and Applications. New York: Springer-Verlag, 2003.
22. M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming. New York: John Wiley & Sons, 1994.
23. F. J. Beutler and K. W. Ross, "Optimal policies for controlled Markov chains with a constraint," J. Mathematical Analysis Appl., vol.112, pp. 236-252, Nov. 1985.
24. M. Ngo and V. Krishnamurthy, "Monotonicity of constrained optimal transmission policies in correlated fading channels with ARQ," IEEE Trans. Signal Process., 2009.
25. A . Farrokh, V. Krishnamurthy, and R. Schober, "Optimal adaptive modulation and coding with switching costs," IEEE Trans. Commun., vol.57, no.3, pp. 697-706, Mar. 2009.
26. J. Huang and V. Krishnamurthy, "Game theoretic issues in cognitive radio systems," J. Commun., invited paper, 2009.