Optimality of threshold policies for transmission scheduling in correlated fading channels

IEEE Transactions on Communications

Volumn 57, Issue 8, 2009, Pages 2474-2483

  Ngo, Minh Hanh ^a   Krishnamurthy, Vikram ^a  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

Cross layer optimization; Dynamic programming; Markov decision processes

Indexed keywords

BUFFER OCCUPANCY; CHANNEL AWARE; CORRELATED FADING; CORRELATED FADING CHANNELS; CROSS-LAYER OPTIMIZATION; DELAY CONSTRAINTS; FINITE NUMBER; LINK LAYERS; MARKOV DECISION PROCESSES; OPTIMAL SCHEDULING; OPTIMAL TRANSMISSION; OPTIMALITY; PACKET LOSS RATES; PENALTY COST; PERFECT CHANNEL STATE INFORMATION; POINT DATA; RETRANSMISSIONS; SUPERMODULARITY; THRESHOLD POLICIES; TRANSMISSION COSTS; TRANSMISSION SCHEDULING; TRANSMISSION TIME; TRANSMISSION TIME SLOTS; WIRELESS CHANNEL;

COMPUTATIONAL COMPLEXITY; DYNAMIC PROGRAMMING; FADING (RADIO); FADING CHANNELS; MARKOV PROCESSES; MOBILE TELECOMMUNICATION SYSTEMS; OPTIMIZATION; SCHEDULING; SYSTEMS ENGINEERING; WIRELESS TELECOMMUNICATION SYSTEMS;

LIGHT TRANSMISSION;

EID: 69549133698     PISSN: 00906778     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCOMM.2009.08.070350     Document Type: Article

References (17)

1. D. M. Topkis, Supermodularity and Complementarity. Princeton University Press, 1998.
2. H. S. Wang and N. Moayeri, "Finite-state Markov channel - a useful model for radio communications channels," IEEE Trans. Veh. Technol. vol. 44, no. 1, pp. 163-171, 1995.
3. A. Zhang and S. A. Kassam, "Finite-state Markov model for Rayleigh fading channels," IEEE Trans. Commun., vol. 47, pp. 1688-1692, Nov. 1999.
4. Y. Guan and L. Turner, "Generalised FSMC model for radio channels with correlated fading," IEE Proc. Commun., vol. 146, 1999, pp. 133-137.
5. J. Razavilar, K. J. R. Liu, and S. Marcus, "Jointly optimized bitrate/delay control policy for wireless packet networks with fading channels," IEEE Trans. Commun., vol. 50, pp. 484-494, Mar. 2002.
6. Q. Zhang and S. A. Kassam, "Hybrid ARQ with selective combining for video transmission over wireless channels," in Proc. International Conf. Image Processing, Oct. 1997, pp. 692-695.
7. C. Derman, G. Lieberman, and S. Ross, "Optimal system allocations with penalty cost," Management Science, vol. 23, no. 4, pp. 399-403, Dec. 1976.
8. S. Ross, Introduction to Stochastic Dynamic Programming. San Diego, CA: Academic Press, 1983.
9. L. Johnston and V. Krishnamurthy, "Opportunistic file transfer over a fading policies," IEEE Trans. Wireless Commun., vol. 5, no. 2, pp. 394-405, Feb. 2005.
10. H. Wang and N. B. Mandayam, "Opportunistic file transfer over a fading channel under energy and delay constraints," IEEE Trans. Commun., vol. 53, no. 4, pp. 632-644, Apr. 2005.
11. G. del Angel and T. L. Fine, "Optimal power and retransmission control policies for random access systems," IEEE/ACM Trans. Networking, vol. 12, no. 6, pp. 1156-1166, 2004.
12. D. Djonin and V. Krishnamurthy, "MIMO transmission control in fading channels - a constrained Markov decision process formulation with monotone randomized policies," IEEE Trans. Signal Processing, vol. 55, no. 10, pp. 5069-5083, Oct. 2007.
13. P. Bucciol, E. Masala, and J. D. Martin, "Perceptual ARQ for H.264 video streaming over 3G wireless networks," in Proc. ICC'04, June 2004, pp. 1288-1292.
14. M. H. Ngo and V. Krishnamurthy, "Monotonicity of constrained optimal transmission policies in correlated fading channels with ARQ," IEEE Trans. Signal Processing, 2009 (in press).
15. M. Puterman, Markov Decision Processes. John Wiley, 1994.
16. D. P. Heyman and M. J. Sobel, Stochastic Models in Operations Research. McGraw-Hill, 1984, vol. 2.
17. V. Krishnamurthy, M. Maskery, and M. H. Ngo, "Game Theoretic Activation and Transmission Scheduling in Unattended Ground Sensor Networks: A Correlated Equilibrium Approach," Wireless Sensor Networks: Signal Processing and Communications Perspectives. Wiley, 2007, pp. 349-388.