On optimality of monotone channel-aware transmission policies: A constrained markov decision process approach

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 3, Issue , 2007, Pages

  Ngo, Minh Hanh ^a   Krishnamurthy, Vikram ^a  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

Markov processes; Resource management; Stochastic optimal control

Indexed keywords

CARRIER COMMUNICATION; CHANNEL STATE INFORMATION; CONSTRAINT THEORY; DECISION MAKING; LAGRANGE MULTIPLIERS; MAPPING; WIRELESS NETWORKS;

OPTIMAL CHANNELAWARE TRANSMISSION; PACKET TRANSMISSION; RESOURCE MANAGEMENT; STOCHASTIC OPTIMAL CONTROL; TRANSMISSION ENERGY;

MARKOV PROCESSES;

EID: 34547538824     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2007.366756     Document Type: Conference Paper

References (11)

1. H. S. Wang and N. Moayeri, "Finite-state Markov channel - A useful model for radio communications channels," IEEE Trans. Vehicular Technology, vol. 44, no. 1, pp. 163-171, 1995.
2. A. Zhang and S. A. Kassam, "Finite-state Markov model for Rayleigh fading channels," IEEE Trans. Commun., vol. 47, pp. 1688-1692, November 1999.
3. F. J. Beutlerand K. W. Ross, "Optimal Policies for Controlled Markov Chains with a Constraint," Journal of Mathematical Analysis and Applications, vol. 112, pp. 236-252, 1985.
4. E. Altman, Constrained Markov Decision Processes, Chapman and Hall, London, 1999.
5. L. I. Sennott, "Average Cost Optimal Stationary Policies in Infinite State Markov Decision Processes with Unbounded Costs," Operations Research, vol. 37, no. 4, pp. 626-633, July-August 1989.
6. L. I. Sennott, "Value iteration in countable state average cost Markov Decision Processes with unbounded costs," Annals of Operations Research, vol. 28, pp. 261-272, 1991.
7. R. Cavazos-Cadena, "Undiscounted Value Iteration in Stable Markov Decision Chains with Bounded Rewards," Journal of Mathematical Systems, Estimation, and Control, vol. 6, no. 2, pp. 1-34, 1996.
8. D. M. Topkis, Supermodularity and Complementarity, Princeton University Press, 1998.
9. D.V. Djonin and V. Krishnamurthy, " MIMO Transmission Control in Fading Channels - A Constrained Markov Decision Process Formulation with Monotone Policies," IEEE Trans. Signal Proc., 2006, To appear.
10. P. Bremaud, Markov Chains: Gibbs Fields, Monte Carlo Simulation, and Queues, Springer-Verlag, 1999.
11. S. Ross, Introduction to Stochastic Dynamic Programming, Academic Press, San Diego, California., 1983.