Near-optimal reinforcement learning framework for energy-aware sensor communications

IEEE Journal on Selected Areas in Communications

Volumn 23, Issue 4, 2005, Pages 788-797

  Pandana, Charles ^a   Liu, K J Ray ^a  

^a UNIVERSITY OF MARYLAND   (United States)

Author keywords

Energy aware sensor communications; Markov decision process (MDP); Reinforcement learning (RL)

Indexed keywords

COMMUNICATION CHANNELS (INFORMATION THEORY); DECISION THEORY; LEARNING AIDS FOR HANDICAPPED PERSONS; LEARNING ALGORITHMS; MARKOV PROCESSES; MODULATION; PACKET NETWORKS; SIGNAL INTERFERENCE; TELECOMMUNICATION TRAFFIC;

ENERGY AWARE SENSOR COMMUNICATIONS; MARKOV DECISION PROCESS (MDP); REINFORCED LEARNING (RL); SIGNAL TO INTERFERENCE RATIO (SIR);

SENSORS;

EID: 17144410312     PISSN: 07338716     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSAC.2005.843547     Document Type: Article

References (16)

1. "10 emerging technologies that will change the world," Technology Review, Feb. 2003.
2. W. Stark, H. Wang, A. Worthen, S. Lafortune, and D. Teneketzis, "Low-energy wireless communication network design," IEEE Wireless Commun., vol. 9, no. 4, pp. 60-72, Aug. 2002.
3. A. J. Goldsmith and S. B. Wicker, "Design challenges for energy-constrained ad hoc wireless networks," IEEE Wireless Commun., vol. 9, no. 4, pp. 8-27, Aug. 2002.
4. A. Ephremides, "Energy concerns in wireless networks," IEEE Wireless Commun., vol. 9, no. 4, pp. 48-59, Aug. 2002.
5. N. Bambos and S. Kandukuri, "Power controlled multiple access (PCMA) in wireless communication networks," in Proc. IEEE INFOCOM, 2000, pp. 386-395.
6. _, "Multimodal dynamic multiple access (MDMA) in wireless packet networks," in Proc. IEEE INFOCOM, 2001, pp. 198-208.
7. T. Holliday, A. Goldsmith, and P. Glynn, "Wireless link adaptation policies: QoS for deadline constrained traffic with imperfect channel estimates," in Proc. IEEE ICC, Apr. 2001, pp. 3366-3371.
8. J. Razavilar, K. J. R. Liu, and S. I. Marcus, "Jointly optimized bit-rate/delay control policy for wireless packet networks with fading channels," IEEE Trans. Commun., vol. 50, no. 3, pp. 484-494, Mar. 2002.
9. D. Bertsekas, Dynamic Programming and Optimal Control, 2nd ed. Belmont, MA: Athena Scientific, 2000, vol. 1 and 2.
10. C. G. Cassandras and S. Lafortune, Introduction to Discrete Event Systems. Norwell, MA: Kluwer, 1999.
11. M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming. New York: Wiley, 1994, Series in probability and mathematical statistics.
12. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press, 1998.
13. C. U. Saraydar, N. B. Mandayam, and D. J. Goodman, "Efficient power control via pricing in wireless data networks," IEEE Trans. Commun., vol. 50, no. 2, pp. 291-303, Feb. 2002.
14. H. S. Wang and N. Maoyeri, "Finite-state Markov channel-A useful model for radio communication channels," IEEE Trans. Veh. Technol., vol. 44, no. 1, pp. 163-171, Feb. 1995.
15. Q. Zhang and S. A. Kassam, "Finite-state Markov model for Rayleigh fading channels," IEEE Trans. Commun., vol. 47, no. 11, pp. 1688-1692, Nov. 1999.
16. D. J. Goodman and N. B. Mandayam, "Power control for wireless data," IEEE Pers. Commun. Mag., vol. 7, no. 2, pp. 48-54, Apr. 2000.