Q-learning based energy management policies for a single sensor node with finite buffer

IEEE Wireless Communications Letters

Volumn 2, Issue 1, 2013, Pages 82-85

  Prabuchandran, K J ^a   Meena, Sunil Kumar ^a   Bhatnagar, Shalabh ^a  

^a INDIAN INSTITUTE OF SCIENCE   (India)

Author keywords

energy harvesting; energy management policies; Q learning; sensor networks

Indexed keywords

ENERGY HARVESTING; ENERGY MANAGEMENT; MARKOV PROCESSES; NETWORK PERFORMANCE; OPTIMIZATION; REINFORCEMENT LEARNING; SENSOR NETWORKS; SENSOR NODES;

CONVERSION FUNCTION; DISCOUNTED COSTS; HEURISTIC POLICIES; MANAGEMENT POLICY; MARKOV DECISION PROCESSES; OPTIMAL ENERGY; OPTIMAL POLICIES; Q-LEARNING;

LEARNING ALGORITHMS;

EID: 84874964078     PISSN: 21622337     EISSN: 21622345     Source Type: Journal    
DOI: 10.1109/WCL.2012.112012.120754     Document Type: Article

References (6)

1. V. Sharma, U. Mukherji, V. Joseph, and S. Gupta, "Optimal energy management policies for energy harvesting sensor nodes," IEEE TRans. Wireless Commun., vol. 9, no. 4, pp. 1326-1336, 2010.
2. K. Tutuncuoglu and A. Yener, "Optimum transmission policies for battery limited energy harvesting nodes," IEEE Trans. Wireless Commun., vol. 99, pp. 1-10, 2010.
3. O. Ozel, K. Tutuncuoglu, J. Yang, S. Ulukus, and A. Yener, "Transmission with energy harvesting nodes in fading wireless channels: optimal policies," IEEE J. Sel. Areas Commun., vol. 29, no. 8, pp. 1732-1743, 2011.
4. D. P. Bertsekas and J. N. Tsitsiklis, Neuro-Dynamic Programming. Athena Scientific, 1996.
5. Prabuchandran K. J., K. M. Sunil, and S. Bhatnagar, "Q-learning based energy management policies for a single sensor node with finite buffer," Technical Report IISC-CSA-SSL-TR 2012-4, Department of Computer Science, Indian Institute of Science. Available: http://stochastic.csa.iisc. ernet.in/www/research/files/IISc-CSA-SSL-TR-2012-4.pdf, Aug. 2012.
6. M. G. Azar, R. Munos, M. Ghavamzadeh, and H. J. Kappen, "Speedy Q-learning," in 2011 NIPS, pp. 2411-2419.