Energy sharing for multiple sensor nodes with finite buffers

IEEE Transactions on Communications

Volumn 63, Issue 5, 2015, Pages 1811-1823

  Padakandla, Sindhu ^a   Prabuchandran, K J ^a   Bhatnagar, Shalabh ^a  

^a INDIAN INSTITUTE OF SCIENCE   (India)

Author keywords

Energy harvesting sensor nodes; energy sharing; Markov decision process; Q learning; state aggregation

Indexed keywords

ALGORITHMS; BEHAVIORAL RESEARCH; DATA COMMUNICATION SYSTEMS; DATA TRANSFER; ENERGY HARVESTING; HEURISTIC ALGORITHMS; LEARNING ALGORITHMS; MARKOV PROCESSES; OPTIMIZATION; SENSOR NODES;

ENERGY SHARINGS; ENERGY-HARVESTING SENSOR NODES; MARKOV DECISION PROCESSES; Q-LEARNING; STATE AGGREGATION;

HEURISTIC METHODS;

EID: 84930508012     PISSN: 00906778     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCOMM.2015.2415777     Document Type: Article

References (34)

1. N. Gay and W. Fischer, "Ultra-low-power rfid-based sensor mote," in Proc. IEEE Sensors, 2010, pp. 1293-1298.
2. A. Lalitha, S. Mondal, V. Sharma, and S. Vinod, "Power-optimal scheduling for a green base station with delay constraints," in Proc. NCC, 2013, pp. 1-5.
3. Z. Ren, P. Cheng, J. Chen, L. Shi, and Y. Sun, "Optimal periodic sensor schedule for steady-state estimation under average transmission energy constraint," IEEE Trans. Autom. Control, vol. 58, no. 12, pp. 3265-3271, Dec. 2013.
4. Z. Ren, P. Cheng, J. Chen, L. Shi, and H. Zhang, "Dynamic sensor transmission power scheduling for remote state estimation," Automatica, vol. 50, no. 4, pp. 1235-1242, Apr. 2014.
5. K. Tutuncuoglu and A. Yener, "Short-term throughput maximization for battery limited energy harvesting nodes," in Proc. IEEE ICC, 2011, pp. 1-5.
6. O. Ozel, K. Tutuncuoglu, J. Yang, S. Ulukus, and A. Yener, "Transmission with energy harvesting nodes in fading wireless channels: Optimal policies," IEEE J. Sel. Areas Commun., vol. 29, no. 8, pp. 1732-1743, Sep. 2011.
7. V. Sharma, U. Mukherji, V. Joseph, and S. Gupta, "Optimal energy management policies for energy harvesting sensor nodes," IEEE Trans. Wireless Commun., vol. 9, no. 4, pp. 1326-1336, Apr. 2010.
8. K. J. Prabuchandran, S. K. Meena, and S. Bhatnagar, "Q-learning based energy management policies for a single sensor node with finite buffer," IEEE Wireless Commun. Lett., vol. 2, no. 1, pp. 82-85, Feb. 2013.
9. J. Yang and S. Ulukus, "Optimal packet scheduling in an energy harvesting communication system," IEEE Trans. Commun., vol. 60, no. 1, pp. 220-230, Jan. 2012.
10. J. Yang and S. Ulukus, "Optimal packet scheduling in a multiple access channel with energy harvesting transmitters," J. Commun. Netw., vol. 14, no. 2, pp. 140-150, Apr. 2012.
11. K. Tutuncuoglu and A. Yener, "Sum-rate optimal power policies for energy harvesting transmitters in an interference channel," J. Commun. Netw., vol. 14, no. 2, pp. 151-161, Apr. 2012.
12. Z. Ding, S. Perlaza, I. Esnaola, and H. Poor, "Power allocation strategies in energy harvesting wireless cooperative networks," IEEE Trans. Wireless Commun., vol. 13, no. 2, pp. 846-860, Feb. 2014.
13. B. Gurakan, O. Ozel, J. Yang, and S. Ulukus, "Energy cooperation in energy harvesting communications," IEEE Trans. Commun., vol. 61, no. 12, pp. 4884-4898, Dec. 2013.
14. K. Tutuncuoglu and A. Yener, "Cooperative energy harvesting communications with relaying and energy sharing," in Proc. IEEE ITW, 2013, pp. 1-5.
15. O. Ozel, J. Yang, and S. Ulukus, "Optimal broadcast scheduling for an energy harvesting rechargeable transmitter with a finite capacity battery," IEEE Trans. Wireless Commun., vol. 11, no. 6, pp. 2193-2203, Jun. 2012.
16. S. Padakandla, K. J. Prabuchandran, and S. Bhatnagar, "Energy sharing for multiple sensor nodes with finite buffers," Mar. 2015. [Online]. Available: http://arxiv.org/abs/1503.04964
17. D. P. Bertsekas, Dynamic Programming and Optimal Control. Belmont, MA, USA: Athena Scientific, 2013.
18. M. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming. Hoboken, NJ, USA: Wiley, 1994.
19. J. Yang and S. Ulukus, "Transmission completion time minimization in an energy harvesting system," in Proc. 44th Annu. CISS, 2010, pp. 1-6.
20. C. K. Ho and R. Zhang, "Optimal energy allocation for wireless communications powered by energy harvesters," in Proc IEEE ISIT, 2010, pp. 2368-2372.
21. O. Ozel, K. Tutuncuoglu, J. Yang, S. Ulukus, and A. Yener, "Adaptive transmission policies for energy harvesting wireless nodes in fading channels," in Proc. 45th Annu. CISS, 2011, pp. 1-6.
22. M. Goyal, A. Kumar, and V. Sharma, "Power constrained and delay optimal policies for scheduling transmission over a fading channel," in Proc. 22nd Annu. Joint Conf. IEEE INFOCOM, 2003, vol. 1, pp. 311-320.
23. J. N. Tsitsiklis and B. Van Roy, "Average cost temporal-difference learning," Automatica, vol. 35, no. 11, pp. 1799-1808, Nov. 1999.
24. J. Abounadi, D. Bertsekas, and V. S. Borkar, "Learning algorithms for markov decision processes with average cost," SIAM J. Control Optim., vol. 40, no. 3, pp. 681-698, 2001.
25. D. P. Bertsekas and J. N. Tsitsiklis, Neuro-Dynamic Programming. Belmont, MA, USA: Athena Scientific, 1996.
26. R. Rubinstein, "The cross-entropy method for combinatorial and continuous optimization," Methodol. Comput. Appl. Probab., vol. 1, no. 2, pp. 127-190, Sep. 1999.
27. S. Bhatnagar, R. S. Sutton, M. Ghavamzadeh, and M. Lee, "Natural actor-critic algorithms," Automatica, vol. 45, no. 11, pp. 2471-2482, Nov. 2009.
28. S. Bhatnagar, V. S. Borkar, and K. J. Prabuchandran, "Feature search in the grassmanian in online reinforcement learning," IEEE J. Sel. Topics Signal Process., vol. 7, no. 5, pp. 746-758, Oct. 2013.
29. R. S. Sutton and A. G. Barto, Introduction to Reinforcement Learning. Cambridge, MA, USA: MIT Press, 1998.
30. R. S. Sutton, D. A. McAllester, S. P. Singh, and Y. Mansour, "Policy gradient methods for reinforcement learning with function approximation," in Advances in Neural Information Processing Systems 12, S. Solla, T. Leen, and K. Müller, Eds. Cambridge, MA, USA: MIT Press, 2000, pp. 1057-1063.
31. I. Menache, S. Mannor, and N. Shimkin, "Basis function adaptation in temporal difference reinforcement learning," Ann. Oper. Res., vol. 134, no. 1, pp. 215-238, Feb. 2005.
32. L. Prashanth and S. Bhatnagar, "Threshold tuning using stochastic optimization for graded signal control," IEEE Trans. Veh. Technol., vol. 61, no. 9, pp. 3865-3880, Nov. 2012.
33. S. Bhatnagar, H. L. Prasad, and L. A. Prashanth, Stochastic Recursive Algorithms for Optimization, vol. 434, Lecture Notes in Control and Information Sciences. Berlin, Germany: Springer-Verlag, 2013.
34. V. R. Konda and J. N. Tsitsiklis, "On actor-critic algorithms," SIAM J. Control Optim., vol. 42, no. 4, pp. 1143-1166, 2003.