Decentralized delay optimal control for interference networks with limited renewable energy storage

IEEE Transactions on Signal Processing

Volumn 60, Issue 5, 2012, Pages 2552-2561

  Huang, Huang ^a   Lau, Vincent K N ^b  

^a HUAWEI TECHNOLOGIES CO LTD   (China)

^b HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

Author keywords

delay optimal control; interference networks; partially observed stochastic game; POMDP; Renewable energy

Indexed keywords

AC POWER; CHANNEL STATE; CONTROL ACTIONS; DECENTRALIZED POLICIES; DELAY MINIMIZATION; LAGRANGIAN MULTIPLIERS; LOCAL DATA; LOCAL ENERGY; LOCAL OPTIMAL SOLUTION; MODEL VARIATION; ONLINE LEARNING ALGORITHMS; OPTIMAL CONTROLS; PARTIALLY OBSERVABLE MARKOV DECISION PROCESS; POLICY GRADIENT; POMDP; RENEWABLE ENERGIES; RENEWABLE ENERGY SOURCE; STOCHASTIC GAME; TECHNICAL CONDITIONS; TRANSMISSION POWER; TWO DELAYS; UTILITY POWER;

CONTROL; NATURAL RESOURCES; RENEWABLE ENERGY RESOURCES; STOCHASTIC SYSTEMS;

LEARNING ALGORITHMS;

EID: 84859974253     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2012.2187284     Document Type: Article

References (29)

1. V. R. Cadambeww. and S. A. Jafar, "Interference alignment and degrees of freedom of the K-user interference channel," IEEE Trans. Inf. Theory, vol. 54, pp. 3425-3441, Aug. 2008.
2. T. Gou and S. Jafar, "Degrees of freedom of the K user M NMIMO interference channel," IEEE Trans. Inf. Theory, vol. 56, pp. 6040-6057, Dec. 2010.
3. S.W. Peters and J. R. W.Heath, "Cooperative algorithms forMIMOinterference channels," IEEE Trans. Veh. Technol., vol. 60, pp. 206-218, Jan. 2011.
4. K. S. Gomadam, V. R. Cadambe, and S. A. Jafar, "Approaching the capacity of wireless networks through distributed interference alignment," 2011 [Online]. Available: http://newport.eecs.uci.edu/ ~syed/papers/dist.pdf
5. G. Scutari, D. P. Palomar, and S. Barbarossa, "Competitive design of multiuserMIMOsystems based on game theory:Aunified view," IEEE J. Sel. Areas Commun., vol. 26, pp. 1089-1103, Sep. 2008.
6. G. Arslan, M. F. Demirkol, and Y. Song, "Equilibrium efficiency improvement inMIMOinterference systems:Adecentralized stream control approach," IEEE Trans.Wireless Commun., vol. 6, pp. 2984-2993, Aug. 2007. (Pubitemid 47295189)
7. V. K. N. Lau and Y. Chen, "Delay-optimal power and precoder adaptation for multi-stream MIMO systems," IEEE Trans. Wireless Commun., vol. 8, pp. 3104-3111, Jun. 2009.
8. D. Hui and V. K. N. Lau, "Cross-layer design for OFDMA wireless systems with heterogeneous delay requirements," IEEE Trans. Wireless Commun., vol. 6, pp. 2872-2880, Aug. 2007. (Pubitemid 47295178)
9. I. Bettesh and S. Shamai, "Optimal power and rate control for minimal average delay: The signal-user case," IEEE Trans. Inf. Theory, vol. 52, pp. 4115-4141, Sep. 2006. (Pubitemid 44363837)
10. X. R. Cao, Stochastic Learning and Optimization: A Sensitivity-Based Approach. New York: Springer, 2007.
11. D. Niyato, E. Hossain, M. M. Rashid, and V. K. Bhargava, "Wireless sensor networks with energy harvesting technologies: A game-theoretic approach to optimal energy management," IEEE Trans. Wireless Commun., vol. 14, pp. 90-96, Aug. 2007. (Pubitemid 47397738)
12. D. Niyato, E. Hossain, and A. Fallahi, "Sleep and wakeup strategies in solar-powered wireless sensor/mesh networks: Performance analysis and optimization," IEEE Trans. Mobile Comput., vol. 6, pp. 221-236, Feb. 2007. (Pubitemid 46113488)
13. L. Huang and M. J. Neely, "Utility optimal scheduling in energy harvesting networks," [Online]. Available: http://arxiv.org/abs/1012.1945
14. V. Sharma, U. Mukherji, V. Joseph, and S. Gupta, "Optimal energy management policieis for energy harvesting sensor nodes," IEEE Trans. Autom. Control, vol. 9, pp. 1326-1336, Apr. 2010.
15. J. Gozalvez, "Green radio technologies," IEEE Veh. Technol.Mag., pp. 9-14, Mar. 2010.
16. D. Steward, G. Saur, M. Penev, and T. Ramsden, "Lifecycle cost analysis of hydrogen versus other technologies for electrical energy storage," Tech. Rep. NREL/TP-560-46719, Nov. 2009.
17. J. Baxter, P. L. Bartlett, and L. Weaver, "Experiments with infinitehorizon, policy-gradient estimation," J. Artif. Intell. Res., vol. 15, pp. 351-381, Nov. 2001.
18. Z. Han, Z. Ji, and K. J. R. Liu, "Non-cooperative resource competition game by virtual referee in multi-cell OFDMA networks," IEEE J. Sel. Areas Commun., vol. 25, pp. 1079-1090, Aug. 2007. (Pubitemid 47171199)
19. L. Jorguseski, R. Litjens, J. Oostveen, and H. Zhang, "Energy saving in wireless access networks," in Towards Green ICT, ser. River Publishers Series in Communications. Aalborg, Denmark: River Publishers, 2010.
20. P. Marbach and J. N. Tsitsiklis, "Simulation-based optimization of Markov reward processes," IEEE Trans. Wireless Commun., vol. 46, pp. 191-209, Feb. 2001. (Pubitemid 32259323)
21. N. Tao, J. Baxter, and L. Weaver, "A multi-agent policy-gradient approach to network routing," in Proc. 18th Int. Conf. Mach. Learn., Jun. 2001, pp. 553-560.
22. O. Buffet, A. Dutech, and F. Charpillet, "Shaping multi-agent systems with gradient reinforcement learning," Autonomous Agents and Multi- Agent Syst., vol. 15, pp. 197-220, Jan. 2007.
23. D. P. Bertsekas, Nonlinear Programming. Belmont, MA: Athena Scientic, 1999.
24. N.Meuleau, K. E. Kim,L. P.Kaelbling, andA. R. Cassandra, "Solving POMDPs by searching the space of finite policies," in Proc. 15th Conf. Uncertainty AI, 1999, pp. 417-426.
25. H. Huang and V. K. N. Lau, "Decentralized delay optimal control for interference networks with limited renewable energy storage," 2012 [Online]. Available: http://arxiv.org/abs/1202.2113
26. D. Palomar andM. Chiang, "Alternative distributed algorithms for network utility maximization: Framework and applications," IEEE Trans. Autom. Control, vol. 52, pp. 2254-2269, Dec. 2007.
27. V. S. Borkar, Stochastic Approximation: A Dynamical Systems Viewpoint. Cambridge, U.K.: Cambridge Univ. Press, 2008.
28. Guidelines for Evaluation of Radio Transmission Technologies for IMT-2000, Recommendation ITU-R M.1225, 1997.
29. O. Arnold, F. Richter, G. Fettweis, and O. Blume, "Power consumption modeling of different base station types in heterogeneous cellular networks," in Proc. Future Network and MobileSummit 2010 Conf., 2010.