The power of online learning in stochastic network optimization

Performance Evaluation Review

Volumn 42, Issue 1, 2014, Pages 153-166

  Huang, Longbo ^a   Liuy, Xin ^b   Hao, Xiaohong ^a  

^a TSINGHUA UNIVERSITY   (China)

^b MICROSOFT RESEARCH ASIA   (China)

Author keywords

[No Author keywords available]

Indexed keywords

OPTIMIZATION; STOCHASTIC SYSTEMS;

CONTROL TECHNIQUES; LEARNING PROCEDURES; LINEAR CONVERGENCE; PERFORMANCE GUARANTEES; STOCHASTIC NETWORK OPTIMIZATIONS; SYSTEM INFORMATION; SYSTEM STATISTICS; THEORY AND PRACTICE;

E-LEARNING;

EID: 84941100687     PISSN: 01635999     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2591971.2591984     Document Type: Conference Paper

References (27)

1. L. Georgiadis, M. J. Neely, and L. Tassiulas. Resource Allocation and Cross-Layer Control in Wireless Networks. Foundations and Trends in Networking Vol. 1, no. 1, pp. 1-144, 2006.
2. A. Eryilmaz and R. Srikant. Fair resource allocation in wireless networks using queue-length-based scheduling and congestion control. IEEE/ACM Trans. Netw., 15(6):1333-1344, 2007.
3. R. Urgaonkar and M. J. Neely. Opportunistic scheduling with reliability guarantees in cognitive radio networks. IEEE Transactions on Mobile Computing, 8(6):766-777, June 2009.
4. L. Huang, J. Walrand, and K. Ramchandran. Optimal smart grid tariff. Information Theory and Applications Workshop (ITA) (Invited), San Diego, Feb. 2012.
5. M. J. Neely, A. S. Tehrani, and A. G. Dimakis. Effficient algorithms for renewable energy allocation to delay tolerant consumers. Proceedings of IEEE SmartGridComm, Oct. 2010.
6. M. J. Neely R. Urgaonkar, B. Urgaonkar and A. Sivasubramaniam. Optimal power cost management using stored energy in data centers. Proceedings of ACM Sigmetrics, June 2011.
7. D. P. Bertsekas. Dynamic Programming and Optimal Control, Vols. I and II. Boston: Athena Scientific, 2005 and 2007.
8. M. J. Neely and L. Huang. Dynamic product assembly and inventory control for maximum profit. IEEE Conference on Decision and Control (CDC), Atlanta, Georgia, Dec. 2010.
9. J. G. Dai and W. Lin. Maximum pressure policies in stochastic processing networks. Operations Research, 53(2):197-218, March-April 2005.
10. L. Jiang and J. Walrand. Stable and utility-maximizing scheduling for stochastic processing networks. Allerton Conference on Communication, Control, and Computing, 2009.
11. P. Varaiya. The Max-Pressure Controller for Arbitrary Networks of Signalized Intersections. Advances in Dynamic Network Modeling in Complex 27 Transportation Systems, Complex Networks and Dynamic Systems 2, Springer Science+Business Media New York, 2013.
12. T. Le, P. Kovacs, N. Walton, H. L. Vu, L. Andrew, and S. Hoogendoorn. Decentralized signal control for urban road networks. ArXiv Technical Teport, arXiv:1310.0491v1, Oct. 2013.
13. S. H. Low and D. E. Lapsley. Optimization ow control-I: Basic algorithm and convergence. IEEE/ACM Transactions on Networking, 7(6):861-875, Dec. 1999.
14. M. Chiang, S. H. Low, A. R. Calderbank, and J. C. Doyle. Layering as optimization decomposition: A mathematical theory of network architectures. Proceedings of the IEEE, 95(1):255-312, January 2007.
15. L. Huang and M. J. Neely. The optimality of two prices: Maximizing revenue in a stochastic network. IEEE/ACM Transactions on Networking, 18(2):406-419, April 2010.
16. M. J. Neely. Super-fast delay tradeoffs for utility optimal fair scheduling in wireless networks. IEEE Journal on Selected Areas in Communications (JSAC), Special Issue on Nonlinear Optimization of Communication Systems, 24(8):1489-1501, Aug. 2006.
17. L. Huang and M. J. Neely. Delay reduction via Lagrange multipliers in stochastic network optimization. IEEE Trans. on Automatic Control, 56(4):842-857, April 2011.
18. L. Huang, S. Moeller, M. J. Neely, and B. Krishnamachari. LIFO-backpressure achieves near optimal utility-delay tradeoff. IEEE/ACM Transactions on Networking, 21(3):831-844, June 2013.
19. D. P. Bertsekas, A. Nedic, and A. E. Ozdaglar. Convex Analysis and Optimization. Boston: Athena Scientific, 2003.
20. Sean Meyn. Control Techniques for Complex Networks. Cambridge University Press, 2007.
21. M. J. Neely. Optimal energy and delay tradeoffs for multi-user wireless downlinks. IEEE Transactions on Information Theory, 53(9):3095-3113, Sept. 2007.
22. L. Ying, S. Shakkottai, and A. Reddy. On combining shortest-path and back-pressure routing over multihop wireless networks. Proceedings of IEEE INFOCOM, April 2009.
23. L. Bui, R. Srikant, and A. Stolyar. Novel architectures and algorithms for delay reduction in back-pressure scheduling and routing. Proceedings of IEEE INFOCOM Mini-Conference, April 2009.
24. L. Huang, X. Liu, and X. Hao. The power of online learning in stochastic network optimization. arXiv Technical Report, arXiv:1404.1592, 2014.
25. B. Li, A. Eryilmaz, and R. Li. Wireless scheduling for utility maximization with optimal convergence speed. Proceedings of IEEE INFOCOM, Turin, Italy, April 2013.
26. R. Durrett. Probability: Theory and Examples. Duxbury Press, 3rd edition, 2004.
27. F. Chung and L. Lu. Concentration inequalities and martingale inequalities - a survey. Internet Math., 3(2006-2007), 79-127.