Learn-and-Adapt Stochastic Dual Gradients for Network Resource Allocation

IEEE Transactions on Control of Network Systems

Volumn 5, Issue 4, 2018, Pages 1941-1951

  Chen, Tianyi ^a   Ling, Qing ^b   Giannakis, Georgios B ^a  

^a University of Minnesota   (United States)

^b SUN YAT SEN UNIVERSITY   (China)

Author keywords

First order method; network resource allocation; statistical learning; stochastic approximation

Indexed keywords

BANDWIDTH; CLOUD COMPUTING; CONTROL SYSTEMS; DISTRIBUTED COMPUTER SYSTEMS; ITERATIVE METHODS; OPTIMIZATION; RESOURCE ALLOCATION; STOCHASTIC CONTROL SYSTEMS; STOCHASTIC SYSTEMS;

FIRST ORDER METHOD; NETWORK RESOURCE ALLOCATIONS; RESOURCE MANAGEMENT; STATISTICAL LEARNING; STOCHASTIC APPROXIMATIONS;

LAGRANGE MULTIPLIERS;

EID: 85035130827     PISSN: None     EISSN: 23255870     Source Type: Journal    
DOI: 10.1109/TCNS.2017.2774043     Document Type: Article

References (33)

1. L. Tassiulas and A. Ephremides, "Stability properties of constrained queueing systems and scheduling policies for maximum throughput in multihop radio networks," IEEE Trans. Autom. Control, vol. 37, no. 12, pp. 1936-1948, Dec. 1992.
2. S. H. Low and D. E. Lapsley, "Optimization flow control-I: Basic algorithm and convergence," IEEE/ACM Trans. Netw., vol. 7, no. 6, pp. 861- 874, Dec. 1999.
3. L. Georgiadis,M. Neely, and L. Tassiulas, "Resource allocation and crosslayer control inwireless networks," Found. Trends Netw., vol. 1, pp. 1-144, 2006.
4. M. J. Neely, "Stochastic network optimization with application to communication and queueing systems," Synthesis Lectures Commun. Netw., vol. 3, no. 1, pp. 1-211, 2010.
5. T. Chen, X. Wang, and G. B. Giannakis, "Cooling-aware energy and workload management in data centers via stochastic optimization," IEEE J. Sel. Topics Signal Process., vol. 10, no. 2, pp. 402-415, Mar. 2016.
6. T. Chen, Y. Zhang, X. Wang, and G. B. Giannakis, "Robust workload and energy management for sustainable data centers," IEEE J. Sel. Areas Commun., vol. 34, no. 3, pp. 651-664, Mar. 2016.
7. J.Gregoire,X.Qian, E. Frazzoli, A. de La Fortelle, and T.Wongpiromsarn, "Capacity-aware backpressure traffic signal control," IEEE Trans. Control Netw. Syst., vol. 2, no. 2, pp. 164-173, Jun. 2015.
8. S. Sun, M. Dong, and B. Liang, "Distributed real-time power balancing in renewable-integrated power grids with storage and flexible loads," IEEE Trans. Smart Grid, vol. 7, no. 5, pp. 2337-2349, Sep. 2016.
9. A. Beck, A. Nedic, A. Ozdaglar, and M. Teboulle, "An O(1/k) gradient method for network resource allocation problems," IEEE Trans. Control Netw. Syst., vol. 1, no. 1, pp. 64-73, Mar. 2014.
10. J. Liu, A. Eryilmaz, N. B. Shroff, and E. S. Bentley, "Heavy-ball: A new approach to tame delay and convergence in wireless network optimization," in Proc. IEEE INFOCOM, San Francisco, CA, USA, Apr. 2016, pp. 1-9.
11. E.Wei, A. Ozdaglar, and A. Jadbabaie, "A distributed Newton method for network utility maximization-I: Algorithm," IEEE Trans. Autom. Control, vol. 58, no. 9, pp. 2162-2175, Sep. 2013.
12. M. Zargham, A. Ribeiro, and A. Jadbabaie, "Accelerated backpressure algorithm," Feb. 2013. [Online].Available https://arxiv.org/abs/1302.1475
13. K. Yuan, B. Ying, and A. H. Sayed, "On the influence of momentum acceleration on online learning," J. Mach. Learning Res., vol. 17, no. 192, pp. 1-66, 2016.
14. L. Huang and M. J. Neely, "Delay reduction via Lagrange multipliers in stochastic network optimization," IEEE Trans. Autom. Control, vol. 56, no. 4, pp. 842-857, Apr. 2011.
15. L. Huang, X. Liu, and X. Hao, "The power of online learning in stochastic network optimization," ACM SIGMETRICS, vol. 42, no. 1, pp. 153-165, Jun. 2014.
16. V. S. Borkar, "Convex analytic methods in Markov decision processes," in Handbook of Markov Decision Processes. New York, NY, USA: Springer, 2002, pp. 347-375.
17. R. Urgaonkar, B. Urgaonkar, M. Neely, and A. Sivasubramaniam, "Optimal power cost management using stored energy in data centers," in Proc. ACM SIGMETRICS, San Jose, CA, USA, Jun. 2011, pp. 221-232.
18. T. Chen, A. G. Marques, and G. B. Giannakis, "DGLB: Distributed stochastic geographical load balancing over cloud networks," IEEE Trans. Parallel Distrib. Syst., vol. 28, no. 7, pp. 1866-1880, Jul. 2017.
19. A. G. Marques, L. M. Lopez-Ramos, G. B. Giannakis, J. Ramos, and A. J. Caamaño, "Optimal cross-layer resource allocation in cellular networks using channel-and queue-state information," IEEE Trans. Veh. Technol., vol. 61, no. 6, pp. 2789-2807, Jul. 2012.
20. A. Ribeiro, "Ergodic stochastic optimization algorithms for wireless communication and networking," IEEE Trans. Signal Process., vol. 58, no. 12, pp. 6369-6386, Dec. 2010.
21. D. P. Bertsekas, A. Nedic, and A. Ozdaglar, Convex Analysis and Optimization. Belmont, MA, USA: Athena Sci., 2003.
22. A. Shapiro, D. Dentcheva, and A. Ruszczyński, Lectures on Stochastic Programming: Modeling and Theory. Philadelphia, PA, USA: SIAM, 2009.
23. H. Robbins and S. Monro, "A stochastic approximation method," Annals Math. Stat., vol. 22, no. 3, pp. 400-407, Sep. 1951.
24. V. Kong and X. Solo, Adaptive Signal Processing Algorithms. Upper Saddle River, NJ, USA: Prentice-Hall, 1995.
25. N. L. Roux, M. Schmidt, and F. R. Bach, "A stochastic gradient method with an exponential convergence rate for finite training sets," in Proc. Adv. Neural Inform. Process. Syst., Lake Tahoe, NV, USA, Dec. 2012, pp. 2663-2671.
26. A. Defazio, F. Bach, and S. Lacoste-Julien, "SAGA: A fast incremental gradient method with support for non-strongly convex composite objectives," in Proc. Adv. Neural Info. Process. Syst., Montreal, QC, Canada, Dec. 2014, pp. 1646-1654.
27. B. T. Polyak, Introduction to Optimization. New York, NY, USA: Optimization Software, 1987.
28. A. Eryilmaz and R. Srikant, "Joint congestion control, routing, and MAC for stability and fairness in wireless networks," IEEE J. Sel. Areas Commun., vol. 24, no. 8, pp. 1514-1524, Aug. 2006.
29. J. C. Duchi, A. Agarwal, M. Johansson, andM. I. Jordan, "Ergodic mirror descent," SIAM J. Optim., vol. 22, no. 4, pp. 1549-1578, 2012.
30. A. Nemirovski, A. Juditsky, G. Lan, and A. Shapiro, "Robust stochastic approximation approach to stochastic programming," SIAM J. Optim., vol. 19, no. 4, pp. 1574-1609, 2009.
31. M. Hong and Z.-Q. Luo, "On the linear convergence of the alternating direction method of multipliers," Math. Program., vol. 162, pp. 165-199, 2017.
32. H. Karimi, J. Nutini, and M. Schmidt, "Linear convergence of gradient and proximal-gradient methods under the Polyak-Łojasiewicz condition," Proc. Eur. Conf. Mach. Learn., Riva del Garda, Italy, Sep. 2016, pp. 795- 811.
33. T. Chen, L. Qing, and G. B. Giannakis "Learn-and-adapt stochastic dual gradients for network resource allocation,"Mar. 2017. [Online].Available: https://arxiv.org/pdf/1703.01673.pdf