An Online Convex Optimization Approach to Proactive Network Resource Allocation

IEEE Transactions on Signal Processing

Volumn 65, Issue 24, 2017, Pages 6350-6364

  Chen, Tianyi ^a,b   Ling, Qing ^c,d   Giannakis, Georgios B ^a,b  

^a University of Minnesota   (United States)

^b UNIVERSITY OF MINNESOTA   (United States)

^c SUN YAT SEN UNIVERSITY   (China)

^d UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA   (China)

Author keywords

Constrained optimization; network resource allocation; online convex optimization; primal dual method

Indexed keywords

CONVEX OPTIMIZATION; GRADIENT METHODS; RESOURCE ALLOCATION; STOCHASTIC SYSTEMS;

CONSTRAINT VIOLATION; DYNAMIC SOLUTIONS; NETWORK RESOURCE ALLOCATIONS; NUMERICAL EXPERIMENTS; ON-LINE ALGORITHMS; ONLINE CONVEX OPTIMIZATIONS; PRIMAL-DUAL METHODS; PROACTIVE NETWORKS;

CONSTRAINED OPTIMIZATION;

EID: 85029155585     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2017.2750109     Document Type: Article

References (43)

1. T. Chen, Q. Ling, and G. B. Giannakis, "Online convex optimization for dynamic network resource allocation," in Proc. Eur. Signal Process. Conf., Kos Island, Greece, Aug./Sep., 2017, pp. 146-150.
2. M. Zinkevich, "Online convex programming and generalized infinitesimal gradient ascent," in Proc. Int. Conf. Mach. Learn., Washington D.C., Aug. 2003.
3. E. Hazan, A. Agarwal, and S. Kale, "Logarithmic regret algorithms for online convex optimization," Mach. Learn., vol. 69, nos. 2/3, pp. 169-192, Dec. 2007.
4. S. Shalev-Shwartz, "Online learning and online convex optimization," Found. Trends Mach. Learn., vol. 4, no. 2, pp. 107-194, 2011.
5. E. Hazan, "Introduction to online convex optimization," Found. Trends Mach. Learn., vol. 2, nos. 3/4, pp. 157-325, 2016.
6. O. Besbes,Y. Gur, andA. Zeevi, "Non-stationary stochastic optimization," Oper. Res., vol. 63, no. 5, pp. 1227-1244, Sep. 2015.
7. E. C. Hall and R. M. Willett, "Online convex optimization in dynamic environments," IEEE J. Sel. Topics Signal Process., vol. 9, no. 4, pp. 647-662, Jun. 2015.
8. A. Jadbabaie, A. Rakhlin, S. Shahrampour, and K. Sridharan, "Online optimization: Competing with dynamic comparators," in Proc. Int. Conf. Artif. Intell. Statist., San Diego, CA, USA, May 2015, pp. 398-406.
9. A. Mokhtari, S. Shahrampour, A. Jadbabaie, and A. Ribeiro, "Online optimization in dynamic environments: Improved regret rates for strongly convex problems," in Proc. IEEE Conf. Decision Control, LasVegas,NV, USA, Dec. 2016, pp. 7195-7201.
10. N. Chen, J. Comden, Z. Liu, A. Gandhi, and A. Wierman, "Using predictions in online optimization: Looking forward with an eye on the past," in Proc. ACM SIGMETRICS Int. Conf. Meas. Model. Comput. Sci., Antibes Juan-les-Pins, France, Jun. 2016, pp. 193-206.
11. L. L. Andrew et al., "A tale of two metrics: Simultaneous bounds on competitiveness and regret," in Proc. Annu. Conf. Learn. Theory, Princeton, NJ, USA, Jun. 2013, pp. 329-330.
12. M. Mahdavi, R. Jin, and T. Yang, "Trading regret for efficiency: Online convex optimization with long term constraints," J. Mach. Learn. Res., vol. 13, pp. 2503-2528, Sep. 2012.
13. H. Yu and M. J. Neely, "A low complexity algorithm with O( √ T ) regret and constraint violations for online convex optimization with long term constraints," arXiv: 1604.02218, Apr. 2016.
14. S. Paternain and A. Ribeiro, "Online learning of feasible strategies in unknown environments," IEEE Trans. Automat. Control, vol. 62, no. 6, pp. 2807-2822, Jun. 2017.
15. A. Koppel, F. Y. Jakubiec, and A. Ribeiro, "A saddle point algorithm for networked online convex optimization," IEEE Trans. Signal Process., vol. 63, no. 19, pp. 5149-5164, Oct. 2015.
16. H.Wang and A. Banerjee, "Online alternating direction method," in Proc. Int. Conf. Mach. Learn., Edinburgh, U.K., Jun. 2012, pp. 1119-1126.
17. S. Shahrampour and A. Jadbabaie, "Distributed online optimization in dynamic environments usingmirror descent," IEEE Trans. Automat. Control, doi: 10.1109/TAC.2017.2743462.
18. S. H. Low and D. E. Lapsley, "Optimization flow control-I: Basic algorithm and convergence," IEEE/ACM Trans. Netw., vol. 7, no. 6, pp. 861-874, Dec. 1999.
19. L. Xiao,M. Johansson, and S. P.Boyd, "Simultaneous routing and resource allocation via dual decomposition," IEEE Trans. Commun., vol. 52, no. 7, pp. 1136-1144, Jul. 2004.
20. E. Ghadimi, I. Shames, and M. Johansson, "Multi-step gradient methods for networked optimization," IEEE Trans. Signal Process., vol. 61, no. 21, pp. 5417-5429, Nov. 2013.
21. A. Beck, A. Nedic, A. Ozdaglar, and M. Teboulle, "An O(1/k) gradient method for network resource allocation problems," IEEE Trans. Control Netw. Syst., vol. 1, no. 1, pp. 64-73, Mar. 2014.
22. E. Wei, A. Ozdaglar, and A. Jadbabaie, "A distributed Newton method for network utility maximization-I: Algorithm," IEEE Trans. Automat. Control, vol. 58, no. 9, pp. 2162-2175, Sep. 2013.
23. T. Chen, Y. Zhang, X. Wang, and G. B. Giannakis, "Robust workload and energy management for sustainable data centers," IEEE J. Sel. Areas Commun., vol. 34, no. 3, pp. 651-664, Mar. 2016.
24. L. Tassiulas and A. Ephremides, "Stability properties of constrained queueing systems and scheduling policies for maximum throughput in multihop radio networks," IEEE Trans. Automat. Control, vol. 37, no. 12, pp. 1936-1948, Dec. 1992.
25. M. J. Neely, "Stochastic network optimization with application to communication and queueing systems," Synthesis Lectures Commun. Netw., vol. 3, no. 1, pp. 1-211, 2010.
26. A. G. Marques, L. M. Lopez-Ramos, G. B. Giannakis, J. Ramos, and A. J. Caamaño, "Optimal cross-layer resource allocation in cellular networks using channel-and queue-state information," IEEE Trans. Veh. Technol., vol. 61, no. 6, pp. 2789-2807, Jul. 2012.
27. A. Nemirovski, A. Juditsky, G. Lan, and A. Shapiro, "Robust stochastic approximation approach to stochastic programming," SIAM J. Optim., vol. 19, no. 4, pp. 1574-1609, 2009.
28. J. C. Duchi, A. Agarwal, M. Johansson, andM. I. Jordan, "Ergodic mirror descent," SIAM J. Optim., vol. 22, no. 4, pp. 1549-1578, 2012.
29. T. Chen,A.Mokhtari, X.Wang, A. Ribeiro, andG.B.Giannakis, "Stochastic averaging for constrained optimization with application to online resource allocation," IEEE Trans. Signal Process., vol. 65, no. 12, pp. 3078-3093, Jun. 2017.
30. M. Svorenova et al., "Resource-performance trade-off analysis for mobile robots," arXiv:1609.04888, Sep. 2016.
31. E. Dall'Anese and A. Simonetto, "Optimal power flow pursuit," IEEE Trans. Smart Grid, to appear, doi: 10.1109/TSG.2016.2571982
32. W.-J. Ma, J. Wang, V. Gupta, and C. Chen, "Distributed energy management for networked microgrids using online alternating direction method of multipliers with regret," IEEE Trans. Smart Grid, to appear, doi: 10.1109/TSG.2016.2569604
33. D. P. Bertsekas, Nonlinear Programming. Belmont, MA, USA: Athena Scientific, 1999.
34. K.-S. Jun, F. Orabona, R. Willett, and S. Wright, "Improved strongly adaptive online learning using coin betting," in Proc. Int. Conf. Artif. Intell. Statist., Fort Lauderdale, FL, USA, Apr. 2017, pp. 943-951.
35. T. Chen, X. Wang, and G. B. Giannakis, "Cooling-aware energy and workload management in data centers via stochastic optimization," IEEE J. Sel. Topics Signal Process., vol. 10, no. 2, pp. 402-415, Mar. 2016.
36. A. Ribeiro, "Ergodic stochastic optimization algorithms for wireless communication and networking," IEEE Trans. Signal Process., vol. 58, no. 12, pp. 6369-6386, Dec. 2010.
37. L. Georgiadis,M. Neely, and L. Tassiulas, "Resource allocation and crosslayer control inwireless networks," Found. Trends Netw., vol. 1, pp. 1-144, 2006.
38. J. D. Little, "A proof for the queuing formula: L = λw," Oper. Res., vol. 9, no. 3, pp. 383-387, Jun. 1961.
39. S. J. Kim and G. Giannakis, "An online convex optimization approach to real-time energy pricing for demand response," IEEE Trans. Smart Grid, to appear, doi: 10.1109/TSG.2016.2539948.
40. J. Tadrous, A. Eryilmaz, and H. El Gamal, "Proactive resource allocation: Harnessing the diversity and multicast gains," IEEE Trans. Inf. Theory, vol. 59, no. 8, pp. 4833-4854, Aug. 2013.
41. "Midcontinent independent system operator (MISO) locational marginal price," Nov. 2016. [Online]. Available: http://www.misoenergy.org/ MarketsOperations/Prices
42. L. Huang, S. Zhang, M. Chen, and X. Liu, "When backpressure meets predictive scheduling," IEEE/ACM Trans. Netw., vol. 24, no. 4, pp. 2237-2250, Aug. 2016.
43. Y. Nesterov, Introductory Lectures on Convex Optimization: A Basic Course, vol. 87. Berlin, Germany: Springer, 2013.