Stochastic Averaging for Constrained Optimization with Application to Online Resource Allocation

IEEE Transactions on Signal Processing

Volumn 65, Issue 12, 2017, Pages 3078-3093

  Chen, Tianyi ^a   Mokhtari, Aryan ^b   Wang, Xin ^c,d   Ribeiro, Alejandro ^b   Giannakis, Georgios B ^a  

^a University of Minnesota   (United States)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

^c FUDAN UNIVERSITY   (China)

^d Florida Atlantic Univ   (United States)

Author keywords

network resource allocation; statistical learning; stochastic approximation; Stochastic optimization

Indexed keywords

APPROXIMATION THEORY; CONSTRAINED OPTIMIZATION; LAGRANGE MULTIPLIERS; LEARNING SYSTEMS; OPTIMIZATION; RESOURCE ALLOCATION; STOCHASTIC SYSTEMS;

CONSTRAINED OPTIMI-ZATION PROBLEMS; NETWORK RESOURCE ALLOCATIONS; RESOURCE ALLOCATION PROTOCOLS; RESOURCE ALLOCATION SCHEMES; STATISTICAL LEARNING; STOCHASTIC APPROXIMATIONS; STOCHASTIC NETWORK OPTIMIZATIONS; STOCHASTIC OPTIMIZATIONS;

E-LEARNING;

EID: 85019123233     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2017.2679690     Document Type: Conference Paper

References (37)

1. T. Chen, A. Mokhtari, X. Wang, A. Ribeiro, and G. B. Giannakis, "A data-driven approach to stochastic network optimization," in Proc. IEEE Global Conf. Signal Inf. Process., Washington, DC, USA, Dec. 2016.
2. J. Whitney and P. Delforge, "Data center efficiency assessment," Issue Paper, 2015. [Online].Available: http://www.nrdc.org/energy/data-centerefficiency-assessment.asp
3. P. X. Gao, A. R. Curtis, B. Wong, and S. Keshav, "It's not easy being green," in Proc. ACM SIGCOMM, vol. 42, no. 4, Helsinki, Finland, Aug. 2012, pp. 211-222.
4. Y. Guo, Y. Gong, Y. Fang, P. P. Khargonekar, and X. Geng, "Energy and network aware workload management for sustainable data centers with thermal storage," IEEE Trans. Parallel Distrib. Syst., vol. 25, no. 8, pp. 2030-2042, Aug. 2014.
5. R. Urgaonkar, B. Urgaonkar, M. Neely, and A. Sivasubramaniam, "Optimal power cost management using stored energy in data centers," in Proc. ACM SIGMETRICS, San Jose, CA, USA, Jun. 2011, pp. 221-232.
6. T. Chen, X. Wang, and G. B. Giannakis, "Cooling-aware energy and workload management in data centers via stochastic optimization," IEEE J. Sel. Topics Signal Process., vol. 10, no. 2, pp. 402-415, Mar. 2016.
7. Y. Yao, L. Huang, A. Sharma, L. Golubchik, and M. Neely, "Data centers power reduction: A two time scale approach for delay tolerant workloads," in Proc. IEEE INFOCOM, Orlando, FL, USA, Mar. 2012, pp. 1431-1439.
8. T. Chen, Y. Zhang, X. Wang, and G. B. Giannakis, "Robust workload and energy management for sustainable data centers," IEEE J. Sel. Areas Commun., vol. 34, no. 3, pp. 651-664, Mar. 2016.
9. J. Liu, A. Eryilmaz, N. B. Shroff, and E. S. Bentley, "Heavy-ball: A new approach to tame delay and convergence in wireless network optimization," in Proc. IEEE INFOCOM, San Francisco, CA, USA, Apr. 2016.
10. B. Li, R. Li, and A. Eryilmaz, "On the optimal convergence speed of wireless scheduling for fair resource allocation," IEEE/ACMTrans. Netw., vol. 23, no. 2, pp. 631-643, Apr. 2015.
11. M. Zargham, A. Ribeiro, and A. Jadbabaie, "Accelerated backpressure algorithm," Feb. 2013, arXiv:1302.1475.
12. A. Ribeiro, "Ergodic stochastic optimization algorithms for wireless communication and networking," IEEE Trans. Signal Process., vol. 58, no. 12, pp. 6369-6386, Jul. 2010.
13. L. Huang and M. J. Neely, "Delay reduction via Lagrange multipliers in stochastic network optimization," IEEE Trans. Autom. Control, vol. 56, no. 4, pp. 842-857, Apr. 2011.
14. L. Huang and M. J. Neely, "Utility optimal scheduling in energyharvesting networks," IEEE/ACM Trans. Netw., vol. 21, no. 4, pp. 1117-1130, Aug. 2013.
15. V. Valls and D. J. Leith, "Descent with approximate multipliers is enough: Generalising max-weight," Nov. 2015, arXiv:1511.02517.
16. V. Vapnik, The Nature of Statistical Learning Theory. Berlin, Germany: Springer-Verlag, 2013.
17. L. Huang, X. Liu, and X. Hao, "The power of online learning in stochastic network optimization," in Proc. ACM SIGMETRICS, vol. 42, no. 1, New York, NY, USA, Jun. 2014, pp. 153-165.
18. T. Zhang, H. Wu, X. Liu, and L. Huang, "Learning-aided scheduling for mobile virtual network operators with QoS constraints," in Proc. 14th Int. Symp. Model. Optim. Mobile, Ad Hoc, Wireless Netw., Tempe, AZ,May 2016, pp. 1-8.
19. A. Defazio, F. Bach, and S. Lacoste-Julien, "SAGA: A fast incremental gradient method with support for non-strongly convex composite objectives," in Proc. Adv. Neural Inf. Process. Syst., Montreal, QC, Canada, Dec. 2014, pp. 1646-1654.
20. H. Daneshmand, A. Lucchi, and T. Hofmann, "Starting small-learning with adaptive sample sizes," in Proc. Int. Conf. Mach. Learn., New York, NJ, USA, Jun. 2016, pp. 1463-1471.
21. M. J. Neely, "Stochastic network optimization with application to communication and queueing systems," Synthesis Lectures on Communication Networks. San Rafael, CA, USA: Morgan & Claypool, 2010, vol. 3, no. 1, pp. 1-211.
22. H. Xu and B. Li, "Joint request mapping and response routing for geodistributed cloud services," in Proc. IEEE INFOCOM, Turin, Italy, Apr. 2013, pp. 854-862.
23. S. Sun, M. Dong, and B. Liang, "Distributed real-time power balancing in renewable-integrated power grids with storage and flexible loads," IEEE Trans. Smart Grid, vol. 7, no. 5, pp. 2337-2349, Sep. 2016.
24. N. Gatsis, A. Ribeiro, and G. B. Giannakis, "A class of convergent algorithms for resource allocation in wireless fading networks," IEEE Trans. Wireless Commun., vol. 9, no. 5, pp. 1808-1823, May 2010.
25. J. Gregoire,X.Qian, E. Frazzoli, A. de La Fortelle, and T.Wongpiromsarn, "Capacity-aware backpressure traffic signal control," IEEE Trans. Control Netw. Syst., vol. 2, no. 2, pp. 164-173, Jun. 2015.
26. D. P. Bertsekas, Nonlinear Programming. Belmont, MA, USA: Athena Scientific, 1999.
27. H. Robbins and S. Monro, "A stochastic approximation method," Ann. Math. Stat., vol. 22, no. 3, pp. 400-407, Sep. 1951.
28. V. Kong and X. Solo, Adaptive Signal Processing Algorithms. Upper Saddle River, NJ, USA: Prentice-Hall, 1995.
29. T. Chen, A. G. Marques, and G. B. Giannakis, "DGLB: Distributed stochastic geographical load balancing over cloud networks," IEEE Trans. Parallel Distrib. Syst., doi: 10.1109/TPDS.2016.2636210.
30. A. Eryilmaz and R. Srikant,"Joint congestion control, routing, and MAC for stability and fairness in wireless networks," IEEE J. Sel. Areas Commun., vol. 24, no. 8, pp. 1514-1524, Aug. 2006.
31. L. Georgiadis,M. Neely, and L. Tassiulas, "Resource allocation and crosslayer control inwireless networks," Found. Trends Netw., vol. 1, pp. 1-144, 2006.
32. N. L. Roux, M. Schmidt, and F. R. Bach, "A stochastic gradient method with an exponential convergence rate for finite training sets," in Proc. Adv. Neural Inf. Process. Syst., Dec. 2012, pp. 2663-2671.
33. O. Bousquet and L. Bottou, "The tradeoffs of large scale learning," in Proc. Adv. Neural Inf. Process. Syst., Dec. 2008, pp. 161-168.
34. A. Mokhtari, H. Daneshmand, A. Lucchi, T. Hofmann, and A. Ribeiro, "Adaptive Newton method for empirical risk minimization to statistical accuracy," in Proc. Adv. Neural Inf. Process. Syst., Barcelona, Spain, Dec. 2016, pp. 4062-4070.
35. H. Yu and M. J. Neely, "A low complexity algorithm with O( √ T ) regret and constraint violations for online convex optimization with long term constraints," Apr. 2016, arXiv:1604.02218.
36. J. Koshal, A. Nedic, and U. V. Shanbhag, "Multiuser optimization: Distributed algorithms and error analysis," SIAM J. Optim., vol. 21, no. 3, pp. 1046-1081, Jul. 2011.
37. S. P. Meyn and R. L. Tweedie, Markov Chains and Stochastic Stability. Berlin, Germany: Springer-Verlag, 2012.