Online optimization in dynamic environments: Improved regret rates for strongly convex problems

2016 IEEE 55th Conference on Decision and Control, CDC 2016

Volumn , Issue , 2016, Pages 7195-7201

  Mokhtari, Aryan ^a   Shahrampour, Shahin ^b   Jadbabaie, Ali ^a   Ribeiro, Alejandro ^a  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b HARVARD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85010723223     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2016.7799379     Document Type: Conference Paper

References (22)

1. S. Boyd and L. Vandenberghe, Convex optimization. Cambridge university press, 2004.
2. A. S. Nemirovski and D. B. Yudin, Problem complexity and method efficiency in optimization. Wiley (Chichester and New York), 1983.
3. A. Beck and M. Teboulle, "Mirror descent and nonlinear projected subgradient methods for convex optimization," Operations Research Letters, vol. 31, no. 3, pp. 167-175, 2003.
4. N. Cesa-Bianchi and G. Lugosi, Prediction, learning, and games. Cambridge University Press, 2006.
5. S. Shalev-Shwartz, "Online learning and online convex optimization," Foundations and Trends in Machine Learning, vol. 4, no. 2, pp. 107-194, 2011.
6. M. Zinkevich, "Online convex programming and generalized infinitesimal gradient ascent," in International Conference on Machine Learning, 2003.
7. Y. Freund and R. E. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting," Journal of computer and system sciences, vol. 55, no. 1, pp. 119-139, 1997.
8. E. Hazan, A. Agarwal, and S. Kale, "Logarithmic regret algorithms for online convex optimization," Machine Learning, vol. 69, no. 2-3, pp. 169-192, 2007.
9. O. Besbes, Y. Gur, and A. Zeevi, "Non-stationary stochastic optimization," Operations Research, vol. 63, no. 5, pp. 1227-1244, 2015.
10. E. Hall and R. Willett, "Online convex optimization in dynamic environments," IEEE Journal of Selected Topics in Signal Processing, vol. 9, no. 4, pp. 647-662, June 2015.
11. A. Jadbabaie, A. Rakhlin, S. Shahrampour, and K. Sridharan, "Online optimization: Competing with dynamic comparators," in Proceedings of the Eighteenth International Conference on Artificial Intelligence and Statistics, 2015, pp. 398-406.
12. R. E. Kalman, "A new approach to linear filtering and prediction problems," Journal of Fluids Engineering, vol. 82, no. 1, pp. 35-45, 1960.
13. M. Herbster and M. K. Warmuth, "Tracking the best expert," Machine Learning, vol. 32, no. 2, pp. 151-178, 1998.
14. E. Hazan and C. Seshadhri, "Adaptive algorithms for online decision problems," in Electronic Colloquium on Computational Complexity (ECCC), vol. 14, no. 088, 2007.
15. N. Cesa-Bianchi, P. Gaillard, G. Lugosi, and G. Stoltz, "A new look at shifting regret," CoRR abs/1202.3323, 2012.
16. A. Daniely, A. Gonen, and S. Shalev-shwartz, "Strongly adaptive online learning," in Proceedings of the 32nd International Conference on Machine Learning (ICML-15), 2015, pp. 1405-1411.
17. H. Luo and R. E. Schapire, "Achieving all with no parameters: Adanormalhedge," in Proceedings of The 28th Conference on Learning Theory, 2015, pp. 1286-1304.
18. A. Koppel, A. Simonetto, A. Mokhtari, G. Leus, and A. Ribeiro, "Target tracking with dynamic convex optimization," in 2015 IEEE Global Conference on Signal and Information Processing (GlobalSIP). IEEE, 2015, pp. 1210-1214.
19. A. Mokhtari, S. Shahrampour, A. Jadbabaie, and A. Ribeiro, "Online optimization in dynamic environments: Improved regret rates for strongly convex problems," arXiv preprint arXiv:1603.04954, 2016.
20. A. Rakhlin and K. Sridharan, "Online learning with predictable sequences," in Conference on Learning Theory, 2013, pp. 993-1019.
21. S. Rakhlin and K. Sridharan, "Optimization, learning, and games with predictable sequences," in Advances in Neural Information Processing Systems, 2013, pp. 3066-3074.
22. C.-K. Chiang, T. Yang, C.-J. Lee, M. Mahdavi, C.-J. Lu, R. Jin, and S. Zhu, "Online optimization with gradual variations." in Conference on Learning Theory, 2012.