Manifold identification of dual averaging methods for regularized stochastic online learning

Proceedings of the 28th International Conference on Machine Learning, ICML 2011

Volumn , Issue , 2011, Pages 1121-1128

  Lee, Sangkyun ^a   Wright, Stephen J ^a  

^a University of Wisconsin   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATE SUBGRADIENTS; AVERAGING METHOD; COMPUTATIONAL RESULTS; HIGH PROBABILITY; INTRINSIC DIMENSIONS; LOSS FUNCTIONS; LOW-DIMENSIONAL MANIFOLDS; MANIFOLD IDENTIFICATION; NON-SMOOTH; ONLINE LEARNING; REGULARIZER; STOCHASTIC LEARNING; STREAMING DATA;

ALGORITHMS; LEARNING SYSTEMS; OPTIMIZATION;

STOCHASTIC SYSTEMS;

EID: 80053458470     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. Burke, J. V. and Moré, J. J. Exposing constraints. SIAM Journal on Optimization, 4(3):573-595, 1994.
2. Hare, W. L. and Lewis, A. S. Identifying active constraints via partial smoothness and prox-regularity. Journal of Convex Analysis, 11(2):251-266, 2004. (Pubitemid 39216721)
3. Langford, J., Li, L., and Zhang, T. Sparse online learning via truncated gradient. Journal of Machine Learning Research, 10:777-801, June 2009.
4. Lee, S. and Wright, S. J. Manifold identification of dual averaging algorithm for regularized stochastic online learning. Technical report, University of Wisconsin-Madison, April 2011.
5. Nemirovski, A., Juditsky, A., Lan, G., and Shapiro, A. Robust stochastic approximation approach to stochastic programming. SIAM Journal on Optimization, 19(4):1574-1609, 2009.
6. Nesterov, Y. Smooth minimization of nonsmooth functions. Mathematical Programming, Series A, 103:127-152, 2005.
7. Nesterov, Y. Primal-dual subgradient methods for convex problems. Mathematical Programming, 120:221-259, 2009.
8. Shi, W., Wahba, G., Wright, S. J., Lee, K., Klein, R., and Klein, B. LASSO-Patternsearch algorithm with application to opthalmology data. Statistics and its Interface, 1:137-153, 2008.
9. Vaisman, I. A First Course in Differential Geometry. Monographs and Textbooks in Pure and Applied Mathematics. Marcel Dekker, 1984.
10. Wright, S. J. Identifiable surfaces in constrained optimization. SIAM Journal on Control and Optimization, 31:1063-1079, 1993.
11. Wright, S. J. Accelerated block-coordinate relaxation for regularized optimization. Technical report, University of Wisconsin-Madison, August 29 2010.
12. Xiao, L. Dual averaging methods for regularized stochastic learning and online optimization. Journal of Machine Learning Research, 11:2543-2596, October 2010.
13. Zinkevich, M. Online convex programming and generalized infinitesimal gradient ascent. In Proceedings of the 20th International Conference on Machine Learning, pp. 928-936, 2003.