Fast distributed coordinate descent for non-strongly convex losses

IEEE International Workshop on Machine Learning for Signal Processing, MLSP

Volumn , Issue , 2014, Pages

  Fercoq, Olivier ^a   Qu, Zheng ^a   Richtárik, Peter ^a   Takáč, Martin ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

acceleration; Coordinate descent; distributed algorithms

Indexed keywords

ACCELERATION; PARALLEL ALGORITHMS; REGRESSION ANALYSIS; SIGNAL PROCESSING;

CONVERGENCE RATES; COORDINATE DESCENT; COORDINATE DESCENT METHODS; ITERATION COUNTERS; LOSS FUNCTIONS; OPTIMIZATION PROBLEMS; STEP SIZE; THEORETICAL STUDY;

ITERATIVE METHODS;

EID: 84912553418     PISSN: 21610363     EISSN: 21610371     Source Type: Conference Proceeding    
DOI: 10.1109/MLSP.2014.6958862     Document Type: Conference Paper

References (11)

1. Joseph K. Bradley, Aapo Kyrola, Danny Bickson, and Carlos Guestrin, "Parallel coordinate descent for l1-regularized loss minimization," in ICML 2011, 2011.
2. Peter Richtárik and Martin Takáč, "Parallel coordinate descent methods for big data optimization," arXiv:1212.0873, 2012.
3. Peter Richtárik and Martin Takáč, "Distributed coordinate descent method for learning with big data," arXiv:1310.2059, 2013.
4. Olivier Fercoq and Peter Richtárik, "Accelerated, parallel and proximal coordinate descent," arXiv:1312.5799, 2013.
5. Yurii Nesterov, "A method of solving a convex programming problem with convergence rate O(1=k2)," Soviet Mathematics Doklady, vol. 27, no. 2, pp. 372-376, 1983.
6. Paul Tseng, "On accelerated proximal gradient methods for convex-concave optimization," Submitted to SIAM Journal on Optimization, 2008.
7. Amir Beck and Marc Teboulle, "A fast iterative shrinkagethresholding algorithm for linear inverse problems," SIAM Journal on Imaging Sciences, vol. 2, no. 1, pp. 183-202, 2009.
8. Olivier Fercoq and Peter Richtárik, "Smooth minimization of nonsmooth functions with parallel coordinate descent methods," arXiv:1309.5885, 2013.
9. Grégoire Allaire and Sidi Mahmoud Kaber, Numerical linear algebra, vol. 55 of Texts in Applied Mathematics, Springer, New York, 2008, Translated from the 2002 French original by Karim Trabelsi.
10. Shai Shalev-Shwartz and Tong Zhang, "Stochastic dual coordinate ascent methods for regularized loss," The Journal of Machine Learning Research, vol. 14, no. 1, pp. 567-599, 2013.
11. Martin Takáč, Avleen Bijral, Peter Richtárik, and Nathan Srebro, "Mini-batch primal and dual methods for SVMs," in ICML 2013, 2013.