A quasi-Newton method for large scale support vector machines

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2014, Pages 8302-8306

  Mokhtari, Aryan ^a   Ribeiro, Alejandro ^a  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONVERGENCE OF NUMERICAL METHODS; NEWTON-RAPHSON METHOD; SIGNAL PROCESSING; STOCHASTIC SYSTEMS;

BROYDEN; CONVERGENCE RATES; FEATURE VECTORS; NUMERICAL RESULTS; OPTIMAL CLASSIFIERS; QUASI-NEWTON METHODS; SUPPORT VECTOR MACHINE CLASSIFICATION;

SUPPORT VECTOR MACHINES;

EID: 84905252681     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2014.6855220     Document Type: Conference Paper

References (16)

1. L. Bottou, "Large-scale machine learning with stochastic gradient descent, " In Proceedings of COMPSTAT'2010, pp. 177-186, Physica-Verlag HD, 2010.
2. S. Shalev-Shwartz, Y. Singer, and N. Srebro, "Pegasos: Primal estimated sub-gradient solver for svm, " In Proceedings of the 24th international conference on Machine learning, pp. 807-814, ACM, 2007.
3. T. Zhang, "Solving large scale linear prediction problems using stochastic gradient descent algorithms, " In Proceedings of the twenty-first international conference on Machine learning, p. 919926, ACM, 2004.
4. N. LeRoux, M. Schmidt, and F. Bach, "A stochastic gradient method with an exponential convergence rate for strongly-convex optimization with finite training sets, " arXiv preprint arXiv, 1202. 6258, 2012.
5. C. G. Broyden, J. E. Du Jr., Wang, and J. J. More, "On the local and superlinear convergence of quasi-newton methods, " IMA J. Appl. Math, vol. 12, no. 3, pp. 223-245, June 1973.
6. A. Bordes, L. Bottou, and P. Gallinari, "Sgd-qn: Careful quasinewton stochastic gradient descent, " The Journal of Machine Learning Research, vol. 10, pp. 1737-1754, 2009.
7. R. H. Byrd, J. Nocedal, and Y. Yuan, "Global convergence of a class of quasi-newton methods on convex problems, " SIAM J. Numer. Anal., vol. 24, no. 5, pp. 1171-1190, October 1987.
8. A. Mokhtari and A. Ribeiro, "A dual stochastic dfp algorithm for optimal resource allocation in wireless systems, " in Proc. IEEE 14th Workshop on Signal Process. Advances in Wireless Commun. (SPAWC). pp. 21-25, Darmstadt Germany, June 16-19 2013.
9. -, "Regularized stochastic bfgs algorithm, " in Proc. IEEE Global Conf. on Signal and Inform. Process. pp. 1109-1112, Austin Texas, Dec. 3-5 2013.
10. J. Nocedal and S. J. Wright, Numerical optimization, 2nd ed. New York, NY: Springer-Verlag, 1999.
11. M. J. D. Powell, Some global convergence properties of a variable metric algorithm for minimization without exact line search, 2nd ed. London, UK: Academic Press, 1971.
12. N. N. Schraudolph, J. Yu, and S. Gnter, "A stochastic quasi-newton method for online convex optimization, " In Proc. 11th Intl. Conf. on Artificial Intelligence and Statistics (AIstats), p. 433 440, Soc. for Artificial Intelligence and Statistics, 2007.
13. V. Vapnik, The nature of statistical learning theory, 2nd ed. springer, 1999.
14. A. Mokhtari and A. Ribeiro, "Res: Regularized stochastic bfgs algorithm, " arXiv preprint arXiv, 1401. 7625, 2014.
15. J. J. E. Dennis and J. J. More, "A characterization of super linear convergence and its application to quasi-newton methods, " Mathematics of computation, vol. 28, no. 126, pp. 549-560, 1974.
16. N. L. Johnson, S. Kotz, and N. Balakrishnan, Continuous Univariate Distributions, vol. 2, 2nd ed. Wiley-Interscience, 1995.