Ultra-fast optimization algorithm for sparse multi kernel learning

Proceedings of the 28th International Conference on Machine Learning, ICML 2011

Volumn , Issue , 2011, Pages 249-256

  Orabona, Francesco ^a   Jie, Luo ^b,c  

^a UNIVERSITY OF MILAN   (Italy)

^b IDIAP RESEARCH INSTITUTE   (Switzerland)

^c EPFL   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION TASKS; CONVERGENCE RATE BOUND; LOSS FUNCTIONS; MULTI-KERNEL; OPTIMIZATION ALGORITHMS; OPTIMIZATION PROCESS; REGULARIZER; SPARSE SOLUTIONS; STATE-OF-THE-ART APPROACH; STATE-OF-THE-ART PERFORMANCE; STOCHASTIC GRADIENT DESCENT METHOD; ULTRA-FAST;

ALGORITHMS; COMMUNICATION CHANNELS (INFORMATION THEORY); LEARNING SYSTEMS;

OPTIMIZATION;

EID: 80053459750     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (29)

1. Bach, F. R., Lanckriet, G. R. G., and Jordan, M. I. Multiple kernel learning, conic duality, and the SMO, algorithm. In Proc. of the 21th Intl Conf. on Machine Learning, 2004.
2. Boyd, S. and vandenberghe, L. Convex Optimization. Cambridge University Press, 2004.
3. Chapelle, O. Training a support vector machine in the primal. Neural Comput., 19:1155-1178, 2007.
4. Cortes, C., Mohri, M., and Rostamizadeh, A. Two-stage learning kernel algorithms. In Proc. of the 27th Intl Conf. on Machine Learning, 2010.
5. Crammer, K. and Singer, Y. On the algorithmic implementation of multiclass kernel-based vector machines. J. Mach. Learn. Res., 2:265-292, 2002.
6. Cristianini, N. and Shawe-Taylor, J. An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods. Cambridge University Press, 2000.
7. Cristianini, N., Kandola, J., Elisseeff, A., and Shawe-Taylor, J. On kernel-target alignment. In Adv. Neural. Inform. Process Syst. 14, 2002.
8. Gehler, P. and Nowozin, S. On feature combination for multiclass object classification. In Proc. of IEEE Intl Conf. on Computer Vision, 2009.
9. Hazan, E., Agarwal, A., and Kale, S. Logarithmic regret algorithms for online convex optimization. Machine Learning, 69(2-3):169-192, 2007. (Pubitemid 47574314)
10. Jie, L., Orabona, F., Fornoni, M., Caputo, B., and Cesa-Bianchi, N. OM-2: An online multi-class multi-kernel learning algorithm. In Proc. of the 4th IEEE Online Learning for Computer Vision Workshop (in CVPR 2010), 2010.
11. Kakade, S., Shalev-Shwartz, S., and Tewari, A. On the duality of strong convexity and strong smoothness: Learning applications and matrix regularization. Technical report, TTI, 2009.
12. Kloft, M., Brefeld, U., Sonnenburg, S., Laskov, P., Müller, K.-R., and Zien, A. Efficient and accurate lp-norm multiple kernel learning. In Adv. Neural. Inform. Process Syst. 22. 2009.
13. Lanckriet, G., Cristianini, N., Bartlett, P., and Ghaoui, L. E. Learning the kernel matrix with semidefinite programming. J. Mach. Learn. Res., 5, 2004.
14. Martins, A. F. T., Smith, N. A., Xing, E. P., Aguiar, P., and Figueiredo, M. Online learning of structured predictors with multiple kernels. In Proc. of the 14th Intl Conf. on Artificial Intelligence and Statistics, 2011.
15. Nath, J. S., Dinesh, G., Raman, S., Bhattacharyya, C., Ben-Tal, A., and Ramakrishnan, K. R. On the algorithmics and applications of a mixed-norm based kernel learning formulation. In Adv. Neural. Inform. Process Syst. 22, 2009.
16. Nilsback, M.-E. and Zisserman, A. A visual vocabulary for flower classification. In Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, 2006.
17. Orabona, F. DOGMA: a MATLAB Toolbox for Online Learning, 2009. Software available at http://dogma.sourceforge.net.
18. Orabona, F., Jie, L., and Caputo, B. Online-batch strongly convex multi kernel learning. In Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, 2010.
19. Rakotomamonjy, A., Bach, F. R., Canu, S., and Grandvalet, Y. SimpleMKL, J. Mach. Learn. Res., 9:2491-2521, 2008.
20. Shalev-Shwartz, S. and Kakade, S. M. Mind the duality gap: Logarithmic regret algorithms for online optimization. In Adv. Neural. Inform. Process Syst. 21, 2008.
21. Shalev-Shwartz, S. and Tewari, A. Stochastic methods for 11 regularized loss minimization. In Proc. of the 26th Intl Conf. on Machine Learning, 2009.
22. Shalev-Shwartz, S., Singer, Y., and Srebro, N. Pegasos:Primal Estimated sub-GrAdient SOlver for SVM. In Proc. of the 24th Intl Conf. on Machine Learning, 2007.
23. Sonnenburg, S., Rätsch, G., Schäfer, C., and Schölkopf, B. Large scale multiple kernel learning. J. Mach. Learn. Res., 7:1531-1565, 2006. (Pubitemid 44373694)
24. Tomioka, R. and Suzuki, T. Sparsity-accuracy trade-off in MKL, 2010. URL http://arxiv.org/abs/1001.2615.
25. Tsochantaridis, I., Hofmann, T., Joachims, T., and Altun, Y. Support vector machine learning for interdependent and structured output spaces. In Proc. of the 21th Intl Conf. on Machine Learning, 2004.
26. Vishwanathan, S. V. N., Sun, Z., Theera-Ampornpunt, N., and Varma, M. Multiple kernel learning and the SMO algorithm. In Adv. Neural. Inform. Process Syst., 2010.
27. Xiao, L. Dual averaging methods for regularized stochastic learning and online optimization. J. Mach. Learn. Res., 11:2543-2596, October 2010.
28. Xu, Z., Jin, R., King, I., and Lyu, M. R. An extended level method for efficient multiple kernel learning. In Adv. Neural. Inform. Process Syst. 21, 2008.
29. Zien, A. and Ong, C. S. Multiclass multiple kernel learning. In Proc. of the 24th Intl Conf. on Machine Learning, 2007.