Large scale multiple kernel learning

Journal of Machine Learning Research

Volumn 7, Issue , 2006, Pages 1531-1565

  Sonnenburg, Sören ^a   Rätsch, Gunnar ^b   Schäfer, Christin ^a   Schölkopf, Bernhard ^c  

^a FRAUNHOFER FIRST   (Germany)

^b FRIEDRICH MIESCHER LABORATORY OF THE MAX PLANCK SOCIETY   (Germany)

^c MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

Author keywords

Column generation; Large scale optimization; Multiple kernel learning; Semi infinite linear programming; String kernels; Support vector machines; Support vector regression

Indexed keywords

COMPUTATION THEORY; CONSTRAINT THEORY; LARGE SCALE SYSTEMS; MATHEMATICAL MODELS; OPTIMIZATION; REGRESSION ANALYSIS;

COLUMN GENERATION; LARGE SCALE OPTIMIZATION; MULTIPLE KERNEL LEARNING; SEMI-INFINITE LINEAR PROGRAMMING; SPARSE FEATURE MAPS; STRING KERNELS; SUPPORT VECTOR MACHINES; SUPPORT VECTOR REGRESSION;

LEARNING SYSTEMS;

EID: 33745776113     PISSN: 15337928     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (30)

1. F. R. Bach, G. R. G. Lanckriet, and M. I. Jordan. Multiple kernel learning, conic duality, and the SMO algorithm. In C. E. Brodley, editor, Twenty-first international conference on Machine learning. ACM, 2004.
2. K. P. Bennett, M. Momma, and M. J. Embrechts. MARK: a boosting algorithm for heterogeneous kernel models. In Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 24-31. ACM, 2002.
3. J. Bi, T. Zhang, and K. P. Bennett. Column-generation boosting methods for mixture of kernels. In W. Kim, R. Kohavi, J. Gehrke, and W. DuMouchel, editors, Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 521-526. ACM, 2004.
4. S. Boyd and L. Vandenberghe. Convex Optimization. Cambridge University Press, Cambridge, UK, 2004.
5. O. Chapelle, V. Vapnik, O. Bousquet, and S. Mukherjee. Choosing multiple parameters for support vector machines. Machine Learning, 46(1-3):131-159, 2002.
6. C. Cortes and V.N. Vapnik. Support-vector networks. Machine Learning, 20(3):273-297, 1995.
7. J. Davis and M. Goadrich. The relationship between precision-recall and roc curves. Technical report #1551, University of Wisconsin Madison, January 2006.
8. T. Fawcett. Roc graphs: Notes and practical considerations for data mining researchers. Technical report hpl-2003-4, HP Laboratories, Palo Alto, CA, USA, January 2003.
9. E. Fredkin. Trie memory. Communications of the ACM, 3(9):490-499, 1960.
10. Y. Grandvalet and S. Canu. Adaptive scaling for feature selection in SVMs. In S. Thrun S. Becker and K. Obermayer, editors, Advances in Neural Information Processing Systems 15, pages 553-560, Cambridge, MA, 2003. MIT Press.
11. R. Hettich and K. O. Kortanek. Semi-infinite programming: Theory, methods and applications. SIAMReview, 3:380-429, 1993.
12. T. Joachims. Text categorization with support vector machines: Learning with many relevant features. In C. Nédellec and C. Rouveirol, editors, ECML '98: Proceedings of the 10th European Conference on Machine Learning, Lecture Notes in Computer Science, pages 137-142, Berlin / Heidelberg, 1998. Springer-Verlag.
13. T. Joachims. Making large-scale SVM learning practical. In B. Schölkopf, C.J.C. Burges, and A.J. Smola, editors, Advances in Kernel Methods - Support Vector Learning, pages 169-184, Cambridge, MA, USA, 1999. MIT Press.
14. G.R.G. Lanckriet, T. De Bie, N. Cristianini, M.I. Jordan, and W.S. Noble. A statistical framework for genomic data fusion. Bioinformatics, 20:2626-2635, 2004.
15. C. Leslie, E. Eskin, and W.S. Noble. The spectrum kernel: A string kernel for SVM protein classification. In R. B. Altman, A. K. Dunker, L. Hunter, K. Lauderdale, and T. E. Klein, editors, Proceedings of the Pacific Symposium on Biocomputing, pages 564-575, Kaua'i, Hawaii, 2002.
16. C. Leslie, R. Kuang, and E. Eskin. Inexact matching string kernels for protein classification. In Kernel Methods in Computational Biology, MIT Press series on Computational Molecular Biology, pages 95-112. MIT Press, 2004.
17. R. Meir and G. Rätsch. An introduction to boosting and leveraging. In S. Mendelson and A. Smola, editors, Proc. of the first Machine Learning Summer School in Canberra, LNCS, pages 119-184. Springer, 2003.
18. C.E. Metz. Basic principles of ROC analysis. Seminars in Nuclear Medicine, VIII(4), October 1978.
19. C. S. Ong, A. J. Smola, and R. C. Williamson. Hyperkernels. In S. Thrun S. Becker and K. Obermayer, editors, Advances in Neural Information Processing Systems 15, volume 15, pages 478-485, Cambridge, MA, 2003. MIT Press.
20. J. Platt. Fast training of support vector machines using sequential minimal optimization. In B. Schölkopf, C.J.C. Burges, and A.J. Smola, editors, Advances in Kernel Methods - Support Vector Learning, pages 185-208, Cambridge, MA, USA, 1999. MIT Press.
21. G. Rätsch. Robust Boosting via Convex Optimization. PhD thesis, University of Potsdam, Potsdam, Germany, 2001.
22. G. Rätsch and S. Sonnenburg. Accurate Splice Site Prediction for Caenorhabditis Elegans, pages 277-298. MIT Press series on Computational Molecular Biology. MIT Press, 2004.
23. G. Rätsch and M.K. Warmuth. Efficient margin maximization with boosting. Journal of Machine Learning Research, 6:2131-2152, 2005.
24. G. Rätsch, A. Demiriz, and K. Bennett. Sparse regression ensembles in infinite and finite hypothesis spaces. Machine Learning, 48(1-3): 193-221, 2002.
25. Special Issue on New Methods for Model Selection and Model Combination. Also NeuroCOLT2 Technical Report NC-TR-2000-085.
26. G. Rätsch, S. Sonnenburg, and B. Schölkopf. RASE: Recognition of alternatively spliced exons in C. elegans. Bioinformatics, 21:i369-i377, 2005.
27. B. Schölkopf and A. J. Smola. Learning with Kernels. MIT Press, Cambridge, MA, 2002.
28. S. Sonnenburg, G. Rätsch, and C. Schäfer. Learning interpretable SVMs for biological sequence classification. In S. Miyano, J. P. Mesirov, S. Kasif, S. Istrail, P. A. Pevzner, and M. Waterman, editors, Research in Computational Molecular Biology, 9th Annual International Conference, RECOMB 2005, volume 3500, pages 389-407. Springer-Verlag Berlin Heidelberg, 2005a.
29. S. Sonnenburg, G. Rätsch, and B. Schölkopf. Large scale genomic sequence SVM classifiers. In L. D. Raedt and S. Wrobel, editors, ICML '05: Proceedings of the 22nd international conference on Machine learning, pages 849-856, New York, NY, USA, 2005b. ACM Press.
30. M.K. Warmuth, J. Liao, and G. Rätsch. Totally corrective boosting algorithms that maximize the margin. In ICML '06: Proceedings of the 23nd international conference on Machine learning. ACM Press, 2006.