MKBoost: A framework of multiple kernel boosting

IEEE Transactions on Knowledge and Data Engineering

Volumn 25, Issue 7, 2013, Pages 1574-1586

  Xia, Hao ^a   Hoi, Steven C H ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

boosting; classification; kernel methods; Multiple kernel learning

Indexed keywords

BOOSTING; CLASSIFICATION TASKS; EMPIRICAL PERFORMANCE; FAMILY OF MACHINES; KERNEL BASED CLASSIFIERS; KERNEL METHODS; MULTIPLE KERNEL LEARNING; OPTIMAL COMBINATION;

BENCHMARKING; CLASSIFICATION (OF INFORMATION); LEARNING ALGORITHMS; OPTIMIZATION;

DATA MINING;

EID: 84878313259     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2012.89     Document Type: Article

References (40)

1. K.P. Bennett, M. Momma, and M.J. Embrechts, "Mark: A Boosting Algorithm for Heterogeneous Kernel Models," Proc. Eighth ACM SIGKDD Int'l Conf. Knowledge Discovery and Data Mining (KDD), pp. 24-31, 2002.
2. J. Bi, T. Zhang, and K.P. Bennett, "Column-Generation Boosting Methods for Mixture of Kernels," Proc. 10th ACM SIGKDD Int'l Conf. Knowledge Discovery and Data Mining (KDD), pp. 521-526, 2004. (Pubitemid 40114964)
3. J. Bi, G. Fung, M. Dundar, and R.B. Rao, "Semi-Supervised Mixture of Kernels via LPBoost Methods," Proc. IEEE Fifth Int'l Conf. Data Mining (ICDM), pp. 569-572, 2005. (Pubitemid 47385742)
4. O. Bousquet and D.J.L. Herrmann, "On the Complexity of Learning the Kernel Matrix," Proc. Advances in Neural Information Processing Systems (NIPS), pp. 399-406, 2002.
5. C.-C. Chang and C.-J. Lin, "LIBSVM: A Library for Support Vector Machines," software, http://www.csie.ntu.edu.tw/cjlin/libsvm, 2001.
6. O. Chapelle and A. Rakotomamonjy, "Second Order Optimization of Kernel Parameters," Proc. Advances in Neural Information Processing Systems (NIPS) Workshop, 2008.
7. K. Crammer, J. Keshet, and Y. Singer, "Kernel Design Using Boosting," Proc. Advances in Neural Information Processing Systems (NIPS), pp. 537-544, 2002.
8. N. Cristianini, J. Shawe-Taylor, A. Elisseeff, and J.S. Kandola, "On Kernel-Target Alignment," Proc. Advances in Neural Information Processing Systems (NIPS), pp. 367-373, 2001.
9. S. Das, B.L. Matthews, A.N. Srivastava, and N.C. Oza, "Multiple Kernel Learning for Heterogeneous Anomaly Detection: Algorithm and Aviation Safety Case Study," Proc. 16th ACM SIGKDD Int'l Conf. Knowledge Discovery and Data Mining (KDD '10), pp. 47-56, 2010.
10. A. Demiriz, K.P. Bennett, and J. Shawe-Taylor, "Linear Programming Boosting via Column Generation," Machine Learning, vol. 46, nos. 1-3, pp. 225-254, 2002. (Pubitemid 34129970)
11. Y. Freund and R.E. Schapire, "A Decision-Theoretic General ization of On-Line Learning and an Application to Boosting," J. Computer and Systems Sciences, vol. 55, no. 1, pp. 119-139, 1997. (Pubitemid 127433398)
12. S.C.H. Hoi, R. Jin, and M.R. Lyu, "Learning Nonparametric Kernel Matrices from Pairwise Constraints," Proc. 24th Int'l Conf. Machine Learning (ICML), pp. 361-368, 2007.
13. S.C.H. Hoi, M.R. Lyu, and E.Y. Chang, "Learning the Unified Kernel Machines for Classification," Proc. 12th ACM SIGKDD Int'l Conf. Knowledge Discovery and Data Mining (KDD '10), pp. 187-196, 2006. (Pubitemid 44540140)
14. R.A. Horn and C.R. Johnson, Matrix Analysis. Cambridge Univ. Press, 1985.
15. S. Ji, L. Sun, R. Jin, and J. Ye, "Multi-Label Multiple Kernel Learning," Proc. Neural Information Processing Systems (NIPS), 2008.
16. R. Jin, S.C.H. Hoi, and T. Yang, "Online Multiple Kernel Learning: Algorithms and Mistake Bounds," Proc. 21st Int'l Conf. Algorithmic Learning Theory (ALT), pp. 390-404, 2010.
17. H. Kashima, K. Tsuda, and A. Inokuchi, "Marginalized Kernels between Labeled Graphs," Proc. 20th Int'l Conf. Machine Learning (ICML), pp. 321-328, 2003.
18. p-Norm Multiple Kernel Learning," Proc. Neural Information Processing Systems (NIPS), pp. 997-1005, 2009.
19. R.I. Kondor and J.D. Lafferty, "Diffusion Kernels on Graphs and Other Discrete Input Spaces," Proc. 19th Int'l Conf. Machine Learning (ICML), pp. 315-322, 2002.
20. G.R.G. Lanckriet, N. Cristianini, P. Bartlett, L.E. Ghaoui, and M.I. Jordan, "Learning the Kernel Matrix with Semidefinite Programming," J. Machine Learning Research, vol. 5, pp. 27-72, 2004.
21. X. Li, L. Wang, and E. Sung, "Adaboost with SVM-Based Component Classifiers," Eng. Applications of Artificial Intelligence, vol. 21, no. 5, pp. 785-795, 2008.
22. C. Longworth and M.J.F. Gales, "Combining Derivative and Parametric Kernels for Speaker Verification," IEEE Trans. Audio, Speech and Language Processing, vol. 17, no. 4, pp. 748-757, May 2009.
23. M. Miwa, R. Sætre, Y. Miyao, and J.I. Tsujii, "Protein-Protein Interaction Extraction by Leveraging Multiple Kernels and Parsers," Int'l J. Medical Informatics, vol. 78, no. 12, pp. 39-46, 2009.
24. D. Pavlov, J. Mao, and B. Dom, "Scaling-up Support Vector Machines Using Boosting Algorithm," Proc. 15th Int'l Conf. Pattern Recognition (ICPR), pp. 2219-2222, 2000.
25. A. Rakotomamonjy, F.R. Bach, S. Canu, and Y. Grandvalet, "SimpleMKL," J. Machine Learning Research, vol. 11, pp. 2491-2521, 2008.
26. B. Schölkopf and A. Smola, Learning with Kernels. MIT Press, 2002.
27. J. Shawe-Taylor and N. Cristianini, Kernel Methods for Pattern Analysis. Cambridge Univ. Press, 2004.
28. S. Sonnenburg, G. Rätsch, C. Schäfer, and B. Schölkopf, "Large Scale Multiple Kernel Learning," J. Machine Learning Research, vol. 7, pp. 1531-1565, 2006. (Pubitemid 44373694)
29. E. Sung, L. Wang, and E. Sung, "A Study of Adaboost with SVM Based Weak Learners," Proc. IEEE Int'l Joint Conf. Neural Networks, vol. 1, pp. 196-201, 2005. (Pubitemid 44055448)
30. L. Tang, J. Chen, and J. Ye, "On Multiple Kernel Learning with Multiple Labels," Proc. 21st Int'l Joint Conf. Artificial Intelligence (IJCAI), pp. 1255-1260, 2009.
31. S.M. Valiollahzadeh, A. Sayadiyan, and M. Nazari, "Face Detection Using Adaboosted SVM-Based Component Classifier," CoRR, abs/0812.2575, 2008.
32. V.N. Vapnik, Statistical Learning Theory. Wiley, 1998.
33. H. Xia and S.C.H. Hoi, "MKBoost: A Framework of Multiple Kernel Boosting," Proc. 11th SIAM Int'l Conf. Data Mining (SDM), pp. 199-210, 2011.
34. Z. Xu, R. Jin, I. King, and M.R. Lyu, "An Extended Level Method for Efficient Multiple Kernel Learning," Proc. Neural Information Processing Systems (NIPS), 2008.
35. X. Zhang and F. Ren, "Improving SVM Learning Accuracy with Adaboost," Proc. Int'l Conf. Natural Computation, vol. 3, pp. 221-225, 2008.
36. X. Zhu, J.S. Kandola, Z. Ghahramani, and J.D. Lafferty, "Non-parametric Transforms of Graph Kernels for Semi-Supervised Learning," Proc. Advances in Neural Information Processing Systems (NIPS), 2004.
37. J. Zhuang, I.W. Tsang, and S.C.H. Hoi, "A Family of Simple Non-Parametric Kernel Learning Algorithms," J. Machine Learning Research, vol. 12, pp. 1313-1347, 2011.
38. J. Zhuang, I.W. Tsang, and S.C.H. Hoi, "Two-Layer Multiple Kernel Learning," J. Machine Learning Research-Proceedings Track, vol. 15, pp. 909-917, 2011.
39. J. Zhuang, J. Wang, S.C.H. Hoi, and X. Lan, "Unsupervised Multiple Kernel Learning," J. Machine Learning Research-Proceedings Track, vol. 20, pp. 129-144, 2011.
40. A. Zien and C.S. Ong, "Multiclass Multiple Kernel Learning," Proc. 24th Int'l Conf. Machine Learning (ICML), pp. 1191-1198, 2007.