An adaptive approach to learning optimal neighborhood kernels

IEEE Transactions on Cybernetics

Volumn 43, Issue 1, 2013, Pages 371-384

  Liu, Xinwang ^a,b   Yin, Jianping ^a   Wang, Lei ^c   Liu, Lingqiao ^b   Liu, Jun ^d   Hou, Chenping ^a   Zhang, Jian ^e  

^a NATIONAL UNIVERSITY OF DEFENSE TECHNOLOGY   (China)

^b AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

^c UNIVERSITY OF WOLLONGONG   (Australia)

^d SIEMENS CORPORATE RESEARCH   (United States)

^e UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

Multiple kernel learning (MKL); Optimal neighborhood kernel learning (ONKL); Support vector machines (SVMs)

Indexed keywords

CLASSIFICATION PERFORMANCE; GAUSSIAN RADIAL BASIS FUNCTIONS; KERNEL LEARNING; KERNEL LEARNING METHODS; MULTIPLE KERNEL LEARNING; OPTIMAL NEIGHBORHOODS; PROBABILISTIC INTERPRETATION; SUPPORT VECTOR MACHINE (SVMS);

CLASSIFICATION (OF INFORMATION); LEARNING ALGORITHMS; RADIAL BASIS FUNCTION NETWORKS; SUPPORT VECTOR MACHINES; VIRTUAL REALITY;

OPTIMIZATION;

EID: 84890442548     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2012.2207889     Document Type: Article

References (42)

1. A. K. Ghosh, "Kernel discriminant analysis using case-specific smoothing parameters," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 5, pp. 1413-1418, Oct. 2008.
2. Y. Tang, L. Li, and X. Li, "Learning similarity with multikernel method," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 1, pp. 131-138, Feb. 2011.
3. C. Chen, J. Zhang, X. He, and Z.-H. Zhou, "Non-parametric kernel learning with robust pairwise constraints," Int. J. Mach. Learn. Cybern., vol. 3, no. 2, pp. 83-96, 2012.
4. X. Wang, S.-X. Lu, and J.-H. Zhai, "Fast fuzzy multicategory svm based on support vector domain description," Int. J. Pattern Recognit. Artif. Intell., vol. 22, no. 1, pp. 109-120, 2008.
5. X. Wang, Q. He, D. Chen, and D. S. Yeung, "A genetic algorithm for solving the inverse problem of support vector machines," Neurocomputing, vol. 68, pp. 225-238, Oct. 2005.
6. Z. Liu, Q. Wu, Y. Zhang, and C. Philip Chen, "Adaptive least squares support vector machines filter for hand tremor canceling in microsurgery," Int. J. Mach. Learn. Cybern., vol. 2, no. 1, pp. 37-47, Mar. 2011.
7. Q. He and C. Wu, "Separating theorem of samples in Banach space for support vector machine learning," Int. J. Mach. Learn. Cybern., vol. 2, no. 1, pp. 49-54, Mar. 2011.
8. B. Schölkopf and A. Smola, Learning With Kernels, Support Vector Machines, Regularization, Optimization and Beyond. Cambridge, MA: MIT Press, 2002.
9. J. Ye, K. Chen, T. Wu, J. Li, Z. Zhao, R. Patel, M. Bae, R. Janardan, H. Liu, G. Alexander, and E. Reiman, "Heterogeneous data fusion for Alzheimer's disease study," in Proc. 14th ACM SIGKDD, 2008, pp. 1025-1033.
10. J. Ye, T. Wu, J. Li, and K. Chen, "Machine learning approaches for the neuroimaging study of Alzheimer's disease," Computer, vol. 44, no. 4, pp. 99-101, Apr. 2011.
11. L. Chen, C. Chen, and M. Lu, "A multiple-kernel fuzzy C-means algorithm for image segmentation," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 5, pp. 1263-1274, Oct. 2011.
12. C. H. Lampert, "Kernel methods in computer vision," Found. Trends Comput. Graph. Vis., vol. 4, no. 3, pp. 193-285, 2009.
13. A. Vedaldi, V. Gulshan, M. Varma, and A. Zisserman, "Multiple kernels for object detection," in Proc. IEEE ICCV, Sep. 29-Oct. 2 2009, pp. 606-613.
14. O. Chapelle, V. Vapnik, O. Bousquet, and S. Mukherjee, "Choosing multiple parameters for support vector machines," Mach. Learn., vol. 46, no. 1-3, pp. 131-159, 2002.
15. J. T. Kwok and I. W. Tsang, "Learning with idealized kernels," in Proc. 20th Int. Conf. Mach. Learn., Aug. 2003, pp. 400-407.
16. L. Wang, "Feature selection with kernel class separability," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 9, pp. 1534-1546, Sep. 2008.
17. X. Liu, L. Wang, J. Yin, and L. Liu, "Incorporation of radius-info can be simple with SimpleMKL," Neurocomputing, vol. 89, no. 15, pp. 30-38, Jul. 2012.
18. F. R. Bach, G. R. G. Lanckriet, and M. I. Jordan, "Multiple kernel learning, conic duality, and the SMO algorithm," in Proc. 21st Int. Conf. Mach. Learn., 2004, p. 6.
19. G. Lanckriet, N. Cristianini, P. Bartlett, L. E. Ghaoui, and M. I. Jordan, "Learning the kernel matrix with semidefinite programming," J. Mach. Learn. Res., vol. 5, pp. 27-72, 2004.
20. M. Hu, Y. Chen, and J. T.-Y. Kwok, "Building sparse multiple-kernel SVM classifiers," IEEE Trans. Neural Netw., vol. 20, no. 5, pp. 827-839, May 2009.
21. S. Sonnenburg, G. Rätsch, C. Schäfer, and B. Schälkopf, "Large scale multiple kernel learning," J. Mach. Learn. Res., vol. 7, pp. 1531-1565, Dec. 2006.
22. R. Alain, B. F. R. Canu, Stéphane, and G. Yves, "SimpleMKL," J. Mach. Learn. Res., vol. 9, pp. 2491-2521, Nov. 2008.
23. Z. Xu, R. Jin, I. King, and M. Lyu, "An extended level method for efficient multiple kernel learning," in Proc. Adv. NIPS, 2009, pp. 1825-1832.
24. H. Yang, Z. Xu, J. Ye, I. King, and M. R. Lyu, "Efficient sparse generalized multiple kernel learning," IEEE Trans. Neural Netw., vol. 22, no. 3, pp. 433-446, Mar. 2011.
25. J. Aflalo, A. Ben-Tal, C. Bhattacharyya, J. S. Nath, and S. Raman, "Variable sparsity kernel learning," J. Mach. Learn. Res., vol. 12, pp. 565-592, Feb. 2011.
26. M. Gönen and E. Alpaydýn, "Multiple kernel learning algorithms," J. Mach. Learn. Res., vol. 12, pp. 2211-2268, Jul. 2011.
27. S. V. N. Vishwanathan, Z. Sun, N. Theera-Ampornpunt, and M. Varma, "Multiple kernel learning and the SMO algorithm," in Proc. Adv. NIPS, Dec. 2010, pp. 2361-2369.
28. M. Varma and B. R. Babu, "More generality in efficient multiple kernel learning," in Proc. Int. Conf. Mach. Learn., Jun. 2009, pp. 1065-1072.
29. J. Liu, J. Chen, S. Chen, and J. Ye, "Learning the optimal neighborhood kernel for classification," in Proc. Int. Joint Conf. Artif. Intell., 2009, pp. 1144-1149.
30. A. Kundu, V. Tankasali, C. Bhattacharyya, and A. Ben-Tal, "Efficient algorithms for learning kernels from multiple similarity matrices with general convex loss functions," in Proc. Adv. NIPS 23, J. Lafferty, C. K. I. Williams, J. Shawe-Taylor, R. Zemel, and A. Culotta, Eds., 2010, pp. 1198-1206.
31. B. Kulis, M. Sustik, and I. Dhillon, "Learning low-rank kernel matrices," in Proc. 23rd ACM Int. Conf. Mach. Learn., 2006, pp. 505-512.
32. R. Luss and A. Aspremont, "Support vector machine classification with indefinitely kernels," in Proc. Adv. NIPS, 2007, pp. 953-960.
33. C. Cortes, M. Mohri, and A. Rostamizadeh, "Learning Non-linear combinations of kernels," in Proc. Adv. NIPS 22, Y. Bengio, D. Schuurmans, J. Lafferty, C. K. I. Williams, and A. Culotta, Eds., 2009, pp. 396-404.
34. C. Nello, S.-T. John, E. André, and K. J. S, "On kernel-target alignment," in Proc. Adv. NIPS, 2001, pp. 367-373.
35. X.-Z. Wang and C.-R. Dong, "Improving generalization of fuzzy if-then rules by maximizing fuzzy entropy," IEEE Trans. Fuzzy Syst., vol. 17, no. 3, pp. 556-567, Jun. 2009.
36. X.-Z. Wang, J.-H. Zhai, and S.-X. Lu, "Induction of multiple fuzzy decision trees based on rough set technique," Inf. Sci., vol. 178, no. 16, pp. 3188-3202, Aug. 2008.
37. A. Nemirovski, Efficient Methods in Convex Programming, Lecture Notes, 1994.
38. P. Sollich, "Bayesian methods for support vector machines: Evidence and predictive class probabilities," Mach. Learn., vol. 46, no. 1-3, pp. 21-52, 2002.
39. J. Liu, J. Chen, and J. Ye, "Large-scale sparse logistic regression," in Proc. 15th ACM SIGKDD, 2009, pp. 547-556.
40. A. Opelt, A. Pinz, M. Fussenegger, and P. Auer, "Generic object recognition with boosting," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 3, pp. 416-431, Mar. 2006.
41. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE CVPR, 2006, pp. 2169-2178.
42. A. Zien and C. S. Ong, "Multiclass multiple kernel learning," in Proc. 24th Int. Conf. Mach. Learn., 2007, pp. 1191-1198.