Learning similarity with multikernel method

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 41, Issue 1, 2011, Pages 131-138

  Tang, Yi ^a   Li, Luoqing ^a   Li, Xuelong ^b  

^a HUBEI UNIVERSITY   (China)

^b XI AN INSTITUTE OF OPTICS AND PRECISION MECHANICS   (China)

Author keywords

Boosting; learning similarity; multikernel

Indexed keywords

BOOSTING; ERROR BOUND; KEY ISSUES; LEARNING SIMILARITY; MACHINE-LEARNING; MULTI-KERNEL;

ALGORITHMS;

EID: 79551682011     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2010.2048312     Document Type: Article

References (40)

1. N. Belkin and P. Niyogi, "Laplacian eigenmaps for dimensionality reduction and data representation," Neural Comput., vol. 15, no. 6, pp. 1373-1396, Jun. 2003.
2. N. Belkin and P. Niyogi, "Semi-supervised learning on Riemannian manifolds," Mach. Learn., vol. 56, no. 1-3, pp. 209-239, Jul. 2004.
3. H. Chen, L. Q. Li, and J. T. Peng, "Error bounds of multi-graph regularized semi-supervised classification," Inf. Sci., vol. 179, no. 12, pp. 1960-1969, May 2009.
4. X. Li and Y. Pang, "Deterministic column-based matrix decomposition," IEEE Trans. Knowl. Data Eng., vol. 22, no. 1, pp. 145-149, Jan. 2010.
5. Y. Yuan, X. Li, Y. Pang, X. Lu, and D. Tao, "Binary sparse nonnegative matrix factorization," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 5, pp. 772-777, May 2009.
6. T. F. Cox and M. A. A. Cox, Multidimensional Scaling. London, U.K.: Chapman & Hall, 1994.
7. S. Roweis and L. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, no. 5500, pp. 2323-2326, Dec. 2000.
8. J. B. Tenenbaum, V. de Silva, and J. C. Langford, "A global geometric framework for nonlinear dimensionality reduction," Science, vol. 290, no. 5500, pp. 2319-2323, Dec. 2000.
9. X. Li, S. Lin, S. Yan, and D. Xu, "Discriminant locally linear embedding with high-order tensor data," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 2, pp. 342-352, Apr. 2008.
10. D. Tao, X. Li, X. Wu, and S. Maybank, "Geometry mean for subspace selection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 260-274, Feb. 2009.
11. X. He and P. Niyogi, "Locality preserving projections," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2003.
12. X. He, S. Yan, Y. Hu, P. Niyogi, and H.-J. Zhang, "Face recognition using Laplacianfaces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 3, pp. 328-340, Mar. 2005.
13. J. Baxter, "A Bayesian information theoretic model of learning to learn via multiple task sampling," Mach. Learn., vol. 28, no. 1, pp. 7-39, Jul. 1997.
14. J. Baxter, "A model for inductive bias learning," J. Artif. Intell. Res., vol. 12, pp. 149-198, 2000.
15. B. Bakker and T. Heskes, "Task clustering and gating for Bayesian multitask learning," J. Mach. Learn. Res., vol. 4, pp. 83-99, Dec. 2003.
16. S. Ben-David and R. Schuller, "Exploiting task relatedness for multiple task learning," in Proc. Comput. Learn. Theory, 2003, vol. 2777, pp. 567-580.
17. L. Wang, P. Xue, and K.-L. Chan, "Two criteria for model selection in multiclass support vector machines," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 6, pp. 1432-1448, Dec. 2008.
18. A. M. Martinez, "Recognizing imprecisely localized, partially occluded and expression variant faces from a single sample per class," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 6, pp. 748-763, Jun. 2002.
19. S. Chopra, R. Hadsell, and Y. LeCun, "Learning a similarity metric dis-criminatively, with application to face verification," in Proc. CVPR, 2005, pp. 539-546.
20. F. Fleuret and G. Blanchard, "Pattern recognition from one example by chopping," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2005.
21. A. Maurer, "Learning similarity with operator-valued large-margin classifiers," J. Mach. Learn. Res., vol. 9, pp. 1049-1082, Jun. 2008.
22. A. Bar-Hillel, T. Hertz, N. Shental, and D. Weinshall, "Learning a Maha-lanobis metric from equivalence constraints," J. Mach. Learn. Res., vol. 6, pp. 937-965, Dec. 2005.
23. S. M. Xiang, F. P. Nie, and C. Zhang, "Learning a Mahalanobis distance metric for data clustering and classification," Pattern Recognit., vol. 41, no. 12, pp. 3600-3612, Dec. 2008.
24. B. Schölkopf, A. J. Smola, and K. Müller, "Nonlinear component analysis as a kernel eigenvalue problem," Neural Comput., vol. 10, no. 5, pp. 1219-1299, Jul. 1998.
25. J. Shawe-Taylor and N. Cristianini, Kernel Methods for Pattern Analysis. Cambridge, MA: Cambridge Univ. Press, 2004.
26. G. Lanckriet, N. Cristianini, P. Bartlett, L. El Ghaoui, and M. I. Jordan, "Learning the kernel matrix with semidefinite programming," J. Mach. Learn. Res., vol. 5, pp. 27-72, Dec. 2004.
27. A. Argyriou, M. Herbster, and M. Pontil, "Combining graph Laplacians for semi-supervised learning," in Proc. NIPS, Cambridge, MA, 2006, pp. 67-74.
28. Q. Wu, Y. M. Ying, and D. X. Zhou, "Multi-kernel regularized classifiers," J. Complex., vol. 23, no. 1, pp. 108-134, Feb. 2007.
29. Y. M. Ying and D. X. Zhou, "Learnability of Gaussians with flexible variances," J. Mach. Learn. Res., vol. 8, pp. 249-276, May 2007.
30. Y. Freund and R. E. Schapire, "A short introduction to boosting," J. Jpn. Soc. Artif. Intell., vol. 14, no. 5, pp. 771-780, 1999.
31. J. Friedman, T. Hastie, and R. Tibshirani, "Additive logistic regression: A statistical view of boosting," Ann. Stat., vol. 28, pp. 337-374, 2000.
32. F. Cucker and S. Smale, "On the mathematical foundations of learning," Bull. Amer. Math. Soc., vol. 39, pp. 1-49, 2002.
33. B. Schölkopf and A. J. Smola, Learning With Kernels. Cambridge, MA: MIT Press, 2002.
34. F. Cucker and D.-X. Zhou, Learning Theory: An Approximation Theory Viewpoint. Cambridge, MA: Cambridge Univ. Press, 2007.
35. C. A. Micchelli and M. Pontil, "Learning the kernel function via the regularization," J. Mach. Learn. Res., vol. 6, pp. 1099-1125, Dec. 2005.
36. J.-K. Zhu, S. Hoi, and M. R.-T. Lyu, "Robust regularized kernel regression," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 6, pp. 1639-1644, Dec. 2008.
37. P. L. Bartlett and S. Mendelson, "Rademacher and Gaussian complexities: Risk bounds and structural results," J. Mach. Learn. Res., vol. 3, pp. 463-482, Mar. 2002.
38. J. M. Borwein and A. S. Lewis, Convex Analysis and Nonlinear Optimization Theory and Examples. New York: Springer-Verlag, 2000.
39. X. Li, Y. Pang, and Y. Yuan, "L1-norm-based 2DPCA," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 4, pp. 1170-1175, Aug. 2010.
40. D. Cai, X. He, and J. Han, "Sparse projections over graph," in Proc. AAAI, 2008, pp. 610-615.