Weighted Mahalanobis distance kernels for support vector machines

IEEE Transactions on Neural Networks

Volumn 18, Issue 5, 2007, Pages 1453-1462

  Wang, Defeng ^a,b   Yeung, Daniel S ^b   Tsang, Eric C C ^b  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^b HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

Author keywords

Indefinite kernels; Pattern recognition; Support vector machines (SVMs)

Indexed keywords

ALGORITHMS; CLUSTER ANALYSIS; DATA STRUCTURES; PATTERN RECOGNITION; SUPERVISED LEARNING;

DATA DISTRIBUTION INFORMATION; EUCLIDEAN DISTANCE; INDEFINITE KERNELS; WEIGHTED MAHALANOBIS DISTANCE KERNELS;

SUPPORT VECTOR MACHINES;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER SIMULATION; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; STATISTICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; MODELS, STATISTICAL; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY;

EID: 34548651702     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2007.895909     Document Type: Article

References (33)

1. V. N. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1999.
2. P.-H. Chen, R.-E. Fan, and C.-J. Lin, "A study on SMO-type decomposition methods for support vector machines," IEEE Trans. Neural Netw., vol. 17, no. 4, pp. 893-908, Jul. 2006.
3. B. Mukherjee, L. Heberlein, and K. Levitt, "Network intrusion detection," IEEE Trans. Neural Netw., vol. 8, no. 3, pp. 26-41, May 1994.
4. C. Christodoulou and C. Pattichis, "Unsupervised pattern recognition for the classification of EMG signals," IEEE Trans. Biomed. Eng., vol. 46, no. 2, pp. 169-178, Feb. 1999.
5. S. Veeramachaneni and G. Nagy, "Style context with second-order statistics," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 1, pp. 14-22, Jan. 2005.
6. M. J. Er, W. Chen, and S. Wu, "High-speed face recognition based on discrete cosine transform and RBF neural networks," IEEE Trans. Neural Netw., vol. 16, no. 3, pp. 679-691, May 2005.
7. K. Huang, H. Yang, I. King, and M. R. Lyu, "Learning large margin classifiers locally and globally," in Proc. 21st Int. Conf. Mach. Learn. (ICML), Banff, Canada, 2004, pp. 401-408.
8. D. DeCoste and B. Schölkopf, "Training invariant support vector machines," Mach. Learn., vol. 46, pp. 161-190, 2002.
9. B. Haasdonk and D. Keysers, "Tangent distance kernels for support vector machines," in Proc. 16th Int. Conf. Pattern Recognit., 2002, pp. 864-868.
10. B. Schölkopf, C. Burges, and V. Vapnik, "Incorporating invariances in support vector learning machines," in Proc. Int. Conf. Artif. Neural Netw. (ICANN), Bochum, Germany, 1996, pp. 47-52.
11. B. Haasdonk, "Feature space interpretation of SVMs with indefinite kernels," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 4, pp. 482-492, Apr. 2005.
12. D. Keysers, W. Macherey, J. Dahmen, and H. Ney, "Learning of variability for invariant statistical pattern recognition," in Lecture Notes in Computer Science. Berlin, Germany: Springer Verlag, 2001, vol. 2167, pp. 263-275.
13. J. Lee, J. Wang, C. Zhang, and Z. Bian, "Probabilistic tangent subspace: A unified view," in Proc. 21st Int. Conf. Mach. Learn. (ICML), Banff, Canada, 2004, pp. 528-535.
14. C. Bahlmann, B. Haasdonk, and H. Burkhardt, "Handwriting recognition with support vector machines - A kernel approach," in Proc. 8th Int. Workshop Frontiers Handwriting Recognit., Canada, 2002, pp. 49-54.
15. C. Burges, "A tutorial on support vector machines for pattern recognition," Data Mining Knowl. Discovery, vol. 2, pp. 121-167, 1998.
16. B. Schölkopf and A. J. Smola, Learning With Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. Cambridge, MA: MIT Press, 2001.
17. B. Schölkopf, "The kernel trick for distances," in Advances in Neural Information Processing System. Cambridge, MA: MIT Press, 2000.
18. C. Berg, J. Christensen, and P. Ressel, Harmonic Analysis on Semigroups: Theory of Positive Definite and Related Function. New York: Springer-Verlag, 1984.
19. V. Vapnik, S. Golowich, and A. Smola, "Support vector method for function approximation, regression estimation, and signal processing," in Advances in Neural Information Processing Systems 9. Cambridge, MA: MIT Press, 1997, pp. 281-287.
20. H. T. Lin and C. J. Lin, "A study on sigmoid kernels for SVM and the training of non-PSD kernels by SMO-type methods," Nat. Taiwan Univ., 2003, Tech. Rep..
21. S. Everitt, S. Landau, and M. Leese, Cluster Analysis. London, U.K.: Hodder Arnold, 2001.
22. A. K. Jain and R. Dubes, Algorithms for Clustering Data. Englewood Cliffs, NJ: Prentice-Hall, 1988.
23. J. H. Ward, "Hierarchical grouping to optimize an objective function," J. Amer. Statist. Assoc., vol. 58, pp. 236-244, 1963.
24. S. Salvador and P. Chan, "Determining the number of clusters/segments in hierarchical clustering/segmentation algorithms," in Proc. 16th IEEE Int. Conf. Tools with AI, 2004, pp. 576-584.
25. D. Eppstein, "Fast hierarchical clustering and other applications of dynamic closest pairs," in Proc. 9th ACM-SIAM Symp. Discrete Algorithms, San Francisco, CA, 1998, pp. 619-628.
26. G. H. Golub and C. F. Van Loan, Matrix Computations. Baltimore, MD: The John Hopkins Univ. Press, 1983.
27. B. Haasdonk and C. Bahlmann, "Learning with distance substitution kernels," in Proc. 26th DAGM Symp. Pattern Recognit., 2004, pp. 220-227.
28. A. Ruiz and P. E. Lopez-de Teruel, "Nonlinear kernel-based statistical pattern analysis," IEEE Trans. Neural Netw., vol. 12, no. 1, pp. 16-32, Jan. 2001.
29. C.-C. Chang and C.-J. Lin, "LIBSVM: A Library for Support Vector Machines," 2001 [Online]. Available: http://www.csie.ntu.edu.tw/_cjlin/libsvm
30. J. Sturm, "Using SEDUMI 1.02, a MATLAB toolbox for optimization over symmetric cones," Optim. Methods Software, vol. 11, pp. 625-653, 1999.
31. G. Rätsch, T. Onoda, and K. R. Müller, "Soft margins for AdaBoost," Mach. Learn., vol. 42, no. 3, pp. 287-320, 2001.
32. C.-C. Chang and C.-J. Lin, "Training nu-support vector classifiers: Theory and algorithms," Neural Comput., vol. 13, pp. 2119-2147, 2001.
33. K. Ikeda, "Effects of kernel function on nu support vector machines in extreme cases," IEEE Trans. Neural Netw., vol. 17, no. 1, pp. 1-9, Jan. 2006.