Hyperellipsoidal statistical classifications in a reproducing kernel hilbert space

IEEE Transactions on Neural Networks

Volumn 22, Issue 6, 2011, Pages 968-975

  Liang, Xun ^a   Ni, Zhihao ^a  

^a RENMIN UNIVERSITY OF CHINA   (China)

Author keywords

Classification accuracy; hyperellipsoid; Mahalanobis distance; reproducing kernel Hilbert space; support vector machines

Indexed keywords

CLASSIFICATION ACCURACY; DISTANCE-BASED; EUCLIDEAN DISTANCE; HYPERELLIPSOID; HYPERSPHERICAL; MAHALANOBIS; MAHALANOBIS DISTANCES; REPRODUCING KERNEL HILBERT SPACE; REPRODUCING KERNEL HILBERT SPACES; STATISTICAL CLASSIFICATION;

COVARIANCE MATRIX; HILBERT SPACES; SUPPORT VECTOR MACHINES;

VECTOR SPACES;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER SIMULATION; METHODOLOGY; STATISTICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; MODELS, STATISTICAL; PATTERN RECOGNITION, AUTOMATED;

EID: 79957994338     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2011.2130539     Document Type: Article

References (42)

1. V. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
2. C. J. C. Burges, "A tutorial on support vector machines for pattern recognition," Data Min. Knowl. Disc., vol. 2, no. 2, pp. 121-167, Jun. 1998. (Pubitemid 128695475)
3. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods. Cambridge, U.K.: Cambridge Univ. Press, 2000.
4. B. Schölkopf and A. Smola, Learning with Kernels. Cambridge, MA: MIT Press, 2002.
5. B. Schölkopf, K. Tsuda, and J. Vert, Kernel Methods in Computational Biology. Cambridge, MA: MIT Press, 2004.
6. R. Chatpatanasiri, T. Korsrilabutr, P. Tangchanachaianan, and B. Kijsirikul, "A new kernelization framework for Mahalanobis distance learning algorithms," Neurocomputing, vol. 73, nos. 10-12, pp. 1570-1579, Jun. 2010.
7. C. Zhang, F. Nie, and S. Xiang, "A general kernelization framework for learning algorithms based on kernel PCA," Neurocomputing, vol. 73, nos. 4-6, pp. 959-967, Jan. 2009.
8. G. R. G. Lanckriet, N. Cristianini, P. Bartlett, L. E. Ghaoui, and M. I. Jordan, "Learning the kernel matrix with semidefinite programming," J. Mach. Learn. Res., vol. 5, pp. 27-72, Jan. 2004.
9. J. Mao and A. K. Jain, "A self-organizing network for hyperellipsoidal clustering (HEC)," IEEE Trans. Neural Netw., vol. 7, no. 1, pp. 16-29, Jan. 1996. (Pubitemid 126811725)
10. W. Song, X. Shaowei, J. Mao, A. Jain, D. V. Prokhorov, and D. C. Wansch, "Comments on 'A self-organizing network for hyperellipsoidal clustering (HEC)' [and reply]," IEEE Trans. Neural Netw., vol. 8, no. 6, pp. 1561-1563, Nov. 1997.
11. A. Ruiz and P. E. Lopez-de-Teruel, "Nonlinear kernel-based statistical pattern analysis," IEEE Trans. Neural Netw., vol. 12, no. 1, pp. 16-32, Jan. 2001. (Pubitemid 32190845)
12. G. R. G. Lanckriet, L. E. Ghaoui, C. Bhattacharyya, and M. I. Jordan, "A robust minimax approach to classification," J. Mach. Learn. Res., vol. 3, no. 3, pp. 555-582, Dec. 2002.
13. T. Jebara and R. Kondor, "Bhattacharyya and expected likelihood kernels," Lect. Notes Comput. Sci., vol. 2777, pp. 57-71, 2003. (Pubitemid 37053195)
14. C. Wallraven, B. Caputo, and A. Graf, "Recognition with local features: The kernel recipe," in Proc. 9th IEEE Int. Conf. Comput. Vis., vol. 1. Nice, France, Oct. 2003, pp. 257-264.
15. K. Huang, H. Yang, I. King, M. R. Lyu, and L. Chan, "The minimum error minimax probability machine," J. Mach. Learn. Res., vol. 5, pp. 1253-1286, Oct. 2004.
16. L. Zhang, W. Zhou, and L. Jiao, "Hidden space support vector machines," IEEE Trans. Neural Netw., vol. 15, no. 6, pp. 1424-1434, Nov. 2004.
17. D. Wang, D. S. Yeung, and E. C. Tsang, "Weighted Mahalanobis distance kernels for support vector machines," IEEE Trans. Neural Netw., vol. 18, no. 5, pp. 1453-1462, Sep. 2007. (Pubitemid 47408544)
18. D. Chen, Q. He, and X. Wang, "On linear separability of data sets in feature space," Neurocomputing, vol. 70, nos. 13-15, pp. 2441-2448, Aug. 2007. (Pubitemid 46825375)
19. K. Huang, H. Yang, I. King, and M. R. Lyu, "Maxi-min margin machine: Learning large margin classifiers locally and globally," IEEE Trans. Neural Netw., vol. 19, no. 2, pp. 260-272, Feb. 2008. (Pubitemid 351359291)
20. S. Xiang, F. Nie, and C. Zhang, "Learning a Mahalanobis distance metric for data clustering and classification," Pattern Recognit., vol. 41, no. 12, pp. 3600-3612, Dec. 2008.
21. C. Shen, J. Kim, and L. Wang, "Scalable large-margin Mahalanobis distance metric learning," IEEE Trans. Neural Netw., vol. 21, no. 9, pp. 1524-1530, Sep. 2010.
22. P.-H. Chen, R.-E. Fan, and C.-J. Lin, "A study on SMO-type decomposition methods for support vector machines," IEEE Trans. Neural Netw., vol. 17, no. 4, pp. 893-908, Jul. 2006. (Pubitemid 44194150)
23. B. Schölkopf, S. Mika, C. J. C. Burges, P. Knirsch, K.-R. Müller, G. Ratsch, and A. J. Smola, "Input space versus feature space in kernel-based methods," IEEE Trans. Neural Netw., vol. 10, no. 5, pp. 1000-1017, Sep. 1999.
24. X. Liang and C. Wang, "Separating hypersurfaces of SVMs in input spaces," Pattern Recognit. Lett., vol. 30, no. 5, pp. 469-476, Apr. 2009.
25. T. H. Cormen, C. E. Leiserson, R. L. Rivest, and C. Stein, Introduction to Algorithms. Cambridge, MA: MIT Press, 2001, pp. 755-756.
26. C.-C. Chang and C.-J. Lin. (2011). LIBSVM: A Library for Support Vector Machines [Online]. Available: http://www.csie.ntu.edu.tw/?cjlin/ libsvm
27. C.-C. Chang and C.-J. Lin. (2011, Mar. 13). LIBSVM FAQ [Online]. Available: http://www.csie.ntu.edu.tw/?cjlin/libsvm/faq.html#faq1
28. R.-E. Fan, P.-H. Chen, and C.-J. Lin, "Working set selection using second order information for training support vector machines," J. Mach. Learn. Res., vol. 6, pp. 1889-1918, Nov. 2005. (Pubitemid 41798130)
29. J. Hicklin, R. F. Boisvert, C. Moler, B. Miller, P. Webb, R. Pozo, K. Remington, and R. F. Boisvert. (2005). Java Matrix Package [Online]. Available: http://math.nist.gov/javanumerics/jama
30. R. Kohavi and B. Becker. UCI Machine Learning Repository [Online]. Available: http://archive.ics.uci.edu/ml/datasets/Adult
31. J. C. Platt, "Fast training of support vector machines using sequential minimal optimization," in Advances in Kernel Methods: Support Vector Learning, B. Schölkopf, C. J. C. Burges, and A. Smola, Eds. Cambridge, MA: MIT Press, 1998, pp. 41-65.
32. G. Fung and O. L. Mangasarian, "Proximal support vector machine classifiers," in Proc. 7th ACM SIGKDD Int. Conf. Knowl. Disc. Data Min., San Francisco, CA, 2001, pp. 77-86.
33. G. M. Fung, O. L. Mangasarian, and A. J. Smola, "Minimal kernel classifiers," J. Mach. Learn. Res., vol. 3, pp. 303-321, Nov. 2002.
34. Libsvm Data Sets [Online]. Available: http://www.csie.ntu.edu.tw/?cjlin/ libsvmtools/datasets
35. J. Wang, K. N. Plataniotis, J. Lu, and A. N. Venetsanopoulos, "Kernel quadratic discriminant analysis for small sample size problem," Pattern Recognit., vol. 41, no. 5, pp. 1528-1538, May 2008.
36. J. B. Taylor, Economics, 2nd ed. Boston, MA: Houghton Mifflin, 1998, p. 45.
37. H. R. Varian, Intermediate Microeconomics, 4th ed. New York: Norton, 1996, p. 344.
38. SVMlight [Online]. Available: http://svmlight.joachims.org
39. R. Collobert and S. Bengio, "SVMTorch: Support vector machines for large-scale regression problems," J. Mach. Learn. Res., vol. 1, pp. 143-160, Feb. 2001. (Pubitemid 33738779)
40. MATLAB SVM Toolbox [Online]. Available: http://www.isis.ecs.soton.ac. vuk/resources/svminfo
41. S. Amari and S. Wu, "Improving support vector machine classifiers by modifying kernel functions," Neural Netw., vol. 12, no. 6, pp. 783-789, Jul. 1999. (Pubitemid 29359218)
42. N. Cristianini, J. Shawe-Taylor, and C. Campbell, "Dynamically adapting kernels in support vectors," in Advances in Neural Information Processing Systems, vol. 11, M. S. Kearns, S. A. Solla, and D. A. Cohn, Eds. Cambridge, MA: MIT Press, 1998.