Proximal support vector machine using local information

Neurocomputing

Volumn 73, Issue 1-3, 2009, Pages 357-365

  Yang, Xubing ^a,b   Chen, Songcan ^a   Chen, Bin ^a   Pan, Zhisong ^c  

^a NANJING UNIVERSITY OF AERONAUTICS AND ASTRONAUTICS   (China)

^b NANJING FORESTRY UNIVERSITY   (China)

^c PLA UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

Author keywords

Eigenvalue; Manifold learning; Outlier; Proximal classification

Indexed keywords

BENCHMARK DATASETS; CLASSIFICATION ABILITY; COMPUTATION TIME; EIGENVALUE; GENERALIZED EIGENVALUE PROBLEMS; GENERALIZED EIGENVALUES; GEOMETRIC INTERPRETATION; HALF SPACES; LOCAL INFORMATION; MANIFOLD LEARNING; MATRIX SINGULARITY; OUTLIER; PROXIMAL CLASSIFICATION; PROXIMAL SUPPORT VECTOR MACHINES; QUADRATIC PROGRAMS; SUPERVISED LEARNING METHODS; SVM CLASSIFICATION;

BLIND SOURCE SEPARATION; CLASSIFIERS; GEARS; IMAGE RETRIEVAL; INFORMATION USE; LEARNING ALGORITHMS; MULTILAYER NEURAL NETWORKS; PROGRAM INTERPRETERS; SUPPORT VECTOR MACHINES; SWITCHING SYSTEMS;

EIGENVALUES AND EIGENFUNCTIONS;

ACCURACY; ARTICLE; CLASSIFIER; CONTROLLED STUDY; INFORMATION PROCESSING; LEARNING ALGORITHM; MATHEMATICAL ANALYSIS; MATHEMATICAL COMPUTING; PRIORITY JOURNAL; SUPPORT VECTOR MACHINE;

EID: 70350735981     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2009.08.002     Document Type: Article

References (44)

1. Burges C.J.C. A tutorial on support vector machine for pattern recognition. Data Mining and Knowledge Discovery 2 2 (1998) 1-47
2. Scholkopf B., Smola A., and Muller K.-R. Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation 10 (1998) 1299-1319
3. Scholkopf B., Simard P., Smola A., and Vapnik V. Prior knowledge in support vector kernels. In: Jordan M., Kearns M., and Solla S. (Eds). Advances in Neural Information Processing Systems 10 (1998), MIT Press, Cambridge, MA 640-646
4. V. Blanz, B. Scholkopf, H. Bulthoff, C. Burges, V. Vapnik, T. Vetter, Comparison of view-based object recognition algorithms using realistic 3d models, in: C. von der Malsburg, W. von Seelen, J.-C. Vorbrüggen, B. Sendhoff (Eds.), Proceedings of the International Conference on Artificial Neural Networks, Lecture Notes in Computer Science, vol. 1112, Springer, Bochum, 1996, pp. 251-256.
5. M. Schmidt, Identifying speaker with support vector networks, in: Interface '96 Proceedings, Sydney, 1996.
6. E. Osuna, R. Freund, F. Girosi, Training support vector machines: an application to face detection, in: IEEE Conference on Computer Vision and Pattern Recognition (1997) 130-136.
7. T. Joachims, Text categorization with support vector machines: learning with many relevant features, in: Proceedings of the 10th European Conference on Machine Learning, 1999, pp. 137-142.
8. G. Fung, O.L. Mangasarian, Proximal support vector machine classifiers, in: F. Provost, R. Srikant (Eds.), Proceedings of the Knowledge Discovery and Data Mining (KDD), 2001, pp. 77-86.
9. Mangasarian O.L., and Wild E.W. Multisurface proximal support vector machine classification via generalized eigenvalues. IEEE Transaction on Pattern Analysis and Machine Intelligence (PAMI) 28 1 (2006) 69-74
10. Cover T.M., and Hart P.E. Nearest neighbor pattern classification. IEEE Transactions on Information Theory 13 (1967) 21-27
11. Wu Y., Ianakiev K., and Govindaraju V. Improved k-nearset neighbor classification. Pattern Recognition 35 (2002) 2311-2318
12. Lafon S., Keller Y., and Coifman R.R. Data fusion and multicue data matching by diffusion maps. IEEE Transaction on Pattern Analysis and Machine Intelligence (PAMI) 28 11 (2006) 1784-1797
13. S. Yan, D. Xu, B. Zhang, H.-J. Zhang, Graph embedding: a general framework for dimensionality reduction, in: Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR2005).
14. Roweis S., and Saul L. Nonlinear dimensionality reduction by locally linear embedding. Science 290 (2000) 2323-2326
15. Tenenbaum J.B., de Silva V., and Langford J.C. A global geometric framework for nonlinear dimensionality reduction. Science 290 (2000) 2319-2323
16. Nelkin M., and Niyogi P. Laplacian eigenmaps and spectral techniques for embedding and clustering, Advances in Neural Information Processing Systems 14 (NIPS 2001) (2002), MIT Press, Cambridge pp. 585-591
17. H.-T. Chen, H.-W. Chang, T.-L. Liu, Local discriminant embedding and its variants, in: Proceedings of International Conference on Computer Vision and Pattern Recognition, 2005.
18. P. Mordohai, G. Medioni, Unsupervised dimensionality estimation and manifold learning in high-dimensional spaces by tensor voting, in: 19th International Joint Conference on Artificial Intelligence (IJCAI), 2005, pp. 798-803.
19. K.Q. Weinberger, L.K. Saul, Unsupervised learning of image manifolds by semidefine programming, in: Proceedings of the International Conference on Computer Vision and Pattern Recognition, Pages II, 2004, pp. 988-995.
20. H. Li, T. Jiang, K. Zhang, Efficient and robust feature extraction by maximum margin criterion, in: Proceedings of the Conference on Advances in Neural Information Processing Systems, MIT Press, Cambrigde, MA, 2004, pp. 97-104.
21. Marno V., and Theo N. Minimum MSE estimation of a regression model with fixed effects from a series of cross-sections. Journal of Econometrics 59 1-2 (1993) 125-136
22. Zhang H., Huang W., Huang Z., and Zhang B. A kernel autoassociator approach to pattern classification. IEEE Transaction on Systems, Man, and Cybernetics-Part B: CYBERNETICS 35 3 (2005)
23. Scholkopf B., and Smola A.J. Learning with Kernels (2002), MIT Press, Cambridge, MA
24. S. Mika, Kernel Fisher discriminants, Ph.D. Thesis, Technischen Universität, Berlin, Germany, 2002.
25. S. Mika, G. Rätsch, J. Weston, B. Schölkopf, K.-R. Müller, Fisher discriminant analysis with kernels, in: Y.-H. Hu, E. Wilson, J. Larsen, S. Douglas (Eds.), Neural Networks for Signal Processing IX, IEEE, 1999, pp. 41-48.
26. Mike S. A mathematical approach to kernel Fisher algorithm. In: Leen T.K., and Dietterich Völker Tresp T.G. (Eds). Advances in Neural Information Processing Systems vol. 13 (2001), MIT Press, Cambridge, MA 591-597
27. M. Kuss, T. Graepel, The geometry of kernel canonical correlation analysis, Technical Report No. 108, Max Planck Institute for Biological Cybernetics, Tubingen, Germany, May 2003.
28. Schlkopf B., Smola A., and Miller K.-R. Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation 10 5 (1998)
29. Scholkopf B., Smola A., and Muller K.-R. Kernel principal component analysis. In: Scholkopf N., Burges C.J.C., and Smola A. (Eds). Advance in Kernel Methods, Support Vector Learning (1999), MIT Press, Cambridge, MA
30. Centeno T.P., and Lawrence N.D. Optimizing kernel parameters and regularization coefficients for non-linear discriminant analysis. Journal of Machine Learning Research 7 (2006) 455-491
31. Müller K.R., Mika S., Rätsch G., et al. An introduction to kernel-based learning algorithms. IEEE Transaction on Neural Network 12 2 (2001) 181-202
32. M. Wang, S. Chen, Enhanced FMAM based on empirical kernel map, IEEE Transaction on Neural Networks 16(3), pp. 557-564.
33. P. Berkes, Handwritten digit recognition with nonlinear Fisher discriminant analysis, in: Proceedings of ICANN Volume 2, Lecture Notes in Computer Science, vol. 3696, Springer, pp. 285-287.
34. Liu C.J., and Wechsler H. A shape- and texture-based enhanced Fisher classifier for face recognition. IEEE Transactions on Image Processing 10 4 (2001) 598-608
35. Yan S., Xu D., Zhang L., Yang Q., Tang X., and Zhang H. Multilinear discriminant analysis for face recognition. IEEE Transactions on Image Processing (TIP) 16 1 (2007) 212-220
36. T. Li, S. Zhu, M. Ogihara, Efficient multi-way text categorization via generalized discriminant analysis, in: Proceedings of the Twelfth International Conference on Information and Knowledge Management (CIKM'03), 2003, pp. 317-324.
37. R. Lin, M. Yang, S.E. Levinson, Object tracking using incremental fisher discriminant analysis, in: 17th International Conference on Pattern Recognition (ICPR'04) (2), 2004, pp. 757-760.
38. M.R. Guarracino, C. Cifarelli, O. Seref, P.M. Pardalos, A parallel classification method for genomic and proteomic problems, in: 20th International Conference on Advanced Information Networking and Applications-Volume 2 (AINA'06), 2006, pp. 588-592.
39. Guarracino M.R., Cifarelli C., Seref O., and Pardalos M. A classification method based on generalized eigenvalue problems. Optimization Methods and Software 22 1 (2007) 73-81
40. Cifarelli C., Guarracino M.R., Seref O., Cuciniello S., and Pardalos P.M. Incremental classification with generalized eigenvalues. Journal of Classification 24 (2007) 205-219
41. Liu J., Chen S., and Tan X. A study on three linear discriminant analysis based methods in small sample size problem. Pattern Recognition 41 1 (2008) 102-116
42. Chen S., and Yang X. Alternative linear discriminant classifier. Pattern Recognition 37 7 (2004) 1545-1547
43. P.M. Murphy, D.W. Aha, UCI machine learning repository 〈www.ics.uci.edu/~mlearn/ML Repository.html〉, 1992.
44. Mitchell T.M. Machine Learning (1997), McGraw-Hill, Boston