The kernel common vector method: A novel nonlinear subspace classifier for pattern recognition

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 37, Issue 4, 2007, Pages 937-951

  Cevikalp, Hakan ^a   Neamtu, Marian ^b   Barkana, Atalay ^c  

^a ESKISEHIR OSMANGAZI UNIVERSITY   (Turkey)

^b VANDERBILT UNIVERSITY   (United States)

^c ANADOLU UNIVERSITY   (Turkey)

Author keywords

Common vector (CV); Kernel based subspace method; Pattern recognition; Subspace classifier

Indexed keywords

COVARIANCE MATRIX; EIGENVALUES AND EIGENFUNCTIONS; MATHEMATICAL MODELS; NUMERICAL METHODS; SUPPORT VECTOR MACHINES; VECTORS;

COMON VECTOR (CV); KERNEL-BASED SUBSPACE METHOD; NONLINEAR SUBSPACE CLASSIFIER;

PATTERN RECOGNITION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; COMPUTER SIMULATION; DECISION SUPPORT SYSTEM; METHODOLOGY; NONLINEAR SYSTEM; THEORETICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; DECISION SUPPORT TECHNIQUES; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MODELS, THEORETICAL; NONLINEAR DYNAMICS; PATTERN RECOGNITION, AUTOMATED;

EID: 34547101458     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2007.896011     Document Type: Article

References (32)

1. E. Oja, Subspace Methods of Pattern Recognition. New York: Res. Stud. Press, 1983.
2. J. Laaksonen, "Subspace classifiers in recognition of handwritten digits," Ph.D. dissertation, Helsinki Univ. Technol., Espoo, Finland, 1997.
3. S.-W. Kim and B. J. Oommen, "On utilizing search methods to select subspace dimensions for kernel-based nonlinear subspace classifiers," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 1, pp. 136-141, Jan. 2005.
4. S. Watanabe, P. F. Lambert, C. A. Kulikowski, J. L. Buxton, and R. Walker, "Evaluation and selection of variables in pattern recognition," in Computer and Information Sciences II. New York: Academic, 1967, p. 91.
5. S. Watanabe and N. Pakvasa, "Subspace method in pattern recognition," in Proc. 1st Int. Conf. Pattern Recog., Washington, DC, 1973, pp. 25-32.
6. K. Fukunaga and W. L. Koontz, "Application of the Karhunen-Loeve expansion to feature selection and ordering," IEEE Trans. Comput. vol. C-19, no. 4, pp. 311-318, Apr. 1970.
7. T. Kohonen, G. Nemeth, K. J. Bry, M. Jalanko, and H. Riittinen, "Spectral classification of phonemes by learning subspaces," in Proc. 5th Int. Conf. Acoust., Speech, Signal Process., Washington, DC, 1979, pp. 97-100.
8. M. Kuusela and E. Oja, "The averaged learning subspace method for spectral pattern recognition," in Proc. 6th Int. Conf. Pattern Recog., Munchen, Germany, 1982, pp. 134-137.
9. J. Laaksonen and E. Oja, "Subspace dimension selection and averaged learning subspace method in handwritten digit classification," in Proc. ICANN, Bochum, Germany, Jul. 1996, pp. 227-232.
10. C. M. Bishop, Neural Networks for Pattern Recognition. New York: Oxford Univ. Press, 1995, pp. 7-9.
11. M. Turk and A. P. Pentland, "Eigenfaces for recognition," J. Cogn. Neurosci., vol. 3, no. 1, pp. 71-86, 1991.
12. R. A. Fisher, "The use of multiple measurements in taxonomic problems," Ann. Eugen., vol. 7, no. 2, pp. 179-188, 1936.
13. M. B. Gulmezoglu, V. Dzhafarov, M. Keskin, and A. Barkana, "A novel approach to isolated word recognition," IEEE Trans. Speech Audio Process., vol. 7, no. 6, pp. 620-628, Nov. 1999.
14. M. B. Gulmezoglu, V. Dzhafarov, and A. Barkana, "The common vector approach and its relation to principal component analysis," IEEE Trans. Speech Audio Process., vol. 9, no. 6, pp. 655-662, Sep. 2001.
15. H. Cevikalp, B. Barkana, and A. Barkana, "A comparison of the common vector and the discriminative common vector methods for face recognition," in Proc. 9th World Multi-Conf. Systemics, Cybern. and Inf., Orlando, FL, 2005.
16. T. Balachander and R. Kothari, "Kernel based subspace pattern classification," in Proc. Int. Joint Conf. Neural Netw., 1999, vol. 5, pp. 3119-3122.
17. K. Tsuda, "Subspace classifier in reproducing kernel Hilbert space," in Proc. Int. Joint Conf. Neural Netw., 1999, vol. 5, pp. 3454-3457.
18. B. Schölkopf, A. J. Smola, and K. R. Muller, "Nonlinear component analysis as a kernel eigenvalue problem," Neural Comput., vol. 10, no. 5, pp. 1299-1319, Jul. 1998.
19. H. Cevikalp, M. Neamtu, M. Wilkes, and A. Barkana, "Discriminative common vectors for face recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 1, pp. 4-13, Jan. 2005.
20. H. Cevikalp, M. Neamtu, and M. Wilkes, "Discriminative common vectors method with kernels," IEEE Trans. Neural Netw., vol. 17, no. 6, pp. 1550-1565, Nov. 2006.
21. J. Xu and L. Zikatanov, "The method of alternating projections and the method of subspace corrections in Hilbert space," J. Amer. Math. Soc., vol. 15, no. 3, pp. 573-597, 2002.
22. A. M. Martinez and R. Benavente, "The AR face database," Comput. Vis. Center, Barcelona, Spain, CVC Tech. Rep. 24, 1998.
23. S. A. Nene, S. K. Nayar, and H. Murase, "Columbia Object Image Library (COIL-100)," Columbia Univ., New York, Tech. Rep., CUCS-006-96, Feb. 1996.
24. UCI-Benchmark Repository - A huge collection of artificial and real word data sets, Univ. California Irvine. Online. Available: http://www.ics.edu/~mlearn/MLRepository.html
25. F. Perez-Cruz and O. Bousquet, "Kernel methods and their potential use in signal processing," IEEE Signal Process. Mag., vol. 21, no. 3, pp. 57-65, May 2004.
26. Y. Ariki and Y. Motegi, "Segmentation and recognition of hand written characters using subspace method," in Proc. 3rd Int. Conf. Doc. Anal. and Recog., Montreal, PQ, Canada, 1995, pp. 120-123.
27. C.-W. Hsu and C.-J. Lin, "A comparison of methods for multiclass support vector machines," IEEE Trans. Neural Netw., vol. 13, no. 2, pp. 415-425, Mar. 2002.
28. G. Baudat and F. Anouar, "Generalized discriminant analysis using a kernel approach," Neural Comput., vol. 12, no. 10, pp. 2385-2404, Oct. 2000.
29. M. van Breukelen, R. P. W. Duin, D. M. J. Tax, and J. E. den Hartog, "Handwritten digit recognition by combined classifiers," Kybernetika, vol. 34, no. 4, pp. 381-386, 1998.
30. A. K. Jain, R. P. W. Duin, and J. Mao, "Statistical pattern recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 1, pp. 4-37, Jan. 2000.
31. L. O. Jimenez and D. A. Landgrebe, "Supervised classification in high dimensional space: Geometrical, statistical and asymptotical properties of multivariate data," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev. vol. 28, no. 1, pp. 39-54, Feb. 1998.
32. A. J. Smola and B. Schölkopf, "Sparse greedy matrix approximation for machine learning," in Proc. ICML, P. Langley, Ed., 2000, pp. 911-918.