Kernel pooled local subspaces for classification

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 35, Issue 3, 2005, Pages 489-502

  Zhang, Peng ^a   Peng, Jing ^a   Domeniconi, Carlotta ^b  

^a TULANE UNIVERSITY   (United States)

^b GEORGE MASON UNIVERSITY   (United States)

Author keywords

Classification; Kernel machines; Nearest neighbors; Subspace analysis

Indexed keywords

COMPUTER VISION; EIGENVALUES AND EIGENFUNCTIONS; LEARNING SYSTEMS; PRINCIPAL COMPONENT ANALYSIS;

GENERALIZED DISCRIMINANT ANALYSIS; KERNEL MACHINES; NEAREST NEIGHBOR RULE; SUBSPACE ANALYSIS;

PATTERN RECOGNITION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOLOGICAL MODEL; CLUSTER ANALYSIS; COMPARATIVE STUDY; COMPUTER ASSISTED DIAGNOSIS; COMPUTER GRAPHICS; COMPUTER SIMULATION; EVALUATION; FACE; FEMALE; HISTOLOGY; HUMAN; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; INFORMATION RETRIEVAL; MATHEMATICAL COMPUTING; METHODOLOGY; PHOTOGRAPHY; REPRODUCIBILITY; SAMPLE SIZE; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING; STATISTICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; CLUSTER ANALYSIS; COMPUTER GRAPHICS; COMPUTER SIMULATION; FACE; FEMALE; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; INFORMATION STORAGE AND RETRIEVAL; MODELS, BIOLOGICAL; MODELS, STATISTICAL; NUMERICAL ANALYSIS, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; PHOTOGRAPHY; REPRODUCIBILITY OF RESULTS; SAMPLE SIZE; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING, COMPUTER-ASSISTED; SUBTRACTION TECHNIQUE;

EID: 20444381620     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2005.846641     Document Type: Article

References (34)

1. T. F. Cootes and C. J. Taylor, "Active shape models: smart snakes," in Proc. British Machine Vision Conf., 1992, pp. 9-18.
2. M. C. Burl, U. M. Fayyad, P. Perona, P. Smyth, and M. P. Burl, "Automating the hunt for volcanos on venus," in Proc. IEEE Conf. Comput. Vision Pattern Recogn., 1994.
3. S. K. Nayar, S. Baker, and H. Murase, "Parametric feature detection," in Proc. IEEE Conf. Comput. Vision Pattern Recogn., 1994, pp. 471-477.
4. A. Pentland, B. Moghaddam, and T. Starner, "View-based and modular eigenspaces for face recognition," in Proc. IEEE Conf. Comput. Vision Pattern Recogn., 1994.
5. B. Moghaddam and A. Pentland, "Probabilistic visual learning for object representation," IEEE Trans. Pattern Anal. Machine Intell., vol. 19, no. 7, pp. 696-710, Jul. 1997.
6. M. Turk and A. Pentland, "Eigenfaces for recognition," Cognitive Neurosci., vol. 3, no. 1, 1991.
7. B. Moghaddam, "Principal manifolds and probabilistic subspaces for visual recognition," IEEE Trans. Pattern Anal. Machine Intell., vol. 24, no. 6, pp. 780-788, Jun. 2002.
8. K. Etemad and R. Chellappa, "Discriminant analysis for recognition of human faces," in Proc. Int. Conf. Acoust., Speech, Signal Process., 1996, pp. 2148-2151.
9. V. I. Belhumeur, J. P. Hespanha, and D. J. Kriegman, "Eigenfaces versus fisherfaces: recognition using class specific linear projection," IEEE Trans. Pattern Anal. Machine Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997.
10. I. T. Jolliffe, Principal Component Analysis. New York: Springer-Verlag, 1986.
11. P. Comon, "Independent, component analysis - A new concept?," Signal Process., vol. 36, pp. 287-314, 1994.
12. D. DeMers and G. Cottrell, "Nonlinear dimensionality reduction," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 1993, vol. 5.
13. M. A. Kramer, "Nonlinear principal components analysis using autoassociative neural networks," Amer. Inst. Chem. Eng. J., vol. 32, no. 2, pp. 233-234, 1991.
14. B. Scholkopf, A. Smola, and K. R. Muller, "Nonlinear component analysis as a kernel eigenvalue problem," Neural Comput., vol. 10, pp. 1299-1319, 1998.
15. G. Baudat and F. Anouar, "Generalized discriminant analysis using a kernel approach," Neural Comput., vol. 12, pp. 2385-2404, 2000.
16. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods. Cambridge, U.K.: Cambridge Univ. Press, 2000.
17. J. Lu, K. N. Plataniotis, and A. N. Venetsanopoulos, "Face recognition using kernel direct discriminant analysis algorithms," IEEE Trans. Neural Networks, vol. 14, no. 1, pp. 117-126, Jan. 2003.
18. R. Courant and D. Hilbert, Eds., Methods of Mathematical Physics. New York: Interscience, 1953, vol. 1.
19. T. Hastie and W. Stuetzle, "Principal curves," J. Amer. Statist. Assoc., vol. 11, no. 1, pp. 193-213, 1999.
20. R. O. Duda and P. E. Hart, Pattern Classification and Scene Analysis. New York: Wiley, 1973.
21. K. Fukunaga, Introduction to Statistical Pattern Recognition. New York: Academic, 1990.
22. H. Yu and J. Yang, "A direct LDA algorithm for high-dimension data with application to face recognition," Pattern Recogn., vol. 34, pp. 2067-2070, 2001.
23. L.-F. Chen, H.-Y. M. Liao, M.-T. Ko, J.-C. Lin, and G.-J. Yu, "A new lda-based face recognition system which can solve the small sample size problem," Pattern Recogn., vol. 33, pp. 1713-1726, 2001.
24. F. Fukunaga and W. Koontz, "Applications of the Karhunen-Loève expansion to feature selection and ordering," IEEE Trans. Comput., vol. C-19, no. 5, pp. 311-318, 1970.
25. X. Huo et al., "Optimal Reduced-Rank Quadratic Classifiers Using the Fukunaga-Koontz Transform, With Applications to Automated Target Recognition," Tech. Rep., Stanford Univ., Georgia Inst. Technol., Lockheed Martin Co., Mar. 2003.
26. X. S. Zhou and T. S. Huang, "Small sample learning during multimedia retrieval using biasmap," in Proc. IEEE Conf. Comput. Vision Pattern Recogn., 2001.
27. K. Fukumizu, F. R. Bach, and M. I. Jordan, "Dimensionality reduction for supervised learning with reproducing kernel hilbert spaces," J. Machine Learning Res., vol. 5, pp. 73-99, 2004.
28. T. Hastie and R. Tibshirani, "Discriminant adaptive nearest neighbor classification and regression," in Advances in Neural Information Processing Systems, D. S. Touretzky, M. C. Mozer, and M. E. Hasselmo, Eds. Cambridge. MA: MIT Press, 1996, vol. 8, pp. 409-415.
29. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Sci., vol. 290, pp. 2323-2326, 2000.
30. S. J. Raudys and A. K. Jain, "Small sample size effects in statistical pattern recognition: recommendations for practitioners," IEEE Trans. Pattern Anal. Machine Intell., vol. 13, no. 3, pp. 252-264, Mar. 1991.
31. R. Beveridge, K. She, B. Draper, and G. Givens, "A nonparametric statistical comparison of principal component and linear discriminant subspaces for face recognition," in Proc. IEEE Computer Soc. Conf. Comput. Vision Pattern Recogn., vol. 1, 2001, pp. 535-542.
32. F. Cucker and S. Smale, "On the mathematical foundations of learning," Bull. Amer. Math. Soc., vol. 39, no. 1, pp. 1-49, 2001.
33. P. Zhang and J. Peng, "Svm vs regularized least squares classification," in Proc. IEEE Int. Conf. Pattern Recogn., vol. 1, 2004, pp. 176-179.
34. P. Zhang and J. Peng, "Parzen Windows, Regularized Least Squares and Discriminant Analysis," Tech. Rep., Tulane Univ., New Orleans, LA, 2004.