Nonlinear discriminant analysis on embedded manifold

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 17, Issue 4, 2007, Pages 468-477

  Yan, Shuicheng ^a,b   Hu, Yuxiao ^b   Xu, Dong ^c   Zhang, Hong Jiang ^a,d   Zhang, Benyu ^d   Cheng, Qiansheng ^e  

^a IEEE   (United States)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^c Department of Earth and Environmental Sciences   (United States)

^d MICROSOFT RESEARCH ASIA   (China)

^e PEKING UNIVERSITY   (China)

Author keywords

Kernel design; Kernel machine; Kernel selection; Linear discriminant analysis (LDA); Manifold learning; Principal component analysis (PCA); Subspace learning

Indexed keywords

KERNEL MACHINE; KERNEL SELECTION; LAPLACIAN EIGENMAPS; LINEAR DISCRIMINANT ANALYSIS (LDA); MANIFOLD LEARNING; SUBSPACE LEARNING;

CLUSTERING ALGORITHMS; DISCRIMINANT ANALYSIS; EMBEDDED SYSTEMS; FACE RECOGNITION; LAPLACE EQUATION; LEARNING ALGORITHMS; PRINCIPAL COMPONENT ANALYSIS; PROBLEM SOLVING;

NONLINEAR ANALYSIS;

EID: 34247597810     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2007.893837     Document Type: Article

References (30)

1. G. Baudat and F. Anouar, "Generalized discriminant analysis using a kernel approach," Neural Computat., vol. 12, no. 10, pp. 2385-2404, 2000.
2. P. Belhumeur, J. Hespanha, and D. Kriegman, "Eigenfaces versus Fisher-faces: Recognition using class specific linear projection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997.
3. M. Belkin and P. Niyogi, "Laplacian eigenmaps and spectral techniques for embedding and clustering," in Proc. Adv. Neural Inf. Process. Syst., Vancouver, BC, Canada, 2001, vol. 15, pp. 585-591.
4. S. Billings and K. Lee, "Nonlinear Fisher discriminant analysis using a minimum squared error cost function and the orthogonal least squares algorithm," Neural Netw., vol. 15, no. 2, pp. 263-270, 2002.
5. Y. Bengio, J. Paiement, and P. Vincent, "Out-of-sample extensions for LLE, Isomap, MDS, eigenmaps, and spectral clustering," in Adv. Neural Inf. Process. Syst., 2003, vol. 15.
6. C. Bregler and S. M. Omohundro, "Nonlinear manifold learning for visual speech recognition," in Proc. 5th Int. Conf. Comp. Vis., Jun. 1995, pp. 494-499.
7. M. Brand, "Charting a manifold," in Proc. Adv. Neural Inf. Process. Syst., 2002, vol. 15, pp. 977-984.
8. D. Cheung, S. Lee, and Y. Xiao, "Effect of data skewness and workload balance in parallel data mining," IEEE Trans. Knowl. Data Eng., vol. 14, no. 3, pp. 498-513, May 2002.
9. F. Chung, "Spectral graph theory," in Proc. Regional Conf. Series in Math., 1997, vol. 92.
10. D. Freedman, "Efficient simplicial reconstructions of manifolds from their samples," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 10, pp. 1349-1357, Oct. 2002.
11. K. Fukunaga, Introduction to Statistical Pattern Recognition, 2nd ed. New York: Academic, 1991.
12. J. Gomes and A. Mojsilovic, "A variational approach to recovering a manifold from sample points," in Proc. Eur. Conf. Comput. Vis., Copenhagen, May 2002, pp. 3-17.
13. X. He and P. Niyogi, "Locality Preserving Projections (LPP)," TR-2002-09, 2002.
14. G. Hinton and S. Roweis, "Stochastic neighbor embedding," in Proc. Adv. Neural Inf. Process. Syst., 2002, vol. 15, pp. 857-864.
15. T. Kim and J. Kittler, "Locally linear discriminant analysis for multimodally distributed classes for face recognition with a single model image," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 3, pp. 318-327, Mar. 2005.
16. Q. Liu, R. Huang, H. Lu, and S. Ma, "Face recognition using kernel based Fisher discriminant analysis," in Proc. 5th IEEE Int. Conf. Autom. Face Gesture Recognit., May 2002, p. 197.
17. J. Lu, K. Plataniotis, and A. Venetsanopoulos, "Face recognition using kernel direct discriminant analysis algorithms," IEEE Trans. Neural Netw., vol. 14, no. 1, pp. 117-126, 2003.
18. J. MacQueen, "On convergence of k-means and partitions with minimum average variance," Ann. Math. Statist., vol. 36, p. 1084 (abstract), 1965.
19. S. Mika, G. Ratsch, J. Weston, B. Scholkopf, and K. Muller, "Fisher discriminant analysis with kernels," in Proc. IEEE Int. Workshop Neural Netw. Signal Process. IX, Aug. 1999, pp. 41-48.
20. B. Moghaddam and A. Pentland, "Probabilistic visual learning for object representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, pp. 696-710, 1997.
21. S. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, pp. 2268-2269, Dec. 2000.
22. S. Roweis, L. Saul, and G. Hinton, "Global coordination of local linear models," in Proc. Adv. Neural Inf. Process. Syst., 2001, vol. 14, pp. 889-896.
23. J. Shi and J. Malik, "Normalized cuts and image segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, pp. 888-905, 2000.
24. T. Sim, S. Baker, and M. Bsat, "The CMU pose, illumination, and expression (PIE) database," in Proc. IEEE Int. Conf. Autom. Face Gesture Recognit., May 2002, pp. 53-56.
25. Y. Teh and S. Roweis, "Automatic alignment of hidden representations," in Proc. Adv. Neural Inf. Process. Syst., 2002, vol. 15, pp. 841-848.
26. J. Tenenbaum, V. de Silva, and J. C. Langford, "A global geometric framework for nonlinear dimensionality reduction," Science, vol. 290, pp. 2319-2323, Dec. 2000.
27. K. Tsuda, T. Kin, and K. Asai, "Marginal kernels for biological sequences," Proc. BIOINFORMATICS, vol. 1, no. 1, pp. 1-8, 2002.
28. Yale Univ. Face. Database. 2002 [Online]. Available: http://cvc.yale.edu/projects/yalefaces/yalefaces.html
29. J. Yang, A. Frangi, J. Yang, D. Zhang, and Z. Jin, "KPCA plus LDA: A complete kernel Fisher discriminant framework for feature extraction and recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 2, pp. 230-244, Feb. 2005.
30. M. Yang, "Kernel eigenfaces versus kernel Fisher-faces: Face recognition using kernel methods," in Proc. 5th IEEE Int. Conf. Autom. Face. Gesture Recognit., May 2002, pp. 215-220.