Feature extraction using constrained maximum variance mapping

Pattern Recognition

Volumn 41, Issue 11, 2008, Pages 3287-3294

  Li, Bo ^a,b   Huang, De Shuang ^a   Wang, Chao ^a,b   Liu, Kun Hong ^a,b  

^a INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

^b UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA   (China)

Author keywords

Feature extraction; LDA; LPP; Multi manifolds learning; MVP; Subspace; UDP

Indexed keywords

APPROXIMATION ALGORITHMS; CANNING; CONFORMAL MAPPING; DATABASE SYSTEMS; DISCRIMINANT ANALYSIS; EDUCATION; EIGENVALUES AND EIGENFUNCTIONS; EXTRACTION; FACE RECOGNITION; LEARNING ALGORITHMS; MATHEMATICAL TRANSFORMATIONS;

CMU PIE; ELSEVIER (CO); EXPERIMENTAL RESULTS; EXTRACTION METHODS; FACE DATABASES; FEATURE EXTRACTION METHODS; FERET FACE DATABASE; HANDWRITING DATA; LEARNING BASED APPROACH; LINEAR APPROXIMATIONS; LINEAR DISCRIMINANT ANALYSIS (CLDA); LINEAR TRANSFORMATIONS; LOCAL GEOMETRY; LOCAL STRUCTURES; LOCALITY PRESERVING PROJECTIONS; MANIFOLD LEARNING; PATTERN CLASSIFICATIONS;

FEATURE EXTRACTION;

EID: 48149086066     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2008.05.014     Document Type: Article

References (41)

1. Tenenbaum J.B., de Silva V., and Langford J.C. A global geometric framework for nonlinear dimensionality reduction. Science 290 (2000) 2319-2323
2. Roweis S.T., and Saul L.K. Nonlinear dimensionality reduction by locally linear embedding. Science 290 (2000) 2323-2326
3. Saul L.K., and Roweis S.T. Think globally, fit locally: unsupervised learning of low dimensional manifolds. J. Mach. Learn. Res. 1 4 (2003) 119-155
4. Belkin M., and Niyogi P. Laplacian eigenmaps and spectral techniques for embedding and clustering. In: Dietterich T.G., Becker S., and Ghahramani Z. (Eds). Advances in Neural Information Processing Systems vol. 14 (2002), MIT Press, Cambridge, MA, USA 585-591
5. Belkin M., and Niyogi P. Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput. 15 6 (2003) 1373-1396
6. Donoho D.L., and Grimes C.E. Hessian eigenmaps: locally linear embedding techniques for high-dimensional data. Proc. Natl. Acad. Arts Sci. 110 (2003) 5591-5596
7. Weinberger K.Q., and Saul L.K. Unsupervised learning of image manifolds by semidefinite programming. Int. J. Comput. Vision 70 1 (2006) 77-90
8. Zhang Z., and Zha H. Principal manifolds and nonlinear dimensionality reduction by local tangent space alignment. SIAM J. Sci. Comput. 26 1 (2004) 313-338
9. N.D. Lawrence, J. Quiñonero-Candela, Local distance preservation in the GP-LVM through back constraints, in: Proceedings of the 23rd International Conference on Machine Learning, Pittsburgh, PA, 2006.
10. Jolliffe I.T. Principal Component Analysis (1986), Springer, New York
11. Belhumeour P.N., Hespanha J.P., and Kriegman D.J. Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 19 7 (1997) 711-720
12. MartõÂnez A.M., and Kak A.C. PCA versus LDA. IEEE Trans. Pattern Anal. Mach. Intell. 23 2 (2001) 228-233
13. Scholkopf B., Smola A., and Muller K.R. Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput. 10 5 (1998) 1299-1319
14. Mika S., Ratsch G., Weston J., Scholkopf B., Smola A., and Muller K.-R. Constructing descriptive and discriminative nonlinear features: Rayleigh coefficients in kernel feature spaces. IEEE Trans. Pattern Anal. Mach. Intell. 25 5 (2003) 623-628
15. Zheng W., Zhao L., and Zou C. Foley-Sammon optimal discriminant vectors using kernel approach. IEEE Trans. Neural Networks 16 1 (2005) 1-9
16. Y. Bengio, J.-F. Paiement, P. Vincent, Out-of-sample extensions for LLE, Isomap, MDS, eigenmaps, and spectral clustering, Technical Report 1238, Université de Montreal, 2003.
17. M. Brand, Charting a manifold, in: Proceedings of the 15th Conference on Neural Information Processing Systems, 2002.
18. Yan S., Xu D., Zhang B., and Zhang H.-J. Graph embedding: a general framework for dimensionality reduction. IEEE Trans. Pattern Anal. Mach. Intell. 29 1 (2007) 40-51
19. Yang J., Zhang D., Yang J.Y., and Niu B. Globally maximizing, locally minimizing: unsupervised discriminant projection with application to face and palm biometrics. IEEE Trans. Pattern Anal. Mach. Intell. 29 4 (2007) 650-664
20. O. Kouropteva, O. Okun, M. Pietikainen, Supervised locally linear embedding algorithm for pattern recognition, Lecture Notes in Computer Science, vol. 2652, 2003, pp. 386-394.
21. D. Ridder, M. Loog, M. Reinders, Local fisher embedding, in: Proceedings of the 17th International Conference on Pattern Recognition, 2004.
22. Vlassis N., Motomura Y., and Krose B. Supervised dimension reduction of intrinsically low dimensional data. Neural Comput. 14 1 (2002) 191-215
23. Geng X., Zhang D.C., and Zhou Z.H. Supervised nonlinear dimensionality reduction for visualization and classification. IEEE Trans. Syst. Man Cybern. B 35 6 (2005) 1098-1107
24. Zhao H.T., Sun S.Y., Jing Z.L., and Yang J.Y. Local structure based supervised feature extraction. Pattern Recognition 39 (2006) 1546-1550
25. Howlanda P., Wangb J., and Parkc H. Solving the small sample size problem in face recognition using generalized discriminant analysis. Pattern Recognition 39 (2006) 277-287
26. Zheng W., Zhao L., and Zou C. An efficient algorithm to solve the small sample size problem for LDA. Pattern Recognition 37 (2004) 1077-1079
27. Ye J., Janardan R., Park C.H., and Park H. An optimization criterion for generalized discriminant analysis on undersampled problems. IEEE Trans. Pattern Anal. Mach. Intell. 26 8 (2004) 982-994
28. Ye J., and Li Q. A two-stage linear discriminant analysis via QR-decomposition. IEEE Trans. Pattern Anal. Mach. Intell. 27 6 (2005) 929-941
29. Chen L.F., Xu H.Y., Liao M., Ko M.T., Lin J.C., and Yu G.J. A new LDA-based face recognition system which can solve the small sample size problem. Pattern Recognition 33 (2000) 1713-1726
30. Zhang T., Yang J., Wang H., and Du C. Maximum variance projection for face recognition. Opt. Eng. 46 6 (2007) 1-8
31. Chang H., and Yeung D.Y. Robust locally linear embedding. Pattern Recognition 39 (2006) 1053-1065
32. X. He, P. Niyogi, Locality preserving projections, in: Advances in Neural Information Processing Systems 16 (NIPS 2003), Vancouver, Canada, 2003.
33. He X., Yang S., Hu Y., Niyogi P., and Zhang H.J. Face recognition using Laplacianfaces. IEEE Trans. Pattern Anal. Mach. Intell. 27 3 (2005) 328-340
34. K.Q. Weinberger, L.K. Saul, An introduction to nonlinear dimensionality reduction by maximum variance unfolding, American Association for Artificial Intelligence 〈www.aaai.org〉, 2006.
35. Vandenberghe L., and Boy S.P. Semidefinite programming. SIAM Rev. 38 1 (1996) 49-95
36. Phillips P.J., Moon H., Rizvi S.A., and Rauss P.J. The FERET evaluation methodology for face-recognition algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 22 10 (2000) 1090-1104. http://cvc.yale.edu/projects/yalefaces/yalefaces.html Yale University Face Database 〈http://cvc.yale.edu/projects/yalefaces/yalefaces.html〉, 2002
37. P.J. Phillips, The Facial Recognition Technology (FERET) Database 〈http://www.itl.nist.gov/iad/humanid/feret/feret_master.html〉, 2006.
38. Phillips P.J., Wechsler H., Huang J., and Rauss P. The FERET database and evaluation procedure for face recognition algorithms, image and vision computing 16 5 (1998) 295-306
39. Sim T., Baker S., and Bsat M. The CMU pose, illumination, and expression database. IEEE Trans. Pattern Anal. Mach. Intell. 25 12 (2003) 1615-1618
40. T. Sim, S. Baker, M. Bsat, The CMU pose, illumination, and expression (PIE) database of human faces, Technical Report CMU-RI-TR-01-02, Robotics Institute, Carnegie Mellon University, January 2001.
41. See 〈http://www.cs.toronto.edu/~roweis/data.html〉.