Flexible manifold embedding: A framework for semi-supervised and unsupervised dimension reduction

IEEE Transactions on Image Processing

Volumn 19, Issue 7, 2010, Pages 1921-1932

  Nie, Feiping ^a,b   Xu, Dong ^a   Tsang, Ivor Wai Hung ^a   Zhang, Changshui ^b  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b TSINGHUA UNIVERSITY   (China)

Author keywords

Dimension reduction; Face recognition; Manifold embedding; Semi supervised learning

Indexed keywords

BENCHMARK DATABASE; DATA POINTS; DIMENSION REDUCTION; DIMENSION REDUCTION ALGORITHM; DIMENSION REDUCTION TECHNIQUES; LABEL INFORMATION; LABELED AND UNLABELED DATA; LABELED DATA; LINEAR CONSTRAINTS; MANIFOLD LEARNING; NONLINEAR MANIFOLDS; OBJECTIVE FUNCTIONS; PENALTY TERM; SEMI-SUPERVISED; SEMI-SUPERVISED LEARNING; TRAINING SAMPLE;

FACE RECOGNITION; LABELS; REGRESSION ANALYSIS; SUPERVISED LEARNING;

DATA REDUCTION;

EID: 77953705810     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2010.2044958     Document Type: Article

References (38)

1. J. Abernethy, O. Chapelle, and C. Castillo, "Web spam identification through content and hyperlinks," in Proc. Int. Workshop Adversarial Inf. Retrieval Web, 2008, pp. 41-44.
2. P. Belhumeur, J. Hespanha, and D. Kriegman, "Eigenfaces vs. fisherfaces: Recognition using class specific linear projection," IEEE Trans. Pattern Anal. Mach. Intell., vol.19, no.7, pp. 711-720, Jul. 1997.
3. M. Belkin and P. Niyogi, "Laplacian eigenmaps and spectral techniques for embedding and clustering," in Proc. Adv. Neural Inf. Process. Syst., 2001, pp. 585-591.
4. M. Belkin, P. Niyogi, and V. Sindhwani, "Manifold regularization: A geometric framework for learning from labeled and unlabeled examples," J. Mach. Learn. Res., vol.12, pp. 2399-2434, 2006.
5. A. Blum and T. Mitchell, "Combining labeled and unlabeled data with co-training," in Proc. Ann. Conf. Computational Learn. Theory, 1998, pp. 92-100.
6. D. Cai, X. He, and J. Han, "Semi-supervised discriminant analysis," presented at the IEEE Int. Conf. Comput.Vision, Rio de Janiero, Brazil, 2007.
7. D. Cai, X. He, and J. Han, "Spectral regression for efficient regularized subspace learning," presented at the IEEE Int. Conf. Comput. Vision, Rio de Janiero, Brazil, 2007.
8. W. Chu, V. Sindhwani, Z. Ghahramani, and S. S. Keerthi, "Relational learning with Gaussian processes," in Proc. Adv. Neural Inf. Process. Syst., 2006, pp. 289-296.
9. A. Georghiades, P. Belhumeur, and D. Kriegman, "From few to many: Illumination cone models for face recognition under variable lighting and pose," IEEE Trans. Pattern Anal. Mach. Intell., vol.23, no.6, pp. 643-660, Jun. 2001.
10. D. B. Graham and N. M. Allinson, "Characterizing virtual eigensignatures for general purpose face recognition," NATO ASI Series F, pp. 446-456, 1998.
11. Z. Guo, Z. Zhang, E. Xing, and C. Faloutsos, "Semi-supervised learning based on semiparametric regularization," in Proc. SIAM Int. Conf. Data Min., 2008, pp. 132-142.
12. X. He, S. Yan, Y. Hu, P. Niyogi, and H. Zhang, "Face recognition using laplacianfaces," IEEE Trans. Pattern Anal. Mach. Intell., vol.27, no.3, pp. 328-340, Mar. 2005.
13. X. Li, S. Lin, S. Yan, and D. Xu, "Discriminant locally linear embedding with high order tensor data," IEEE Trans. Syst., Man, Cybern., B, Cybern., vol.38, no.2, pp. 342-352, Feb. 2008.
14. C. Liu, H. Y. Shum, and W. T. Freeman, "Face hallucination: Theory and practice," Int. J. Comput. Vision, vol.75, no.1, pp. 115-134, 2007.
15. W. Liu, D. Tao, and J. Liu, "Transductive component analysis," in Proc. IEEE Int. Conf. Data Min., 2008, pp. 433-442.
16. S. A. Nene, S. K. Nayar, and H. Murase, "Columbia object image library (Coil-20)," Columbia Univ., Tech. Rep. CUCS-005-96, Feb. 1996.
17. F. P. Nie, S. M. Xiang, Y. Q. Jia, and C. S. Zhang, "Semi-supervised orthogonal discriminant analysis via label propagation," Pattern Recog., vol.42, no.11, pp. 2615-2627, 2009.
18. S. Roweis and L. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol.290, no.22, pp. 2323-2326, 2000.
19. T. Sim and S. Baker, "The cmu pose, illumination, and expression database," IEEE Trans. Pattern Anal. Mach. Intell., vol.25, no.12, pp. 1615-1617, Dec. 2003.
20. V. Sindhwani, P. Niyogi, and M. Belkin, "Beyond the point cloud: From transductive to semi-supervised learning," in Proc. Int. Conf. Mach. Learn., 2005, pp. 824-831.
21. V. Sindhwani, P. Niyogi, and M. Belkin, "Linear manifold regularization for large scale semi-supervised learning," presented at the Workshop Learn. With Partially Classified Train. Data, Int. Conf. Mach. Learn., Bonn, Germany, 2005.
22. V. Sindhwani and P. Melville, "Document-word co-regularization for semi-supervised sentiment analysis," in Proc. IEEE Int. Conf. Data Min., 2008, pp. 1025-1030.
23. J. Tenenbaum, V. Silva, and J. Langford, "A global geometric framework for nonlinear dimensionality reduction," Science, vol.290, no.22, pp. 2319-2323, 2000.
24. I. W. Tsang and J. T. Kwok, "Large-scale sparsified manifold regularization," in Proc. Adv. Neural Inf. Process. Syst., 2006, pp. 1401-1408.
25. M. Turk and A. Pentland, "Face recognition using eigenfaces," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recog., 1991, pp. 586-591.
26. V. Vapnik, Statistical Learning Theory. New York: Wiley-Interscience, 1998.
27. M. Wu, K. Yu, S. Yu, and B. Schölkopf, "Local learning projections," in Proc. Int. Conf. Mach. Learn., 2007, pp. 1039-1046.
28. D. Xu and S. Yan, "Semi-supervised bilinear subspace learning," IEEE Trans. Image Process., vol.18, no.7, pp. 1671-1676, Jul. 2009.
29. D. Xu, S. Yan, S. Lin, T. S. Huang, and S. F. Chang, "Enhancing bilinear subspace learning by element rearrangement," IEEE Trans. Pattern Anal. Mach. Intell., vol.31, no.10, pp. 1913-1920, Oct. 2009.
30. S. Yan, D. Xu, B. Zhang, H. Zhang, Q. Yang, and S. Lin, "Graph embedding and extensions: A general framework for dimensionality reduction," IEEE Trans. Pattern Anal. Mach. Intell., vol.29, no.1, pp. 40-51, Jan. 2007.
31. X. Yang, H. Fu, H. Zha, and J. L. Barlow, "Semi-supervised nonlinear dimensionality reduction," in Proc. Int. Conf. Mach. Learn., 2006, pp. 1065-1072.
32. Y. Yang, D. Xu, F. Nie, J. Luo, and Y. Zhuang, "Ranking with local regression and global alignment for cross media retrieval," in Proc. ACM Multimedia, 2009, pp. 175-184.
33. T. Zhang, A. Popescul, and B. Dom, "Linear prediction models with graph regularization for web-page categorization," in Proc. ACM SIGKDD Int. Conf. Knowledge Discovery Data Min., 2006, pp. 821-826.
34. T. Zhang, D. Tao, and J. Yang, "Discriminative locality alignment," in Proc. Eur. Conf. Comput. Vision, 2008, pp. 725-738.
35. T. Zhang, D. Tao, X. Li, and J. Yang, "Patch alignment for dimensionality reduction," IEEE Trans. Knowledge Data Eng., vol.21, no.9, pp. 1299-1313, Sep. 2009.
36. D. Zhou, O. Bousquet, T. N. Lal, J. Weston, and B. Schölkopf, "Learning with local and global consistency," in Proc. Adv. Neural Inf. Process. Syst., 2004, pp. 321-328.
37. X. Zhu, Z. Ghahramani, and J. Lafferty, "Semi-supervised learning using gaussian fields and harmonic functions," in Proc. Int. Conf. Mach. Learn., 2003, pp. 912-919.
38. X. Zhu, "Semi-supervised learning literature survey," Univ.Wisconsin- Madison, 2007.