Semi-supervised classification based on random subspace dimensionality reduction

Pattern Recognition

Volumn 45, Issue 3, 2012, Pages 1119-1135

  Yu, Guoxian ^a   Zhang, Guoji ^a   Domeniconi, Carlotta ^b   Yu, Zhiwen ^a,c   You, Jane ^c  

^a SOUTH CHINA UNIVERSITY OF TECHNOLOGY   (China)

^b Krasnow Institute for Advanced Study   (United States)

^c HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

Author keywords

Dimensionality reduction; Ensembles of classifiers; Graph construction; Random subspaces; Semi supervised classification

Indexed keywords

DIMENSIONALITY REDUCTION; ENSEMBLES OF CLASSIFIERS; GRAPH CONSTRUCTION; RANDOM SUBSPACES; SEMI-SUPERVISED CLASSIFICATION;

CLUSTERING ALGORITHMS; FACE RECOGNITION;

SUPERVISED LEARNING;

EID: 80054993407     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2011.08.024     Document Type: Article

References (42)

1. R.O. Duda, P.E. Hart, and D.G. Stork Pattern classification 2nd ed. 2000 Wiley-Interscience NY
2. X. Zhu, Semi-Supervised Learning Literature, Technical Report 1530, Department of Computer Sciences, University of Wisconsin-Madison, 2008.
3. O. Chapelle, B. Schölkopf, and A. Zien Semi-Supervised Learning 2006 MIT Press Cambridge, MA
4. X.J. Zhu, Z. Ghahramani, J. Lafferty, Semi-supervised learning using Gaussian fields and harmonic functions, in: Proceedings of the 20th International Conference on Machine Learning (ICML), 2003.
5. D.Y. Zhou, O. Bousquet, T.N. Lal, J. Weston, B. Schölkopf, Learning with local and global consistency, in: Proceedings of the Advances in Neural Information Processing Systems (NIPS), 2003.
6. M. Belkin, P. Niyogi, and V. Sindhwani Manifold regularization: a geometric framework for learning from labeled and unlabeled examples Journal of Machine Learning Research 7 2006 2399 2434 (Pubitemid 44708005)
7. J.D. Wang, F. Wang, C.S. Zhang, H.C. Shen, and L. Quan Linear neighborhood propagation and its applications IEEE Transactions on Pattern Analysis and Machine Intelligent 31 9 2009 1600 1615
8. S.T. Roweis, and L.K. Saul Nonlinear dimensionality reduction by locally linear embedding Science 290 5500 2000 2323 2326 (Pubitemid 32041578)
9. L. Parsons, E. Haque, and H. Liu Subspace clustering for high dimensional data: a review ACM SIGKDD Explorations Newsletter 6 1 2004 90 105
10. T.K. Ho The random subspace method for constructing decision forests IEEE Transactions on Pattern Analysis and Machine Intelligent 20 8 1998 832 844 (Pubitemid 128741345)
11. C. Lai, M.J.T. Reinders, and L. Wessels Random subspace method for multivariate feature selection Pattern Recognition Letters 27 10 2006 1067 1076
12. B.J. Yan, C. Domeniconi, Subspace metric ensembles for semi-supervised clustering of high dimensional data, in: Proceedings of the 17th European Conference on Machine Learning (ECML), 2006.
13. J. Wang, S.W. Luo, X.H. Zeng, A random subspace method for co-training, in: Proceedings of the IEEE International Joint Conference on Neural Networks (IJCNN), 2008.
14. Y. Gao, Y.S. Wang, Boosting in random subspace for face recognition, in: Proceedings of the 18th International Conference on Pattern Recognition (ICPR), 2006.
15. L.F. Chen, H.Y.M. Liao, M.T. Ko, and G.J. Yu A new LDA-based face recognition system which can solve the small sample size problem Pattern Recognition 33 10 2000 1712 1726
16. X.G. Wang, and X.O. Tang Random sampling for subspace face recognition International Journal of Computer Vision 70 1 2006 91 104
17. T. Jolliffe Principal Component Analysis 2002 Springer Verlag
18. L. Breiman Bagging predictors Machine Learning 24 2 1996 123 140 (Pubitemid 126724382)
19. X.Y. Zhang, and Y.D. Jia A linear discriminant analysis framework based on random subspace for face recognition Pattern Recognition 40 9 2007 2585 2591
20. P.N. Belhumeur, J.P. Hespanha, and D.J. Kriegman Eigenfaces vs Fisherfaces: recognition using class specific linear projection IEEE Transactions on Pattern Analysis and Machine Intelligent 19 7 1997 711 720 (Pubitemid 127762263)
21. H. Yu, and J. Yang A direct LDA algorithm for high-dimensional data- with application to face recognition Pattern Recognition 34 10 2001 2067 2070
22. Y.L. Zhu, J. Liu, and S.C. Chen Semi-random subspace method for face recognition Image and Vision Computing 27 9 2009 1358 1370
23. L.J.P. Maaten, E.O. Postma,H.J. Herik, Dimensionality Reduction: A Comparative Review, Tilburg University Technical Report, TiCC-TR 2009-005, 2009.
24. D.D. Margineantu, T.G. Dietterich, Pruning adaptive boosting, in: Proceedings of the 14th International Conference on Machine Learning (ICML), 1997.
25. F.R.K. Chung. Spectral graph theory, in: Proceedings of the Regional Conference Series in Mathematics, 1997.
26. Z.H. Zhou, When semi-supervised learning meets ensemble learning, in: Proceedings of the 8th International Workshop on Multiple Classifier System (MCS), 2009.
27. S.C. Yan, D. Xu, B.Y. Zhang, H.J. Zhang, Q. Yang, and S. Lin Graph embedding and extensions: a general framework for dimensionality reduction IEEE Transactions on Pattern Analysis on Machine Intelligent 29 1 2007 40 51 (Pubitemid 46415944)
28. M. Belkin, and P. Niyogi Semi-supervised learning on Riemannian manifolds Machine Learning 56 1 2004 209 239
29. M. Martinez, R. Benavente, The AR-Face Database, CVC Technical Report 24, 1998.
30. S. Georghiades, P.N. Belhumeur, and D.J. Kriegman From few to many: illumination cone models for face recognition under variable lighting and pose IEEE Transactions on Pattern Analysis Machine Intelligent 23 6 2001 643 660 (Pubitemid 32585276)
31. W.Y. Wang, S.W. Zhang, W. Liang, A graph based subspace semi-supervised learning framework for dimensionality reduction, in: Proceedings of the 10th European Conference on Computer Vision (ECCV), 2008.
32. D. Cai, X.F. He, J.W. Han, Semi-supervised discriminant analysis, in: Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2007.
33. D. Cai, X.F. He, K. Zhou, J.W. Han, H.J. Bao, Locality sensitive discriminant analysis, in: Proceedings of the 20th International Joint Conference on Artificial Intelligent (IJCAI), 2007.
34. Y. Zhang, D.Y. Yeung, Semi-supervised discriminant analysis using robust path-based similarity, in: Proceedings of the IEEE 21th Computer Vision and Pattern Recognition (CVPR), 2008.
35. W. Liu, S.F. Chang, Robust multi-class transductive learning with graphs, in: Proceedings of the IEEE 22th Computer Vision and Pattern Recognition (CVPR), 2009.
36. T. Jebara, J. Wang, S.F. Chang, Graph construction and b-matching for semi-supervised learning, in: Proceedings of the 26th International Conference on Machine Learning (ICML), 2009.
37. M.F. Balcan, A. Blum, P.P. Choi, J. Lafferty, et.al., Person identification in webcam images: an application of semi-supervised learning, in: Proceedings of the 22th International Conference on Machine Learning (ICML), 2005.
38. W. Tang, Z.D. Lu, I.S. Dhillon, Clustering with multiple graphs, in: Proceedings of the IEEE 9th International Conference on Data Mining (ICDM), 2009.
39. R. Polikar, J. Depasquale, H.S. Mohammed, G. Brown, and L.I. Kuncheva Learn: a random subspace approach for the missing feature problem Pattern Recognition 43 11 2010 3817 3832
40. E. Kokiopoulou, and P. Frossard Graph based classification of multiple observation sets Pattern Recognition 43 12 2010 3988 3997
41. G.X. Yu, H. Peng, J. Wei, and Q.L. Ma Enhanced locality preserving projections with robust path based similarity Neurocomputing 74 3 2011 598 605
42. J.J. Rodriguez, L.I. Kuncheva, and C.J. Alonso Rotation forest: a new classifier ensemble method IEEE Transactions on Pattern Analysis and Machine Intelligent 28 10 2006 1619 1630 (Pubitemid 46405081)