Marginal semi-supervised sub-manifold projections with informative constraints for dimensionality reduction and recognition

Neural Networks

Volumn 36, Issue , 2012, Pages 97-111

  Zhang, Zhao ^a   Zhao, Mingbo ^a   Chow, Tommy W S ^a  

^a CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Dimensionality reduction; Image recognition; Informative constraints; Marginal projections; Semi supervised learning

Indexed keywords

BENCH-MARK PROBLEMS; CONSISTENT CONSTRAINT; DIMENSIONALITY REDUCTION; EIGEN DECOMPOSITION; EXTENSIVE SIMULATIONS; INFORMATIVE CONSTRAINTS; LOCAL PROPERTY; MARGINAL PROJECTIONS; PAIRWISE CONSTRAINTS; PERFORMANCE OF ALGORITHM; RANDOM CONSTRAINTS; SEMI-SUPERVISED; SEMI-SUPERVISED LEARNING; WEIGHTED LEAST SQUARES;

IMAGE RECOGNITION; SUPERVISED LEARNING;

ALGORITHMS;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; COMPUTER SIMULATION; CONTROLLED STUDY; DIMENSIONALITY RECOGNITION; DIMENSIONALITY REDUCTION; DISCRIMINANT ANALYSIS; MACHINE LEARNING; PAIRWISE CONSTRAINT; PRIORITY JOURNAL; REGRESSION ANALYSIS; STATISTICAL PARAMETERS; VALIDITY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; FACE; HANDWRITING; HUMANS; LEAST-SQUARES ANALYSIS; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED;

EID: 84870258142     PISSN: 08936080     EISSN: 18792782     Source Type: Journal    
DOI: 10.1016/j.neunet.2012.09.010     Document Type: Article

References (43)

1. Baghshah, M. S., & Shouraki, S. B. (2009). Semi-supervised metric learning using pairwise constraints. In Proceedings of IJCAI 2009 (pp. 1217-1222).
2. Baghshah M.S., Shouraki S.B. Non-linear metric learning using pairwise similarity and dissimilarity constraints and the geometrical structure of data. Pattern Recognition 2010, 43:2982-2992.
3. Belkin M., Niyogi P. Laplacian eigenmaps for dimensionality reduction and data representation. Neural Computation 2003, 15(6):1373-1396.
4. Cai, D., He, X. F., & Han, J. (2007). Semi-supervised discriminant analysis. In: Proceedings of ICCV 2007 (pp. 1-7).
5. Semi-supervised learning 2006, MIT Press, Cambridge. O. Chapelle, B. Schölkopf, A. Zien (Eds.).
6. Chen H., Li L.Q., Peng J.T. Semi-supervised learning based on high density region estimation. Neural Networks 2010, 23:812-818.
7. Chen L., Liao H., Ko M., Lin J., Yu G. A new LDA-based face recognition system which can solve the small sample size problem. Pattern Recognition 2000, 33(10):1713-1726.
8. Chen, J., Ye, J., & Li, Q. (2007). Integrating global and local structures: a least squares framework for dimensionality reduction. In Proceedings of CVPR 2007.
9. He, X., Cai, D., Yan, S., & Zhang, H. (2005). Neighborhood preserving embedding. In: Proceedings of ICCV 2005 (pp. 1208-1213).
10. He X., Yan S., Hu Y., Niyogi P., Zhang H. Face recognition using Laplacian faces. IEEE Transactions on Pattern Analysis and Machine Intelligence 2005, 27(3):228-340.
11. Hinton G.E., Salakhutdinov R.R. Reducing the dimensionality of data with neural networks. Science 2006, 313(5786):504-507.
12. Hull J. A database for handwritten text recognition research. IEEE Transactions on Pattern Analysis and Machine Intelligence 1994, 16(5):550-554.
13. Jia Y., Nie F., Zhang C. Trace ratio problem revisited. IEEE Transactions on Neural Networks 2009, 20(4):729-735.
14. Kokiopoulou1 E., Chen J., Saad Y. Trace optimization and eigenproblems in dimension reduction methods. Numerical Linear Algebra with Applications 2011, 18:565-602.
15. Leibe, B., & Schiele, B. (2003). Analyzing appearance and contour based methods for object categorization. In Proceedings of CVPR 2003 (pp. 409-415).
16. Li H., Jiang T., Zhang K. Efficient and robust feature extraction by maximum margin criterion. IEEE Transactions on Neural Networks 2006, 17(1):157-165.
17. Martinez A.M., Kak A.C. PCA versus LDA. IEEE Transactions on Pattern Analysis and Machine Intelligence 2001, 23(2):228-233.
18. User's guide 1994-2001, MATLAB, The MathWorks, Inc. http://www.mathworks.com.
19. Mohammad, N. T. (2007). Dimensionality reduction using neural networks. In Proceedings of the artificial neural networks in engineering, conference.
20. Qi Z.Q., Tian Y.J., Shi Y. Laplacian twin support vector machine for semi-supervised classification. Neural Networks 2012, 35:46-53.
21. Roweis S., Saul L. Nonlinear dimensionality reduction by locally linear embedding. Science 2000, 290(5500):2323-2326.
22. Schölkopf B., Smola A. Learning with kernels 2002, MIT Press, Cambridge, MA, pp. 25-55.
23. Song Y.Q., Nie F.P., Zhang C.S. Semi-supervised sub-manifold discriminant analysis. Pattern Recognition Letters 2008, 29:1806-1813.
24. Song Y.Q., Nie F.P., Zhang C.S., Xiang S.M. A unified framework for semi-supervised dimensionality reduction. Pattern Recognition 2008, 41(9):2789-2799.
25. Strutz T. Data fitting and uncertainty: a practical introduction to weighted least squares and beyond 2010, Vieweg + Teubner Verlag.
26. Sugiyama M. Dimensionality reduction of multimodal labeled data by local Fisher discriminant analysis. Journal of Machine Learning Research 2007, 8:1027-1061.
27. Sugiyama M., Idé T., Nakajima S., Sese J. Semi-supervised local Fisher discriminant analysis for dimensionality reduction. Machine Learning 2010, 78(1-2):35-61.
28. Sun, L., Ceran, B., & Ye, J.P. (2010). A scalable two-stage approach for a class of dimensionality reduction techniques. In Proceedings of ACM KDD 2010 (pp. 313-322).
29. Sun, L., Ji, S. W., & Ye, J.P. (2008). A least squares formulation for canonical correlation analysis. In Proceedings of ICML 2008 (pp. 1024-1031).
30. Sun L., Ji S.W., Ye J.P. Canonical correlation analysis for multi-label classification: a least squares formulation, extensions and analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 2011, 33(1):194-200.
31. Sun D., Zhang D.Q. Bagging constraint score for feature selection with pairwise constraints. Pattern Recognition 2010, 43:2106-2118.
32. Venna J., Kaski S. Local multidimensional scaling. Neural Networks 2006, 19:889-899.
33. Weyrauch, B., Huang, J., Heisele, B., & Blanz, V. (2004). Component-based face recognition with 3D morphable models. In Proceedings of the 1st IEEE workshop on face processing in video.
34. Xiang S.M., Nie F.P., Zhang C.S. Learning a Mahalanobis distance metric for data clustering and classification. Pattern Recognition Letters 2008, 41(12):3600-3612.
35. Xing E.P., Ng A.Y., Jordan M.I., Russell S. Distance metric learning with application to clustering with side-information. Proceedings of NIPS 15 2003, 505-512. MIT Press, Cambridge, MA.
36. Xua Y., Zhong A.N., Yang J., Zhang D. LPP solution schemes for use with face recognition. Pattern Recognition 2010, 43(12):4165-4176.
37. Ye, J. P. (2007). Least square linear discriminant analysis. In Proceedings of ICML 2007.
38. Zhang D.Q., Chen S.C., Zhou Z.H. Constraint score: a new filter method for feature selection with pairwise constraints. Pattern Recognition Letters 2008, 41(5):1440-1451.
39. Zhang Z., Chow T.W.S., Zhao M.B. Trace ratio optimization based semi-supervised nonlinear dimensionality reduction for marginal manifold visualization. The IEEE Transactions on Knowledge and Data Engineering 2012, 10.1109/TKDE.2012.47.
40. Zhang Z., Zhao M.B., Chow T.W.S. Constrained large margin local projection algorithms and extensions for multimodal dimensionality reduction. Pattern Recognition 2012, 45(12):4466-4493.
41. Zhang, Z., Zhao, M. B., & Chow, T. W. S. (2012b). Extracting the informative constraints for semi-supervised marginal projections in multimodal dimensionality reduction. In Proceedings of IEEE international joint conference on neural networks.
42. Zhang, D. Q., Zhou, Z. H., & Chen, S. C. (2007). Semi-supervised dimensionality reduction. In: Proceedings of SDM 2007.
43. Zhao M.B., Zhang Z., Chow W.S. Trace ratio criterion based generalized discriminative learning for semi-supervised dimensionality reduction. Pattern Recognition 2012, 45(4):1482-1499.