Semi-supervised Gaussian process latent variable model with pairwise constraints

Neurocomputing

Volumn 73, Issue 10-12, 2010, Pages 2186-2195

  Wang, Xiumei ^a   Gao, Xinbo ^a   Yuan, Yuan ^b   Tao, Dacheng ^c   Li, Jie ^a  

^a XIDIAN UNIVERSITY   (China)

^b ASTON UNIVERSITY   (United Kingdom)

^c NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Dimensionality reduction; Gaussian process latent variable model; Pairwise constraints; Semi supervised learning

Indexed keywords

DIMENSIONALITY REDUCTION; GAUSSIAN PROCESSES; LATENT VARIABLE MODELS; PAIRWISE CONSTRAINTS; SEMI-SUPERVISED LEARNING;

ALGORITHMS; GAUSSIAN DISTRIBUTION; GAUSSIAN NOISE (ELECTRONIC); SUPERVISED LEARNING;

EQUIVALENCE CLASSES;

ARTICLE; COMPUTER MODEL; GAUSSIAN PROCESS LATENT VARIABLE MODEL; HUMAN COMPUTER INTERACTION; KERNEL METHOD; LEARNING ALGORITHM; MATHEMATICAL COMPUTING; PATTERN RECOGNITION; PERFORMANCE MEASUREMENT SYSTEM; PRINCIPAL COMPONENT ANALYSIS; PRIORITY JOURNAL; PROCESS OPTIMIZATION; TASK PERFORMANCE;

EID: 77952543650     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2010.01.021     Document Type: Article

References (30)

1. Joliffe I. Principal Component Analysis 1986, Springer, New York.
2. Pang Y., Tao D., Yuan Y., Li X. Binary two-dimensional PCA. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 2008, 38(4):1176-1180.
3. Borg I., Groenen P. Modern multidimensional scaling: theory and applications 2005, Springer, New York. 2nd ed.
4. Scholkopf B., Smola A., Muller K.-R. Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation 1998, 10(5):1299-1319.
5. Pang Y., Yuan Y., Li X. Iterative subspace analysis based on feature line distance. IEEE Transactions on Image Processing, 2009, 18(4):903-907.
6. Pang Y., Yuan Y., Li X. Gabor-Based region covariance matrices for face recognition. IEEE Transactions on Circuits and Systems for Video Technology 2008, 18(7):989-993.
7. T. Lin, H. Zha, S. Lee, Riemannian manifold learning for nonlinear dimensionality reduction, in: Proceeding of the European Conference on Computer Vision, Graz, Austria, May 2006, pp. 44-55.
8. Tipping M.E., Bishop C.M. Probabilistic principal component analysis. Journal of the Royal Statistical Society, Series B 1999, 61(3):611-622.
9. Bartholomew D.J. Latent Variable Models and Factor Analysis 1987, Charles Griffin & Co. Ltd, London.
10. Bartholomew D.J. Statistical Factor Analysis and Related Methods 2004, Wiley, New York.
11. Lawrence N.D. Gaussian process models for visualization of high dimensional data. Advance in Neural Information Processing Systems 2004, 16:329-336.
12. Lawrence N.D. Probabilistic non-linear principal component analysis with Gaussian process latent variable models. Journal of Machine Learning Research 2005, 6:1783-1816.
13. Rasmussen C.E., Williams C.K.I. Gaussian Processes for Machine Learning 2006, the MIT press, Cambridge.
14. Girolami M., Rogers S. Variational Bayesian multinomial probit regression with Gaussian process priors. Neural Computation 2006, 18(8):1790-1817.
15. Opper M., Winther O. Gaussian processes for classification: mean-field algorithms. Neural Computation 2000, 12(11):2655-2684.
16. Wang F., Zhang C. Robust self-tuning semi-supervised learning. Neurocomputing 2008, 71(16-18):2931-2939.
17. Zhao J., Lu K., He X. Locality sensitive semi-supervised feature selection. Neurocomputing 2008, 71(10-12):1842-1849.
18. D. Zhang, Z. Zhou, S. Chen, Semi-supervised dimensionality reduction, in: Proceeding of the International Conference on Data Mining, Minneapolis, USA, Apr. 2007, pp. 629-634.
19. S.C. H. Hoi, W. Liu, M.R. Lyu, W. Ma, Learning distance metrics with contextual constraints for image retrieval, in: Proceeding of the International Conference on Computer Vision and Pattern Recognition, NewYork, USA, Jun. 2006, pp. 2072-2078.
20. Bar-Hillel A., Hertz T., Shental N., Weinshall D. Learning a mahalanobis metric from equivalence constraints. Journal of Machine Learning Research 2005, 6:937-965.
21. He X., Niyogi P. Locality preserving projections. Advance in Neural Information Processing Systems 2003, 16:153-160.
22. H. Cevikalp, J. Verbeek, F. Jurie, A. Kläser, Semi-supervised dimensionality reduction using pairwise equivalence constraints, in: Proceeding of the International Conference on Computer Vision Theory and Applications, Funchal, Portugal, Jan. 2008, pp. 489-496.
23. Williams C.K.I., Rasmussen C.E. Gaussian processes for regression. Advance in Neural Information Processing Systems 1995, 8:598-604.
24. Williams C.K.I., Barber D. Bayesian classification with Gaussian processes. IEEE Transactions on Pattern Analysis and Machine Intelligence 1998, 20(12):1342-1351.
25. S.P. Yu, K. Yu, V. Tresp et al., Supervised probabilistic principal component analysis, in: Proceedings of the Intinternational Conference on Knowledge Discovery and Data Mining, Philadelphia, USA, Aug 2006, pp. 464-473.
26. http://archive.ics.uci.edu/ml.
27. N.D. Lawrence, J. Quinonero-Candela, Local distance preservation in the GP-LVM through back constraints, in: Proceeding of the International Conference on Machine Learning, Pittsburgh, USA, Jun 2006, pp. 513-520.
28. Zhang D., Chen S., Zhou Z. Constraint Score: a new filter method for feature selection with pairwise constraints. Pattern Recognition 2008, 41:1440-1451.
29. Z. Li, J. Liu, X. Tang, Pairwise constraint propagation by semidefinite programming for semi-supervised classification, in: Proceedings of the International Conference on Machine Learning, Helsinki, Finland, Jun 2008, pp. 576-583.
30. S. Basu, M. Bilenko, R.J. Mooney, A probabilistic framework for semi-supervised clustering, in: Proceeding of the International Conference on Knowledge Discovery and Data Mining, Seattle, USA, Aug. 2004 pp. 59-68.