Supervised Gaussian process latent variable model for dimensionality reduction

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 41, Issue 2, 2011, Pages 425-434

  Gao, Xinbo ^a   Wang, Xiumei ^a   Tao, Dacheng ^b   Li, Xuelong ^c  

^a XIDIAN UNIVERSITY   (China)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^c XI AN INSTITUTE OF OPTICS AND PRECISION MECHANICS   (China)

Author keywords

Dimensionality reduction; Gaussian process latent variable model (GP LVM); generalized discriminant analysis (GDA); probabilistic principal component analysis (probabilistic PCA); supervised learning

Indexed keywords

CLASS LABELS; DATA SETS; DIMENSIONALITY REDUCTION; EXPERIMENTAL EVIDENCE; GAUSSIAN PROCESSES; GENERALIZED DISCRIMINANT ANALYSIS; LATENT VARIABLE; LATENT VARIABLE MODELS; LOW-DIMENSIONAL MANIFOLDS; MAXIMUM A POSTERIORI ALGORITHM; PROBABILISTIC APPROACHES; PROBABILISTIC PRINCIPAL COMPONENT ANALYSIS; SUPERVISED CLASSIFICATION;

DISCRIMINANT ANALYSIS; GAUSSIAN DISTRIBUTION; GAUSSIAN NOISE (ELECTRONIC); SUPERVISED LEARNING;

PRINCIPAL COMPONENT ANALYSIS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER SIMULATION; DECISION SUPPORT SYSTEM; METHODOLOGY; NORMAL DISTRIBUTION; STATISTICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; DECISION SUPPORT TECHNIQUES; MODELS, STATISTICAL; NORMAL DISTRIBUTION; PATTERN RECOGNITION, AUTOMATED;

EID: 79952901555     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2010.2057422     Document Type: Article

References (37)

1. H. Hotelling, "Analysis of a complex of statistical variables into principal components," J. Educational Psychol., vol. 24, no. 7, pp. 417-441, Oct. 1933.
2. T. Zhou, D. Tao, and X. Wu, "Manifold elastic net: A unified framework for sparse dimension reduction," Data Mining Knowl. Discovery, 2010, DOI: 10.1007/s10618-010-0182-x.
3. Y. Pang, Y. Yuan, and X. Li, "Iterative subspace analysis based on feature line distance," IEEE Trans. Image Process., vol. 18, no. 4, pp. 903-907, Apr. 2009.
4. S. Si, D. Tao, and K. P. Chan, "Evolutionary cross-domain discriminative Hessian eigenmaps," IEEE Trans. Image Process., vol. 19, no. 4, pp. 1075-1086, Apr. 2010.
5. T. Zhang, D. Tao, X. Li, and J. Yang, "Patch alignment for dimensionality reduction," IEEE Trans. Knowl. Data Eng., vol. 21, no. 9, pp. 1299-1313, Sep. 2009.
6. X. He and P. Niyogi, "Locality preserving projections," in Proc. Adv. Neural Inf. Process. Syst., 2003, pp. 153-160.
7. X. He, D. Cai, and S. Yan, "Neighborhood preserving embedding," in Proc. 10th Int. Conf. Comput. Vis., 2005, pp. 1208-1213. (Pubitemid 44042318)
8. W. Bian and D. Tao, "Biased discriminant Euclidean embedding for content based image retrieval," IEEE Trans. Image Process., vol. 19, no. 2, pp. 545-554, Feb. 2010.
9. D. Song and D. Tao, "Biologically inspired feature manifold for scene classification," IEEE Trans. Image Process., vol. 19, no. 1, pp. 174-184, Jan. 2010.
10. D. Cai, X. He, and J. W. Han, "Orthogonal Laplacianfaces for face recognition," IEEE Trans. Image Process., vol. 15, no. 11, pp. 3608-3614, Nov. 2006. (Pubitemid 44615155)
11. Y. Yuan, X. Li, Y. Pang, X. Lu, and D. Tao, "Binary sparse nonnegative matrix factorization," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 5, pp. 772-777, May 2009.
12. X. Li, Y. Pang, and Y. Yuan, "L1-norm-based 2DPCA," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 4, pp. 1170-1175, Aug. 2010.
13. X. Li, S. Lin, S. Yan, and D. Xu, "Discriminant locally linear embedding with high-order tensor data," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 2, pp. 342-352, Apr. 2008. (Pubitemid 351479557)
14. D. J. Bartholomew, Statistical Factor Analysis and Related Methods. New York: Wiley, 2004.
15. M. E. Tipping and C. M. Bishop, "Probabilistic principal component analysis," J. Roy. Statist. Soc., B, vol. 61, no. 3, pp. 611-622, 1999.
16. S. T. Roweis, "EM algorithms for PCA and SPCA," in Proc. Adv. Neural Inf. Process. Syst., 1997, pp. 626-632.
17. S. Mika, G. Ratsch, J. Weston, B. Scholkopf, and K.-R. Muller, "Fisher discriminant analysis with kernels," in Proc. IEEE Neural Netw. Signal Process. Workshop IX, 1999, pp. 41-48. (Pubitemid 30510358)
18. S. Si, D. Tao, and B. Geng, "Bregman divergence based regularization for transfer subspace learning," IEEE Trans. Knowl. Data Eng., vol. 22, no. 7, pp. 929-942, Jul. 2010.
19. X. Li and Y. Pang, "Deterministic column-based matrix decomposition," IEEE Trans. Knowl. Data Eng., vol. 22, no. 1, pp. 145-149, Jan. 2010.
20. B. Scholkopf, A. Smola, and K.-R. Muller, "Nonlinear component analysis as a kernel eigenvalue problem," Neural Comput., vol. 10, no. 5, pp. 1299-1319, Jul. 1998. (Pubitemid 128463674)
21. N. D. Lawrence, "Probabilistic non-linear principal component analysis with Gaussian process latent variable models," J. Mach. Learn. Res., vol. 6, pp. 1783-1816, Nov. 2005.
22. J. M. Wang, D. J. Fleet, and A. Hertzmann, "Gaussian process dynamical models for human motion," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 2, pp. 283-289, Feb. 2008.
23. X. Wang, X. Gao, Y. Yuan, and D. Tao, "Semi-supervised Gaussian process latent variable model with pairwise constraints," Neurocomputing, vol. 73, no. 10-12, pp. 2186-2195, Jun. 2010.
24. X. Gao, X. Wang, X. Li, and D. Tao, "Transfer latent variable model based on divergence analysis," Pattern Recognit., 2010, DOI: 10.1016/j.patcog.2010.06.013.
25. C. E. Rasmussen and C. K. I. Williams, Gaussian Process for Machine Learning. Cambridge, MA: MIT Press, 2006.
26. R. Navaratnam, A. W. Fitzgibbon, and R. Cipolla, "The joint manifold model for semi-supervised multi-valued regression," in Proc. 8th Int. Conf. Comput. Vis., 2007, pp. 1-8.
27. C. Henrik, E. P. Torr, and N. D. Lawrence, "Gaussian process latent variable models for human pose estimation," in Proc. Mach. Learn. Multimodal Interaction, 2008, pp. 132-143. (Pubitemid 351333596)
28. R. Urtasun and T. Darrell, "Discriminative Gaussian process latent variable model for classification," in Proc. 24th Int. Conf.Mach. Learn., 2007, pp. 927-934. (Pubitemid 350094070)
29. S. P. Yu, K. Yu, V. Tresp, H.-P. Kriegel, and M. Wu, "Supervised probabilistic principal component analysis," in Proc. 12th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2006, pp. 464-473. (Pubitemid 44535543)
30. A. P. Dawid, "Conditional independence in statistical theory," J. Roy. Statist. Soc., B, vol. 41, no. 1, pp. 1-31, 1979.
31. D. J. Bartholomew, Latent Variable Models and Factor Analysis. London, U.K.: Griffin, 1987.
32. C. K. I. Williams and C. E. Rasmussen, "Gaussian processes for regression," in Proc. Adv. Neural Inf. Process. Syst., 1996, pp. 598-604.
33. C. K. I. Williams and D. Barber, "Bayesian classification with Gaussian processes," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 12, pp. 1342-1351, Dec. 1998. (Pubitemid 128741378)
34. G. Baudat and F. Anouar, "Generalized discriminant analysis using a kernel approach," Neural Comput., vol. 12, no. 10, pp. 2385-2404, Oct. 2000.
35. R. A. Fisher, "The statistical utilization of multiple measurements," Ann. Eugenics, vol. 8, pp. 376-386, 1938.
36. [Online]. Available: http://archive.ics.uci.edu/ml/datasets.html
37. C. J. C. Burges, "A tutorial on support vector machines for pattern recognition," Data Mining Knowl. Discovery, vol. 2, no. 2, pp. 121-167, Jun. 1998. (Pubitemid 128695475)