Bilinear probabilistic principal component analysis

IEEE Transactions on Neural Networks and Learning Systems

Volumn 23, Issue 3, 2012, Pages 492-503

  Zhao, Jianhua ^a   Yu, Philip L H ^b   Kwok, James T ^c  

^a YUNNAN UNIVERSITY OF FINANCE AND ECONOMICS   (China)

^b UNIVERSITY OF HONG KONG   (Hong Kong)

^c HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

Author keywords

2 D data; dimension reduction; expectation maximization; principal component analysis; probabilistic model

Indexed keywords

2-D DATA; CURSE OF DIMENSIONALITY; DIMENSION REDUCTION; DIMENSION REDUCTION METHOD; EXPECTATION - MAXIMIZATIONS; PARAMETER ESTIMATION ALGORITHM; PROBABILISTIC MODELS; PROBABILISTIC PRINCIPAL COMPONENT ANALYSIS;

PARAMETER ESTIMATION; PRINCIPAL COMPONENT ANALYSIS; VIRTUAL REALITY;

DATA REDUCTION;

EID: 84870770070     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2012.2183006     Document Type: Article

References (38)

1. C. M. Bishop, Pattern Recognition and Machine Learning. New York: Springer-Verlag, 2006.
2. K. Zhang and J. T. Kwok, "Clustered Nyström method for large scale manifold learning and dimension reduction," IEEE Trans. Neural Netw., vol. 21, no. 10, pp. 1576-1587, Oct. 2010.
3. S. Yu, "Advanced probabilistic models for clustering and projection," Ph.D. dissertation, Faculty Math. Comput. Sci. Statist., Univ. Munich, Munich, Germany, 2006.
4. M. E. Tipping and C. M. Bishop, "Mixtures of probabilistic principal component analysers," Neural Comput., vol. 11, no. 2, pp. 443-482, 1999.
5. D. J. Bartholomew, Latent Variable Models and Factor Analysis, 1st ed. New York: Oxford Univ. Press, 1987.
6. J. H. Zhao and Q. Jiang, "Probabilistic PCA for t distributions," Neurocomputing, vol. 69, nos. 16-18, pp. 2217-2226, 2006.
7. I. T. Jolliffe, Principal Component Analysis, 2nd ed. New York: Springer-Verlag, 2002.
8. B. Moghaddam and A. Pentland, "Probabilistic visual learning for object representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 696-710, Jul. 1997.
9. J. Ye, R. Janardan, and Q. Li, "GPCA: An efficient dimension reduction scheme for image compression and retrieval," in Proc. 10th ACM Int. Conf. Knowl. Discov. Data Min., Seattle, WA, Aug. 2004, pp. 354-363.
10. X. Xie, S. Yan, J. Kwok, and T. Huang, "Matrix-variate factor analysis and its applications," IEEE Trans. Neural Netw., vol. 19, no. 10, pp. 1821-1826, Oct. 2008.
11. J. Ye, "Generalized low rank approximations of matrices," Mach. Learn., vol. 61, nos. 1-3, pp. 167-191, 2005.
12. J. Yang, D. Zhang, A. F. Frangi, and J. Yang, "2-D PCA: A new approach to appearance-based face representation and recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 1, pp. 131-137, Jan. 2004.
13. S. Yu, J. Bi, and J. Ye, "Probabilistic interpretations and extensions for a family of 2D PCA-style algorithms," in Proc. KDD Workshop Data Min. Using Matri. Tensors, Las Vegas, NV, Aug. 2008, pp. 1-7.
14. S. Yu, J. Bi, and J. Ye, "Matrix-variate and higher-order probabilistic projections," Data Min. Knowl. Discov., vol. 22, no. 3, pp. 372-392, 2011.
15. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. Royal Stat. Soc. Series B Stat. Methodol., vol. 39, no. 1, pp. 1-38, 1977.
16. C. M. Bishop, "Bayesian PCA," Advances in Neural Information Proceeding System. Cambridge, MA: MIT Press, 1999.
17. V. ?Smídl and A. Quinn, "On Bayesian principal component analysis," Comput. Stat. Data Anal., vol. 51, no. 9, pp. 4101-4123, 2007.
18. J. H. Friedman, "Regularized discriminant analysis," J. Am. Stat. Assoc., vol. 84, no. 405, pp. 165-175, 1989.
19. D. Cai, X. He, Y. Hu, J. Han, and T. Huang, "Learning a spatially smooth subspace for face recognition," in Proc. Int. Conf. Comput. Vision Pattern Recognit., Minneapolis, MN, Jun. 2007, pp. 1-7.
20. K. Mardia and C. Goodall, "Spatial-temporal analysis of multivariate environmental monitoring data," in Proc. Multivariate Environ. Stat., 1993, pp. 347-385.
21. K. Werner and M. Jansson, "Estimating MIMO channel covariances from training data under the Kronecker model," Signal Process., vol. 89, no. 1, pp. 1-13, 2009.
22. J. C. de Munck, H. M. Huizenga, L. J. Waldorp, and R. M. Heethaar, "Estimating stationary dipoles from MEG/EEG data contaminated with spatially and temporally correlated background noise," IEEE Trans. Signal Process., vol. 50, no. 7, pp. 1565-1572, Jul. 2002.
23. N. Lu and D. L. Zimmerman, "The likelihood ratio test for a separable covariance matrix," Stat. Probabil. Lett., vol. 73, no. 4, pp. 449-457, 2005.
24. K. Werner, M. Jansson, and P. Stoica, "On estimation of covariance matrices with Kronecker product structure," IEEE Trans. Signal Process., vol. 56, no. 2, pp. 478-491, Feb. 2008.
25. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning, 2nd ed. New York: Springer-Verlag, 2009.
26. S. Dudoit, J. Fridlyand, and T. P. Speed, "Comparison of discrimination methods for the classification of tumors using gene expression data," J. Am. Stat. Assoc., vol. 97, no. 457, pp. 77-87, 2002.
27. I. L. Dryden, L. Bai, C. J. Brignell, and L. Shen, "Factored principal components analysis, with applications to face recognition," Stat. Comput., vol. 19, no. 3, pp. 229-238, 2009.
28. G. J. McLachlan and T. Krishnan, The EM Algorithm and Extensions. New York: Wiley, 1996.
29. W. J. Zangwill, Nonlinear Programming: A Unified Approach. Englewood Cliffs, NJ: Prentice-Hall, 1969.
30. X. L. Meng and D. B. Rubin, "Maximum likelihood estimation via the ECM algorithm: A general framework," Biometrika, vol. 80, no. 2, pp. 267-278, 1993.
31. X. L. Meng and D. A. van Dyk, "The EM algorithm: An old folk-song sung to a fast new tune," J. R. Stat. Soc. Series B Stat. Methodol., vol. 59, no. 3, pp. 511-567, 1997.
32. J. H. Zhao and P. L. H. Yu, "Fast ML estimation for the mixture of factor analyzers via an ECM algorithm," IEEE Trans. Neural Netw., vol. 19, no. 11, pp. 1956-1961, Nov. 2008.
33. A. Edelman, T. Arias, and S. Smith, "The geometry of algorithms with orthogonality constraints," SIAM J. Matrix Anal. App., vol. 20, no. 2, pp. 303-353, 1998.
34. A. M. Martinez and A. C. Kak, "PCA versus LDA," IEEE Trans. Patt. Anal. Mach. Intell., vol. 23, no. 2, pp. 228-233, Feb. 2001.
35. S. Chen, L. Zhang, and P. Zhong, "Tests for high-dimensional covariance matrices," J. Am. Stat. Assoc., vol. 105, no. 490, pp. 810-819, 2010.
36. P. Comon and C. Jutten, Handbook of Blind Source Separation, Independent Component Analysis and Applications. New York: Academic, 2010.
37. H. P. Lu, N. P. Konstantinos, and A. N. Venetsanopoulos, "MPCA: Multilinear principal component analysis of tensor objects," IEEE Trans. Neural Netw., vol. 19, no. 1, pp. 18-39, Jan. 2008.
38. A. K. Gupta and D. K. Nagar, Matrix Variate Distributions. London, U.K.: Chapman & Hall, 1999.