Exponential family factors for bayesian factor analysis

IEEE Transactions on Neural Networks and Learning Systems

Volumn 24, Issue 6, 2013, Pages 964-976

  Li, Jun ^a   Tao, Dacheng ^a  

^a UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

Bayesian methods; exponential family distributions; principal component analysis; statistical learning

Indexed keywords

BAYESIAN METHODS; DATA ANALYSIS METHODS; EXPONENTIAL FAMILY; EXPONENTIAL FAMILY DISTRIBUTIONS; LATENT SEMANTIC INDEXING; PROBABILISTIC FORMULATION; STATISTICAL LEARNING; STATISTICAL SIGNIFICANCE;

BAYESIAN NETWORKS; FACTOR ANALYSIS; PRINCIPAL COMPONENT ANALYSIS;

MULTIVARIANT ANALYSIS;

EID: 84876102362     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2013.2245341     Document Type: Article

References (49)

1. D. J. Bartholomew, Latent Variable Models and Factor Analysis. London, U.K.: Griffin, 1987.
2. A. Basilevsky, Statistical Factor Analysis and Related Methods. New York, USA: Wiley, 1994.
3. H. Hotelling, "Analysis of a complex of statistical variables into principal components," J. Educ. Psychol., vol. 24, no. 6, pp. 417-441, 1933.
4. I. Jolliffe, Principal Component Analysis. New York, USA: Springer-Verlag, 2002.
5. S. Deerwester, S. Dumais, and G. Furnas, "Indexing by latent semantic analysis," J. Amer. Soc. Inf. Sci., vol. 41, no. 6, pp. 391-407, 1990.
6. A. Hyvrinen and E. Oja, "Independent component analysis: Algorithms and applications." Neural netw., vol. 13, nos. 4-5, pp. 411-30, 2000. (Pubitemid 30447427)
7. M. S. Bartlett, J. R. Movellan, and T. J. Sejnowski, "Face recognition by independent component analysis," IEEE Trans. Neural Netw., vol. 13, no. 6, pp. 1450-1464, Nov. 2002. (Pubitemid 35428531)
8. X. Xie, S. Yan, J. T. Kwok, and T. S. Huang, "Matrix-variate factor analysis and its applications," IEEE Trans. Neural Netw., vol. 19, no. 10, pp. 1821-1826, Oct. 2008.
9. D. D. Lee and H. S. Seung, "Learning the parts of objects by nonnegative matrix factorization," Nature, vol. 401, no. 6755, pp. 788-791, 1999.
10. A. d'Aspremont, F. Bach, and L. E. Ghaoui, "Full regularization path for sparse principal component analysis," in Proc. Int. Conf. Mach. Learn., 2007, pp. 177-184.
11. D. D. Lee and H. S. Seung, "Algorithms for non-negative matrix factorization," in Proc. Adv. Neural Inf. Process. Syst. Conf., 2001, pp. 556-562.
12. D. Tao, X. Li, X. Wu, and S. J. Maybank, "Geometric mean for subspace selection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 260-274, Feb. 2009.
13. F. Wang and P. Li, "Efficient non-negative matrix factorization with random projections," in Proc. 10th SIAM Int. Conf. Data Mining, Dec. 2010, pp. 281-292.
14. N. Guan, D. Tao, Z. Luo, and B. Yuan, "Manifold regularized discriminative nonnegative matrix factorization with fast gradient descent," IEEE Trans. Image Process., vol. 20, no. 7, pp. 2030-2048, Jul. 2011.
15. J. Cadima and I. T. Jolliffe, "Loadings and correlations in the interpretation of principal components," Appl. Stat., vol. 22, no. 2, pp. 203-214, 1995.
16. I. T. Jolliffe, "Rotation of principal components," J. Appl. Stat., vol. 22, no. 1, pp. 29-35, 1995.
17. H. Zou, T. Hastie, and R. Tibshirani, "Sparse principal component analysis," J. Comput. Graph. Stat., vol. 15, no. 2, pp. 262-286, 2006.
18. T. Zhou, D. Tao, and X. Wu, "Manifold elastic net: A unified framework for sparse dimension reduction," Data Mining Knowl. Discovery, vol. 22, no. 3, pp. 340-371, 2011.
19. W. Bian and D. Tao, "Max-min distance analysis by using sequential SDP relaxation for dimension reduction," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 5, pp. 1037-1050, May 2011.
20. R. Zass and A. Shashua, "Nonnegative sparse PCA," in Proc. Adv. Neural Inf. Process. Syst. Conf., 2007, pp. 1561-1568.
21. Y. Li and S. I. Amari, "Two conditions for equivalence of 0-norm solution and 1-norm solution in sparse representation," IEEE Trans. Neural Netw., vol. 21, no. 7, pp. 1189-1196, Jul. 2010.
22. Y. Washizawa, "Feature extraction using constrained approximation and suppression," IEEE Trans. Neural Netw., vol. 21, no. 2, pp. 201-210, Feb. 2010.
23. S. Roweis, "EM algorithms for PCA and SPCA," in Proc. Adv. Neural Inf. Process. Syst. Conf., 1997, pp. 1-7.
24. M. E. Tipping and C. M. Bishop, "Principal component analysis," J. Royal Soc. Stat.-Ser. B, vol. 61, no. 3, pp. 611-622, 1999.
25. T. Hofmann, "Probabilistic latent semantic indexing," in Proc. Special Interest Group Inf. Retr., 1999, pp. 50-57.
26. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent dirichlet allocation," J. Mach. Learn. Res., vol. 3, no. 1, pp. 993-1022, Jan. 2003.
27. M. Welling and N. Sutter, "Deterministic latent variable models and their pitfalls," in Proc. SIAM Conf. Data Mining, 2008, pp. 1-12.
28. S. Moussaoui, D. Brie, A. Mohammad-djafari, and C. Carteret, "Separation of non-negative mixture of non-negative sources using a bayesian approach and MCMC sampling," IEEE Trans. Signal Process., vol. 13, no. 2, pp. 1-10, Feb. 2004.
29. M. N. Schmidt, O. Winther, and L. K. Hansen, "Bayesian non-negative matrix factorization," in Proc. Int. Conf. Independ. Compon. Anal. Signal Separat., 2009, pp. 540-547.
30. Y. Guan and J. Dy, "Sparse probabilistic principal component analysis," in Proc. Int. Conf. Artif. Intell. Stat., 2009, pp. 185-192.
31. P. McCullagh and J. A. Nelder, Generalized Linear Models, (Monographs on statistics and applied probability). Boca Raton, FL, USA: CRC Press, 1989.
32. M. Collins, S. Dasgupta, and R. E. Schapire, "A generalization of principal component analysis to the exponential family," in Proc. Adv. Neural Inf. Process. Syst. Conf., 2002, pp. 1-8.
33. S. Mohamed, K. Heller, and Z. Ghahramani, "Bayesian exponential family PCA," in Proc. Adv. Neural Inf. Process. Syst. Conf., 2009, pp. 1-8.
34. J. Li and D. Tao, "Simple exponential family PCA," in Proc. Int. Conf. Artif. Intell. Stat., Mar. 2010, pp. 453-460.
35. J. Li and D. Tao, "Simple exponential family PCA," IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 3, pp. 485-497, Mar. 2013.
36. R. M. Neal, "Probabilistic inference using markov chain monte carlo methods," Univ. of Toronto, ON, Canada, Tech. Rep., 1993.
37. Y. W. Teh, D. Newman, and M. Welling, "a collapsed variational bayesian inference algorithm for latent dirichlet allocation," in Proc. Adv. Neural Inf. Process. Syst. Conf., 2006, pp. 1-8.
38. R. Salakhutdinov and A. Mnih, "Probabilistic matrix factorization," in Proc. Adv. Neural Inf. Process. Syst. Conf., 2008, pp. 1-8.
39. R. Speer, C. Havasi, and H. Lieberman, "AnalogySpace: Reducing the dimensionality of common sense knowledge," in Proc. 23rd AAAI Conf. Artif. Intell., 2008, pp. 548-553.
40. I. Sutskever, "Modelling relational data using Bayesian clustered tensor factorization," in Proc. Adv. Neural Inf. Process. Syst. Conf., 2009, pp. 1-8.
41. A. Gelman, J. B. Carlin, H. S. Stern, and D. B. Rubin, Bayesian Data Analysis. London, U.K.: Chapman & Hall, 2003.
42. E. Gutièrrez-Pena and A. F. M. Smith, "Conjugate parameterizations for natural exponential families," J. Amer. Stat. Assoc., vol. 90, no. 432, pp. 1347-1356, 1995. (Pubitemid 126093148)
43. P. D. Hoff, "Hierarchical multilinear models for multiway data," Comput. Stat. Data Anal., vol. 55, no. 1, pp. 530-543, 2011.
44. C. M. Bishop, "Bayesian PCA," in Proc. Adv. Neural Inf. Process. Syst. Conf., 1999, pp. 382-388.
45. P. O. Hoyer, "Non-negative matrix factorization with sparseness constraints," J. Mach. Learn. Res., vol. 5, no. 1, pp. 1457-1469, Jan. 2004.
46. UCI Machine Learning Repository: Data Sets. (2009) [Online]. Available: http://archive.ics.uci.edu/ml/
47. J. J. Hull, "A database for handwritten text recognition research," IEEE Trans. Pattern Anal. Mach. Intell., vol. 16, no. 5, pp. 550-554, May 1994.
48. C. H. Lampert, H. Nickisch, and S. Harmeling, "Learning to detect unseen object classes by between-class attribute transfer," in Proc. Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 951-958.
49. D. N. Osherson, J. Stern, O. Wilkie, M. Stob, and E. E. Smith, "Default probability," Cognit. Sci., vol. 15, no. 2, pp. 251-269, 1991.