Fast variational Bayesian inference for non-conjugate matrix factorization models

Journal of Machine Learning Research

Volumn 22, Issue , 2012, Pages 1012-1018

  Seeger, Matthias ^a   Bouchard, Guillaume ^b  

^a EPFL   (Switzerland)

^b XEROX RESEARCH CENTRE EUROPE   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; BAYESIAN NETWORKS; FACTORIZATION; INFERENCE ENGINES; MAXIMUM LIKELIHOOD ESTIMATION; SHRINKAGE; STOCHASTIC SYSTEMS; VARIATIONAL TECHNIQUES;

CORRELATION STRUCTURE; MATRIX FACTORIZATIONS; PREDICTION PERFORMANCE; PROBABILISTIC MATRIX FACTORIZATIONS; STOCHASTIC GRADIENT DESCENT; VARIATIONAL BAYESIAN; VARIATIONAL BAYESIAN INFERENCES; VARIATIONAL BOUNDING;

MATRIX ALGEBRA;

EID: 84919880360     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (19)

1. J. Cai, E. Candes, and Z. Shen. A singular value thresholding algorithm for matrix completion. SIAM J. Optim., 20:1956-1982, 2008.
2. O. Chapelle and Z. Harchaoui. A machine-learning approach to conjoint analysis. In NIPS 17, pages 257-264, 2005.
3. S. Deerwester, S. Dumais, G. Furnas, R. Landauer, and R. Harshman. Indexing by latent semantic analysis. Journal of the American Society for Information Science, 41(6):391-407, 1990.
4. T. Jaakkola. Variational Methods for Inference and Estimation in Graphical Models. PhD thesis, MIT, 1997.
5. E. Khan, B. Marlin, G. Bouchard, and K. Murphy. Variational bounds for mixed-data factor analysis. In NIPS 22, 2010.
6. J. Konstan, B. Miller, D. Maltz, J. Herlocker, L. Gordon, and J. Riedl. Grouplens: Applying collaborative filtering to usenet groups. Communications of the ACM, 40(3):77-87, 1997.
7. B. Lakshimanarayan, G. Bouchard, and C. Archambeau. Robust bayesian matrix factorisation. In AISTATS, pages 425-433, 2011.
8. Y. Lim and Y.-W. Teh. Variational Bayesian approach to movie rating prediction. In Proceedings of KDD Cup and Workshop, 2007.
9. S. Nakajima and Sugiyama. Theoretical analysis of Bayesian matrix factorization. JMLR, 12:2579-2644, 2011.
10. L. Paninski, J. Pillow, and E. Simoncelli. Maximum likelihood estimation of a stochastic integrate-and-fire neural encoding model. N. Comp., 16:2533-2561, 2004.
11. T. Raiko, A. Ilin, and J. Karhunen. Principal component analysis for large scale problems with lots of missing values. In ECML 18, pages 691-698, 2007.
12. M. Rattray, O. Stegle, K. Sharp, and J. Winn. Inference algorithms and learning theory for Bayesian sparse factor analysis. Journal of Physics: Conference Series, 197(012002), 2009.
13. G. Reinsel and R. Velu. Multivariate Reduced-Rank Regression: Theory and Applications. Springer, 1st edition, 1998.
14. R. Rosipal and N. Krämer. Overview and recent advances in partial least squares. In Subspace, Latent Structure and Feature Selection Techniques. Springer, 2006.
15. R. Salakhutdinov and A. Mnih. Probabilistic matrix factorization. In NIPS 20, pages 1257-1264, 2008.
16. N. Srebro, J. Rennie, and T. Jaakkola. Maximum margin matrix factorization. In NIPS 17, pages 1329-1336, 2005.
17. M. Tao and X. Yuan. Recovering low-rank and sparse components of matrices from incomplete and noisy observations. SIAM J. Optim., 21(1):57-81, 2011.
18. M. Tipping and C. Bishop. Probabilistic principal component analysis. J. Roy. Stat. Soc. B, 61(3):611-622, 1999.
19. R. Tomioka, T. Suzuki, M. Sugiyama, and H. Kashima. An efficient and general augmented Lagrangian algorithm for learning low-rank matrices. In ICML 27, pages 1087-1094, 2010.