Implicit regularization in variational Bayesian matrix factorization

ICML 2010 - Proceedings, 27th International Conference on Machine Learning

Volumn , Issue , 2010, Pages 815-822

  Nakajima, Shinichi ^a   Sugiyama, Masashi ^b  

^a NIKON CORPORATION   (Japan)

^b TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN; HYPER-PARAMETERS; IDENTIFIABILITY; LOW-RANK MATRICES; MATRIX FACTORIZATIONS; MAXIMUM A POSTERIORI; TARGET MATRICES; VARIATIONAL BAYESIAN;

BAYESIAN NETWORKS; FACTORIZATION; LEARNING SYSTEMS;

MATRIX ALGEBRA;

EID: 77956502504     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. Anderson, T. W. (1984). An introduction to multivariate statistical analysis. New York: Wiley. Second edition.
2. Attias, H. (1999). Inferring parameters and structure of latent variable models by variational Bayes. Proceedings of the Proceedings of the Fifteenth Conference Annual Conference on Uncertainty in Artificial Intelligence (UAI-99) (pp. 21-30).
3. Baldi, P., & Brunak, S. (1998). Bioinformatics: The machine learning approach. Cambridge, MA, USA: MIT Press.
4. Baldi, P. F., & Hornik, K. (1995). Learning in Linear Neural Networks: A Survey. IEEE Transactions on Neural Networks, 6, 837-858.
5. Bishop, C. M. (2006). Pattern recognition and machine learning. New York, NY, USA: Springer.
6. Efron, B., & Morris, C. (1973). Stein's Estimation Rule and Its Competitors-An Empirical Bayes Approach. Journal of the American Statistical Association, 68, 117-130.
7. Funk, S. (2006). Try this at home. http://sifter.org/∼simon/journal/ 20061211.html.
8. Gelman, A. (2004). Parameterization and Bayesian Modeling. Journal of the American Statistical Association, 99, 537-545.
9. James, W., & Stein, C. (1961). Estimation with quadratic loss. Proceedings of the 4th Berkeley Symposium on Mathematical Statistics and Probability (pp. 361-379). Berkeley, CA, USA: University of California Press.
10. Jeffreys, H. (1946). An Invariant Form for the Prior Probability in Estimation Problems. Proceedings of the Royal Society of London. Series A, Mathematical and Physical Sciences (pp. 453-461).
11. Konstan, J. A., Miller, B. N., Maitz, D., Herlocker, J. L., Gordon, L. R., & Riedl, J. (1997). Grouplens: Applying collaborative filtering to Usenet news. Communications of the ACM, 40, 77-87.
12. Lim, Y. J., & Teh, T. W. (2007). Variational Bayesian Approach to Movie Rating Prediction. Proceedings of KDD Cup and Workshop.
13. Nakajima, S., & Watanabe, S. (2007). Variational Bayes Solution of Linear Neural Networks and its Generalization Performance. Neural Computation, 19, 1112-1153.
14. Raiko, T., Ilin, A., & Karhunen, J. (2007). Principal component analysis for large sale problems with lots of missing values. Proceedings of the 18th European conference on Machine Learning (pp. 691-698).
15. Rao, C. R. (1965). Linear statistical inference and its applications. New York, NY, USA: Wiley.
16. Reinsel, G. R., & Velu, R. P. (1998). Multivariate reduced-rank regression: Theory and applications. New York, NY, USA: Springer.
17. Rosipal, R., & Krämer, N. (2006). Overview and recent advances in partial least squares. Subspace, Latent Structure and Feature Selection Techniques (pp. 34-51). Berlin, Germany: Springer.
18. Salakhutdinov, R., & Mnih, A. (2008). Probabilistic matrix factorization. Advances in Neural Information Process-ing Systems 20 (pp. 1257-1264). Cambridge, MA, USA: MIT Press.
19. Srebro, N., Rennie, J., & Jaakkola, T. (2005). Maximum Margin Matrix Factorization. Advances in Neural Information Processing Systems 17.
20. Watanabe, K., & Watanabe, S. (2006). Stochastic Complexities of Gaussian Mixtures in Variational Bayesian Approximation. Journal of Machine Learning Research, 7, 625-644. (Pubitemid 43668112)
21. Watanabe, S. (2001). Algebraic Analysis for Nonidentifiable Learning Machines. Neural Computation, 13, 899-933. (Pubitemid 33594310)
22. Watanabe, S. (2009). Algebraic geometry and statistical learning. Cambridge, UK: Cambridge University Press.
23. Yamazaki, K., & Watanabe, S. (2003). Singularities in Mixture Models and Upper Bounds of Stochastic Complexity. Neural Networks, 16, 1029-1038.