Online model selection based on the variational Bayes

Neural Computation

Volumn 13, Issue 7, 2001, Pages 1649-1681

  Sato, Masa aki ^a  

^a JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0000147488     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/089976601750265045     Document Type: Article

References (32)

1. Amari, S. (1985). Differential geometrical method in statistics. New York: Springer-Verlag.
2. Amari, S. (1998). Natural gradient works efficiently in learning. Neural Computation, 10, 251-276.
3. Attias, H. (1999). Inferring parameters and structure of latent variable models by variational Bayes. In Proc. 15th Conference on Uncertainty in Artificial Intelligence (pp. 21-30).
4. Attias, H. (2000). A variational Bayesian framework for graphical models. In S. A. Solla, T. K. Leen, & K.-R. Müller (Eds.), Advances in neural information processing systems, 12. Cambridge, MA: MIT Press (pp. 206-212).
5. Bishop, C. M. (1995). Neural networks for pattern recognition. New York: Oxford University Press.
6. Bishop, C. M. (1999). Variational principal components. In IEE Conference Publication on Artificial Neural Networks ICANN99 (pp. 509-514).
7. Chickering, D. M., & Heckerman, D. (1997). Efficient approximations for the marginal likelihood of Bayesian networks with hidden variables. Machine Learning, 29, 181-212.
8. Cooper, G., & Herskovitz, E. (1992). A Bayesian method for the induction of probabilistic networks from data. Machine Learning, 9, 309-347.
9. Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of Royal Statistical Society B, 39, 1-22.
10. Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (1995). Bayesian data analysis. London: Chapman & Hall.
11. Ghahramani, Z., & Beal, M. J. (2000). Variational inference for Bayesian mixture of factor analysers. In S. A. Solla, T. K. Leen, & K.-R. Müller (Eds.), Advances in neural information processing systems, 12. Cambridge, MA: MIT Press (pp. 449-455).
12. Heckerman, D., Geiger, D., & Chickering, D. (1995). Learning Bayesian networks: The combination of knowledge and statistical data. Machine Learning, 20, 197-243.
13. Kushner, H. J., & Yin, G. G. (1997). Stochastic approximation algorithms and applications. New York: Springer-Verlag.
14. Mackay, D. J. C. (1992a). Bayesian interpolation. Neural Computation, 4, 405-447.
15. Mackay, D. J. C. (1992b). A practical Bayesian framework for backpropagation networks. Neural Computation, 4, 448-472.
16. Mackay, D. J. C. (1999). Comparison of approximate methods for handling hyperparameters. Neural Computation, 11, 1035-1068.
17. Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., & Teller, E. (1953). Equations of state calculations by fast computing machines. Journal of Chemical Physics, 21, 1087-1092.
18. Neal, R. M. (1996). Bayesian learning for neural networks. New York: Springer-Verlag.
19. Neal, R. M., & Hinton, G. E. (1998). A view of the EM algorithm that justifies incremental, sparse, and other variants. In M. I. Jordan (Ed.), Learning in graphical models (pp. 355-368). Norwell, MA: Kluwer.
20. Rabiner, L. R. (1989). A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE, 77, 257-286.
21. Richardson, S., & Green, P. J. (1997). On Bayesian analysis of mixtures with an unknown number of components. Journal of the Royal Statistical Society B, 59, 731-792.
22. Rissanen, J. (1987). Stochastic complexity. Journal of the Royal Statistical Society B, 49, 223-239, 253-265.
23. Roberts, S. J., Husmeier, D., Rezek, I., & Penny, W. (1998). Bayesian approaches to gaussian mixture modeling. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20, 1133-1142.
24. Roweis, S. T., & Ghahramani, Z. (1999). A unifying review of linear gaussian models. Neural Computation, 11, 305-345.
25. Sato, M. (2000). Convergence of on-line EM algorithm. In Proc. of 7th International Conference on Neural Information Processing ICONIP-2000 Vol. 1 (pp. 476-481).
26. Sato, M., & Ishii, S. (2000). On-line EM algorithm for the normalized gaussian network. Neural Computation, 12, 407-432.
27. Schwartz, G. (1978). Estimating the dimension of a model. Annals of Statistics, 6, 461-464.
28. Tipping, M. E., & Bishop, C. M. (1999). Mixtures of probabilistic principal component analyzers. Neural Computation, 11, 443-482.
29. Titterington, D. M., Smith, A. F. M., & Makov, U. E. (1985). Statistical analysis of finite mixture distributions. New York: Wiley.
30. Ueda, N. (1999). Variational Bayesian learning with split and merge operations (Tech. Rep. No. PRMU99-174, 67-74). Institute of Electronics, Information, and Communications Engineers, (in Japanese)
31. Ueda, N., Nakano, R., Ghahramani, Z., & Hinton, G. E. (1999). SMEM algorithm for mixture models. In M. S. Kearns, S. A. Solla, & D. A. Cohn (Eds.), Advances in neural information processing systems, 11 (pp. 599-605). Cambridge, MA: MIT Press.
32. Waterhouse, S., Mackay, D., & Robinson, T. (1996). Bayesian methods for mixture of experts. In D. S. Touretzky, M. C. Mozer, & M. E. Hasselmo (Eds.), Advances in neural information processing systems, 8 (pp. 351-357). Cambridge, MA: MIT Press.