Variational Bayesian learning for optimal model search

Transactions of the Japanese Society for Artificial Intelligence

Volumn 16, Issue 2, 2001, Pages 299-308

  Ueda, Naonori ^a  

^a NTT Communication Science Laboratories   (Japan)

Author keywords

Bayesian learning; Local optima problem; Model search; Split and merge operations; Variational approximation

Indexed keywords

BAYESIAN LEARNING; LOCAL OPTIMA PROBLEM; MODEL SEARCH; SPLIT AND MERGE OPERATIONS; VARIATIONAL APPROXIMATION;

APPROXIMATION THEORY; COMPUTATIONAL COMPLEXITY; MAXIMUM LIKELIHOOD ESTIMATION; OPTIMIZATION; PARAMETER ESTIMATION; PROBLEM SOLVING;

NONLINEAR EQUATIONS;

EID: 18544376851     PISSN: 13460714     EISSN: 13468030     Source Type: Journal    
DOI: 10.1527/tjsai.16.299     Document Type: Article

References (19)

1. [Akaike 73] Akaike, H.: A new look at the statistical model identification, IEEE Trans. Autom. Contor., Vol. AC-19, pp.716-723 (1973).
2. [Attias 99] Attias, H.: Learning parameters and structure of latent variable models by variational Bayes, In proc. Uncertainty in Artificial Intelligence, (1999).
3. [Bartlett 96] Bartlett, P.: The sample complexity of pattern classification with neural networks: the size of the weights is more important than the size of the network, Technical report, Australian National University (1996).
4. [Dempster 77] Dempster, A.P., Laird, N.M., and Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm, Journal of Royal Statistical Society B, Vol. 9, pp. 1-38 (1977).
5. [Gamerman 97] Gamerman, D.: Markov chain Monte Carlo, Chapman & Hall (1997).
6. [Jacobs 91] Jacobs, R.J., Jordan, M.I. Nowlan, S.J., and Hinton, G.E.: Adaptive mixtures of local experts, Neural Computation, Vol. 3, pp. 79-87 (1991).
7. [Jordan 97] Jordan, M.I., Ghahramani, Z., Jaakkola, T.S., and Saul, L.K.: An introduction to variational methods for graphical models, Machine Learning, Vol. 37, No. 2 (1997).
8. [Richardson 97] Richardson, S. and Green, P.: On Bayesian analysis of mixtures with an unknown number of components, Journal of the Royal Statistical Society B, Vol. 59, pp. 731-792 (1997).
9. [MacKay 92] MacKay, D.: Bayesian interpolation, Neural Computation, Vol. 4, pp. 405-447 (1992).
10. [Rasmussen 96] Rasmussen, C.E., Neal, R.M., Hinton, G.E., van Camp, D., Revow, M., Ghahramani, Z., Kustra, R. and Tibshirani, R.: The DELVE Manual, http://www.cs.utoronto.ca/~delve/ (1996).
11. Japanese only
12. [Rissanen 87] Rissanen, J.: Stochastic complexity, Journal of the Royal Statistical Society B, Vol. 49, pp. 223-239 (1987).
13. [Saul 96] Saul, L.K., Jaakkola, T., and Jordan, M.I.: Mean field theory for sigmiod belief networks, Journal of Artificial Intelligence Research, Vol. 4, pp. 61-76 (1996).
14. [Ueda 99a] Ueda, N. and Nakano, R., Ghahramani, Z., and Hinton, G.E.: SMEM algorithm for mixture models, Advances in Neural Information Processing Systems 11 (1999).
15. Japanese only
16. [Ueda 00] Ueda, N. and Nakano, R., Ghahramani, Z., and Hinton, G.E.: SMEM algorithm for mixture models, Neural Computation, Vol. 12, No. 9, pp. 2109-2128 (2000).
17. [Waterhouse 95] Waterhouse, S.R., MacKay, D. and Robinson, A.J.: Bayesian methods for mixture of experts, Advances in Neural Information Processing Systems 8, (1995).
18. [Xu 94] Xu, L., Jordan, M.I., and Hinton, G.E.: An alternative model for mixtures of experts, Advances in Neural Information Processing Systems 7, pp. 633-640 (1994).
19. [Zoubin 00] Ghahramani, Z. and Beal, M.J.: Variational inference for Bayesian mixture of factor analyzers, Advances in Neural Information Processing Systems 12, (2000).