Bayesian Methods for Mixtures of Experts

NIPS 1995: Proceedings of the 8th International Conference on Neural Information Processing Systems

Volumn , Issue , 1995, Pages 351-357

  Waterhouse, Steve ^a   MacKay, David ^b   Robinson, Tony ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN NETWORKS; INFERENCE ENGINES; MAXIMUM LIKELIHOOD ESTIMATION;

BAYESIAN APPROACHES; BAYESIAN FRAMEWORKS; BAYESIAN METHODS; ENSEMBLE LEARNING; FREE ENERGY MINIMIZATION; MIXTURE OF EXPERTS; MIXTURE-OF-EXPERTS MODEL; MODEL-BASED OPC; OVERFITTING; VARIATIONAL FREE ENERGY;

FREE ENERGY;

EID: 85156191859     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (9)

1. Dempster, A. P., Laird, N. M. & Rubin, D. B. (1977), 'Maximum likelihood from incomplete data via the EM algorithm', Journal of the Royal Statistical Society, Series B 39, 1-38.
2. Geman, S., Bienenstock, E. & Doursat, R. (1992), 'Neural networks and the bias/variance dilemma', Neural Computation 5, 1-58.
3. Gull, S. F. (1989), Developments in maximum entropy data analysis, in J. Skilling, ed., 'Maximum Entropy and Bayesian Methods, Cambridge 1988', Kluwer, Dordrecht, pp. 53-71.
4. Hinton, G. E. & van Camp, D. (1993), Keeping neural networks simple by minimizing the description length of the weights, To appear in: Proceedings of COLT-93.
5. Jordan, M. I. & Jacobs, R. A. (1994), 'Hierarchical Mixtures of Experts and the EM algorithm', Neural Computation 6, 181-214.
6. MacKay, D. J. C. (1992a), 'Bayesian interpolation', Neural Computation 4 (3), 415-447.
7. MacKay, D. J. C. (1992b), 'The evidence framework applied to classification networks', Neural Computation 4 (5), 698-714.
8. Neal, R. M. & Hinton, G. E. (1993), 'A new view of the EM algorithm that justifies incremental and other variants'. Submitted to Biometrika. Available at URL:ftp://ftp. cs.toronto.edu/pub/radford/www.
9. Weigend, A. S., Huberman, B. A. & Rumelhart, D. E. (1990), 'Predicting the future: a connectionist approach', International Journal of Neural Systems 1, 193-209.