On Convergence Properties of the EM Algorithm for Gaussian Mixtures

Neural Computation

Volumn 8, Issue 1, 1996, Pages 129-151

  Xu, Lei ^a,b   Jordan, Michael I ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 2342533082     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/neco.1996.8.1.129     Document Type: Article

References (21)

1. Amari, S. 1995. Information geometry of the EM and em algorithms for neural networks. Neural Networks 8, (5) (in press).
2. Baum, L. E., and Sell, G. R. 1968. Growth transformation for functions on manifolds. Pac. J. Math. 27, 211-227.
3. Bengio, Y., and Frasconi, P., 1995. An input-output HMM architecture. In Advances in Neural Information Processing Systems 7, G. Tesauro, D. S. Touretzky, and J. Alspector, eds. MIT Press, Cambridge MA.
4. Boyles, R. A. 1983. On the convergence of the EM algorithm. J. Royal Stat. Soc. B45(1), 47-50.
5. Dempster, A. P., Laird, N. M., and Rubin, D. B. 1977. Maximum likelihood from incomplete data via the EM algorithm. J. Royal Stat. Soc. B39, 1-38.
6. Ghahramani, Z. and Jordan, M. I. 1994. Function approximation via density estimation using the EM approach. In Advances in Neural Information Processing Systems 6, J. D. Cowan, G. Tesauro, and J. Alspector, eds., pp. 120-127. Morgan Kaufmann, San Mateo, CA.
7. Jordan, M. I., and Jacobs, R. A. 1994. Hierarchical mixtures of experts and the EM algorithm. Neural Comp. 6, 181-214.
8. Jordan, M. I., and Xu, L. 1995. Convergence results for the EM approach to mixtures-of-experts architectures. Neural Networks (in press).
9. Levinson, S. E., Rabiner, L. R., and Sondhi, M. M. 1983. An introduction to the application of the theory of probabilistic functions of Markov process to automatic speech recognition. Bell Sys. Techni. J. 62, 1035-1072.
10. Neal, R. N., and Hinton, G. E. 1993. A New View of the EM Algorithm that Justifies Incremental and Other Variants. University of Toronto, Department of Computer Science preprint.
11. Nowlan, S. J. 1991. Soft Competitive Adaptation: Neural Network Learning Algorithms Based on Fitting Statistical Mixtures. Tech. Rep. CMU-CS-91-126, CMU, Pittsburgh, PA.
12. Redner, R. A., and Walker, H. F. 1984. Mixture densities, maximum likelihood, and the EM algorithm, SIAM Rev. 26, 195-239.
13. Titterington, D. M. 1984. Recursive parameter estimation using incomplete data. J. of Royal Stat. Soc. B46, 257-267.
14. Tresp, V., Ahmad, S., and Neuneier, R. 1994. Training neural networks with deficient data. In Advances in Neural Information Processing Systems 6, J. D. Cowan, G. Tesauro, and J. Alspector, eds. Morgan Kaufmann, San Mateo, CA.
15. Waterhouse, S. R., and Robinson, A. J. 1994. Classification using hierarchical mixtures of experts. Proc. IEEE Workshop on Neural Networks for Signal Processing, pp. 177-186.
16. Wu, C. F. J. 1983. On the convergence properties of the EM algorithm. Ann. Stat. 11, 95-103.
17. Xu, L., and Jordan, M. I. 1993a. Unsupervised learning by EM algorithm based on finite mixture of Gaussians. Proc. WCNN'93, Portland, OR, II, 431-434.
18. Xu, L., and Jordan, M. I. 1993b. EM learning on a generalized finite mixture model for combining multiple classifiers. Proc. WCNN'93, Portland, OR, IV, 227-230.
19. Xu, L., and Jordan, M. I. 1993c. Theoretical and Experimental Studies of the EM Algorithm for Unsupervised Learning Based on Finite Gaussian Mixtures. MIT Computational Cognitive Science, Tech. Rep. 9302, Dept. of Brain and Cognitive Science, MIT, Cambridge, MA.
20. Xu, L., Jordan, M. I., and Hinton, G. E. 1994. A modified gating network for the mixtures of experts architecture. Proc. WCNN'94, San Diego, 2, 405-410.
21. Yuille, A. L., Stolorz, P., and Utans, J. 1994. Statistical physics, mixtures of distributions and the EM algorithm. Neural Comp. 6, 334-340.