Split and merge EM algorithm for improving Gaussian mixture density estimates

Journal of VLSI Signal Processing Systems for Signal, Image, and Video Technology

Volumn 26, Issue 1, 2000, Pages 133-140

  Ueda, Naonori ^a,c,d   Nakano, Ryohei ^a   Ghahramani, Zoubin ^b   Hinton, Geoffrey E ^b  

^a NTT Communication Science Laboratories   (Japan)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c NTT CORPORATION   (Japan)

^d PURDUE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA COMPRESSION; LEARNING ALGORITHMS; MAXIMUM LIKELIHOOD ESTIMATION; MERGING; PROBABILITY DENSITY FUNCTION; SPURIOUS SIGNAL NOISE;

EXPECTATION-MAXIMIZATION (EM) ALGORITHMS; GAUSSIAN MIXTURES;

SIGNAL FILTERING AND PREDICTION;

EID: 0034244838     PISSN: 09225773     EISSN: None     Source Type: Journal    
DOI: 10.1023/a:1008155703044     Document Type: Article

References (12)

1. G. MacLachlan and K. Basford, Mixture Models: Inference and Application to Clustering, Marcel Dekker, 1988.
2. N. Kambhatla and T.K. Leen, "Classifying with Gaussian Mixtures and Clusters," in Advances in Neural Information Processing Systems 7, Cambridge MA: MIT Press, 1995, pp. 681-687.
3. D. Ormoneit and V. Tresp, "Improved Gaussian Mixture Density Estimates Using Bayesian Penalty Terms and Network Averaging," in Advances in Neural Information Processing Systems 8, D.S. Touretzky, G. Tesauro and T.K. Leen (eds.), Cambridge MA: MIT Press, 1996, pp. 542-548.
4. L. Rabiner and Juang Biing-Hwang, Fundamentals of Speech Recognition, PTR Prentice-Hall, 1993.
5. A.P. Dempster, N.M. Laird, and D.B. Rubin, "Maximum Likelihood from Incomplete Data via the EM Algorithm," Journal of Royal Statistical Society B, vol. 39, 1977, pp. 1-38.
6. N. Ueda and R. Nakano, "Deterministic Annealing Variant of the EM Algorithm," Advances in Neural Information Processing Systems 7, D.S. Touretzky, G. Tesauro and T.K. Leen (eds.), Cambridge MA: MIT Press, 1995, pp. 545-552.
7. N. Ueda and R. Nakano, "Deterministic Annealing EM Algorithm," Neural Networks, vol. 11, 1998, pp. 271-282.
8. N. Ueda and R. Nakano, "A New Competitive Learning Approach Based on an Equidistortion Principle for Designing Optimal Vector Quantizers," Neural Networks, vol. 7, no. 8, 1994, pp. 1211-1227.
9. M.E. Tipping and C.M. Bishop, "Mixtures of Probabilistic Principal Component Analysers," Tech. Rep. NCRG-97-3, Aston Univ. Birmingham, UK, 1997.
10. Z. Ghahramani and G.E. Hinton, "The EM Algorithm for Mixtures of Factor Analyzers," Tech. Report CRG-TR-96-1, Univ. of Toronto, 1997. http://www.gatsby.ucl. ac.uk/∼zoubin/papers/tr-96-1.ps.gz.
11. N. Ueda, R. Nakano, Z. Ghahramani, and G.E. Hinton, "SMEM Algorithm for Mixture Models," in Advances in Neural Information Processing Systems 11, M.S. Kearns, S.A. Solla and D.A. Cohn (eds.), Cambridge MA: MIT Press, 1999, pp. 599-605.
12. N. Ueda, R. Nakano, Z. Ghahramani, and G.E. Hinton, "SMEM Algorithm for Mixture Models," Neural Computation, MIT Press, to appear.