Estimation of structured Gaussian mixtures: The inverse EM algorithm

IEEE Transactions on Signal Processing

Volumn 55, Issue 7 I, 2007, Pages 3185-3191

  Snoussi, Hilchem ^a   Mohammad Djafari, Ali ^b  

^a UNIVERSITÉ DE TECHNOLOGIE DE TROYES   (France)

^b UNIV PARIS SUD   (France)

Author keywords

EM algorithm; Gaussian mixture; Structured covariances; Unsupervised classification

Indexed keywords

ALGORITHMS; COVARIANCE MATRIX; GAUSSIAN NOISE (ELECTRONIC); MATRIX ALGEBRA; NUMERICAL METHODS; PARAMETER ESTIMATION;

EXPECTATION-MAXIMIZATION (EM) ALGORITHM; GAUSSIAN MIXTURE; STATIONARY AUTOREGRESSIVE TIME SERIES;

WHITE NOISE;

EID: 34347386030     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2007.893923     Document Type: Article

References (16)

1. K. Roeder and L. Wasserman, "Practical Bayesian density estimation using mixtures of normals," J. Amer. Statist. Assoc., vol. 92, pp. 894-902, 1997.
2. R. R. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," Proc. IEEE, vol. 77, pp. 257-286, Feb. 1989.
3. H. Snoussi and A. Mohammad-Djafari, "Bayesian unsupervised learning for source separation with mixture of Gaussians prior," Int. J. VLSI Signal Process. Syst. Signal, Image, Video Technol., vol. 37, no. 2-3, pp. 263-279, Jun.-Jul. 2004.
4. H. Snoussi and A. Mohammad-Djafari, "MCMC joint separation and segmentation of hidden Markov fields," in Neural Networks for Signal Processing XII, Sep. 2002, pp. 485-494.
5. G. J. McLachlan and K. E. Basford, Mixture Models, Inference and Applications to Clustering. New York: Marcel Dekker, 1987, vol. 84 of statistics.
6. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. R. Statist. Soc. B, vol. 39, pp. 1-38, 1977.
7. X. Descombes, R. Morris, J. Zerubia, and M. Berthod, "Estimation of Markov random field prior parameters using Markov chain Monte Carlo maximum likelihood," INRIA, Sophia Antipolis, France, Res. Rep. 3015, 1996.
8. J. P. Burg, D. G. Luenberger, and D. L. Wenger, "Estimation of structured covariance matrices," Proc. IEEE, vol. 70, no. 9, pp. 963-974, Sep. 1982.
9. T. J. Schulz, "Penalized maximum-likelihood estimation of covariance matrices with linear structure," IEEE Trans. Signal Process., vol. 45, no. 12, pp. 3027-3038, Dec. 1997.
10. G. J. McLachlan and D. Peel, Finite Mixture Models, ser. In Probability and Statistics. New York: Wiley, 2000.
11. J. Kiefer and J. Wolfowitz, "Consistency of the maximum likelihood estimator in the presence of infinitely many incidental parameters," Ann. Math. Statist., vol. 27, pp. 887-906, 1956.
12. H. Snoussi and A. Mohammad-Djafari, "Penalized maximum likelihood for multivariate Gaussian mixture," in Bayesian Inference and Maximum Entropy Methods, R. L. Fry, Ed. College Park, MD: Amer. Inst. Physics, 2001, pp. 36-46.
13. H. Snoussi and A. Mohammad-Djafari, "Degeneracy and likelihood penalization in multivariate Gaussian mixture models," Univ. of Technology of Troyes, Troyes, France, Tech. Rep. UTT, 2005 [Online]. Available: http://h.snoussi.free.fr/)
14. D. Ormoneit and V. Tresp, "Averaging, maximum penalized likelihood and Bayesian estimation for improving Gaussian mixture probability density estimates," IEEE Trans. Neural Netw., vol. 9, pp. 639-649, Jul. 1998.
15. R. J. Hathaway, "A constrained EM algorithm for univariate normal mixtures," J. Statist. Comput. Simul., vol. 23, pp. 211-230, 1986.
16. C. F. J. Wu, "On the convergence of the EM algorithm," Ann. Statist., vol. 11, no. 1, pp. 95-103, 1983.