Penalized maximum likelihood estimator for normal mixtures

Scandinavian Journal of Statistics

Volumn 30, Issue 1, 2003, Pages 45-59

  Ciuperca, Gabriela ^a   Ridolfi, Andrea ^b   Idier, Jérôme ^b  

^a UNIVERSITÉ LYON 1   (France)

^b NONE

Author keywords

Bayesian estimation; Mixtures of normal distributions; Penalized maximum likelihood; Strong consistency

Indexed keywords

EID: 0038784399     PISSN: 03036898     EISSN: None     Source Type: Journal    
DOI: 10.1111/1467-9469.00317     Document Type: Article

References (35)

1. Biernacki, C., Celeux, G. & Govaert, G. (1997). Assessing a mixture model for clustering with the integrated classification likelihood. Research Report 3521, INRIA (www.inria.fr).
2. Butler, R. W. (1986). Predictive likelihood inference with applications. With discussion and a reply by the author. J. Roy. Statist. Soc. Ser. B 48, 1-38.
3. Champagnat, F., Goussard, Y. & Idier, J. (1996). Unsupervised deconvolution of sparse spike trains using stochastic approximation. IEEE Trans. Signal Process. 44, 2988-2998.
4. Chanda, K. C. (1954). A note on the consistency and maxima of the roots of the likelihood equations. Biometrika 41, 56-61.
5. Cheng, R. C. H. & Liu, W. B. (2001). The consistency of estimators in finite mixtures models. Scand. J. Statist. 28, 606-616.
6. Day, N. E. (1969). Estimating the components of a mixture of normal distributions. Biometrika 56, 463-474.
7. Dempster, A. P., Laird, N. M. & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. J. Roy. Statist. Soc. Ser. B 39, 1-38.
8. Diebolt, J. & Robert, C. (1994). Estimation of finite mixture distribution through Bayesian sampling. J. Roy. Statist. Soc. Ser. B 56, 363-375.
9. Escobar, M. D. & West, M. (1995). Bayesian density estimation and inference using mixtures. J. Amer. Statist. Assoc. 90, 577-588.
10. Feng, Z. D. & McCulloch, C. E. (1996). Using bootstrap likelihood ratios in finite mixture models. J. Roy. Statist. Soc. Ser. B 58, 609-617.
11. Fowlkes, E. B. (1979). Some methods for studying the mixture of two normal (lognormal) distributions. J. Amer. Statist. Assoc. 74, 561-575.
12. Green, P. J. (1990). On use of the EM algorithm for penalized likelihood estimation. J. Roy. Statist. Soc. Ser. B 52, 443-452.
13. Good, I. J. & Gaskins, R. A. (1971). Nonparametric roughness penalties for probability densities Biometrika 58, 255-277.
14. Hathaway, R. J. (1985). A constrained formulation of maximum-likelihood estimation for normal mixture distributions. Ann. Statist. 13, 795-800.
15. Hathaway, R. J. (1986). A constrained EM algorithm for univariate normal mixtures. J. Statist. Comput. Simulation 23, 211-230.
16. Hero, A. O. & Fessler, J. A. (1993). Asymptotic convergence properties of EM-type algorithms. Technical Report, 282, Department of Electrical Engineering and Computer Science, The University of Michigan.
17. Kiefer, J. & Wolfowitz, J. (1956). Consistency of the maximum likelihood estimator in the presence of infinitely many incidental parameters. Ann. Math. Statist. 27, 887-906.
18. McLachlan, G. J. & Basford, K. E. (1987). Mixture models, inference and applications to clustering. Marcel Dekker, New York.
19. McLachlan, G. J. & Peel, D. (2000). Finite mixture models. Wiley, New York.
20. Newcomb, S. (1886). A generalized theory of the combination of observations so as to obtain the best result. Amer. J. Math. 8, 343-366.
21. Pearson, K. (1894). Contribution to the mathematical theory of evolution. Philos. Trans. Roy. Soc. London 185, 71-110.
22. Peters, B. C. & Walker, H. F. (1978). An iterative procedure for obtaining maximum likelihood estimates of the parameters for a mixture of normal distributions. SIAM J. Appl. Math. 362-378.
23. Redner, R. (1980). Maximum likelihood estimation for mixture models. Technical memorandum, NASA.
24. Redner, R. (1981). Note on the consistency of the maximum likelihood estimate for non-identifiable distributions. Ann. Statist. 9, 225-228.
25. Redner, R. A. & Walker H. F. (1984). Mixture densities, maximum likelihood and the EM algorithm. SIAM Rev. 26, 195-239.
26. Richardson, S. & Green, P. J. (1997). On Bayesian analysis of mixtures with an unknown number of components. J. Roy. Statist. Soc. Ser. B 59, 731-792.
27. Ridolfi, A. (1997). Maximum likelihood estimation of hidden Markov model parameters, with application to medical image segmentation. Tesi di Laurea, Politecnico di Milano, Milan, Italy.
28. e colloque GRETSI, 259-262, Vannes, France.
29. Ridolfi, A. & Idier, J. (2000). Penalized maximum likelihood estimation for univariate normal mixture distributions. Bayesian inference and maximum entropy methods, MaxEnt Workshops. Gif-sur-Yvette, France, July 2000.
30. Roberts, S. J., Husmeier, D., Rezek, I., & Penny, W. (1998). Bayesian approaches to Gaussian mixture modeling. IEEE Trans. Pattern Anal. Machine Intell. 20, 887-906.
31. Stephens, M. (1997). Bayesian methods for mixtures of normal distributions. PhD Thesis, University of Oxford.
32. Stephens, M. (2000). Bayesian analysis of mixtures models with an unknown number of components - an alternative to reversible jumps methods. Ann. Statist. 28, 40-74.
33. Wallace, C. S. & Freeman, P. R. (1987). Estimation and inference by compact coding. J. Roy. Statist. Soc. Ser. B 49, 240-265.
34. Wald, A. (1949). Note on the consistency of the maximum likelihood estimate. Ann. Math. Statist. 20, 595-601.
35. Wolfowitz, J. (1949). On Wald's proof of the consistency of the maximum likelihood estimate. Ann. Math. Statist. 20, 601-602.