Asymptotic behaviour of the posterior distribution in overfitted mixture models

Journal of the Royal Statistical Society. Series B: Statistical Methodology

Volumn 73, Issue 5, 2011, Pages 689-710

  Rousseau, Judith ^a   Mengersen, Kerrie ^b  

^a UNIVERSITÉ PARIS DAUPHINE   (France)

^b QUEENSLAND UNIVERSITY OF TECHNOLOGY   (Australia)

Author keywords

Asymptotic behaviour; Bayesian methods; Mixture models; Overfitting; Posterior concentration

Indexed keywords

EID: 80054736950     PISSN: 13697412     EISSN: 14679868     Source Type: Journal    
DOI: 10.1111/j.1467-9868.2011.00781.x     Document Type: Article

References (20)

1. Akaike, H. (1973) Information theory and an extension of the maximum likelihood principle. In Proc. 2nd Int. Symp. Information Theory (eds B. N. Petrov and F. Csáki), pp. 267-281. Budapest: Akadémiai Kiadó.
2. Azais, J.-M., Gassiat, E. and Mercadier, C. (2006) Asymptotic distribution and power of the likelihood ratio test for mixtures: bounded and unbounded case. Bernoulli, 12, 775-799.
3. Champaz, A. and Rousseau, J. (2008) Bounds for Bayesian order identification with application to mixtures. Ann. Statist., 36, 938-962.
4. Dacunha-Castelle, D. and Gassiat, E. (1999) Testing the order of a model using locally conic parametrization: population mixtures and stationary ARMA processes. Ann. Statist., 27, 1178-1209.
5. Dempster, A. P., Laird, N. M. and Rubin, D. B. (1977) Maximum likelihood from incomplete data via the EM algorithm (with discussion). J. R. Statist. Soc. B, 39, 1-38.
6. Feng, Z. D. and McCulloch, C. E. (1996) Using bootstrap likelihood ratio in finite mixture models. J. R. Statist. Soc. B, 58, 609-617.
7. Frühwirth-Schnatter, S. (2006) Finite Mixture and Markov Switching Models. New York: Springer.
8. Ghosal, S. and van der Vaart, A. (2001) Entropies and rates of convergence for maximum likelihood and bayes estimation for mixtures of normal densities. Ann. Statist., 29, 1233-1263.
9. Ghosal, S. and van der Vaart, A. (2006) Convergence rates of posterior distributions for non iid observations. Ann. Statist., 35, 192-223.
10. Lee, K., Marin, J.-M. Mengersen, K. and Robert, C. (2008) Bayesian inference on mixtures of distributions. In Platinum Jubilee of the Indian Statistical Institute (ed. N. N. Sastry). Bangalore: Indian Statistical Institute.
11. Liu, X. and Shao, Y. (2004) Asymptotics for likelihood ratio tests under loss of identifiability. Ann. Statist., 31, 807-832.
12. MacLachlan, G. and Peel, D. (2000) Finite Mixture Models. New York: Wiley.
13. Marin, J.-M. and Robert, C. (2007) Bayesian Core. New York: Springer.
14. McGrory, C. and Titterington, D. (2007) Variational approximations in bayesian model selection for finite mixture distributions. Computnl Statist. Data Anal., 51, 5352-5367.
15. Richardson, S. and Green, P. J. (1997) On Bayesian analysis of mixtures with an unknown number of components (with discussion). J. R. Statist. Soc. B, 59, 731-792; correction, 60 (1998), 661.
16. Robert, C. and Wraith, D. (2009) Computational methods for Bayesian model choice. Proc. AIP, 1193, 251-262.
17. Rousseau, J. (2007) Approximating interval hypothesis: p-values and Bayes factors. In Bayesian Statistics 8 (eds J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith). Oxford: Oxford University Press.
18. Schwarz, G. (1978) Estimating the dimension of a model. Ann. Statist., 6, 461-464.
19. Scricciolo, C. (2001) Convergence rates of posterior distributions for dirichlet mixtures of normal densities. Technical Report. University of Padova, Padova.
20. Titterington, D., Smith, A. and Makov, U. (1985) Statistical Analysis of Finite Mixture Distributions. New York: Wiley.