Reparameterisation issues in mixture modelling and their bearing on MCMC algorithms

Computational Statistics and Data Analysis

Volumn 29, Issue 3, 1999, Pages 325-343

  Robert, Christian P ^a   Mengersen, Kerrie L ^b  

^a CREST   (France)

^b QUEENSLAND UNIVERSITY OF TECHNOLOGY   (Australia)

Author keywords

Bayesian inference; Convergence of Markov chains; Gibbs sampling; Identifiability; Non informative prior; Normal distribution

Indexed keywords

ALGORITHM; BAYESIAN ANALYSIS; MARKOV CHAIN; MODELING; PARAMETERIZATION;

ALGORITHMS; INFERENCE ENGINES; MARKOV PROCESSES; MATHEMATICAL MODELS; PARAMETER ESTIMATION; SAMPLING;

BAYESIAN INFERENCE; COMPONENT REPARAMETERIZATION; GIBBS SAMPLING; NON-INFORMATIVE PRIORS;

NORMAL DISTRIBUTION;

EID: 0033611397     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0167-9473(98)00058-9     Document Type: Article

References (34)

1. Basford, K.E., McLachlan, G.J., York, M.G., 1998. Modelling the distribution of stamp paper thickness via finite normal mixtures: the 1872 Hidalgo stamp issue of Mexico revisited. Appl. Statist., to appear.
2. Besag J., Green P., Higdon D., Mengersen K. Bayesian computation and stochastic systems (with discussion). Statist. Sci. 10:1995;3-66.
3. Bernardo, J.M., Girón, F.J., 1988. A Bayesian analysis of simple mixture problems. In: Bernardo, J.M., DeGroot, M.H., Lindley, D.V., Smith, A.F.M. (Eds.), Bayesian Statistics, vol. 3, Oxford University Press, London. pp. 67-68.
4. Carlin B., Chib S. Bayesian model choice through Markov-Chain Monte Carlo. J. Roy. Statist. Soc. (Ser. B). 57:1995;473-484.
5. Casella G., Robert C.P. Rao-Blackwellisation of sampling schemes. Biometrika. 83:1996;81-94.
6. Crawford S.L., DeGroot M.H., Kadane J.B., Small M.J. Modelling lake-chemistry distributions: approximate Bayesian methods for estimating a finite-mixture model. Technometrics. 34:1992;441-453.
7. Diebolt, J., Robert, C.P., 1994. Estimation of finite mixture distributions through Bayesian sampling. J. Roy. Statist. Soc. (Ser. B) 56 (2), 363-375.
8. Escobar M.D. Estimating normal means with a Dirichlet process prior. J. Amer. Statist. Assoc. 89:1994;268-277.
9. Escobar M.D., West M. Bayesian density estimation and inference using mixtures. J. Amer. Statist. Assoc. 90:1995;577-588.
10. Gelfand A.E., Smith A.F.M. Sampling based approaches to calculating marginal densities. J. Amer. Statist. Assoc. 85:1990;398-409.
11. Ghosh, J., Sen, P.K., 1985. On the asymptotic performance of the log-likelihood ration statistic for the mixture model and related results. In: LeCam, L., Ohlsen, R.A. (Eds.), Proc. Berkeley Conf. J. Neyman and J. Kiefer, vol. 2, pp. 789-806.
12. Gilks, W.R., Richardson, S. Spiegelhalter, D.I., 1996. Markov Chain Monte Carlo in Practice. Chapman & Hall, London.
13. Goffinet B., Loisel P., Laurent B. Testing in normal mixture models when the proportions are known. Biometrika. 79:1992;842-846.
14. Gruet, M.A., Philippe, A., Robert, C.P., 1998. Convergence assessment for MCMC algorithms in the estimation of mixtures of exponential distributions. Technical Report 9808. CREST, Paris.
15. Izenman A.J., Sommer C.J. Philatelic mixtures and multimodal densities. J. Amer. Statist. Assoc. 83:1988;941-953.
16. Lu J.S., Wong W.H., Kong A. Covariance structure of the Gibbs sampler with applications to the comparison of estimators and sampling schemes. Biometrika. 81:1994;27-40.
17. Meng X.L., Rubin D.B. Maximum likelihood estimation via the ECM algorithm: a general framework. Biometrika. 80:1993;267-278.
18. Mengersen, K., Robert, C., 1996. Testing for mixtures: a Bayesian entropic approach. In: Berger, J.O., Bernardo, J.M., Dawid, A.P., Lindley, D.V., Smith, A.F.M. (Eds.), Bayesian Statistics, vol. 5. Oxford University Press, London, pp. 255-276.
19. Muller P., Erkanli A., West M. Curve fitting using Dirichlet process mixtures. Biometrika. 83:1996;67-79.
20. Pearson K. Contribution to the mathematical theory of evolution. Phil. Trans. Roy. Soc. A. 185:1894;71-110.
21. Philippe A. Discussion of Casella's paper. TEST. 5:1997;325-331.
22. Philippe A. Accept-reject simulation of left- and right-truncated gamma distributions. Statist. Comput. 7:1997;173-181.
23. Phillips, D.B., Smith, A.F.M., 1996. Bayesian model comparison via jump diffusions. In: Gilks, W.R., Richardson, S., Spiegelhalter, D.J. (Eds.), Markov Chain Monte Carlo in Practice. Chapman & Hall, London, pp. 215-240.
24. Richardson S.T., Green P.J. On Bayesian analysis of mixtures with an unknown number of components (with discussion). J. Roy. Statist. Soc. Ser. B. 59:1997;731-792.
25. Robert C.P. Convergence control techniques for Markov Chain Monte Carlo algorithms. Statist. Sci. 10:1995;231-253.
26. Robert, C.P., 1996a. Inference in mixture models. In: Gilks, W.R., Richardson, S., Spiegelhalter, D.J. (Eds.), Markov Chain Monte Carlo in Practice. Chapman & Hall, London, pp. 441-464.
27. Robert, C.P., 1996b. Méthodes de Monte Carlo par Chaînes de Markov. Economica, Paris.
28. Robert C.P. Discussion of Richardson and Green' paper. J. Roy. Statist. Soc. Ser. B. 59:1997;758-764.
29. Robert, C.P., Titterington, M., 1998. Resampling schemes for hidden Markov models and their application for maximum likelihood estimation. Statist. Comput., to appear.
30. Roeder K. Density estimation with confidence sets exemplified by superclusters and voids in the galaxy. J. American Stat. Assoc. 85:1990;617-624.
31. Roeder, K., Wasserman, L., 1995. Practical Bayesian Density Estimation Using Mixtures of Normals. Technical Report. Carnegie Mellon University, Pittsburg.
32. Thode H., Finch S., Mendell N.R. Simulated percentage points for the null distribution of the likelihood ratio test for a mixture of two normals. Biometrics. 44:1988;1195-1201.
33. Titterington, D.M., Smith, A.F.M., Makov, U.D., 1985. Statistical Analysis of Finite Mixture Distributions. Wiley, New York.
34. West, M., 1992. Modelling with mixtures. In: Bernardo, J.M., Berger, J.O., Dawid, A.P., Smith, A.F.M. (Eds.), Bayesian Statistics, vol. 4. Oxford University Press, Oxford.