A fast distance-based approach for determining the number of components in mixtures

Canadian Journal of Statistics

Volumn 31, Issue 1, 2003, Pages 3-22

  Sahu, Sujit K ^a   Cheng, Russell C H ^a  

^a UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

Author keywords

Bayes factor; Gibbs sampler; Kullback Leibler distance; Markov chain Monte Carlo; Mixture model; Reversible jump

Indexed keywords

EID: 0038239484     PISSN: 03195724     EISSN: None     Source Type: Journal    
DOI: 10.2307/3315900     Document Type: Article

References (21)

1. T. W. Andersen (1984). An Introduction to Multivariate Statistical Analysis. Second Edition. Wiley, New York.
2. A. Azzalini & A. W. Bowman (1990). A look at some data on the Old Faithful geyser. Applied Statistics: Journal of the Royal Statistical Society Series C, 39, 357-365.
3. B. P. Carlin & S. Chib (1995). Bayesian model choice via Markov Chain Monte Carlo. Journal of the Royal Statistical Society Series B, 57, 473-484.
4. G. Celeux, M. Hum & C. P. Robert (2000). Computational and inferential difficulties with mixture posterior distributions. Journal of the American Statistical Association, 95, 957-970.
5. J. H. Chen & J. D. Kalbfleisch (1996). Penalized minimum-distance estimates in finite mixture models. The Canadian Journal of Statistics, 24, 167-175.
6. R. C. H. Cheng & S. K. Sahu (2002). On Strong Consistency of Posterior Distributions in Finite Mixture Models with Unknown Number of Components. Technical report, University of Southampton. Available from www.maths.soton.ac.uk/staff/Sahu.
7. S. Chib (1995). Marginal likelihood from the Gibbs output. Journal of the American Statistical Association, 90, 1313-1321.
8. D. K. Dey, L. Kuo & S. K. Sahu (1995). A Bayesian predictive approach to determining the number of components in a mixture distribution. Statistics and Computing, 5, 297-305.
9. T. J. DiCiccio, R. E. Kass, A. E. Raftery & L. A. Wasserman (1997). Computing Bayes factors by combining simulation and asymptotic approximations. Journal of the American Statistical Association, 92, 903-915.
10. G. E. Forsythe, M. A. Malcolm & C. B. Moler (1977). Computer Methods for Mathematical Computation. Prentice-Hall. Upper Saddle River, New Jersey.
11. S. Geisser & W. F. Eddy (1979). A predictive approach to model selection. Journal of the American Statistical Association, 74, 153-160.
12. A. E. Gelfand & D. K. Dey (1994). Bayesian model choice: asymptotics and exact calculations. Journal of the Royal Statistical Society Series B, 56, 501-514.
13. H. Ishwaran, L. F. James & J. Y. Sun (2001). Bayesian model selection in finite mixtures by marginal density decompositions. Journal of the American Statistical Association, 96, 1316-1332.
14. L. F. James, C. E. Preibe & D. J. Marchette (2001). Consistent estimation of mixture complexity. The Annals of Statistics, 29, 1281-1296.
15. K. Mengersen & C.P. Robert (1996). Testing for mixtures: A Bayesian entropic approach (with discussion). In Bayesian Statistics 5 (J. M. Bernardo, J. O. Berger, A. P. Dawid & A. F. M. Smith, eds.), Oxford University Press, pp. 255-276.
16. A. E. Raftery (1996). Hypothesis testing and model selection. In Markov Chain Monte Carlo in Practice (W. R. Gilks, S. Richardson & D. J. Spiegelhalter, eds.), Chapman & Hall, London, pp. 163-187.
17. C. R. Rao (1973). Linear Statistical Inference and its Applications. Second Edition. Wiley, New York.
18. S. Richardson & P. J. Green (1997). On Bayesian analysis of mixtures with an unknown number of components (with discussion). Journal of the Royal Statistical Society Series B, 59, 473-484.
19. K. Roeder & L. A. Wasserman (1997). Practical Bayesian density estimation using mixture of normals. Journal of the American Statistical Association, 92, 894-902.
20. D. J. Spiegelhalter, A. Thomas & N. G. Best (1996). Computation on Bayesian graphical models. In Bayesian Statistics 5 (J. M. Bernardo, J. O. Berger, A. P. Dawid & A. F. M. Smith, eds.), Oxford University Press, pp. 407-426.
21. M. Stephens (2000). Bayesian analysis of mixture models with an unknown number of components - an alternative to reversible jump methods. The Annals of Statistics, 28, 40-74.