Bayesian analysis of mixture models with an unknown number of components - An alternative to reversible jump methods

Annals of Statistics

Volumn 28, Issue 1, 2000, Pages 40-74

  Stephens, Matthew ^a  

^a Department of Statistics ^*  (United Kingdom)

Author keywords

Bayesian analysis; Birth death process; Markov process; MCMC; Mixture model; Model choice; Reversible jump; Spatial point process

Indexed keywords

EID: 0034374610     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/aos/1016120364     Document Type: Article

References (45)

1. ANDERSON, E. (1935). The irises of the Gaspe Peninsula. Bulletin of the American Iris Society 59 2-5.
2. BADDELEY, A. J. and VAN LIESHOUT, M. N. M. (1993). Stochastic geometry models in high-level vision. In Advances in Applied Statistics (K. V. Mardia and G. K. Kanji, eds.) 1 231-256. Carfax, Abingdon, UK.
3. BROOKS, S. P. and ROBERTS, G. O. (1998). Convergence assessment techniques for Markov chain Monte Carlo. Statist. Comput. 8 319-335.
4. CARLIN, B. P. and CHIB, S. (1995). Bayesian model choice via Markov Chain Monte Carlo methods. J. Roy. Statist. Soc. Ser. B 57 473-484.
5. CHIB, S. (1995). Marginal likelihood from the Gibbs output. J. Amer. Statist. Assoc. 90 1313-1321.
6. COWLES, M. K. and CARLIN, B. P. (1996). Markov Chain Monte Carlo convergence diagnostics: a comparative review. J. Amer. Statist. Assoc. 91 883-904.
7. CRAWFORD, S. L. (1994). An application of the Laplace method to finite mixture distributions. J. Amer. Statist. Assoc. 89 259-267.
8. DAWID, A. P. (1997). Contribution to the discussion of piper by Richardson and Green (1997). J. Roy. Statist. Soc. Ser. B 59 772-773.
9. DICICCIO, T., KASS, R., RAFTERY, A. and WASSERMAN, L. (1997). Computing Bayes factors by posterior simulation and asymptotic approximations. J. Amer. Statist. Assoc. 92 903-915.
10. DIEBOLT, J. and ROBERT, C. P. (1994). Estimation of finite mixture distributions through Bayesian sampling. J. Roy. Statist. Soc. Ser. B 56 363-375.
11. ESCOBAR, M. D. and WEST, M. (1995). Bayesian density estimation and inference using mixtures. J. Amer. Statist. Assoc. 90 577-588.
12. GELMAN, A. and RUBIN, D. B. (1992). Inference from iterative simulation using multiple sequences (with discussion). Statist. Sci. 7 457-511.
13. GELMAN, A. G., CARLIN, J. B., STERN, H. S. and RUBIN, D. B. (1995). Bayesian Data Analysis. Chapman & Hall, London.
14. GEORGE, E. I. and MCCULLOCH, R. E. (1996). Stochastic search variable selection. In Markov Chain Monte Carlo in Practice (W. R. Gilks S. Richardson and D. J. Spiegelhalter, eds.) Chapman & Hall, London.
15. GEYER, C. J. and MØLLER, J. (1994). Simulation procedures and likelihood inference for spatial point processes. Scand. J. Statist. 21 359-373.
16. GILKS, W. R., RICHARDSON, S. and SPIEGELHALTER, D. J., eds. (1996). Markov Chain Monte Carlo in Practice. Chapman & Hall, London.
17. GLÖTZL, E. (1981). Time-reversible and Gibbsian point processes I. Markovian spatial birth and death process on a general phase space. Math. Nach. 102 217-222.
18. GREEN, P. J. (1995). Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika 82 711-732.
19. HÄRDLE, W. (1991). Smoothing techniques with implementation in S. Springer, New York.
20. JENNISON, C. (1997). Comment on "On Bayesian analysis of mixtures with an unknown number of components," by S. Richardson and P. J. Green. J. Roy. Statist. Soc. Ser. B 59 778-779.
21. KELLY, F. P. and RIPLEY, B. D. (1976) A note on Strauss's model for clustering. Biometrika 63 357-360.
22. LAWSON, A. B. (1996). Markov chain Monte Carlo methods for spatial cluster processes. In Computer Science and Statistics: Proceedings of the 27th Symposium on the Interface 314-319.
23. MATHIESON, M. J. (1997). Ordinal models and predictive methods in pattern recognition. Ph.D. thesis, Univ. Oxford.
24. MCLACHLAN, G. J. (1992). Discriminant Analysis and Statistical Pattern Recognition. Wiley, New York.
25. MCLACHLAN, G. J. and BASFORD, K. E. (1988). Mixture Models: Inference and Applications to Clustering. Dekker, New York.
26. PHILLIPS, D. B. and SMITH, A. F. M. (1996). Bayesian model comparison via jump diffusions. In Markov Chain Monte Carlo in Practice (W. R. Gilks, S. Richardson and D. J. Spiegelhalter, eds.) 215-239. Chapman & Hall, London.
27. POSTMAN, M., HUCHRA, J. P. and GELLER, M. J. (1986). Probes of large-scale structure in the Corona Borealis region. The Astronomical Journal 92 1238-1247.
28. PRESTON, C. J. (1976). Spatial birth-and-death processes. Bull. Inst. Internat. Statist. 46 371-391.
29. PRIEBE, C. E. (1994). Adaptive mixtures. J. Amer. Statist. Assoc. 89 796-806.
30. RICHARDSON, S. and GREEN, P. J. (1997). On Bayesian analysis of mixtures with an unknown number of components (with discussion). J. Roy. Statist. Soc. Ser. B 59 731-792.
31. RIPLEY, B. D. (1977). Modelling spatial patterns (with discussion). J. Roy. Statist. Soc. Ser. B 39 172-212.
32. RIPLEY, B. D. (1987). Stochastic Simulation. Wiley, New York.
33. ROBERT, C. P. (1994). The Bayesian Choice: a Decision-Theoretic Motivation. Springer, New York.
34. ROBERT, C. P. (1996). Mixtures of distributions: Inference and estimation. In Markov Chain Monte Carlo in Practice (W. R. Gilks, S. Richardson and D. J. Spiegelhalter, eds.) Chapman & Hall, London.
35. ROEDER, K. (1990). Density estimation with confidence sets exemplified by superclusters and voids in the galaxies. J. Amer. Statist. Assoc. 85 617-624.
36. SHEATHER, S. J. and JONES, M. C. (1991). A reliable data-based bandwidth selection method for kernel density estimation. J. Roy. Statist. Soc. Ser. B 53 683-690.
37. STEPHENS, D. A. and FISCH, R. D. (1998). Bayesian analysis of quantitative trait locus data using reversible jump Markov chain Monte Carlo. Biometrics 54 1334-1367.
38. STEPHENS, M. (1997). Bayesian Methods for Mixtures of Normal Distributions. Ph.D. thesis, Univ. Oxford. Available from www.stats.ox.ac.uk/~stephens.
39. STOYAN, D., KENDALL, W. S. and MECKE, J. (1987). Stochastic Geometry and Its Applications, 1st ed. Wiley, New York.
40. TIERNEY, L. (1996). Introduction to general state-space Markov chain theory. In Markov Chain Monte Carlo in Practice (W. R. Gilks, S. Richardson and D. J. Spiegelhalter, eds.) 59-74. Chapman & Hall, London.
41. TITTERINGTON, D. M., SMITH, A. F. M. and MAKOV, U. E. (1985). Statistical Analysis of Finite Mixture Distributions. Wiley, New York.
42. VENABLES, W. N. and RIPLEY, B. D. (1994). Modern Applied Statistics with S-Plus. Springer, New York.
43. VENABLES, W. N. and RIPLEY, B. D. (1997). Modern Applied Statistics with S-Plus, 2nd ed. Springer, New York.
44. WEST, M. (1993). Approximating posterior distributions by mixtures. J. Roy. Statist. Soc. Ser. B 55 409-422.
45. WILSON, S. R. (1982). Sound and exploratory data analysis. In COMPSTAT 1982. Proceedings in Computational Statistics (H. Caussinus, P. Ettinger and R. Tamassone, eds.) 447-450. Physica, Vienna.