A predictive view of Bayesian clustering

Journal of Statistical Planning and Inference

Volumn 136, Issue 8, 2006, Pages 2407-2429

  Quintana, Fernando A ^a  

^a PONTIFICIA UNIVERSIDAD CATÓLICA DE CHILE   (Chile)

Author keywords

Density estimation; Dirichlet process; EM algorithm; Model based clustering; Outlier detection; Product partition models; Species sampling models

Indexed keywords

EID: 33645899959     PISSN: 03783758     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jspi.2004.09.015     Document Type: Article

References (65)

1. Aitkin M., and Tunnicliffe Wilson G. Mixture models, outliers, and the EM algorithm. Technometrics 22 (1980) 325-331
2. Antoniak C.E. Mixtures of Dirichlet processes with applications to Bayesian nonparametric problems. Ann. Statist. 2 (1974) 1152-1174
3. Arratia R., Barbour A.D., and Tavaré S. Poisson process approximations for the Ewens sampling formula. Ann. Appl. Probab. 2 (1992) 519-535
4. Banfield J.D., and Raftery A.E. Model-based Gaussian and non-Gaussian clustering. Biometrics 49 (1993) 803-821
5. Barry D., and Hartigan J.A. Product partition models for change point problems. Ann. Statist. 20 (1992) 260-279
6. Barry D., and Hartigan J.A. A Bayesian analysis for change point problems. J. Amer. Statist. Assoc. 88 (1993) 309-319
7. Belsley D.A., Kuh E., and Welsch R.E. Regression Diagnostics. Identifying Influential Data and Sources of Collinearity (1980), Wiley, New York
8. Blackwell D., and MacQueen J.B. Ferguson distributions via Pólya urn schemes. Ann. Statist. 1 (1973) 353-355
9. Brunner, L., Chan, A., James, L., Lo, A.Y., 2001. Weighted Chinese restaurant processes and Bayesian mixture models. Unpublished manuscript.
10. Bush C.A., and MacEachern S.N. A semiparametric Bayesian model for randomised block designs. Biometrika 83 (1996) 275-285
11. Cifarelli D.M., and Melilli E. Some new results for Dirichlet priors. Ann. Statist. 28 (2000) 1390-1413
12. Crowley E.M. Product partition models for normal means. J. Amer. Statist. Assoc. 92 (1997) 192-198
13. Cruz F., Loschi R., Iglesias P., and Arellano-Valle R. A Gibbs sampling scheme to product partition model. an application to change-point problems. Comput. Oper. Res. 30 (2003) 463-482
14. Damien P., Wakefield J.C., and Walker S.G. Gibbs sampling for Bayesian non-conjugate and hierarchical models using auxiliary variables. J. Roy. Statist. Soc. Ser. B 61 (1997) 331-344
15. Dasgupta A., and Raftery A.E. Detecting features in spatial point processes with cluster via model-based clustering. J. Amer. Statist. Assoc. 93 (1998) 294-302
16. Dempster A.P., Laird N.M., and Rubin D.B. Maximum likelihood from incomplete data via the EM algorithm (with discussion). J. Roy. Statist. Soc. Ser. B 39 (1977) 1-37
17. Devroye L., and Lugos G. Combinatorial Methods in Density Estimation (2001), Springer, New York
18. Diaconis P., and Freedman D. On the consistency of Bayes estimates (with discussion). Ann. Statist. 14 (1986) 1-67
19. Diaconis P., and Kemperman J. Some new tools for Dirichlet priors. In: Bernardo J.M., Berger J.O., Dawid A.P., and Smith A.F.M. (Eds). Bayesian Statistics 5. Proceedings of the Fourth Valencia International Meeting (1996), Oxford University Press, Oxford 97-106
20. Escobar M.D., and West M. Bayesian density estimation and inference using mixtures. J. Amer. Statist. Assoc. 90 (1995) 577-588
21. Ewens W. The sampling theory of selectively neutral alleles. Theoret. Population Biol. 3 (1972) 87-112
22. Ferguson T.S. A Bayesian analysis of some nonparametric problems. Ann. Statist. 1 (1973) 209-230
23. Fraley C., and Raftery A.E. How many clusters? Which clustering methods? Answers via model-based cluster analysis. Comput. J. 41 (1998) 578-588
24. Fraley C., and Raftery A.E. Model-based clustering discriminant analysis and density estimation. J. Amer. Statist. Assoc. 97 (2002) 611-631
25. Fraley, C., Raftery, A.E., 2002b. MCLUST: software for model-based clustering, density estimation and discriminant analysis. Technical Report, Department of Statistics, University of Washington.
26. Hartigan J.A. Partition models. Comm. Statist. Part A-Theory Methods 19 (1990) 2745-2756
27. Hartigan J.A., and Wong M.A. A k-means clustering algorithm. Appl. Statist. 28 (1979) 100-108
28. Hennig C. Fixed point clusters for linear regression. computation and comparison. J. Classification 19 (2002) 249-276
29. Hennig C. Clusters, outliers, and regression. fixed point clusters. J. Multivariate Anal. 86 (2003) 183-212
30. Hocking R.R. Methods and Applications of Linear Models. Regression and the Analysis of Variance (1996), Wiley, New York
31. Hocking R.R., and Pendleton O.J. The regression dilemma. Comm. Statist. Ser. A 12 (1983) 497-527
32. Ishwaran H., and James L.F. Gibbs sampling methods for stick-breaking priors. J. Amer. Statist. Assoc. 96 (2001) 161-173
33. Ishwaran, H., James, L.F., 2003a. Generalized weighted Chinese restaurant processes for species sampling mixture models. Statist. Sinica 13, 1211-1235.
34. Ishwaran, H., James, L.F., 2003b. Some further developments for stick-breaking priors: finite and infinite clustering and classification. Sankhya, Ser. A 65, 577-592.
35. Jain S., and Neal R.M. A split-merge Markov chain Monte Carlo procedure for the Dirichlet process mixture model. J. Comput. Graphic. Statist. 13 (2004) 158-182
36. Jorgensen M. Influence-based diagnostics for finite mixture models. Biometrics 46 (1990) 1047-1058
37. Kong A., Liu J.S., and Wong W.H. Sequential imputations and Bayesian missing data problems. J. Amer. Statist. Assoc. 89 (1994) 278-288
38. Korwar R.M., and Hollander M. Contributions to the theory of Dirichlet processes. Ann. Probab. 1 (1973) 705-711
39. Liu J.S. Nonparametric hierarchical Bayes via sequential imputations. Ann. Statist. 24 (1996) 911-930
40. Lo A.Y. On a class of Bayesian nonparametric estimates. I. Density estimates. Ann. Statist. 12 (1984) 351-357
41. Lo, A.Y., Brunner, L.J., Chan, A.T., 1998. Weighted Chinese restaurant processes and Bayesian mixture models. Technical Report, Department of Information and Systems Management, Hong Kong University of Science and Technology.
42. Loschi R., and Cruz F. An analysis of the influence of some prior specifications in the identification of change points via product partition model. Comput. Statist. Data Anal. 39 (2002) 477-501
43. MacEachern S.N., and Müller P. Estimating mixture of Dirichlet process models. J. Comput. Graphic. Statist. 7 2 (1998) 223-338
44. MacEachern S.N., Clyde M., and Liu J.S. Sequential importance sampling for nonparametric Bayes models. the next generation. Canad. J. Statist. 27 (1999) 251-267
45. McLachlan G.J., and Basford K.E. Mixture Models. Inference and Applications to Clustering (1988), Marcel Dekker, New York
46. McLachlan G.J., and Peel D. Finite Mixture Models (2000), Wiley, New York
47. Muliere, P., Secchi, P., 1995. A note on a proper Bayesian Bootstrap. Technical Report 18, Dipartamento di Economia Politica e Metodi Quantitativi, Università degli Sudi di Pavia.
48. Müller, P., Quintana, F.A., 2004. Nonparametric Bayesian data analysis. Statist. Sci. 19 (1), 95-110.
49. Murtagh F., and Raftery A.E. Fitting straight lines to point patterns. Pattern Recognition 17 (1984) 479-483
50. Neal R.M. Markov chain sampling methods for Dirichlet process mixture models. J. Comput. Graphic. Statist. 9 (2000) 249-265
51. Pitman, J., 1996. Some developments of the Blackwell-MacQueen Urn scheme. In: Ferguson, T.S., Shapeley, L.S., MacQueen, J.B. (Eds.), Statistics, Probability and Game Theory. Papers in Honor of David Blackwell, Haywar, California: IMS Lecture Notes-Monograph Series, pp. 245-268.
52. Quintana F.A., and Iglesias P.L. Bayesian clustering and product partition models. J. Roy. Statist. Soc. Ser. B 65 (2003) 557-574
53. Quintana F.A., and Newton M.A. Computational aspects of nonparametric Bayesian analysis with applications to the modeling of multiple binary sequences. J. Comput. Graphic. Statist. 9 4 (2000) 711-737
54. Redner R.A., and Walker H.F. Mixture densities maximum likelihood and the EM algorithm. SIAM Rev. 26 (1984) 195-202
55. Richardson S., and Green P.J. On Bayesian analysis of mixtures with an unknown number of components (with discussion). J. Roy. Statist. Soc. Ser. B 59 (1997) 731-792
56. Roeder K. Density estimation with confidence sets exemplified by superclusters and voids in the galaxies. J. Amer. Statist. Assoc. 85 (1990) 617-624
57. Rolin, J.-M., 1992. Some useful properties of the Dirichlet process. Technical Report 9207, Center for Operations Research and Econometrics, Université Catholique de Louvain.
58. Schwarz G. Estimating the dimension of a model. Ann. Statist. 6 (1978) 461-464
59. Scott D. Parametric statistical modeling by minimum integrated square error. Technometrics 43 (2001) 274-285
60. Scott D.W. Multivariate Density Estimation. Theory Practice and Visualization (1992), Wiley, New York
61. Sethuraman J. A constructive definition of Dirichlet priors. Statist. Sinica 4 (1994) 639-650
62. Silverman B.W. Density Estimation for Statistics and Data Analysis (1986), Chapman & Hall/CRC, London
63. Stephens M. Bayesian analysis of mixture models with an unknown number of components-alternative to reversible jump methods. Ann. Statist. 28 (2000) 40-74
64. Walker, S.G., Damien, P., 1996. Sampling a Dirichlet process mixture model. Technical Report, Business School, University of Michigan.
65. Yeung K.Y., Fraley C., Murua A., Raftery A., and Ruzzo L. Model-based clustering and data transformations for gene expression data. Bioinformatics 17 10 (2001) 977-987