Model-based clustering with noise: Bayesian inference and estimation

Journal of Classification

Volumn 20, Issue 1, 2003, Pages 49-76

  Bensmail, H ^b   Meulman, J J ^a  

^a LEIDEN UNIVERSITY   (Netherlands)

^b UNIVERSITY OF TENNESSEE   (United States)

Author keywords

Bayes factor; Canonical discriminant analysis; Eigenvalue decomposition; Gaussian mixture; Gibbs sampler; Markov chain Monte Carlo

Indexed keywords

EID: 0037899007     PISSN: 01764268     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00357-003-0005-5     Document Type: Article

References (47)

1. ANDERSON, T. W. (1984), An Introduction to Multivariate Statistical Analysis, New York: Wiley.
2. BANFIELD, J. D. and RAFTERY, A. E., (1993), "Model-Based Gaussian and Non Gaussian Clustering", Biometrics, 49, 803-821.
3. BENSMAIL, H., CELEUX, G., RAFTERY, A. E. and ROBERT, C. (1997), "Inference in Model-Based Cluster Analysis", Computing and Statistics, 7, 1-10.
4. BINDER, D. H. (1978), "Bayesian Cluster Analysis," Biometrika, 65 (1), 31-38.
5. BINDER, D. H. (1981), "Approximations to Bayesian Clustering Rules," Biometrika, 68 (1), 275-285.
6. BOCK, H. H. (1985), "On Some Significance Tests in Cluster Analysis," Journal of Classification, 2, 77-108.
7. BOCK, H. H. (1996), "Probability Models in Partitional Cluster Analysis," Computational Statistics and Data Analysis, 23, 5-28.
8. BOZDOGAN, H. (1993), "Choosing the Number of Component-Clusters in the Mixture Model Using a New Informational Complexity Criterion of the Inverse Fisher Information Matrix," O. Opitz, B. Lausen, and R. Klar, Eds., Information and Classification, Springer-Verlag, 40-54.
9. CELEUX, G., and ROBERT, C. (1993), "Une Histoire de Discretisation (avec Commentaires)," La Revue de Modulad, 11, 7-44.
10. CELEUX, G., and SOROMENHO, G. (1996), "An entropy Criterion for Assessing the Number of Clusters in a Mixture Model", Journal of Classification, 13(1), 1996.
11. DASGUPTA, A., and RAFTERY, A. E. (1998), "Detecting Features in Spatial Point Processes with Clutter via Model-Based Clustering," Journal of the American Statistical Association, 93, 294-302.
12. DIEBOLT, J., and ROBERT, C. P.(1994), "Bayesian Estimation of Finite Mixture Distributions," Journal of of the Royal Statistical Society, Series B, 56, 363-375.
13. EDWARDS, W., LINDMAN, H., and SAVAGE, L. J. (1963), "Bayesian Statistical Inference for Psychological Research," Psychological Review, 70, 193-242.
14. ENGELMAN, L., and HARTIGAN, J. A. (1969), "Percentage Points of a Test for Clusters," Journal of the American Statistical Association, 64, 1647-1648.
15. FRALEY, C. (1999), "Algorithms for Model-Based Gaussian Hierarchical Clustering," SIAM Journal on Scientific Computing, 20, 270-281.
16. FRALEY, C., and RAFTERY, A. (1998), "How Many Clusters? Which Clustering Method? Answers via Model-Based Cluster Analysis", Computer Journal, 41, 578-588.
17. GELMAN, A., CARLIN, J. B., STERN, H. S., and RUBIN, D. B. (1995), Bayesian data analysis. Chapman and Hall.
18. GILKS, W. R., RICHARDSON, S., SPIEGELHALTER, D., J. (1996), "Markov Chain Monte Carlo Methods in Practice". New York: Chapman and Hall.
19. GREEN, P. G., (1995), "Reversible Jump Markov Chain Monte Carlo Computation and Bayesian Model Determination", Biometrika, 82, 711-732 (1995).
20. GORDON, A. D. (1999), Classification: Methods for the Exploratory Analysis of Multivariate Data. Chapman and Hall, 2nd Eds. New York.
21. HARTIGAN, J. A. (1975), Clustering Algorithms, Wiley, New York.
22. JEFFREYS, H. (1961), Theory of Probability, Clarendon.
23. KASS, R. E., and RAFTERY, A. E. (1995), "Bayes Factors," Journal of the American Statistical Association, 90, 773-795.
24. KAUFMAN, L., and ROUSSEEUW, P. J. (1990), Finding Groups in Data, Wiley, New York.
25. LAVINE, M., and WEST, M. (1992), "A Bayesian Method for Classification and Discrimination," Canadian Journal of Statistics, 20, 451-461.
26. LEROUX, B. G., (1992), "Consistent Estimation of a Mixing Distribution", The Annals of Statistics, 20, 1350-1360.
27. LEWIS, S. M., and RAFTERY, A. E. (1997), "Estimating Bayes Factors via Posterior Simulation with the Laplace-Metropolis Estimator," Journal of the American Statistical Association, 92, 438, 648-655.
28. MACQUEEN, J. B. (1967), "Some Methods for Classification and Analysis of Multivariate Observations," in Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, Vol. 1, 281-297.
29. MCLACHLAN, G. (1982), The Classification and Mixture Maximum Likelihood Approaches to Cluster Analysis, (Vol. 2), Amsterdam: Handbook of Statistics, in P. R. Krishnaiah and L. N. Kanal, 199-208.
30. MCLACHLAN, G., and Basford, K. (1988), Mixture Models: Inference and Applications to Clustering, Marcel Dekker, New York.
31. MCLACHLAN, G., and Peel, D. (2000). Finite Mixture Models. New York; Wiley.
32. MENZEFRICKE, U. (1981), "Bayesian Clustering of Data Sets," Communication in Statistics-Theory and Methods A., 10, 65-77.
33. MEULMAN, J. J. (1986), A Distance Approach to Nonlinear Multivariate Analysis, DSWO Press, Leiden.
34. MEULMAN, J. J., ZEPPA, P., BOON, M. E., and RIETVELD, W. J. (1992), "Prediction of Various Grades of Cervical Preneoplasia and Neoplasia on Plastic Embedded Cytobrush Samples: Discriminant Analysis with Qualitative and Quantitative Predictors," Analytical and Quantitative Cytology and Histology, 14, 60-72.
35. MUKHERJEE, M., and FEIGELSON, E. D., BABU, G. J., MURTAGH, F., FRALEY, C., and RAFTERY, A. (1998), "Three Types of Gamma Ray Bursts," Astrophysical Journal, 508, 314-327.
36. MURTAGH, F., and RAFTERY, A. (1984), "Fitting Straight Lines to Point Patterns", Pattern Recognition, 17, 479-483.
37. RAFTERY, A. E. (1996), "Approximate Bayes Factors and Accounting for Model Uncertainty in Generalized Linear Models," Biometrika, 83, 251-266.
38. REAVEN, G. M., and MILLER, R. G. (1979), "An Attempt to Define the Nature of Chemical Diabetes Using a Multidimensional Analysis," Diabetologia, 16, 17-24.
39. RICHARDSON, S., and GREEN, P. J. (1997), "On Bayesian Analysis of Mixtures with an Unknown Number of Components," Journal of the Royal Statistical Society, Series B, 59", 731-792.
40. ROEDER, K., and WASSERMAN, L. (1997), "Practical Bayesian Density Estimation Using Mixture of Normals," Journal of the American Statistical Association, 92, 439, 894-902.
41. SCHWARZ, G. (1978), "Estimating the Dimension of a Model," The Annals of Statsitics, 6, 461-464.
42. SCOTT, A. J., and SYMONS, M. J.(1971), "Clustering Methods Based on Likelihood Ratio Criteria," Biometrics, 27, 387-397.
43. SYMONS, M (1981), "Clustering Criteria and Multivariate Normal Mixtures," Biometrics, 37, 35-43.
44. TANNER, M., and WONG, W. (1987), "The Calculation of Posterior Distributions by Data Augmentation (with Discussion)," Journal of the American Statistical Association, 82, 528-550.
45. TIERNEY, L. (1994), "Markov Chains for Exploring Posterior Distributions," Annals of Statistics, 22, 1701-1762.
46. WEI, G. C. G, and TANNER M. A. (1990), "A Monte Carlo Implementation of the EM Algorithm and the Poor Man's Data Augmentation Algorithms", Journal of the American Statistical Association, 85, 699-704.
47. WOLFE, J. H. (1978), "Comparative Cluster Analysis of Patterns of Vocational Interest," Multivariate Behavioral Research, 13, 33-44.