Choosing models in model-based clustering and discriminant analysis

Journal of Statistical Computation and Simulation

Volumn 64, Issue 1, 1999, Pages 49-71

  Biernacki, Christophe ^a   Govaert, Gérard ^b  

^a INRIA RHÔNE ALPES   (France)

^b UNIVERSITÉ DE TECHNOLOGIE DE COMPIÈGNE   (France)

Author keywords

Bayesian and classification criteria; Cross validation; Eigenvalue decomposition; Gaussian mixture models; Information

Indexed keywords

EID: 0033236321     PISSN: 00949655     EISSN: None     Source Type: Journal    
DOI: 10.1080/00949659908811966     Document Type: Article

References (24)

1. Aitkin, M. and Rubin, D. B. (1985) Estimation and Hypothesis Testing in Finite Mixture Models. Journal of the Royal Statistical Society, Series B, 47, 67-75.
2. Akaike, H. (1974) A New Look at the Statistical Identification Model. IEEE Transactions on Automatic Control, 19, 716-723.
3. Banfield, J. D. and Raftery, A. E. (1993) Model-based Gaussian and non-Gaussian Clustering. Biometrics, 49, 803-821.
4. Bensmail, H. and Celeux, G. (1996) Regularized Gaussian Discriminant Analysis through Eigenvalue Decomposition. Journal of the American Statistical Association, 91, 1743-1748.
5. Bensmail, H., Celeux, G., Raftery, A. E. and Robert, C. P. (1997) Inference in Model-based Cluster Analysis. Statistics and Computing, 1, 1-10.
6. Biernacki, C. (1997) Choix de modèles en classification. Ph.D. Thesis, UTC Compiègne.
7. Biernacki, C. and Govaert, G. (1997) Using the Classification Likelihood to Choose the Number of Clusters. Computing Science and Statistics, 29(2), 451-457.
8. Bozdogan, H. (1987) Model Selection and Akaike Information Criterion (AIC): The General Theory and its Analytic Extensions. Psychometrika, 52, 345-370.
9. Bozdogan, H. (1990) On the Information-Based Measure of Covariance Complexity and its Application to the Evaluation of Multivariate Linear Models. Communications in Statistics, Theory and Methods, 19, 221-278.
10. Celeux, G. and Govaert, G. (1995) Gaussian Parsimonious Clustering Models. Pattern Recognition, 28, 781-793.
11. Celeux, G. and Soromenho, G. (1996) An Entropy Criterion for Assessing the Number of Clusters in a Mixture Model. Journal of Classification, 13, 195-212.
12. Cutler, A. and Windham, M. P. (1993) Information-Based Validity Functionals for Mixture Analysis, Proceedings of the first US-Japan Conference on the Frontiers of Statistical Modeling. (Bozdogan, H. Ed.), Amsterdam: Kluwer, pp. 149-170.
13. Dempster, A. P., Laird, N. M. and Rubin, D. B. (1997) Maximum Likelihood from Incomplete Data with the EM Algorithm (with discussion). Journal of the Royal Statistical Society, Series B, 39, 1-38.
14. Flury, B. W., Schmid, M. J. and Narayanan, A. (1993) Error Rates in Quadratic Discrimination with Constraints on the Covariance Matrices. Journal of Classification, 11, 101-120.
15. Hathaway, R. J. (1986) Another Interpretation of the EM Algorithm for Mixture Distributions. Statistics and Probability Letters, 4, 53-56.
16. Kass, R. E. and Raftery, A. E. (1995) Bayes Factors and Model Uncertainty. Journal of the American Statistical Association, 90, 773-795.
17. McLachlan, G. J. (1982) Classification and Mixture Maximum Likelihood Approaches to Cluster Analysis. In: Handbook of Statistics, 2, Krishnaiah, P. R. and Kanal, L. (Eds.). Amsterdam: North-Holland, 199-208.
18. McLachlan, G. J. (1992) Discriminant Analysis and Statistical Pattern Recognition. New York, Wiley.
19. McLachlan, G. J. and Peel, D. (1996) On a Resampling Approach to Choose the Number of Components in Normal Mixtures Models. Research Report #58, Centre for Statistics Research Report, The University of Queensland.
20. Raftery, A. E. (1996) Hypothesis Testing and Model Selection via Posterior Simulation. In: Practical Markov Chain Monte Carlo (Gilks, W. R., Spiegelhalter D. J. and Richardson, S. Eds.), London: Chapman and Hall, pp. 163-188.
21. Richardson, S. and Green, P. J. (1997) Fully Bayesian Analysis of Mixtures with an Unknown Number of Components (with discussion). Journal of the Royal Statistical Society, B, 59, 731-792.
22. Ripley, B. D. (1996) Neural Networks and Pattern Recognition. New York: Cambridge University Press.
23. Schwarz, G. (1978) Estimating the Dimension of a Model. Annals of Statistics, 6, 461-464.
24. Wolfe, J. H. (1971) A Monte Carlo Study of the Sampling Distribution of the Likelihood Ratio for Mixtures of Multinormal Distributions. US Naval Personnel Research Activity. Technical Bulletin STB 72-2, San Diego, California.