Normality-based validation for crisp clustering

Pattern Recognition

Volumn 43, Issue 3, 2010, Pages 782-795

  Lago Fernández, Luis F ^a   Corbacho, Fernando ^b  

^a UNIVERSIDAD AUTÓNOMA DE MADRID   (Spain)

^b Cognodata Consulting ^*  (Spain)

Author keywords

Cluster validation; Crisp clustering; Negentropy

Indexed keywords

CLUSTER VALIDATION; COVARIANCE MATRICES; DATA DISTRIBUTION; DIFFERENTIAL ENTROPY; HIGH ORDER; INTRA-CLUSTER; NEGENTROPY; NEW INDICES; NUMBER OF CLUSTERS; REAL PROBLEMS; VALIDITY INDEX;

COVARIANCE MATRIX; ENTROPY;

NORMAL DISTRIBUTION;

EID: 70449703225     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2009.09.018     Document Type: Article

References (54)

1. Everitt B., Landau S., and Leese M. Cluster Analysis (2001), Hodder Arnold, London
2. Jain A., and Dubes R. Algorithms for Clustering Data (1988), Prentice-Hall, Englewood Cliffs, NJ
3. Xu R., and Wunsch II D. Survey of clustering algorithms. IEEE Trans. Neural Networks 16 3 (2005) 645-678
4. Gordon A.D. Cluster validation. In: Hayashi C., Ohsumi N., Yajima K., Tanaka Y., Bock H.H., and Baba Y. (Eds). Data Science, Classification and Related Methods (1998), Springer, New York 22-39
5. Celeux G., and Soromenho G. An entropy criterion for assessing the number of clusters in a mixture model. J. Classification 13 2 (1993) 195-212
6. Ding Y., and Harrison R.F. Relational visual cluster validity (RVCV). Pattern Recognition Lett. 28 15 (2007) 2071-2079
7. Hathaway R.J., and Bezdek J.C. Visual cluster validity for prototype generator clustering models. Pattern Recognition Lett. 24 9-10 (2003) 1563-1569
8. Pal N.R., and Biswas J. Cluster validation using graph theoretic concepts. Pattern Recognition 30 6 (1997) 847-857
9. Rezaee M., Lelieveldt B., and Reiber J. A new cluster validity index for the fuzzy c-mean. Pattern Recognition Lett. 19 3-4 (1998) 237-246
10. H. Rhee, K. Oh, A validity measure for fuzzy clustering and its use in selecting optimal number of clusters, in: Proceedings of the 5th IEEE International Conference on Fuzzy Systems, vol. 2, 1996, pp. 1020-1025.
11. Wang W., and Zhang Y. On fuzzy cluster validity indices. Fuzzy Sets and Systems 158 19 (2007) 2095-2117
12. Xie X., and Beni G. A validity measure for fuzzy clustering. IEEE Trans. Pattern Anal. Mach. Intell. 13 8 (1991) 841-847
13. Bezdek J.C., and Pal R.N. Some new indexes of cluster validity. IEEE Trans. Syst. Man Cybernet. B 28 3 (1998) 301-315
14. Davies D.L., and Bouldin D.W. A cluster separation measure. IEEE Trans. Pattern Anal. Mach. Intell. 1 4 (1979) 224-227
15. Dunn J.C. A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters. J. Cybernet. 3 3 (1973) 32-57
16. Pakhira M.K., Bandyopadhyay S., and Maulik U. Validity index for crisp and fuzzy clusters. Pattern Recognition 37 3 (2004) 487-501
17. Bouguessa M., Wang S., and Sun H. An objective approach to cluster validation. Pattern Recognition Lett. 27 13 (2006) 1419-1430
18. Geva A.B., Steinberg Y., Bruckmair S., and Nahum G. A comparison of cluster validity criteria for a mixture of normal distributed data. Pattern Recognition Lett. 21 6-7 (2000) 511-529
19. A. Ciaramella, G. Longo, A. Staiano, R. Tagliaferri, in: NEC: A Hierarchical Agglomerative Clustering based on Fisher and Negentropy Information, Lecture Notes in Computer Science, vol. 3931, Springer, Berlin, 2006, pp. 49-56.
20. M. Song, H. Wang, Detecting low complexity clusters by skewness and kurtosis in data stream clustering, in: Proceedings of the 9th International Symposium on Artificial Intelligence and Mathematics, 2006.
21. Biernacki C., Celeux G., and Govaert G. An improvement of the NEC criterion for assessing the number of clusters in a mixture model. Pattern Recognition Lett. 20 3 (1999) 267-272
22. Bozdogan H. Choosing the number of component clusters in the mixture-model using a new information complexity criterion of the inverse-Fisher information matrix. In: Opitz O., Lausen B., and Klar R. (Eds). Data Analysis and Knowledge Organization (1993), Springer, Heidelberg 40-54
23. Figueiredo M.A.T., and Jain A.K. Unsupervised learning of finite mixture models. IEEE Trans. Pattern Anal. Mach. Intell. 24 3 (2002) 381-396
24. Rasmussen C. The infinite Gaussian mixture model. In: Solla S., Leen T., and Müller K.-R. (Eds). Advances in Neural Information Processing Systems vol. 12 (2000), MIT Press, Cambridge, MA 554-560
25. Neal R.M. Markov chain sampling methods for Dirichlet process mixture models. J. Comput. Graphical Stat. 9 2 (2000) 249-265
26. Richardson S., and Green P. On Bayesian analysis of mixtures with unknown number of components. J. R. Stat. Soc. B 59 (1997) 731-792
27. Ben-Hur A., Elisseeff A., and Guyon I. A stability based method for discovering structure in clustered data. In: Altman R., Dunker A., Hunter L., Klein T., and Lauderdale K. (Eds). Pacific Symposium on Biocomputing vol. 7 (2002), World Scientific, Singapore 6-17
28. Lange T., Roth V., Braun M.L., and Buhmann J.M. Stability-based validation of clustering solutions. Neural Comput. 16 6 (2004) 1299-1323
29. Bertoni A., and Valentini G. Model-order selection for bio-molecular data clustering. BMC Bioinformatics 8 Suppl. 2 (2007) S7
30. Friedman J.H., and Tukey J.W. A projection pursuit algorithm for exploratory data analysis. IEEE Trans. Comput. C-23 (1974) 881-890
31. Huber P.J. Projection pursuit. Ann. Stat. 13 2 (1985) 435-475
32. Jones M.C., and Sibson R. What is projection pursuit?. J. R. Stat. Soc. A 159 (1987) 1-38
33. Cover T.M., and Thomas J.A. Elements of Information Theory (1991), Wiley, New York
34. Bowman A.W., and Foster P.J. Adaptive smoothing and density based test of multivariate normality. J. Am. Stat. Assoc. 88 422 (1993) 529-537
35. Henze N., and Wagner T. A new approach to the BHEP tests for multivariate normality. J. Multivariate Anal. 62 1 (1997) 1-23
36. Romeu J.L., and Ozturk A. A comparative study of goodness-of-fit tests for multivariate normality. J. Multivariate Anal. 46 2 (1993) 309-334
37. Székely G.J., and Rizzo M.L. A new test for multivariate normality. J. Multivariate Anal. 93 1 (2005) 58-80
38. Fang K.T., Yuan K.H., and Bentler P.M. Applications of sets of points uniformly distributed on a sphere to testing multinormality and robust estimation. In: Jiang Z.P., Yan S.J., Cheng P., and Wu R. (Eds). Probability and Statistics (1992), World Scientific, Singapore 56-73
39. Mardia K.V. Measures of multivariate skewness and kurtosis with applications. Biometrika 57 3 (1970) 519-530
40. Baringhaus L., and Henze N. A consistent test for multivariate normality based on the empirical characteristic function. Metrika 35 1 (1988) 339-348
41. Csorgo S. Testing for normality in arbitrary dimension. Ann. Stat. 14 2 (1986) 708-723
42. Vasiceck O. A test for normality based on sample entropy. J. R. Stat. Soc. B 38 1 (1976) 54-59
43. Zhu L.X., Wong H.L., and Fang K.T. A test for multivariate normality based on sample entropy and projection pursuit. J. Stat. Plann. Inference 45 3 (1995) 373-385
44. A. Hyvärinen, New approximations of differential entropy for independent component analysis and projection pursuit, Technical Report A47, Department of Computer Science and Engineering and Laboratory of Computer and Information Science, Helsinki University of Technology, 1997.
45. Comon P. Independent component analysis, a new concept?. Signal Process. 36 3 (1994) 287-314
46. Van Hulle M.M. Edgeworth approximation of multivariate differential entropy. Neural Comput. 17 9 (2005) 1903-1910
47. Rousseeuw P.J. Silhouettes: a graphical aid to the interpretation and validation of cluster analysis. J. Comput. Appl. Math. 20 (1987) 53-65
48. Bezdek J.C., Li W.Q., Attikiouzel Y., and Windham M. A geometric approach to cluster validity for normal mixtures. Soft Comput. 1 (1997) 166-179
49. D. Levine, PGAPack Parallel Genetic Algorithm Library 〈http://www-fp.mcs.anl.gov/CCST/research/reports_pre1998/comp_bio/stalk/pgapack.html〉.
50. A. Asuncion, D.J. Newman, UCI Machine Learning Repository 〈http://www.ics.uci.edu/∼ mlearn/MLRepository.html〉.
51. Fisher R.A. The use of multiple measurements in taxonomic problems. Ann. Eugenics 7 (1936) 179-188
52. Mangasarian W.H., and Wolberg O.L. Cancer diagnosis via linear programming. SIAM News 23 5 (1990) 1-18
53. S. Aeberhard, D. Coomans, O. de Vel, Comparison of classifiers in high dimensional settings, Technical Report 92-02, Department of Computer Science and Department of Mathematics and Statistics, James Cook University of North Queensland, 1992.
54. MacKay D. Information Theory, Inference and Learning Algorithms (2003), Cambridge University Press, Cambridge