Fuzzy unsupervised classification of multivariate time trajectories with the Shannon entropy regularization

Computational Statistics and Data Analysis

Volumn 50, Issue 6, 2006, Pages 1452-1477

  Coppi, Renato ^a   D'Urso, Pierpaolo ^b  

^a SAPIENZA UNIVERSITY OF ROME   (Italy)

^b UNIVERSITY OF MOLISE   (Italy)

Author keywords

Dynamic fuzzy clustering; Entropy regularization; Maximum entropy; Multivariate time varying data; Shannon entropy; Uncertainty

Indexed keywords

CLASSIFICATION (OF INFORMATION); FUNCTIONS; MATHEMATICAL MODELS; TRAJECTORIES;

DATASETS; INTRA-CLUSTER; METEOROLOGICAL DATASETS; OBJECTIVE FUNCTIONS;

FUZZY SETS;

EID: 27744501380     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2005.01.008     Document Type: Article

References (40)

1. Alanzado, A.C., Miyamoto, S., 2002. Fuzzy c-means and a mixture distribution for clustering of noisy data. Proceedings of SCIS & ISIS 2002 Conference, October 21-25, Tsukuba, Japan.
2. Barbarà, D., Couto, J., Li, Y., 2002. COOLCAT: an entropy-based algorithm for categorical clustering. Proceedings of the 11th International Conference on Information and Knowledge Management, pp. 582-589.
3. J.C. Bezdek Numerical taxonomy with fuzzy sets J. Math. Biol. 1 1974 57 71
4. J.C. Bezdek Pattern Recognition with Fuzzy Objective Function Algorithms 1981 Plenum Press New York
5. Cheng, C.-H., Fu, A.W., Zhang, Y., 1999. Entropy-based subspace clustering for mining numerical data. Proceedings of the Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Diego, USA, pp. 84-93.
6. R. Coppi, and P. D'Urso The geometric approach to the comparison of multivariate time trajectories S. Borra R. Rocci M. Vichi M. Schader Advances in Data Science and Classification 2001 Springer Heidelberg 93 100
7. R. Coppi, and P. D'Urso Fuzzy K-means clustering models for triangular fuzzy time trajectories Statist. Methods Appl. 11 1 2002 21 40
8. R. Coppi, and P. D'Urso Three-way fuzzy clustering models for LR fuzzy time trajectories Comput. Statist. Data Anal. 43 2003 149 177
9. P. D'Urso Dissimilarity measures for time trajectories J. Italian Statist. Soc. 1-3 2000 1 31
10. P. D'Urso Fuzzy C-means clustering models for multivariate time varying data: different approaches Int. J. Uncertainty, Fuzziness Knowledge-Based Systems 12 3 2004 287 326
11. D'Urso, P., 2005. Fuzzy clustering for data time array with inlier and outlier time trajectories. IEEE Trans. Fuzzy Systems, in press.
12. J.C. Dunn A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters J. Cybern. 3 1974 32 57
13. B. Frieden Physics from Fisher Information. A Unification 1999 Cambridge University Press Cambridge
14. Gini, C., 1912. Variabilità e mutabilità, Studi Economico-Giuridici della Facoltà di Giurisprudenza dell'Università di Cagliari, III, parte II.
15. Gokcay, E., Principe, J.C., 2000. A new clustering evaluation function using Rényi's information potential. IEEE International Conference on Acoustics, Speech, and Signal Processing.
16. E. Gokcay, and J.C. Principe Information theoretic clustering IEEE Trans. Pattern Anal. Mach. Intell. 24 2 2002 158 171
17. Honda, K., Ichihashi, H., 2004. Linear fuzzy clustering technique with missing values and their application to Local Principal Component Analysis. IEEE Transactions on Fuzzy Systems, 12 (2), 183-193.
18. Ichihashi, H., Honda, K., Tani, N., 2000. Gaussian mixture PDF approximation and fuzzy c-means clustering with entropy regularization. Proceedings of the Fourth Asian Fuzzy System Symposium, Tsukuba, Japan, 31 May-3 June 2000, pp. 217-221.
19. M. Jardino Unsupervised non-hierarchical entropy-based clustering H.A.L. Kiers J.P. Rasson P.J.F. Groenen M. Schader Data Analysis Classification and Related Methods 2000 Springer Berlin
20. Jenssen, R., Hild II, K.E., Erdogmus, D., Principe, J.C., Eltoft, T., 2003. Clustering using Rényi's entropy. Proceedings of IJCNN'03, Portland, Oregon.
21. H.A.L. Kiers Towards a standardized notation and terminology in multiway analysis J. Chemometr. 14 2000 105 122
22. K. Košmelj, and V. Batagelj Cross-sectional approach for clustering time varying data J. Classification 7 1990 99 109
23. C. Lepǎdatu, and E. Nitulescu Information energy and information temperature for molecular systems Acta Chim. Slov. 50 2003 539 546
24. Li, R., Mukaidono, M., 1995. A maximum entropy approach to fuzzy clustering. Proceedings of the Fourth IEEE Conference on Fuzzy Systems (FUZZ-IEEE/IFES '95), Yokohama, 20-24 March 1995, pp. 2227-2232.
25. R. Li, and M. Mukaidono Gaussian clustering method based on maximum-fuzzy-entropy interpretation Fuzzy sets and Systems 102 1999 253 258
26. M. Ménard, and M. Eboueya Extreme physical information and objective function in fuzzy clustering Fuzzy Sets and Systems 128 2002 285 303
27. M. Ménard, V. Courboulay, and P.A. Dardignac Possibilistic and probabilistic fuzzy clustering: unification within the framework of the non-extensive thermostatistics Pattern Recognition 36 2003 1325 1342
28. M. Ménard, P.A. Dardignac, and C.C. Chibelushi Non-extensive thermostatistics and extreme physical information for fuzzy clustering Internat. J. Comput. Cognition 2 4 2004 1 63
29. Miyagishi, K., Yasutomi, Y., Ichihashi, H., Honda, K., 2000. Fuzzy clustering with regularization by K-L information. 16th Fuzzy System Symposium, Akita, pp. 549-550 (in Japanese).
30. Miyamoto, S., Umayahara, K., 2000. Fuzzy c-means with variables for cluster sizes, 16th Fuzzy System Symposium, Akita, Sept. 6-8 2000, 537-538 (in Japanese).
31. S. Miyamoto, and A.C. Alanzado Fuzzy c-means and mixture distribution models in the presence of noise clusters Internat. J. Image Graphics 2 4 2002 573 586
32. Miyamoto, S., Mukaidono, M., 1997. Fuzzy c-means as a regularization and maximum entropy approach. Proceedings of the Seventh International Fuzzy Systems Association World Congress (IFSA'97), II, pp. 86-92.
33. Onicescu, O., 1966. Théorie de l'Information. Energie Informationnelle, Paris, C.R. Acad. Sci., Tome 263.
34. S.J. Roberts, R.M. Everson, and I. Rezek Minimum entropy data partitioning Proc. Internat. Conf. Artif. Neural Networks 2 1999 844 848
35. S.J. Roberts, R.M. Everson, and I. Rezek Maximum certainty data partitioning Pattern Recognition 33 5 2000 833 839
36. K. Rose, E. Gurewitz, and G. Fox A deterministic annealing approach to clustering Pattern Recognition Lett. 11 1990 589 594
37. M. Sato, and Y. Sato On a multicriteria fuzzy clustering method for 3-way data Internat. J. Uncertainty, Fuzziness Knowledge-Based Systems 2 1994 127 142
38. E. Simpson Measurement of diversity Nature 163 1949 688
39. J. Yao, M. Dash, S.T. Tan, and H. Liu Entropy-based fuzzy clustering and fuzzy modeling Fuzzy Sets and Systems 113 2000 381 388
40. L.A. Zadeh Outline of a new approach to the analysis of complex systems and decision processes IEEE Trans. Systems Man Cybern. 3 1973 28 44