A novel hierarchical-clustering-combination scheme based on fuzzy-similarity relations

IEEE Transactions on Fuzzy Systems

Volumn 18, Issue 1, 2010, Pages 27-39

  Mirzaei, Abdolreza ^a   Rahmati, Mohammad ^b  

^a ISFAHAN UNIVERSITY OF TECHNOLOGY   (Iran)

^b AMIRKABIR UNIVERSITY OF TECHNOLOGY   (Iran)

Author keywords

Clustering combination; Dendrogram descriptor; Fuzzy equivalence relation; Hierarchical clustering; Min transitive closure; Ultrametric property

Indexed keywords

CLUSTERING COMBINATION; DENDROGRAMS; DESCRIPTORS; EQUIVALENCE RELATIONS; HIER-ARCHICAL CLUSTERING; TRANSITIVE CLOSURE;

SET THEORY;

COMBINATORIAL MATHEMATICS;

EID: 76849100191     PISSN: 10636706     EISSN: None     Source Type: Journal    
DOI: 10.1109/TFUZZ.2009.2034531     Document Type: Article

References (65)

1. H. Ayad and M. Kamel, "Finding Natural clusters using multi-clusterer combiner based on shared nearest neighbors," in Proc. 4th Int. Workshop Multiple Classifier Syst. (Lecture Notes in Computer Science 2709), T. Windeatt and F. Roli, Eds. Guildford, U.K.: Springer-Verlag, 2003, pp. 166-175.
2. H. G. Ayad and M. S. Kamel, "Cumulative voting consensus method for partitions with variable number of clusters," IEEE Trans. Pattern Anal. Mach., vol.30, no.1, pp. 160-173, Jan. 2008.
3. P. Berman, B. D. Gupta, M. Y. Kao, and J. Wang, "On constructing an optimal consensus clustering from multiple clusterings," Inf. Process. Lett., vol.104, no.4, pp. 137-145, 2007.
4. L. Breiman, "Bagging predictors," Mach. Learn., vol.24, no.2, pp. 123- 140, 1996.
5. R. J. G. B. Campello, "A fuzzy extension of the Rand index and other related indexes for clustering and classification assessment," Pattern Recognit. Lett., vol.28, no.7, pp. 833-841, 2007.
6. P. Dawyndt, H. D.Meyer, and B. D. Baets, "On the min-transitive approximation of symmetric fuzzy relations," in Proc. IEEE Int. Conf. Fuzzy Syst., vol.1, Budapest, Hungary, 2004, vol.1, pp. 167-171.
7. I. S. Dhillon, S. Mallela, and R. Kumar, "A divisive information-theoretic feature clustering algorithm for text classification, " J. Mach. Learn. Res., vol.3, pp. 1265-1287, 2003.
8. S.Dudoit and J. Fridlyand, "Bagging to improve the accuracy of clustering procedure," Bioinform., vol.19, no.9, pp. 1090-1099, 2003.
9. J. C. Dunn, "Some recent investigations of a new fuzzy partitioning algorithm and its application to pattern classification problems," J. Cybern., vol.4, pp. 1-15, 1974.
10. X. Z. Fern and C. E. Brodley, "Solving cluster ensemble problems by bipartite graph partitioning," in Proc. 21st Int. Conf. Mach. Learn., 2004, vol.69, p. 36.
11. B. Fischer and J. M. Buhmann, "Bagging for path-based clustering," IEEE Trans. Pattern Anal. Mach. Intell., vol.25, no.11, pp. 1411-1415, Nov. 2003.
12. A. Fred, "Finding consistent clusters in data partitions," in Proc. 2nd Int. Workshop Multiple Classifier Syst. (Lecture Notes in Computer Science 2096), F. Roli and J. Kittler, Eds. Cambridge, U.K.: Springer-Verlag, 2001, pp. 309-318.
13. A. Fred and A. K. Jain, "Data clustering using evidence accumulation," in Proc. 16th Int. Conf. Pattern Recognit., 2002, pp. 276-280.
14. A. Fred and A. K. Jain, "Robust data clustering," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2003, pp. 128-133.
15. A. Fred and A. K. Jain, "Combining multiple clusterings using evidence accumulation," IEEE Trans. Pattern Anal.Mach. Intell., vol.27, no.6, pp. 835-850, Jun. 2005.
16. D. Frossyniotis, A. Likas, and A. Stafylopatis, "A clusteringmethod based on boosting," Pattern Recognit. Lett., vol.25, no.6, pp. 641-654, 2004.
17. G. Fu, "An algorithm for computing the transitive closure of a fuzzy similarity matrix," Fuzzy Sets Syst., vol.51, pp. 189-194, 1992.
18. A. Gionis, H. Mannila, and P. Tsaparas, "Clustering aggregation," presented at the Int. Conf. Data Eng., Tokyo, Japan, 2005.
19. D. Gondek and T. Hofmann, "Non-redundant clustering with conditional ensembles," in Proc. ACM SIGKDD Conf. Knowl. Discov. Data Mining, 2005, pp. 70-77.
20. L. A. Goodman and W. H. Kruskal, "Measure of association for crossclassification," J. Amer. Stat. Assoc., vol.49, pp. 732-764, 1954.
21. A. D. Gordon and M. Vichi, "Partitions of partitions," J. Classification, vol.15, no.2, pp. 265-285, 1998.
22. A. D. Gordon and M. Vichi, "Fuzzy partition models for fitting a set of partitions," Psychometrika, vol.66, no.2, pp. 229-247, 2001. (Pubitemid 33570331)
23. D. Gusfield, "Partition-distance: A problem and class of perfect graphs arising in clustering," Inf. Process. Lett., vol.82, pp. 159-164, 2002.
24. S.T.Hadjitodorov, L. I.Kuncheva, and L. P. Todorova, "Moderate diversity for better cluster ensembles," Inf. Fusion, vol.7, no.3, pp. 264-275, 2006.
25. A. K. Jain, M. N. Murty, and P. J. Flynn, "Data clustering: A review," ACM Comput. Surveys, vol.31, pp. 264-323, 1999.
26. G. J. Klir, U. S. Clair, and B. Yuan, Fuzzy Set Theory: Foundations and Applications. Englewood Cliffs, NJ: Prentice-Hall, 1997.
27. A. M. Krieger and P. E. Green, "A generalized Rand-index method for consensus clustering of separate partitions of the same data base," J. Classification, vol.16, no.1, pp. 63-89, 1999.
28. L. I. Kuncheva, Combining Pattern Classifiers: Methods and Algorithms. New York: Wiley, 2004.
29. L. I. Kuncheva, S. T. Hadjitodorov, and L. P. Todorova, "Experimental comparison of cluster ensemble methods," in Proc. 19th Int. Conf. Inf. Fusion, pp. 1-7, 2006.
30. S. Kundu, "An optimal O(N2) algorithm for computing the min-transitive closure of a weighted graph," Inf. Process. Lett., vol.74, pp. 215-220, 2000.
31. F. J. Lapointe and G. Cucumel, "The average consensus (Abstract)," presented at the Int. Fed. Classification Soc. (IFCS-91) Meeting, Edinburgh, U.K., 1991.
32. F. J. Lapointe and P. Legendre, "Statistical significance of the matrix correlation coefficient for comparing independent phylogenetic trees," Syst. Biol., vol.41, no.3, pp. 378-384, 1992.
33. H. K. Larsen and R. Yager, "A fast max-min similarity algorithm," in The Interface Between AI and OR in a Fuzzy Environment, J. C. Verdegay and M. Delgado, Eds. Köln, Germany: IS 95 Verlag TUV Rheinland, 1989, pp. 147-155.
34. H. S. Lee, "An optimal algorithm for computing the max-min transitive closure of a fuzzy similarity matrix," Fuzzy Sets Syst., vol.123, pp. 129- 136, 2001.
35. F. Leisch and K. Hornik, "Stabilization of k-means with bagged clustering," presented at the Joint Stat. Meeting, Baltimore, MD, 1999.
36. V. Makarenkov and P. Legendre, "Optimal variable weighting for ultrametric and additive trees and k-means partitioning: Methods and software," J. Classification, vol.18, pp. 245-271, 2001. (Pubitemid 33587487)
37. H. D. Meyer, H. Naessens, and B. D. Baets, "Algorithms for computing the min-transitive closure and associated partition tree of a symmetric fuzzy relation," Eur. J. Oper. Res., vol.155, no.1, pp. 226-238, 2004.
38. B. Minaei, A. Topchy, andW. F. Punch, "Ensembles of partitions via data resampling," presented at the Int. Conf. Inf. Technol., Las Vegas, NV, 2004.
39. A. Mirzaei, M. Rahmati, andM. Ahmadi, "A new method for hierarchical clustering combination," Intell. Data Anal., vol.12, no.6, pp. 549-571, 2008.
40. S. Monti, P. Tamayo, J. Mesirov, and T. Golub, "Consensus clustering: A resampling based method for class discovery and visualization of gene expression microarray data," Mach. Learn., vol.52, pp. 91-118, 2003.
41. H. Naessens, H. De Meyer, and B. De Baets, "Algorithms for the computation of T-transitive closures," IEEE Trans. Fuzzy Syst., vol.10, no.4, pp. 541-551, Aug. 2002.
42. W. Pedrycz, "Collaborative fuzzy clustering," Pattern Recognit. Lett., vol.23, no.14, pp. 1675-1686, 2002.
43. W. Pedrycz and K. Hirota, "A consensus-driven fuzzy clustering," Pattern Recognit. Lett., vol.29, no.9, pp. 1333-1343, 2008.
44. J. Podani, "Simulation of random dendrograms and comparison tests: Some comments," J. Classification, vol.17, pp. 123-142, 2000.
45. K. Punera and J. Ghosh, "Consensus-based ensembles of soft clusterings," Appl. Artif., vol.22, no.7, pp. 780-810, 2008.
46. R. E. Schapire, "The strength of weak learnability," Mach. Learn., vol.5, no.2, pp. 197-227, 1990.
47. A. Strehl and J. Ghosh, "Cluster ensembles-A knowledge reuse framework for combining multiple partitions," J. Mach. Learn. Res., vol.3, pp. 583-617, 2002.
48. A. Strehl and J. Ghosh, "Cluster ensembles-A knowledge reuse framework for combining partitions," in Proc. Conf. Artif. Intell. Edmonton, AB, Canada: AAAI/MIT Press, Jul. 2002, pp. 93-98.
49. S. Theodoridis and K. Koutroumbas, Pattern Recognition, 2nd ed. Amsterdam, The Netherlands/New York: Elsevier/Academic, 2003.
50. N. Tishby, F. Perira, andW. Bialek, "The information bottleneck method," in Proc. 37th Ann. Allerton Conf. Commun., Control, Comput., 1999, pp. 368-377.
51. A. Topchy, A. K. Jain, andW. Punch, "Combining multiple weak clustering," in Proc. IEEE Int. Conf. Data Mining, 2003, pp. 331-338.
52. A. Topchy, A. K. Jain, and W. Punch, "A mixture model for clustering ensembles," in Proc. SIAM Conf. Data Mining, 2004, pp. 379-390.
53. A. Topchy, A. K. Jain, and W. Punch, "Clustering ensembles: Models of consensus and weak partitions," IEEE Trans. Pattern Anal. Mach. Intell., vol.27, no.12, pp. 1866-1881, Dec. 2005.
54. A. Topchy, B. Minaei, A. K. Jain, and W. Punch, "Adaptive clustering," in Proc. ICPR, Cambridge, U.K., 2004, pp. 272-275.
55. S. J. Verzi, G. L. Heileman, and M. Georgiopoulos, "Boosted ARTMAP: Modifications to fuzzy ARTMAP motivated by boosting theory," Neural Netw., vol.19, no.4, pp. 446-468, 2006.
56. M. Vichi, "Principal classifications analysis: a method for generating consensus dendrograms and its application to three-way data," Comput. Stat. Data Anal., vol.27, no.3, pp. 311-331, 1998.
57. M. Vichi, "One-mode classification of a three-way data matrix," J. Classification, vol.16, no.1, pp. 27-44, 1999.
58. M. Wallace, Y. Avrithis, and S. Kollias, "Computationally efficient sup-t transitive closure for sparse fuzzy binary relations," Fuzzy Sets Syst., vol.157, pp. 341-372, 2006.
59. A. Weingessel, E. Dimitriadou, and K. Hornik. (2003). An ensemble method for clustering. DSC Working Papers [Online]. Available: http://www.ci.tuwien.ac. at/Conferences/DSC-2003
60. Y. Zhao and G. Karypis, "Evaluation of hierarchical clustering algorithms for document datasets," in Proc. 11th Int. Conf. Inf. Knowl. Manag., McLean, VA, 2002, pp. 515-524.
61. Z. H. Zhou and W. Tang, "Clusterer ensemble," Knowl.-Based Syst., vol.19, no.1, pp. 77-83, 2006.
62. Z. H. Zhou and Y. Yu., "Ensembling local learners through multimodal perturbation," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol.35, no.4, pp. 725-735, Aug. 2005.
63. Gunnar Raetsch's Benchmark Datasets. (2008, Oct. 13). [Online]. Available: http://users.rsise.anu.edu.au/?raetsch/data/index
64. Univ. Calif. Irvine Repository of Machine Learning Databases. (2008, Oct. 13). [Online]. Available: http://www.ics.uci.edu/?mlearn/ MLRepository.htm
65. Real Medical Datasets. (2008, Oct. 13). [Online]. Available: http://www. informatics.bangor.ac.uk/?kuncheva/activities/real-data.htm