A new method for hierarchical clustering combination

Intelligent Data Analysis

Volumn 12, Issue 6, 2008, Pages 549-571

  Mirzaei, Abdolreza ^a   Rahmati, Mohammad ^a   Ahmadi, Majid ^b  

^a AMIRKABIR UNIVERSITY OF TECHNOLOGY   (Iran)

^b UNIVERSITY OF WINDSOR   (Canada)

Author keywords

Cluster ensembles; Clustering; Clustering combination; Hierarchical clustering

Indexed keywords

EID: 58049085518     PISSN: 1088467X     EISSN: 15714128     Source Type: Journal    
DOI: 10.3233/ida-2008-12603     Document Type: Article

References (56)

1. H. Ayad and M. Kamel, Finding Natural clusters using multi-clusterer combiner based on shared nearest neighbors, in: Proc. 4th International Workshop on Multiple Classifier Systems, volume 2709 of Lecture Notes in Computer Science, T. Windeatt and F. Roli, eds, Guildford, UK, 2003, Speringer-Verlag, pp. 166-175.
2. Banerjee, S. Merugu, I. Dhillon and J. Ghosh, Clustering with Bregman Divergences, in: Proc. of Fourth SIAM int'l Conf. Data Mining, 2004, 234-245.
3. Banerjee, S. Merugu, I. Dhillon and J. Ghosh, Clustering with Bregman Divergences, J. Machine Learning Research 6 (2005), 1705-1749.
4. A. Ben-Hur, A. Elisseeff and I. Guyon, A stability based method for discovering structure in clustered data, in: Pacific Symposium on Biocomputing, R.B. Aetman, ed., New Jersey World Scientific Publishing Co., 2002, pp. 6-17.
5. L. Breiman, Bagging predictors, Machine Learning 24(2) (1996), 123-140.
6. L. Breiman, Random Forests, Machine Learning 45(1) (2001), 5-32.
7. D.L. Davies and D.W. Bouldin, A cluster separation measure, IEEE Trans Pattern Anal Machine Intell 1 (1979), 224-227.
8. T. Dietterich, Ensemble methods in machine learning, in: Proc. of the First Int. Workshop on Multiple Classifier Systems, J. Kittler and F. Roli, eds, Cagliari, Italy, 2000, Speringer-Verlag, pp. 1-15.
9. H. Drucker and C. Cortes, Boosting decision trees, Advances in Neural Information Systems 8 (1996), 479-485.
10. R.O. Duda, P.E. Hart and D.G. Stork, Pattern Classification, John Wiely & Sons, 2001.
11. S. Dudoit and J. Fridlyand, Bagging to improve the accuracy of clustering procedure, Bioinformatics 19(9) (2003), 1090-1099.
12. J.C. Dunn, Well separated clusters and fuzzy partitions, J Cybernet 4 (1974), 95-104.
13. X.Z. Fern and C.E. Brodley, Solving cluster ensemble problems by bipartite graph partitioning, in: Proc. of the Twenty-first International Conference on Machine Learning 69 (2004), 36.
14. Fischer, J.M. Buhmann, Bagging for path-based clustering, IEEE Trans on Pattern Analysis and Machine Intelligence 25(11) (2003), 1411-1415.
15. A.L.N. Fred, Finding consistent clusters in data partitions, in: Proc. 2nd International Workshop on Multiple Classifier Systems, vol. 2096 of Lecture Notes in Computer Science, F. Roli and J. Kittler, eds, Cambridge, UK, Speringer-Verlag, 2001, pp. 309-318.
16. A.L.N. Fred and A.K. Jain, Robust data clustering, in Proc. of IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2003, 128-133.
17. A.L.N. Fred and A.K. Jain, Data clustering using evidence accumulation, in Proc. 16th International Conference on Pattern Recognition, ICPR, Canada, 2002, 276-280.
18. A.L.N. Fred and A.K. Jain, Combining Multiple Clusterings Using Evidence Accumulation, IEEE Transactions on Pattern Analysis and Machine Intelligence 27(6) (2006), 835-850.
19. D. Frossyniotis, A. Likas and A. Stafylopatis, A clustering method based on boosting, Pattern Recognition Letters 25(6) (2004).
20. Gionis, H. Mannila and P. Tsaparas, Clustering aggregation, in: Proc. of int. Conf. on Data Engineering ICDE, Japan, 2005.
21. S.T. Hadjitodorov, L.I. Kuncheva and L.P. Todorova, Moderate diversity for better cluste r ensembles, Information Fusion 7(3) (2006), 264-275.
22. M. Halkidi et al., On clustering validation techniques, J Intelligent Inform System 17 (2001), 107-145.
23. A. Hubert, Comparing partitions, J Classification 2 (1985), 193-198.
24. K. Jain and R.C. Dubes, Algorithms for Clustering Data, Prentice Hall, 1988.
25. K. Jain, M.N. Murty and P.J. Flynn, Data clustering: A review, ACM computing Surveys 31(3) (1999), 264-323.
26. H. Kargupta and B.H. Park, A Fourier spectrum-based approach to represent decision trees for mining data streams in mobile environments, IEEE Trans Knowledge and Data Engineering 16(2) (2002), 216-229.
27. H. Kargupta, B.H. Park and H. Dutta, Orthogonal decision trees, IEEE Trans. Knowledge and Data Engineering 18(7) (2006), 1028-1042.
28. L.I. Kuncheva, Combining Pattern Classifiers: Methods and Algorithms ISBN: 0-471-66025-6, 2004.
29. L.I. Kuncheva, S.T. Hadjitodorov and L.P. Todorova, Experimental comparison of cluster ensemble methods, in Proc. 19th International Conference on Information Fusion, ICIF '06, 2006, 1-7.
30. J. Lapointe and P. Legendre, A statistical framework to test the consensus among additive trees (clandograms), JSTOR, Systematic Biology 41(2) (1992), 158-171.
31. Leisch, K. Hornik, Stabilization of k-means with bagged clustering, in Proc. of the Joint Statistical Meetings, 1999.
32. Minaei, A. Topchy and W.F. Punch, Ensembles of partitions via data resampling, in: Proc. Intl. Conf. on Information Technology, ITCC 04 Las Vegas, 2004.
33. S. Monti, P. Tamayo, J. Mesirov and T. Golub, Consensus clustering: A resampling based method for class discovery and visualization of gene expression microarray data, Machine Learning 52 (2003), 91-118.
34. R. Nock and F. Nielsen, On weighting clustering, IEEE Trans on Pattern Analysis and Machine Intelligence 25(11) (2006), 1223-1235.
35. B.H. Park, Constructing simpler decision trees from ensemble models using Fourier analysis, in: Proc. of Seventh Work Shop Research Issues in Data Mining and Knowledge Discovery, 2002, 18-23.
36. J. Podani, simulation of random dendrograms and comparison tests: Some comments, Journal of Classification 17 (2004), 123-142.
37. W. Rand, Objective criteria for the evaluation of clustering methods, J Am Stat Assoc 66 (1971), 846-850.
38. C. van Rijsbergen, Information Retrieval, second edition, Butterworths, 1979.
39. H.C. 39, Cluster Analysis for Researchers, Belmont, 1984.
40. P.J. Rousseeuw, Silhouettes: A graphical aid to the interpretation and validation of cluster analysis, J Comput Appl Math 20 (1987), 53-65.
41. R.E. Schapire, The strength of weak learnability, Machine Learning 5(2) (1990), 197-227.
42. Strehl, J. Ghosh, Cluster ensembles - a knowledge reuse framework for combining multiple partitions, The Journal of Machine Learning Research 3 (2002), 583-617.
43. Strehl, J. Ghosh, Cluster ensembles - a knowledge reuse framework for combining partitions, in: Proc. of AAAI, AAAI/MIT Press, 2002.
44. A. Topchy, A.K. Jain and W. Punch, A mixture model for clustering ensembles, in: Proc. of SIAM Conference on Data Mining, 2004, 379-390.
45. A. Topchy, A.K. Jain and W. Punch, Clustering ensembles: Models of consensus and weak partitions, IEEE Trans on Pattern Analysis and Machine Intelligence 27(12) (2005).
46. A. Topchy, A.K. Jain and W. Punch, Combining multiple weak clustering, in: Proc. of IEEE int. Conf on Data Mining, Melbourne, Australia, 2003, 331-338.
47. A. Topchy, B. Minaei, A.K. Jain and W. Punch, Adaptive clustering, in Proc. of ICPR, Cambridge, UK, 2004, 272-275.
48. S.J. Verzi, G.L. Heileman and M. Georgiopoulos, Boosted ARTMAP: Modifications to fuzzy ARTMAP motivated by boosting theory, Neural Networks 19(4) (2006), 446-468.
49. R. Web, Statistical Pattern Recognition, John Wiely & Sons, 2002.
50. Weingessel, E. Dimitriadou and K. Hornik, An Ensemble Method for Clustering, DSC Working Papers, 2003, available at http://www.ci.tuwien.ac.at/Conferences/DSC-2003.
51. Y. Zhao and G. Karypis, Evaluation of hierarchical clustering algorithms for document datasets, in: Proc. of the Eleventh International Conference on Information and Knowledge Management, McLean, Virginia, USA, 2002, 515-524.
52. Z.-H. Zhou and W. Tang, Clusterer ensemble, Knowledge-Based Systems 19(1) (2006), 77-83.
53. Z.H. Zhou and Y. Yu, Ensembling local learners through multimodal perturbation, IEEE Transactions on Systems, Man, and Cybernetics - Part B 35 (2005), 725-735.
54. Gunnar Raetsch's Benchmark Datasets available at http://users.rsise.anu.edu.au/~raetsch/data/index.
55. UCI repository of machine learning databases at: http://www.ics.uci.edu/ ~mlearn/MLRepository.htm.
56. Real medical datasets used in [29] at: http://www.informatics.bangor.ac.uk/~kuncheva/activities/real.data.htm.