A cluster ensemble framework for large data sets

Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics

Volumn 4, Issue , 2006, Pages 3342-3347

  Hore, Prodip ^a   Hall, Lawrence ^a   Goldgof, Dmitry ^a  

^a University of South Florida   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLUSTERING ALGORITHMS; COMPUTATIONAL COMPLEXITY;

DATA SETS; DISTRIBUTED CLUSTERING; UNBALANCED DATA DISTRIBUTION;

DATA STRUCTURES;

EID: 34548139373     PISSN: 1062922X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSMC.2006.384634     Document Type: Conference Paper

References (33)

1. A. Strehl and J. Ghosh, "Clusters ensembles- a knowledge reuse framework for combining multiple partitions," Journal of Machine learning Research, 3, 2002, pp. 583-617.
2. B. Long, Z. (Mark) Zhang, "and Philip S. Yu, " Combining Multiple Clusterings by Soft Correspondence," ICDM 2005, pp. 282-289.
3. K. Punera and J. Ghosh, "A scaleable and Robust Framework for Structure Discovery,",ICDM 2005, pp. 757-760.
4. H. Kriegel, P. Kroger, A. Pryakhin, M. Scubert, "Effective and Efficient Distributed Model-based Clustering," ICDM 2005, pp. 258-265.
5. X.Z Fern and C.E Brodley. "Solving cluster ensemble problem by bipartite graph partitioning," ICML 2004.
6. B. Fischer and J.H Buhmann, "Path-based clustering for grouping of smooth curves and texture segmentation," IEEE Transaction on Pattern Analysis and Machine Intelligence, 2003.
7. A. Topchy, A.K Jain, W. Punch, "A mixture model for clustering ensembles," Proc. AIAM Data mining, 2004
8. S. Dudoit and J. Fridlyand "Bagging to improve the accuracy of a clustering procedure," Bioinformatics, 2003
9. G. Forman and B. Zhang, "Distributed Data Clustering can be Efficient and Exact," SIGKDD Explorations, 2000
10. Kuhn, H.W., "The Hungarian Method for the Assignment Problem," Naval. Res. Logist. Quart., 2, 1955, pp. 83-97.
11. P. Hore and L. Hall, "Scalable Clustering: A Distributed Approach," FUZZ-IEEE, 2004.
12. A. Topchy, A.K Jain, and W. Punch, "Combining Multiple Weak Clusterings," Proc. IEEE Intl. Conf. on Data Mining, 2003, pp. 331-338.
13. I. Davidson and A. Satyanarayana, "Speeding up K-means clustering by Bootstrap averaging," IEEE ICDM 2004.
14. A.L.N Fred, "Finding Consistent Clusters in Data Partitions," Proc. Int. Workshop on multiple Classifier Systems, Eds. F. Roli, J. Kittler, LNCS 2364, 2002, pp. 309-318.
15. F. Farnstrom, J. Lewis, and C. Elkan, "Scalability of Clustering Algorithms Revisited," SIGKDD Explorations, 2(1), 2000, pp. 51-57.
16. S. Eschrich, J. Ke, L.O. Hall and D.B. Goldgof, "Fast Accurate Fuzzy Clustering through Data Reduction," IEEE Transactions on Fuzzy Systems, 11, 2, pp. 262-270 2003.
17. Ganti, V., Gehrke, J. and Ramakrishnan, R., "Mining very large databases," Computer, August, 1999, 38-45.
18. Zhang, T., Ramakrishnan, R. and Livny, M.,"BIRCH : An Efficient Data Clustering Method for Very Large Databases," Proc. ACM SIGMOD Int'l. Conf. on Management of Data, ACM Press, 1996 NY,103-114.
19. Ganti, V., Ramakrishnan, R., Gehrke, J., Powell, A. L. and French, J. C.,"Clustering Large Datasets in Arbitrary Metric Spaces," Proc. 15th Int'l. Conf. on Data Engineering, IEEE CS Press, Los Alamitos, CA, 1999 502-511.
20. Bradley, P., Fayyad, U. and Reina, C., "Scaling clustering algorithms to large databases," Proc. 4th Int'l. Conf. Knowledge Discovery and Data Mining, AAAI Press, Menlo Park, CA, 1998, 9-15.
21. Domingos, P. and Hulten, G., "A General Method for Scaling Up Machine Learning Algorithms and its Application to Clustering," Proc. Eighteenth Int'l. Conf. on Machine Learning, 2001, 106-113.
22. Behrouz Minaei-Bidgoli, Alexander Topchy, William F. Punch, "Ensembles of partitions via data resampling,"
23. AK Jain and RC Dubes, "Algorithms for Clustering Data. Prentice Hall," Englewood Cliffs NJ, USA, 1988
24. Inderjit S. Dhillon and Dharmendra S. Modha, "A Data-Clustering Algorithm On Distributed Memory Multiprocessors," Proc. of Large-scale Parallel KDD Systems Workshop, ot ACM SIGKDD, 1999, pp. 245-260.
25. Joydeep Ghosh and Srujana Merugu, "Distributed Clustering with Limited Knowledge Sharing," Proc. 5th International Conference on Advances in Pattern Recognition, pp. 48-53, Dec 2003.
26. Joydeep Ghosh, Alexander Strehl, and Srujana Merugu, "A Consensus Framework for Integrating Distributed Clusterings Under Limited Knowledge Sharing," Proc. National Science Foundation (NSF) Workshop on Next Generation Data Mining, 2002, pp. 99-108
27. Eshref Januzaj, Hans-Peter Kriegel, and Martin Pfeifle, "Towards Effective and Efficient Distributed Clustering," Proc. Int. Workshop on Clustering Large Data Sets, 3rd IEEE International Conference on Data Mining, 2003, pp. 49-58
28. Matthias Klusch, Stefano Lodi, and Gianluca Moro, "Distributed Clustering Based on Sampling Local Density Estimates," Proc. Eighteenth International Joint Conference on Artificial Intelligence, 2003, pp. 485-490.
29. C.J. Merz and P.M. Murphy. "UCI Repository of Machine Learning Databases Univ. of CA.," Dept. of CIS, Irvine, CA., http://www.ics.uci.edu/ ~mlearn/MLRepository.html.
30. R. Duda, P. Hart, and D. Stork "Pattern Classification"
31. N.R. Pal and J.C. Bezdek. "Complexity reduction for large image processing," Transactions on Systems, Man, and Cybernetics - Part B, 2002, pp. 598-611.
32. Cheng T.W., Goldgof D.B., and Hall L.O. "Fast fuzzy clustering,", Fuzzy Sets and Systems, 1998, pp. 49-56.
33. Personal communication: We communicated with one of the authors of [2]. We were told that their experiment might choose 6 classes randomly and they have no record of it except the last experiment.