A new agglomerative hierarchical clustering algorithm implementation based on the map reduce framework

International Journal of Digital Content Technology and its Applications

Volumn 4, Issue 3, 2010, Pages

  Gao, Hui ^a   Jiang, Jun ^a   She, Li ^a   Fu, Yan ^a  

^a UNIVERSITY OF ELECTRONIC SCIENCE AND TECHNOLOGY OF CHINA   (China)

Author keywords

Agglomerative hierarchical clustering; Initial classification; Map reduce; Text clustering

Indexed keywords

AGGLOMERATIVE HIERARCHICAL CLUSTERING; DATA BLOCKS; DATA SETS; DISTRIBUTED DATA; HIGHER EFFICIENCY; IMPROVED ALGORITHM; INITIAL CLASSIFICATION; INITIALIZATION METHODS; MAP REDUCE; RESEARCH FIELDS; SELF-ORGANIZING MODEL; TEXT CLUSTERING; TEXT MINING; TEXT-CLUSTERING ALGORITHM;

CLUSTER ANALYSIS; MULTI AGENT SYSTEMS; TEXT PROCESSING;

CLUSTERING ALGORITHMS;

EID: 78651524475     PISSN: 19759339     EISSN: None     Source Type: Journal    
DOI: 10.4156/jdcta.vol4.issue3.9     Document Type: Article

References (16)

1. A. K. Jain, R. C. Dubes, Algorithms for Clustering Data, Prentice Hall, Englewood Cliffs, NJ, 1988.
2. P. Bradley, U. Fayyad, C. Reina, "Clustering very large database using EM mixture models", in Proc. 15th Intern. Conf. on Pattern Recognition, 2000, pp.76-80.
3. K. Nigam, A.K. McCallum, S. Thrun, T.M. Mitchel, "Text classification from labeled and unlabeled documents using EM", Machine Learning, 39 (2/3), 2000, pp.103-134
4. M.H.C. Law, M.A.T. Figueiredo, A.K. Jain, "Simultaneous feature selection and clustering using mixture models", IEEE Transaction on Pattern Analysis and Machine Intelligence, 26(9), 2004, pp.1154-1166.
5. Lichen An, New Methods for Cluster Analysis in Distributed Environments, Zhejiang: University Of Zhejiang, 2006.
6. Maojia Li, K-means Algorithm and Parallelization, Chongqing: University Of Chongqing, 2003.
7. Zhang Zhen Ya, Cheng Hong Mei, Wang Jin, Wang Xu Fa, An Approach on the Data Structure for the Matrix Storing Based on the Implementation of Agglomerative Hierarchical Clustering Algorithm, Computer Science, 2006(1), pp.14-17.
8. Manasi N. Joshi, Parallel K-Means Algorithm on Distributed Memory Multiprocessors, 2003.
9. K.Alsabti, S.Ranka, V.Singh, An Efficient K-Means Clustering Algorithm, http://www.cise.ufl.edu/_ranka/1997.
10. Liu Liping, Zhi-Qing Meng, A method of choosing the initial cluster centers, Computer Engineering and Applications, 2004.8, pp.179-180.
11. Dan Judd, P.McKinley, A.Jain, Large-Scale Parallel Data Clustering, IEEE Transactions on Pattern Analysis and Machine Intelligence, 1998.8, Vol.20, No.8, pp.871-876.
12. M.Hemalatha, P. Ranjith Jebah Thangiah, K.Vivekanandan, A Distributed and Parallel Clustering Algorithm for Massive Biological Data, JCIT: Journal of Convergence Information Technology, Vol. 3, No. 4, pp. 84-88, 2008
13. Attila Gürsoy, Ilker Cengiz, Parallel Pruning for K-Means Clustering on Shared Memory Architectures, Springer-Verlag Berlin Heidelberg, 2001, pp.321-325.
14. Information on http://hadoop.apache.org.
15. Suo H.G., Wang Y.W., An improved k_means algorithm for document clustering, Journal of Shandong University (Natural Science), 43(1), 2008, pp.60-64.
16. Liuming, Wangxiao Long, Liuyuan Chao, A Fast Clustering Algorithm for Large-scale and High Dimensional Data, ACTA AUTOMATICA SINICA, 35(7), 2009, pp859-866.