Large-scale data sets clustering based on MapReduce and Hadoop

Journal of Computational Information Systems

Volumn 7, Issue 16, 2011, Pages 5956-5963

  Zhou, Ping ^a   Lei, Jingsheng ^a   Ye, Wenjun ^a  

^a SHANGHAI UNIVERSITY OF ELECTRIC POWER   (China)

Author keywords

Hadoop; Large scale data sets; MapReduce; Parallel K Means clustering

Indexed keywords

AUTOMATIC CLASSIFICATION; DATA MINING METHODS; DATA SETS; DISTRIBUTED PARALLEL COMPUTING; HADOOP; K-MEANS ALGORITHM; K-MEANS CLUSTERING; K-MEANS CLUSTERING ALGORITHM; MAP-REDUCE; PERFORMANCE REQUIREMENTS; PROGRAMMING MODELS; SCIENTIFIC DATA; SINGLE COMPUTER;

CLUSTER ANALYSIS; COMPUTER PROGRAMMING; DATA MINING; INFORMATION RETRIEVAL SYSTEMS; PARALLEL ARCHITECTURES;

CLUSTERING ALGORITHMS;

EID: 84155181855     PISSN: 15539105     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (7)

1. Hadoop. http://hadoop.apache.org/.
2. S. Ghemawat, H. Gobioff, S.T. Leung, The Google file system, 19th Symposium on Operating Systems Principles, New York, pages 29-43 2003.
3. Jeffrey Dean and Sanjay Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. In Proceedings of the 6th USENIX Symposium on Operating Systems Design and Implementation, pages 137-149, 2004.
4. H. Maulik, and S. Bandyopadhyay. Genetic Algorithm-Based Clustering Technique. Pattern Recognition, Vol.33, pages 1455-1465, 2000.
5. S.Z. Selim, and M.A. Ismail. K-means-Type Algorithms: a Generalized Convergence Theorem and Characterization of Local Optimality. IEEE Trans on Pattern Analysis and Machine Intelligence, Vol.6, No.1, pages 81-87, 1984.
6. D. Arthur and S. Vassilvitskii. K-Means++: The Advantage of Careful Seeding. Society for Industrial and Applied Mathematics, Philadelphia, PA, USA, 2007.
7. Berry, M. http://blog.data-miners.com/2008/02/MapReduce-and-k-means- clustering.html, 2008.