Distributed affinity propagation clustering based on MapReduce

Jisuanji Yanjiu yu Fazhan/Computer Research and Development

Volumn 49, Issue 8, 2012, Pages 1762-1772

  Lu, Weiming ^a   Du, Chenyang ^a   Wei, Baogang ^a   Shen, Chunhui ^a   Ye, Zhenchao ^a  

^a ZHEJIANG UNIVERSITY   (China)

Author keywords

Affinity propagation clustering; Cluster ensemble; Data partition; Distributed computing; MapReduce

Indexed keywords

AFFINITY PROPAGATION; CLUSTER ENSEMBLES; COMPUTER TECHNOLOGY; DATA PARTITION; DATA SETS; HIGH QUALITY; HUMAN FACE IMAGE; K-MEANS ALGORITHM; LARGE SCALE DATA; MAP-REDUCE; SCALABILITY PROBLEMS; SYNTHETIC DATASETS; TRADITIONAL CLUSTERING;

DISTRIBUTED COMPUTER SYSTEMS; LEARNING ALGORITHMS; SCALABILITY;

CLUSTERING ALGORITHMS;

EID: 84867162628     PISSN: 10001239     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (19)

1. Jain A K, Murty M N, Flynn P J. Data clustering: A review[J]. ACM Computing Surveys, 1999, 31(3): 264-323
2. Bach R F, Jordan I M. Learning spectral clustering[C] //Advances in Neural Information Processing Systems. Cambridge, Mass: MIT, 2004: 305-312
3. Frey B J, Dueck D. Clustering by passing messages between data points[J]. Science, 2007, 315(5814): 72-976
4. Chu C T, Kim S K, Lin Y A, et al. Map-reduce for machine learning on multicore[C] //Proc of Neural Information Processing Systems Conf. Cambridge, Mass: MIT, 2007: 281-288
5. Zhao Weizhong, Ma Huifang, He Qing. Parallel K-means clustering based on MapReduce[G] //LNCS 5931: Proc of the 1st Int Conf on Cloud Computing. Berlin: Springer, 2009: 674-679
6. Ni Weiwei, Lu Jieping, Sun Zhihui. An effective distributed k-means clustering algorithm based on the pretreatment of vectors' inner-product[J]. Journal of Computer Research and Development. 2005, 42(9): 1493-1497 (in Chinese)
7. Chen Wenyen, Song Yangqiu, Bai Hongjie, et al. Parallel spectral clustering in distributed systems[J]. IEEE Trans on Pattern Analysis and Machine Intelligence, 2010, 33(3): 568-586
8. Xia Dingyin, Wu Fei, Zhang Xuqing, et al. Local and global approaches of affinity propagation clustering for large scale data[J]. Journal of Zhejiang University, Science A, 2008, 9(10): 1373-1381
9. Dean J, Ghemawat S. MapReduce: Simplified data processing on large clusters[J]. Communications of the ACM, 2008, 51(1): 107-113
10. Apache Hadoop Project[CP/OL]. [2011-08-14]. http://hadoop.apache.org/core/
11. Fränti P, Virmajoki O. Iterative shrinking method for clustering problems[J]. Pattern Recognition, 2006, 39(5): 761-765
12. UCI Machine Learning Repository[DB/OL]. [2011-08-14]. http://archive.ics.uci.edu/ml
13. Lyons M, Akamatsu S, Kamachi M, et al. Coding facial expressions with Gabor wavelets[C] //Proc of the 3rd IEEE Int Conf on Automatic Face and Gesture Recognition. Piscataway, NJ: IEEE, 1998: 200-205
14. He Xiaofei, Yan Shuicheng, Hu Yuxiao, et al. Face recognition using Laplacianfaces[J]. IEEE Trans on Pattern Analysis and Machine Intelligence, 2005, 27(3): 328-340
15. Todd W. Mami fold Learning Matlab Demo[CP/OL]. [2011-08-14]. http://www.math.ucla.edu/~wittman/mani/index.html
16. Zhang Tian, Ramakrishnan Raghu, Livny Miron. BIRCH: A new data clustering algorithm and its applications[J]. Data Mining and Knowledge Discovery, 1997, 1(2): 141-182
17. Clustering datasets [DB/OL]. [2011-08-14]. http://cs.joensuu.fi/sipu/datasets/
18. Strehl A, Ghosh J. Cluster ensembles-A knowledge reuse framework for combining multiple partitions[J]. Journal of Machine Learning Research, 2002, 3(12): 583-617
19. Papadimitriou C H, Steiglitz K. Combinatorial Optimization: Algorithms and Complexity[M]. New York: Prentice-hall, 1998