Parallel particle swarm optimization clustering algorithm based on MapReduce methodology

Proceedings of the 2012 4th World Congress on Nature and Biologically Inspired Computing, NaBIC 2012

Volumn , Issue , 2012, Pages 104-111

  Aljarah, Ibrahim ^a   Ludwig, Simone A ^a  

^a North Dakota State University   (United States)

Author keywords

Data Clustering; Hadoop; MapReduce; Parallel Processing

Indexed keywords

APPLICATION AREA; CLUSTERING QUALITY; COMMODITY HARDWARE; DATA CLUSTERING; DATA SET SIZE; HADOOP; LARGE DATA; LARGE DATASETS; LARGE SCALE DATA; LINEAR SPEED-UP; MAP-REDUCE; PARALLEL PARTICLE SWARM OPTIMIZATION; PARALLEL PROCESSING; SCALABLE APPROACH;

BIOINFORMATICS; DATA VISUALIZATION; DIGITAL STORAGE; PARALLEL ARCHITECTURES;

CLUSTERING ALGORITHMS;

EID: 84873132411     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/NaBIC.2012.6402247     Document Type: Conference Paper

References (24)

1. G. Bell, A. Hey, and A. Szalay, "Beyond the data deluge," Science 323 AAAS, vol. 39, 2006.
2. J. Han, Data Mining: Concepts and Techniques. Morgan Kaufmann, San Francisco, CA, USA, 2005.
3. J. Dean and S. Ghemawat, "Mapreduce: Simplified data processing on large clusters," 2004, pp. 137-150. [Online]. Available: http://www.usenix.org/events/osdi04/tech/dean.html
4. M. Snir, S. Otto, S. Huss-Lederman, D. Walker, and J. Dongarra, MPI: The Complete Reference. MIT Press Cambridge, MA, USA, 1995.
5. -(2011) Apache software foundation, hadoop mapreduce. [Online]. Available: http://hadoop.apache.org/mapreduce
6. -(2011) Disco mapreduce framework. [Online]. Available: http://discoproject.org
7. -(2011) Hadoop - facebook engg, note. [Online]. Available: http://www.facebook.com/note.php?noteid=16121578919
8. -(2011) Yahoo inc. hadoop at yahoo! [Online]. Available: http://developer.yahoo.com/hadoop
9. T. Gunarathne, T. Wu, J. Qiu, and G. Fox, "Cloud computing paradigms for pleasingly parallel biomedical applications," in Proceedings of 19th ACM International Symposium on High Performance Distributed Computing. ACM, January 2010, pp. 460-469.
10. S. Krishnan, C. Baru, and C. Crosby, "Evaluation of mapreduce for gridding lidar data," in Proceedings of the CLOUDCOM '10. Washington, DC, USA: IEEE Computer Society, 2010, pp. 33-40.
11. Z. Weizhong, M. Huifang, and H. Qing, "Parallel kmeans clustering based on mapreduce," in Proceedings of the CloudCom '09. Berlin, Heidelberg: Springer-Verlag, 2009, pp. 674-679.
12. L. Guang, W. Gong-Qing, H. Xue-Gang, Z. Jing, L. Lian, and W. Xindong, "K-means clustering with bagging and mapreduce," in Proceedings of the 2011 44th Hawaii International Conference on System Sciences. Washington, DC, USA: IEEE Computer Society, 2011, pp. 1-8.
13. S. Papadimitriou and J. Sun, "Disco: Distributed coclustering with map-reduce: A case study towards petabyte-scale end-to-end mining," in Proc. of the IEEE ICDM '8, Washington, DC, USA, 2008, pp. 512-521.
14. E. Alina, I. Sungjin, and M. Benjamin, "Fast clustering using mapreduce," in Proceedings of KDD '11. NY, USA: ACM, 2011, pp. 681-689.
15. F. Cordeiro, "Clustering very large multi-dimensional datasets with mapreduce," in Proceedings of KDD '11. NY, USA: ACM, 2011, pp. 690-698.
16. J. Kennedy and R. Eberhart, "Particle swarm optimization," in Proceedings of the IEEE ICNN '95. Australia, 1995, pp. 1942-1948.
17. A. Jain, M. Murty, and P. Flynn, "Data clustering: A review." NY, USA: ACM, 1999.
18. X. Cui, T. Potok, and P. Palathingal, "Document clustering using particle swarm optimization," in IEEE Swarm Intelligence Symposium. Pasadena, California, USA: ACM, 2005, pp. 185-191.
19. T. Schoene, S. A. Ludwig, and R. Spiteri, "Stepoptimized particle swarm optimization," in Proceedings of the 2012 IEEE CEC. Brisbane, Australia, June 2012.
20. R. Orlandic, Y. Lai, and W. Yee, "Clustering highdimensional data using an efficient and effective data space reduction," in Proc. ACM 14th Conf. on Information and Knowledge Management, Bremen, Germany, 2005, pp. 201-208. (Pubitemid 44022131)
21. A. Grama, A. Gupta, G. Karypis, and V. Kumar, Introduction to Parallel Computing. Addison-Wesley, USA, 2003.
22. H. Shi and R. Eberhart, "Parameter selection in particle swarm optimization," in Proc. 7th Annual Conference on Evolutionary Programming, San Diego, CA, 1998, pp. 201-208.
23. I. Trelea, "The particle swarm optimization algorithm: convergence analysis and parameter selection," in Information Processing Letters, 2003.
24. I. Witten, E. Frank, and M. Hall, Data Mining: Practical Machine Learning Tools And Techniques, 3rd Edition. Morgan Kaufmann, 2011.