Scalable community detection from networks by computing edge betweenness on MapReduce

2014 International Conference on Big Data and Smart Computing, BIGCOMP 2014

Volumn , Issue , 2014, Pages 145-148

  Moon, Seunghyeon ^a   Lee, Jae Gil ^a   Kang, Minseo ^a  

^a Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

Author keywords

community detection; edge betweenness; Girvan Newman algorithm; Hadoop; MapReduce; SPB MRA

Indexed keywords

MULTIPROCESSING SYSTEMS; POPULATION DYNAMICS;

COMMUNITY DETECTION; EDGE BETWEENNESS; HADOOP; MAP-REDUCE; SPB-MRA;

ALGORITHMS;

EID: 84900600176     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/BIGCOMP.2014.6741425     Document Type: Conference Paper

References (10)

1. M. E. Newman and M. Girvan, "Finding and evaluating community structure in networks," Physical Review E, vol. 69, no. 2, p. 026113, 2004.
2. J. Dean and S. Ghemawat, "MapReduce: simplified data processing on large clusters," Communications of the ACM, vol. 51, no. 1, pp. 107-113, 2008.
3. R. Chaiken, B. Jenkins, P.-A. Larson, B. Ramsey, D. Shakib, S. Weaver, and J. Zhou, "Scope: easy and efficient parallel processing of massive data sets," Proceedings of the VLDB Endowment, vol. 1, no. 2, pp. 1265-1276, 2008.
4. J. Cohen, B. Dolan, M. Dunlap, J. M. Hellerstein, and C. Welton, "Mad skills: new analysis practices for big data," Proceedings of the VLDB Endowment, vol. 2, no. 2, pp. 1481-1492, 2009.
5. A. F. Gates, O. Natkovich, S. Chopra, P. Kamath, S. M. Narayanamurthy, C. Olston, B. Reed, S. Srinivasan, and U. Srivastava, "Building a high-level dataflow system on top of Map-Reduce: the Pig experience," Proceedings of the VLDB Endowment, vol. 2, no. 2, pp. 1414-1425, 2009.
6. H.-c. Yang, A. Dasdan, R.-L. Hsiao, and D. S. Parker, "Map-Reduce-Merge: simplified relational data processing on large clusters," in Proceedings of 2007 ACM SIGMOD International Conference on Management of Data, 2007, pp. 1029-1040.
7. "Apache Hadoop," http://hadoop.apache.org/, accessed: August 1, 2013.
8. Z. F. Zeng, B. Wu, and T. T. Zhang, "A multi-source message passing model to improve the parallelism efficiency of graph mining on MapReduce," in Proceedings of 2012 IEEE International Parallel and Distributed Processing Symposium Workshops &PhD Forum (IPDPSW), 2012, pp. 2019-2025.
9. "Stanford large network dataset collection," http://snap. stanford.edu/data/, accessed: August 1, 2013.
10. J. Han, M. Kamber, and J. Pei, Data mining: concepts and techniques, 2nd ed. Morgan Kaufmann, 2006.