Parallel processing of large graphs

Future Generation Computer Systems

Volumn 32, Issue 1, 2014, Pages 324-337

  Kajdanowicz, Tomasz ^a   Kazienko, Przemyslaw ^a   Indyk, Wojciech ^a  

^a WROCLAW UNIVERSITY OF TECHNOLOGY   (Poland)

Author keywords

Big data; Bulk Synchronous Parallel; Cloud computing; Collective classification; Large graph processing; MapReduce; Networked data; Parallel processing; Shortest path

Indexed keywords

BIG DATUM; BULK SYNCHRONOUS PARALLEL; COLLECTIVE CLASSIFICATIONS; LARGE GRAPHS; MAP-REDUCE; NETWORKED DATUM; PARALLEL PROCESSING; SHORTEST PATH;

ALGORITHMS; CLOUD COMPUTING; ITERATIVE METHODS;

GRAPH THEORY;

EID: 84891597962     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2013.08.007     Document Type: Article

References (30)

1. A. Lumsdaine, D. Gregor, B. Hendrickson, and J. Berry Challenges in parallel graph processing Parallel Process. Lett. 17 1 2007 5 20 (Pubitemid 46573923)
2. G. Malewicz, M. Austern, A. Bik, J. Dehnert, I. Horn, N. Leiser, and G. Czajkowski Pregel: a system for large-scale graph processing Proceedings of the 2010 International Conference on Management of Data, SIGMOD'10 2010 ACM New York, NY, USA 135 146
3. S. Yang, B. Wang, H. Zhao, and B. Wu Efficient dense structure mining using MapReduce ICDM Workshops'09 2009 IEEE Computer Society 332 337
4. J. Lin, and M. Schatz Design patterns for efficient graph algorithms in MapReduce Proceedings of the Eighth Workshop on Mining and Learning with Graphs MLG'10 2010 ACM New York, NY, USA 78 85
5. J. Lin, and C. Dyer Data-Intensive Text Processing with MapReduce Synthesis Lectures on Human Language Technologies 2010 Morgan & Claypool Publishers
6. Y. Bu, B. Howe, M. Balazinska, and M. Ernst Haloop: efficient iterative data processing on large clusters Proc. VLDB Endowment 3 1-2 2010 285 296
7. U. Kang, C. Tsourakakis, and C. Faloutsos Pegasus: a peta-scale graph mining system implementation and observations Proceedings of the 2009 Ninth IEEE International Conference on Data Mining ICDM'09 2009 IEEE Computer Society Washington, DC, USA 229 238
8. Y. Zhang, Q. Gao, L. Gao, and C. Wang iMapReduce: a distributed computing framework for iterative computation J. Grid Comput. 10 1 2012 47 68
9. R. Chen, X. Weng, B. He, and M. Yang Large graph processing in the cloud Proceedings of the 2010 International Conference on Management of Data, SIGMOD'10 2010 ACM New York, NY, USA 1123 1126
10. E. Elnikety, T. Elsayed, H. Ramadan, iHadoop: asynchronous iterations for MapReduce, in: CloudCom'11, 2011, pp. 81-90.
11. L. Valiant A bridging model for parallel computation Commun. ACM 33 8 1990 103 111
12. T. Kajdanowicz, W. Indyk, P. Kazienko, and J. Kukul Comparison of the efficiency of MapReduce and bulk synchronous parallel approaches to large network processing Proceedings of the ICDM 2012 Workshops, The Second IEEE ICDM Workshop on Data Mining in Networks ICDM'2012 2012 IEEE Computer Society New York, NY, USA 218 225
13. T. White Hadoop: The Definitive Guide 2010 O'Reilly
14. D. Krizanc, A. Saarimaki, Bulk synchronous parallel: practical experience with a model for parallel computing, in: Proceedings of the 1996 Conference on Parallel Architectures and Compilation Techniques 1996, 1996, pp. 208-217.
15. Apache Giraph, http://incubator.apache.org/giraph/ (accessed: 31.05.2012).
16. S. Seo, E. Yoon, J. Kim, S. Jin, J. Kim, and S. Maeng Hama: an efficient matrix computation with the MapReduce framework Proceedings of the 2010 IEEE Second International Conference on Cloud Computing Technology and Science CLOUDCOM'10 2010 IEEE Computer Society Washington, DC, USA 721 726
17. B. Shao, H. Wang, and Y. Xiao Managing and mining large graphs: systems and implementations Proceedings of the 2012 International Conference on Management of Data SIGMOD'12 2012 ACM New York, NY, USA 589 592
18. M. Najork, D. Fetterly, A. Halverson, K. Kenthapadi, and S. Gollapudi Of hammers and nails: an empirical comparison of three paradigms for processing large graphs Proceedings of the Fifth ACM International Conference on Web Search and Data Mining WSDM'12 2012 ACM New York, NY, USA 103 112
19. M.F. Pace, BSP vs MapReduce, CoRR arXiv:abs/1203.2081.
20. A. Lumsdaine, G. Douglas, B. Hendrickson, and J. Berry Challenges in parallel graph processing Parallel Process. Lett. 17 2007 5 20 (Pubitemid 46573923)
21. MPI: a message passing interface Proc. of Supercomputing'93 Message Passing Interface Forum 1993 IEEE Computer Society Press 878 883
22. T.A. El-Ghazawi, W.W. Carlson, J.M. Draper, UPC language specification, 1.2 edition, http://www.gwu.edu/~upc/downloads/upc-specs-1.2.pdf.
23. J. Cohen Graph twiddling in a MapReduce world J. Comput. Sci. Eng. 11 2009 29 41
24. J. Huang, D. Abadi, and K. Ren Scalable SPARQL querying of large RDF graphs Proc. VLDB Endowment 4 21 2011
25. S. Salihoglu, J. Widom, Gps: a graph processing system, Technical Report, Stanford University. URL: http://ilpubs.stanford.edu:8090/1039/.
26. P. Kalnis, Z. Khayyat, K. Awara, H. Jamjoom, Mizan: optimizing graph mining in large parallel systems. URL: http://hdl.handle.net/10754/217609.
27. S. Chakrabarti, B. Dom, and P. Indyk Enhanced hypertext categorization using hyperlinks SIGMOD Rec. 27 2 1998 307 318 (Pubitemid 128655978)
28. W. Indyk, T. Kajdanowicz, and P. Kazienko Relational large scale multi-label classification method for video categorization Multimedia Tools Appl. 65 1 2013 63 74
29. P. Haller, H. Miller, Parallelizing machine learning-functionally: a framework and abstractions for parallel graph processing, in: 2nd Annual Scala Workshop, 2011.
30. X. Cheng, C. Dale, J. Liu, Statistics and social network of YouTube videos, in: 16th International Workshop on Quality of Service, IWQoS 2008, 2008, pp. 229-238.