LFGraph: Simple and fast distributed graph analytics

Proceedings of the 1st ACM SIGOPS Conference on Timely Results in Operating Systems, TRIOS 2013

Volumn , Issue , 2013, Pages

  Hoque, Imranul ^a   Gupta, Indranil ^b  

^a VMWARE INC   (United States)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FLOW GRAPHS;

DIRECTED EDGES; FIRST SYSTEMS; GRAPH ANALYTICS; GRAPH PARTITIONING; INFORMATION FLOWS; LOW MEMORY; PUBLISH-SUBSCRIBE;

DIRECTED GRAPHS;

EID: 85066547801     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2524211.2524218     Document Type: Conference Paper

References (40)

1. Apache Giraph. http://incubator.apache.org/giraph/.
2. Apache Hadoop. http://hadoop.apache.org/.
3. Apache Hama. http://hama.apache.org.
4. Apache Mahout. http://mahout.apache.org/.
5. FlockDB. https://github.com/twitter/flockdb.
6. GoldenOrb version 0.1.1. http://goldenorbos.org/.
7. GraphLab version 2.1. http://graphlab.org.
8. InfiniteGraph. http://www.objectivity.com.
9. Neo4j. http://www.neo4j.org.
10. Phoebus. https://github.com/xslogic/phoebus.
11. ABOU-RJEILI, A., AND KARYPIS, G. Multilevel Algorithms for Partitioning Power-Law Graphs. In Proceedings of the 20th International Conference on Parallel and Distributed Processing (IPDPS '06) (2006).
12. BOLDI, P., ROSA, M., SANTINI, M., AND VIGNA, S. Layered Label Propagation: A MultiResolution Coordinate-Free Ordering for Compressing Social Networks. In Proceedings of the 20th International Conference on World Wide Web (WWW '11 (2011), pp. 587-596.
13. BOLDI, P., AND VIGNA, S. TheWebGraph Framework I: Compression Techniques. In Proceedings of the 13th International World Wide Web Conference (WWW '04) (2004), pp. 595-601.
14. BORDINO, I., BOLDI, P., DONATO, D., SANTINI, M., AND VIGNA, S. Temporal Evolution of the UK Web. In Proceedings of the 1st International Workshop on Analysis of Dynamic Networks (ICDMADN '08) (2008), pp. 909-918.
15. BRODER, A., KUMAR, R., MAGHOUL, F., RAGHAVAN, P., RAJAGOPALAN, S., STATA, R., TOMKINS, A., AND WIENER, J. Graph Structure in the Web. In Proceedings of the 9th International World Wide Web Conference (WWW '00) (2000), pp. 309-320.
16. BU, Y., HOWE, B., BALAZINSKA, M., AND ERNST, M. D. HaLoop: Efficient Iterative Data Processing on Large Clusters. Proceedings of the VLDB Endowment 3, 1-2 (2010), 285-296.
17. CHEN, R., YANG, M., WENG, X., CHOI, B., HE, B., AND LI, X. Improving Large Graph Processing on Partitioned Graphs in the Cloud. In Proceedings of the 3rd ACM Symposium on Cloud Computing (SoCC '12) (2012), pp. 1-13.
18. DEAN, J., AND GHEMAWA, S. MapReduce: Simplified Data Processing on Large Clusters. In Proceedings of the 6th Symposium on Opearting Systems Design and Implementation (OSDI '04) (2004), pp. 137-149.
19. EKANAYAKE, J., LI, H., ZHANG, B., GUNARATHNE, T., BAE, S.-H., QIU, J., AND FOX, G. Twister: A Runtime for Iterative MapReduce. In Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing (HPDC '10) (2010), pp. 810-818.
20. GONZALEZ, J. E., LOW, Y., GU, H., BICKSON, D., AND GUESTRIN, C. PowerGraph: Distributed Graph-Parallel Computation on Natural Graphs. In Proceedings of the 10th USENIX Symposium on Operating Systems Design and Implementation( OSDI '12) (2012), pp. 17-30.
21. GREGOR, D., AND LUMSDAINE, A. The Parallel BGL: A Generic Library for Distributed Graph Computations. In Proceedings of the 4th Workshop on Parallel/High-Performance Object-Oriented Scientific Computing (2005).
22. HAGBERG, A., SCHULT, D., AND SWART, P. Exploring Network Structure, Dynamics, and Function using NetworkX. In Proceedings of the 7th Python in Science Conference (2008), pp. 11-15.
23. KANG, U., AND FALOUTSOS, C. E. T. C. PEGASUS: A Peta-Scale Graph Mining System-Implementation and Observations. In Proceedings of the 9th IEEE International Conference on Data Mining (ICDM '09) (2009), pp. 229-238.
24. KARYPIS, G., AND KUMAR, V. Multilevel k-way Partitioning Scheme for Irregular Graphs. Journal of Parallel and Distributed Computing 48 (1998), 96-129.
25. KHAYYAT, Z., AWARA, K., ALONAZI, A., JAMJOOM, H., WILLIAMS, D., AND KALNIS, P. Mizan: A System for Dynamic Load Balancing in Large-scale Graph Processing. In Proceedings of the 8th European Conference on Computer Systems (EuroSys '13) (2013).
26. KWAK, H., LEE, C., PARK, H., AND MOON, S. What is Twitter, a Social Network or a News Media? In Proceedings of the 19th International Conference on World Wide Web (WWW '10) (2010), pp. 591-600.
27. KYROLA, A., BLELLOCH, G., AND GUESTRIN, C. GraphChi: Large-Scale Graph computation on Just a PC. In Proceedings of the 10th USENIX Symposium on Operating Systems Design and Implementation (OSDI '12) (2012), pp. 31-46.
28. LOW, Y., GONZALEZ, J., KYROLA, A., BICKSON, D., GUESTRIN, C., AND HELLERSTEIN, J. M. GraphLab: A New Parallel Framework for Machine Learning. In Proceeding of the 26th Conference on Uncertainty in Artificial Intelligence (UAI '10) (2010), pp. 340-349.
29. LOW, Y., GONZALEZ, J., KYROLA, A., BICKSON, D., GUESTRIN, C., AND HELLERSTEIN, J. M. Distributed GraphLab: A Framework for Machine Learning and Data Mining in the Cloud. Proceedings of the VLDB Endowment 5, 8 (2012), 716-727.
30. MALEWICZ, G., AUSTERN, M. H., BIK, A. J., DEHNERT, J. C., HORN, I., LEISER, N., AND CZAJKOWSKI, G. Pregel: A System for Large-Scale Graph Processing. In Proceedings of the 2010 ACM International Conference on Management of Data (SIGMOD '10) (2010), pp. 135-146.
31. PAGE, L., BRIN, S., MOTWANI, R., AND WINOGRAD, T. The PageRank Citation Ranking: Bringing Order to the Web. Technical Report 1999-66, Stanford InfoLab, 1999.
32. POWER, R., AND LI, J. Piccolo: Building Fast and Distributed Programs with Partitioned Tables. In Proceedings of the 9th USENIX Symposium on Operating Systems Design and Implementation (OSDI '10) (2010), pp. 1-14.
33. PRABHAKARAN, V., WU, M., WENG, X., MCSHERRY, F., ZHOU, L., AND HARIDASAN, M. Managing Large Graphs on Multi-Cores with Graph Awareness. In Proceedings of the 2012 USENIX conference on Annual Technical Conference (USENIX ATC '12) (2012), pp. 41-52.
34. PUJOL, J. M., ERRAMILLI, V., SIGANOS, G., YANG, X., LAOUTARIS, N., CHHABRA, P., AND RODRIGUEZ, P. The Little Engine(s) That Could: Scaling Online Social Networks. In Proceedings of the ACM SIGCOMM 2010 Conference (SIGCOMM '10) (2010), pp. 375-386.
35. SALIHOGLU, S., AND WIDOM, J. GPS: A Graph Processing System. Technical Report, Stanford University, 2012.
36. SHAO, B., WANG, H., AND LI, Y. Trinity: A Distributed Graph Engine on a Memory Cloud. In Proceedings of the ACM International Conference on Management of Data (SIGMOD '13) (2013).
37. STANTON, I., AND KLIOT, G. Streaming Graph Partitioning for Large Distributed Graphs. In Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '12) (2012), pp. 1222-1230.
38. SURI, S., AND VASSILVITSKII, S. Counting Triangles and the Curse of the Last Reducer. In Proceedings of the 20th international Conference on World Wide Web (WWW '11) (2011), pp. 607-614.
39. VENKATARAMAN, S., BODZSAR, E., ROY, I., AUYOUNG, A., AND SCHREIBER, R. S. Presto: Distributed Machine Learning and Graph Processing with Sparse Matrices. In Proceedings of the 8th European Conference on Computer Systems (EuroSys '13) (2013).
40. ZAHARIA, M., CHOWDHURY, M., DAS, T., DAVE, A., MA, J., MCCAULEY, M., FRANKLIN, M. J., SHENKER, S., AND STOICA, I. Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing. In Proceedings of the 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI '12) (2012).