Fast failure recovery in distributed graph processing systems

Proceedings of the VLDB Endowment

Volumn 8, Issue 4, 2014, Pages 437-448

  Shen, Yanyan ^a   Chen, Gang ^b   Jagadish, H V ^c   Lu, Wei ^d   Ooi, Beng Chin ^a   Tudor, Bogdan Marius ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b ZHEJIANG UNIVERSITY   (China)

^c UNIVERSITY OF MICHIGAN   (United States)

^d RENMIN UNIVERSITY OF CHINA   (China)

Author keywords

[No Author keywords available]

Indexed keywords

BIG DATA; GRAPH THEORY; GRAPHIC METHODS;

BIG DATA APPLICATIONS; FAILURE RECOVERY; FAST FAILURE RECOVERY; GRAPH PROCESSING; GRAPH-BASED; NODE FAILURE; PROCESSING SYSTEMS; RECOVERY MECHANISMS; RECOVERY PROCESS; RECOVERY STRATEGIES;

RECOVERY;

EID: 84938782665     PISSN: None     EISSN: 21508097     Source Type: Journal    
DOI: 10.14778/2735496.2735506     Document Type: Conference Paper

References (26)

1. http://giraph.apache.org/.
2. https://hama.apache.org/.
3. A. Abou-Rjeili and G. Karypis. Multilevel algorithms for partitioningpower-law graphs. In IPDPS, pages 124-124, 2006.
4. P. Alvaro, N. Conway, J. M. Hellerstein, and D. Maier. Blazes:Coordination analysis for distributed programs. In ICDE, pages52-63, 2014.
5. J. F. Bartlett. A nonstop kernel. In SOSP, pages 22-19, 1981.
6. A. Borg, J. Baumbach, and S. Glazer. A message system supportingfault tolerance. In SOSP, pages 90-99, 1983.
7. A. Borg, W. Blau, W. Graetsch, F. Herrmann, and W. Oberle. Faulttolerance under unix. In ACM Trans. Comput. Syst., pages 1-24,1989.
8. S. E. Bratsberg, S.-O. Hvasshovd, and O. Torbjørnsen. Location andreplication independent recovery in a highly available database. In BNCOD, pages 23-37, 1997.
9. E. N. M. Elnozahy, L. Alvisi, Y.-M. Wang, and D. B. Johnson. Asurvey of rollback-recovery protocols in message-passing systems. ACM Comput. Surv., 34(3), 2002.
10. J. E. Gonzalez, Y. Low, H. Gu, D. Bickson, and C. Guestrin.Powergraph: Distributed graph-parallel computation on naturalgraphs. In OSDI, pages 17-30, 2012.
11. R. W. Hockney. The communication challenge for mpp: Intelparagon and meiko cs-2. In Parallel Computing, pages 389-398,1994.
12. D. Jiang, G. Chen, B. C. Ooi, K.-L. Tan, and S. Wu. epic: anextensible and scalable system for processing big data. In PVLDB, pages 541-552, 2014.
13. G. Karypis and V. Kumar. Metis - unstructured graph partitioning andsparse matrix ordering system, version 2.0. Technical report, 1995.
14. Z. Khayyat, K. Awara, A. Alonazi, H. Jamjoom, D. Williams, andP. Kalnis. Mizan: a system for dynamic load balancing in large-scalegraph processing. In EuroSys, pages 169-182, 2013.
15. D. LaSalle and G. Karypis. Multi-threaded graph partitioning. InIPDPS, pages 225-236, 2013.
16. F. Li, B. C. Ooi, M. T. Özsu, and S. Wu. Distributed datamanagement using mapreduce. ACM Comput. Surv.,46(3):31:1-31:42, 2014.
17. Y. Low, J. Gonzalez, A. Kyrola, D. Bickson, C. Guestrin, and J. M.Hellerstein. Graphlab: A new parallel framework for machinelearning. In UAI, pages 340-349, 2010.
18. Y. Low, J. Gonzalez, A. Kyrola, D. Bickson, C. Guestrin, and J. M.Hellerstein. Distributed graphlab: A framework for machine learningin the cloud. In PVLDB, pages 716-727, 2012.
19. W. Lu, Y. Shen, S. Chen, and B. C. Ooi. Efficient processing of knearest neighbor joins using mapreduce. In PVLDB, pages1016-1027, 2012.
20. G. Malewicz, M. H. Austern, A. J. C. Bik, J. C. Dehnert, I. Horn,N. Leiser, and G. Czajkowski. Pregel: a system for large-scale graphprocessing. In SIGMOD, pages 135-146, 2010.
21. D. Ongaro, S. M. Rumble, R. Stutsman, J. Ousterhout, andM. Rosenblum. Fast crash recovery in ramcloud. In SOSP, pages29-41, 2011.
22. S. Salihoglu and J. Widom. Gps: a graph processing system. InSSDBM, pages 22:1-22:12, 2013.
23. K. Schloegel, G. Karypis, and V. Kumar. Parallel static and dynamicmulti-constraint graph partitioning. In CCPE, pages 219-240, 2002.
24. B. Shao, H. Wang, and Y. Li. Trinity: A distributed graph engine on amemory cloud. In SIGMOD, pages 505-516, 2013.
25. L. G. Valiant. A bridging model for parallel computation. InCommun. ACM, pages 103-111, 1990.
26. R. S. Xin, J. E. Gonzalez, M. J. Franklin, and I. Stoica. Graphx: aresilient distributed graph system on spark. In GRADES, pages2:1-2:6, 2013.