Low-overhead fault tolerance for high-throughput data processing systems

Proceedings - International Conference on Distributed Computing Systems

Volumn , Issue , 2011, Pages 689-699

  Martin, André ^a   Knauth, Thomas ^a   Creutz, Stephan ^a   Becker, Diogo ^a   Weigert, Stefan ^a   Fetzer, Christof ^a   Brito, Andrey ^b  

^a DRESDEN UNIVERSITY OF TECHNOLOGY   (Germany)

^b FEDERAL UNIVERSITY OF CAMPINA GRANDE   (Brazil)

Author keywords

[No Author keywords available]

Indexed keywords

COMMUNICATION TECHNIQUES; DATA PROCESSING SYSTEMS; DETERMINISTIC EXECUTION; FAULT TOLERANCE MECHANISMS; HIGH-THROUGHPUT DATA; INTERMEDIATE RESULTS; JOB COMPLETION; KEY FEATURE; MAP-REDUCE; PROGRAMMING PARADIGMS; VIRTUAL SYNCHRONY;

DATA HANDLING; DISTRIBUTED COMPUTER SYSTEMS; FAULT TOLERANT COMPUTER SYSTEMS;

FAULT TOLERANCE;

EID: 80051907648     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDCS.2011.29     Document Type: Conference Paper

References (21)

1. J. Dean and S. Ghemawat, "MapReduce: simplified data processing on large clusters, " Commun. ACM, vol. 51, no. 1, pp. 107-113, 2008.
2. "Hadoop, " http://hadoop.apache.org/, March 2011.
3. F. B. Schneider, "Implementing fault-tolerant services using the state machine approach: A tutorial, " ACM Computing Surveys, vol. 22, pp. 299-319, 1990.
4. E. N. M. Elnozahy, L. Alvisi, Y.-M. Wang, and D. B. Johnson, "A survey of rollback-recovery protocols in message-passing systems, " ACM Comput. Surv., vol. 34, no. 3, pp. 375-408, 2002.
5. K. Birman and T. Joseph, "Exploiting virtual synchrony in distributed systems, " in Proceedings of the eleventh ACM Symposium on Operating systems principles, ser. SOSP'87. New York, NY, USA: ACM, 1987, pp. 123-138.
6. M. K. Aguilera and R. E. Strom, "Efficient atomic broadcast using deterministic merge, " in PODC'00: Proceedings of the nineteenth annual ACM symposium on Principles of distributed computing. New York, NY, USA: ACM, 2000, pp. 209-218.
7. http://www.nsf.gov/pubs/2008/nsf08560/nsf08560.htm, March 2011.
8. T. Condie, N. Conway, P. Alvaro, J. M. Hellerstein, K. Elmeleegy, and R. Sears, "MapReduce online, " in NSDI'10: Proceedings of the 7th USENIX conference on Networked systems design and implementation. Berkeley, CA, USA: USENIX Association, 2010, pp. 21-21.
9. E. N. M. Elnozahy, L. Alvisi, Y.-M. Wang, and D. B. Johnson, "A survey of rollback-recovery protocols in message-passing systems, " ACM Comput. Surv., vol. 34, no. 3, pp. 375-408, 2002.
10. A. Brito, C. Fetzer, and P. Felber, "Minimizing Latency in Fault-Tolerant Distributed Stream Processing Systems, " in ICDCS'09: Proceedings of the 2009 29th IEEE International Conference on Distributed Computing Systems. Washington, DC, USA: IEEE Computer Society, 2009, pp. 173-182.
11. M. K. Aguilera and R. E. Strom, "Efficient atomic broadcast using deterministic merge, " in PODC'00. New York, NY, USA: ACM, 2000, pp. 209-218.
12. R. Strom, C. Dorai, T. Feng, and Z. Wei, "Deterministic Replay for Transparent Recovery in Component-Oriented Middleware, " in 2009 29th IEEE International Conference on Distributed Computing Systems. Washington, DC, USA: IEEE Computer Society, 2009, pp. 615-622.
13. R. Jiménez-Peris, M. Patiño-Martínez, and S. Arévalo, "Deterministic scheduling for transactional multithreaded replicas, " Reliable Distributed Systems, IEEE Symposium on, vol. 0, p. 164, 2000.
14. C. Basile, Z. Kalbarczyk, and R. K. Iyer, "Active replication of multithreaded applications, " IEEE Trans. Parallel Distrib. Syst., vol. 17, no. 5, pp. 448-465, 2006.
15. A. Brito, C. Fetzer, and P. Felber, "Multithreading-enabled active replication for event stream processing operators, " in The 28th International Symposium on Reliable Distributed Systems. Los Alamitos, CA, USA: IEEE Computer Society, September 2009, pp. 22-31.
16. V. Gulisano, R. Jimenez-Peris, M. Patino-Martinez, and P. Valduriez, "Streamcloud: A large scale data streaming system, " in Proceedings of the 2010 IEEE 30th International Conference on Distributed Computing Systems, ser. ICDCS'10. Washington, DC, USA: IEEE Computer Society, 2010, pp. 126-137.
17. T. Bergan, N. Hunt, L. Ceze, and S. D. Gribble, "Deterministic process groups in dos, " in Proceedings of the 9th USENIX conference on Operating systems design and implementation, ser. OSDI'10. Berkeley, CA, USA: USENIX Association, 2010, pp. 1-16.
18. A. Aviram, S.-C.Weng, S. Hu, and B. Ford, "Efficient system-enforced deterministic parallelism, " in Proceedings of the 9th USENIX conference on Operating systems design and implementation, ser. OSDI'10. Berkeley, CA, USA: USENIX Association, 2010, pp. 1-16.
19. H. Cui, J. Wu, C.-C. Tsai, and J. Yang, "Stable deterministic multithreading through schedule memoization, " in Proceedings of the 9th USENIX conference on Operating systems design and implementation, ser. OSDI'10. Berkeley, CA, USA: USENIX Association, 2010, pp. 1-13.
20. D. Peng and F. Dabek, "Large-scale incremental processing using distributed transactions and notifications, " in Proceedings of the 9th USENIX Symposium on Operating Systems Design and Implementation. Berkeley, CA, USA: USENIX Association, 2010.
21. L. Neumeyer, B. Robbins, A. Nair, and A. Kesari, "S4: Distributed stream computing platform, " Data Mining Workshops, International Conference on, vol. 0, pp. 170-177, 2010.