Active replication at (almost) no cost

Proceedings of the IEEE Symposium on Reliable Distributed Systems

Volumn , Issue , 2011, Pages 21-30

  Martin, André ^a   Fetzer, Christof ^a   Brito, Andrey ^b  

^a DRESDEN UNIVERSITY OF TECHNOLOGY   (Germany)

^b FEDERAL UNIVERSITY OF CAMPINA GRANDE   (Brazil)

Author keywords

active replication; energy efficiency; fault tolerance; mapreduce

Indexed keywords

ACTIVE REPLICATION; AMAZON EC2; BATCH PROCESSING SYSTEM; CLOUD PROVIDERS; COMPUTATIONAL RESOURCES; CPU CYCLES; CPU UTILIZATION; DISTRIBUTED APPLICATIONS; EVENT STREAMS; IS COSTS; LARGE CLUSTERS; LOAD VARIATIONS; LOW LATENCY; MAP-REDUCE; NOVEL APPLICATIONS; ONLINE DATA; PERFORMANCE DEGRADATION; PRIVATE DATA; PROGRAMMING PARADIGMS; RECENT TRENDS; TOLERANCE APPROACH;

BATCH DATA PROCESSING; COST EFFECTIVENESS; ENERGY EFFICIENCY; FAULT TOLERANT COMPUTER SYSTEMS;

FAULT TOLERANCE;

EID: 83155189012     PISSN: 10609857     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SRDS.2011.12     Document Type: Conference Paper

References (18)

1. J. Dean and S. Ghemawat, "MapReduce: simplified data processing on large clusters," Commun. ACM, vol. 51, no. 1, pp. 107-113, 2008.
2. B. Babcock, S. Babu, M. Datar, R. Motwani, and J. Widow, "Model and issues in data stream systems," in Proceedings of the twenty-first ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems (PODS'02). Madison, USA: ACM Press, New York, NY, June 2002, pp. 1-16.
3. J. Hyde, "Data in flight," Queue, vol. 7, pp. 20:20-20:26, December 2009. [Online]. Available: http://doi.acm.org/10.1145/1661785.1667562
4. C. Millsap, "Thinking Clearly about Performance," Queue, vol. 8, no. 9, pp. 10-20, 2010.
5. F. B. Schneider, "Implementing fault-tolerant services using the state machine approach: A tutorial," ACM Computing Surveys, vol. 22, pp. 299-319, 1990.
6. A. Brito, A. Martin, D. Becker de Brum, S. Weigert, S. Creutz, T. Knauth, and C. Fetzer, "Scalable and Low-Latency Data Processing with StreamMapReduce," 2011, technical report - available at http://www.lsd.ufcg.edu.br/~andrey/smr2011.pdf.
7. E. N. M. Elnozahy, L. Alvisi, Y.-M. Wang, and D. B. Johnson, "A survey of rollback-recovery protocols in message-passing systems," ACM Comput. Surv., vol. 34, no. 3, pp. 375-408, 2002.
8. L. Neumeyer, B. Robbins, A. Nair, and A. Kesari, "S4: Distributed stream computing platform," in ICDM Workshops, 2010, pp. 170-177.
9. M. K. Aguilera and R. E. Strom, "Efficient atomic broadcast using deterministic merge," in PODC '00: Proceedings of the nineteenth annual ACM symposium on Principles of distributed computing. New York, NY, USA: ACM, 2000, pp. 209-218.
10. G. Copeland and T. Keller, "A comparison of highavailability media recovery techniques," SIGMOD Rec., vol. 18, pp. 98-109, June 1989. [Online]. Available: http://doi.acm.org/10.1145/66926.66936
11. "Hadoop," http://hadoop.apache.org/, March 2011.
12. M. A. Shah, J. M. Hellerstein, S. Chandrasekaran, and M. J. Franklin, "Flux: An Adaptive Partitioning Operator for Continuous Query Systems," Data Engineering, International Conference on, vol. 0, p. 25, 2003.
13. A. Martin, T. Knauth, S. Creutz, D. B. de Brum, S. Weigert, A. Brito, and C. Fetzer, "Low-overhead fault tolerance for high-throughput data processing systems," in ICDCS '11: Proceedings of the 2011 31st IEEE International Conference on Distributed Computing Systems. Los Alamitos, CA, USA: IEEE Computer Society, June 2011, pp. 689-699.
14. M. A. Shah, J. M. Hellerstein, and E. Brewer, "Highly available, fault-tolerant, parallel dataflows," in SIGMOD '04: Proceedings of the 2004 ACM SIGMOD international conference on Management of data. New York, NY, USA: ACM, 2004, pp. 827-838.
15. J.-H. Hwang, M. Balazinska, A. Rasin, U. Cetintemel, M. Stonebraker, and S. Zdonik, "High-availability algorithms for distributed stream processing," in ICDE '05: Proceedings of the 21st International Conference on Data Engineering. Washington, DC, USA: IEEE Computer Society, 2005, pp. 779-790.
16. A. Brito, C. Fetzer, and P. Felber, "Multithreading-enabled active replication for event stream processing operators," in Proceedings of the 28th International Symposium on Reliable Distributed Systems. Los Alamitos, CA, USA: IEEE Computer Society, September 2009, pp. 22-31.
17. R. Jiménez-Peris, M. Patiño-Martínez, and S. Arévalo, "Deterministic scheduling for transactional multithreaded replicas,"in Proceedings of the 19th IEEE Symposium on Reliable Distributed Systems, vol. 0. Los Alamitos, CA, USA: IEEE Computer Society, 2000, pp. 164-173.
18. Z. Zhang, Y. Gu, F. Ye, H. Yang, M. Kim, H. Lei, and Z. Liu, "A Hybrid Approach to High Availability in Stream Processing Systems," Distributed Computing Systems, International Conference on, vol. 0, pp. 138-148, 2010.