CEC: Continuous eventual checkpointing for data stream processing operators

Proceedings of the International Conference on Dependable Systems and Networks

Volumn , Issue , 2011, Pages 145-156

  Sebepou, Zoe ^a   Magoutis, Kostas ^a  

^a INSTITUTE OF COMPUTER SCIENCE   (Greece)

Author keywords

Continuous Stream Processing; Fault Tolerance

Indexed keywords

AMOUNT OF INFORMATION; CHECK POINTING; DATA STREAM PROCESSING; DISTRIBUTED FILE SYSTEMS; EXCEPTION HANDLING; LOW OVERHEAD; RECOVERY TIME; STREAM PROCESSING; STREAM PROCESSING SYSTEMS;

COMPUTER SYSTEM RECOVERY; FAULT TOLERANCE; RECOVERY;

DATA HANDLING;

EID: 80051935655     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/DSN.2011.5958214     Document Type: Conference Paper

References (22)

1. IBM Ushers in Era of Stream Computing. IBM Press Report, http://www-03.ibm.com/press/us/en/pressrelease/27508.wss.
2. Kernel Asynchronous I/O for Linux, http://lse.sourceforge.net/io/aio. html.
3. Borealis Application Programmer's Guide, Borealis Team, 2008.
4. D. J. Abadi, D. Carney, U. Cetintemel, M. Cherniack, C. Convey, S. Lee, M. Stonebraker, N. Tatbul, and S. Zdonik. Aurora: A New Model and Architecture for Data Stream Management. The VLDB Journal, 12(2):120-139, 2003. (Pubitemid 37017924)
5. A. Arasu, B. Babcock, S. Babu, J. Cieslewicz, K. Ito, R. Motwani, U. Srivastava, and J. Widom. STREAM: The Stanford Data Stream Management System. Springer, 2004.
6. M. Balazinska, H. Balakrishnan, S. R. Madden, and M. Stonebraker. Fault-Tolerance in the Borealis Distributed Stream Processing System. ACM Transactions on Database Systems, 33(1):1-44, 2008.
7. D. Borthakur. The Hadoop Distributed Fle System: Architecture and Design, The Apache Software Foundation, 2007.
8. Cetintemel, Abadi, Ahmad, Balakrishnan, Balazinska, Cherniack, Hwang, Lindner, Madden, Maskey, Rasin, Ryvkina, Stonebraker, Tatbul, Xing, and Zdonik. The aurora and borealis stream processing engines. In Data Stream Management: Processing High-Speed Data Streams, 2006.
9. C. Drew. Military is Awash in Data from Drones, New York Times, January 10, 2010.
10. E. N. M. Elnozahy, L. Alvisi, Y.-M. Wang, and D. B. Johnson. A survey of rollback-recovery protocols in messagepassing systems. ACM Comput. Surv., 34(3):375-408, 2002.
11. J. Gray. Why Do Computers Stop and What Can be Done About it?, Tandem Technical Report 85-7, 1985.
12. D. Hilley and U. Ramachandran. Persistent temporal streams. In Middleware '09: Proceedings of the 10th ACM/IFIP/USENIX International Conference on Middleware, pages 1-20, New York, NY, USA, 2009.
13. J.-H. Hwang, M. Balazinska, A. Rasin, U. Cetintemel, M. Stonebraker, and S. Zdonik. High-availability algorithms for distributed stream processing. In ICDE '05: Proceedings of the 21st International Conference on Data Engineering, pages 779-790, Washington, DC, USA, 2005. (Pubitemid 41731201)
14. J.-H. Hwang, U. Cetintemel, and S. Zdonik. Fast and highlyavailable stream processing over wide area networks. In ICDE '08: Proceedings of the 2008 IEEE 24th International Conference on Data Engineering, pages 804-813, Washington, DC, USA, 2008.
15. J.-H. Hwang, Y. Zing, U. Cetintemel, and S. Zdonik. A Cooperative Self-Configuring High-Availability Solution for Stream Processing. In ICDE '07: Proceedings of the 2007 IEEE 23th International Conference on Data Engineering, pages 176-185, Istanbul, Turkey, 2007. (Pubitemid 47422021)
16. G. Jacques-Silva, B. Gedik, H. Andrade, K.-L. Wu, Language-level Checkpointing Support for Stream Processing Applications, in Proceedings of 39th IEEE/IFIP International Conference on Dependable Systems and Networks (DSN'2009), Lisbon, Portugal, 2009.
17. Y. Kwon, M. Balazinska, and A. Greenberg. Fault-tolerant Stream Processing Using a Distributed, Replicated Fle System. volume 1, pages 574-585. VLDB Endowment, 2008.
18. M. Ligon and R. Ross. Overview of the Parallel Virtual Fle System. In Proceedings of Extreme Linux Workshop, 1999.
19. F. B. Schneider. Implementing Fault-Tolerant Services Using the State Machine Approach: a Tutorial. ACM Computing Surveys, 22(4):299-319, 1990.
20. Z. Sebepou and K. Magoutis. Scalable Storage Support for Data Stream Processing. In Proceedings of 26th IEEE Conference on Mass Storage Systems and Technologies (MSST 2010), Lake Tahoe, Nevada, May 2010.
21. M. A. Shah, J. M. Hellerstein, and E. Brewer. Highly Available, Fault-Tolerant, Parallel Dataflows. In SIGMOD '04: Proceedings of the 2004 ACM SIGMOD International Conference on Management of Data, New York, NY, 2004.
22. J. Zhou, C. Zhang, H. Tang, J. Wu, T. Yang, "Programming Support and Adaptive Checkpointing for High-Throughput Data Services with Log-Based Recovery", in Proceedings of 40th IEEE/IFIP International Conference on DependableSystems and Networks (DSN'2010), Chicago, IL, 2010.