A cooperative, self-configuring high-availability solution for stream processing

Proceedings - International Conference on Data Engineering

Volumn , Issue , 2007, Pages 176-185

  Hwang, Jeong Hyon ^a   Xing, Ying ^a   Çetintemel, Uǧur ^a   Zdonik, Stan ^a  

^a Brown University

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SIMULATION; COMPUTER SYSTEM RECOVERY; MATHEMATICAL MODELS; PROBLEM SOLVING; SERVERS;

CHECKPOINT SCHEDULE; DELTA-CHECKPOINTING TECHNIQUES; STREAM PROCESSING;

QUERY PROCESSING;

EID: 34548724425     PISSN: 10844627     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDE.2007.367863     Document Type: Conference Paper

References (24)

1. http://ita.ee.lbl.gov/html/contrib/LBL-TCP-3.html/.
2. D. Abadi, Y. Ahmad, M. Balazinska, U. Cetintemel, M. Chemiack, J.-H. Hwang, W. Lindner, A. Maskey, A. Rasin, E. Ryvkina, N. Tatbul, Y. Xing, and S. Zdonik. The design of the borealis stream processing engine. In Proc. of the 2st CIDR. ACM Press, 2005.
3. D. J. Abadi, D. Carney, U. Çetintemel, M. Chemiack, C. Convey, S. Lee, M. Stonebraker, N. Tatbul, and S. Zdonik. Aurora: A new model and architecture for data stream management. The VLDB Journal, Sep 2003.
4. B. Babcock, S. Babu, M. Datar, R. Motwani, and J. Widom. Models and issues in data stream systems. In Proc. of 2002 ACM PODS, June 2002.
5. M. Balazinska, H. Balakrishnan, S. Madden, and M. Stonebraker. Fault-tolerance in the borealis distributed stream, processing system. In Proc. of the 2005 ACM SIGMOD, June 2005.
6. D. Carney, U. Çetintemel, M. Cherniack, C. Convey, S. Lee, G. Seidman, M. Stonebraker, N. Tatbul, and S. Zdonik. Monitoring streams: A new class of data management applications. In Proc. of the 28th VLDB, Aug. 2002.
7. S. Chandrasekaran, A. Deshpande, M. Franklin, and J. Hellerstein. TelegraphCQ: Continuous dataflow processing for an uncertain world. In Proc. of the 1st CIDR, Jan. 2003.
8. K. M. Chandy and L. Lamport. Distributed snapshots: determining global states of distributed systems. ACM Trans. Comput. Syst., 3(1):63-75, 1985.
9. M. Cherniack, H. Balakrishnan, M. Balazinska, D. Carney, U. Çetintemel, Y. Xing, and S. Zdonik. Scalable distributed stream processing. In Proc. of the 1st CIDR, 2003.
10. E. N. M. Elnozahy, L. Alvisi, Y-M. Wang, and D. B. Johnson. A survey of rollback-recovery protocols in message-passing systems. ACM Comput. Surv., 34(3):375-408, 2002.
11. J. Gray and A. Reuter. Transaction Processing : Concepts and Techniques. Morgan Kaufmann Publishers, 1993.
12. M. Hiscock and S. Gormley. Understanding high availability with websphere mq. An IBM white paper, May 2005.
13. J.-H. Hwang, M. Balazinska, A. Rasin, U. Cetintemel, M. Stonebraker, and S. Zdonik. High-availability algorithms for distributed stream processing. In Proc. of the 21th ICDE, Mar. 2005.
14. J.-H. Hwang, Y. Xing, U. Cetintemel, and S. Zdonik. A cooperative, self-configuring high-availability solution for stream processing. Technical Report CS-06-11, Brown University, 2006.
15. IBM. Ibm. db2 - online documentation, http://www.ibm.com/software/data/ db2/udb/hadr.html.
16. C. Mohan and I. Narang. An efficient and flexible method for archiving a data base. In Proc. of the 1993 ACM SIGMOD, May 1993.
17. M. Otey and D. Otey. Choosing a database for high availability: An analysis of sql server and oracle. A Microsoft white paper, Apr. 2005.
18. A. Ray. Oracle data guard: Ensuring disaster recovery for the enterprise. An Oracle white paper, Mar. 2002.
19. M. A. Shah, J. M. Hellerstein, and E. Brewer. Highly-available, faulttolerant, parallel dataflows. In Proc. of the 2004 ACM SIGMOD, June 2004.
20. M. A. Shah, J. M. Hellerstein, S. Chandrasekaran, and M. J. Franklin. Flux: An adaptive partitioning operator for continuous query systems. In Proc. of the 19th ICDE, Mar. 2003.
21. R. Strom and S. Yemini. Optimistic recovery in distributed systems. ACM Trans. Comput. Syst., 3(3):204-226, 1985.
22. N. Tatbul, U. Cetintemel, S. Zdonik, M. Cherniack, and M. Stonebraker. Load shedding in a data stream manager. In Proc. of the 29th VLDB, Aug. 2003.
23. Y. Xing, J.-H. Hwang, U. Cetintemel, and S. Zdonik. Providing resiliency to load variations in distributed stream processing. In Proc. of the 32th VLDB, Sept. 2006.
24. Y. Xing, S. Zdonik, and J.-H. Hwang. Dynamic load distribution in the borealis stream, processor. In Proc. of the 21th ICDE, Mar. 2005.