Fault-tolerance in the borealis distributed stream processing system

ACM Transactions on Database Systems

Volumn 33, Issue 1, 2008, Pages

  Balazinska, Magdalena ^a,c   Balakrishnan, Hari ^b,d   Madden, Samuel R ^b,d   Stonebraker, Michael ^b,d  

^a UNIVERSITY OF WASHINGTON   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^c University of Washington   (United States)

^d MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Availability; Consistency; Distributed stream processing; Fault tolerance

Indexed keywords

DISTRIBUTED STREAM PROCESSING; USER-SPECIFIED BOUND;

COMPUTER SOFTWARE; COMPUTER SYSTEM RECOVERY; FAULT TOLERANCE; NETWORK PROTOCOLS; SECURITY OF DATA;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 41549146660     PISSN: 03625915     EISSN: 15574644     Source Type: Journal    
DOI: 10.1145/1331904.1331907     Document Type: Article

References (48)

1. ABADI, D. J., AHMAD, Y., BALAZINSKA, M., ÇETINTEMEL, U., CHERNIACK, M., HWANG, J.-H., LINDNER, W., MASKEY, A. S., RASIN, A., RYVKINA, E., TATBUL, N., XING, Y., AND ZDONIK, S. 2005. The design of the Borealis stream processing engine. In Proceedings of the 2nd Biennial Conference on Innovative Data Systems Research (CIDR).
2. ABADI, D. J., CARNEY, D., ÇETINTEMEL, U., CHERNIACK, M., CONVEY, C., LEE, S., STONEBRAKER, M., TATBUL, N., AND ZDONIK, S. 2003. Aurora: A new model and architecture for data stream management. VLDS J. 12, 2.
3. ALERI. http://www.aleri.com/index.html.
4. ALONSO, G., GüNTHÖR, R., KAMATH, M., AGRAWAL, D., EL ABBADI, A., AND MOHAN, C. 1995. Exotica/FMDC: Handling disconnected clients in a workflow management system. In Proceedings of the 3rd International Conference on Cooperative Information Systems.
5. ALONSO, G. AND MOHAN, C. 1997. WFMS: The next generation of distributed processing tools. S. Jajodia and L. Kerschberg, Eds. In Advanced Transaction Models and Architectures, Kluwer.
6. ALONSO, G., MOHAN, C., GÜNTHÖR, R., AGRAWAL, D., EL ABBADI, A., AND KAMATH, M. 1995. Exotica/FMQM: A persistent message-based architecture for distributed workflow management. In Proceedings of IFIP WG8.1 Working Conference on Information Systems for Decentralized Organizations.
7. ALONSO, G., REINWALD, B., AND MOHAN, C. 1997. Distributed data management in workflow environments. In Proceedings of the 7th ACMRIDE.
8. BALAKRISHNAN, H., BALAZINSKA, M., CARNEY, D., ÇETINTEMEL, U., CHERNIACK, M., CONVEY, C., GALVEZ, E., SALZ, J., STONEBRAKER, M., TATBUL, N., TIBBETS, R., AND ZDONIK, S. 2004. Retrospective on Aurora. VLDB J. 13, 4.
9. BALAZINSKA, M. 2006. Fault-tolerance and load management in a distributed stream processing system. Ph.D. thesis, Massachusetts Institute of Technology.
10. BALAZINSKA, M., BALAKRISHNAN, H., MADDEN, S., AND STONEBRAKER, M. 2005. Fault-tolerance in the Borealis distributed stream processing system. In Proceedings of the ACM SIGMOD International Conference on Management of Data.
11. BERNSTEIN, P. A., HSU, M., AND MANN, B. 1990. Implementing recoverable requests using queues. In Proceedings of the ACM SIGMOD International Conference on Management of Data.
12. BREWER, E. A. 2001. Lessons from giant-scale services. IEEE Internet Comput. 5, 4, 46-55.
13. CHANDRASEKARAN, S., COOPER, O., DESHPANDE, A., FRANKLIN, M. J., HELLERSTEIN, J. M., HONG, W., KRISHNAMURTHY, S., MADDEN, S., RAMAN, V., REISS, F., AND SHAH, M. 2003. TelegraphCQ: Continuous dataflow processing for an uncertain world. In Proceedings of the 1st Biennial Conference on Innovative Data Systems Research (CIDR).
14. CHERNIACK, M., BALAKRISHNAN, H., BALAZINSKA, M., CARNEY, D., ÇETINTEMEL, U., XING, Y., AND ZDONIK, S. 2003. Scalable distributed stream processing. In Proceedings of the 1st Biennial Conference on Innovative Data Systems Research (CIDR).
15. CORAL8. http://coral8.com/.
16. CRANOR, C., JOHNSON, T., SHKAPENYUK, V., AND SPATSCHECK, O. 2003. Gigascope: A stream database for network applications. In Proceedings of the ACM SIGMOD International Conference on Management of Data.
17. ELNOZAHY, E. N. M., ALVISI, L., WANG, Y.-M., AND JOHNSON, D. B. 2002. A survey of rollback-recovery protocols in message-passing systems. ACM Comput. Surv 34, 3, 375-408.
18. FEKETE, A., GUPTA, D., LUCHANGCO, V., LYNCH, N., AND SHVARTSMAN, A. 1996. Eventually-serializable data services. In Proceedings of the 15th ACM Symposium onPrinciples of Distributed, Computing (PODC'96).
19. GARCIA-MOLINA, H. AND BARBARA, D. 1985. How to assign votes in a distributed system. J. ACM 32, 4, 841-860.
20. GIFFORD, D. K. 1979. Weighted voting for replicated data. In Proceedings of the 7th ACM Symposium on Operating Systems Principles (SOSP).
21. GILBERT, S. AND LYNCH, N. 2002. Brewer's conjecture and the feasibility of consistent, available, partition-tolerant Web services. ACM SIGACT News 33, 2.
22. GRAY, J., HELLAND, P., O'NEIL, P., AND SHASHA, D. 1996. The dangers of replication and a solution. In Proceedings of the ACM SIGMOD International Conference on Management of Data.
23. GRAY, J. AND REUTERS, A. 1993. Transaction Processing: Concepts and Techniques. Morgan Kaufmann.
24. HSU, M. 1995. Special issue on workflow systems. IEEE Data Eng. Bull. 18, 1.
25. HWANG, J.-H., BALAZINSKA, M., RASIN, A., ÇETINTEMEL, U., STONEBRAKER, M., AND ZDONIK, S. 2005. High-availability algorithms for distributed stream processing. In Proceedings of the 21st International Conference on Data Engineering (ICDE).
26. KAMATH, M., ALONSO, G., GUENTHOR, R., AND MOHAN, C. 1996. Providing high availability in very large workflow management systems. In Proceedings of the 5th International Conference on Extending Database Technology.
27. KAO, B. AND GARCIA-MOLINA, H. 1995. An overview of real-time database systems. In Advances in Real-Time Systems. Prentice-Hall.
28. KAWELL, L., BECKHARDT, S., HALVORSEN, T., OZZIE, R., AND GREIF, I. 1988. Replicated document management in a group communication system. In Proceedings of the ACM Conference on Computer-Supported Cooperative Work (CSCW).
29. LAM, K.-W., SON, S. H., HUNG, S.-L., AND WANG, Z. 2000. Scheduling transactions with stringent real-time constraints. Inform. Syst. 25, 6, 431-452.
30. LOMET, D. AND TUTTLE, M. 2003. A theory of redo recovery. In Proceedings of the ACM SIGMOD International Conference on Management of Data.
31. MELLIAR-SMITH, P. M. AND MOSER, L. E. 2004. Progress in real-time fault tolerance. In Proceedings of the 23rd IEEE International Symposium on Reliable Distributed Systems (SRDS'04).
32. MOSSÉ, D., MELHEM, R., AND GHOSH, S. 2003. A nonpreemptive real-time scheduler with recovery from transient faults and its implementation. IEEE Trans. Softw. Engin. 29, 8.
33. MOTWANI, R., WIDOM, J., ARASU, A., BABCOCK, B., BABU, S., DATAR, M., MANKU, G., OLSTON, C., ROSENSTEIN, J., AND VARMA, R. 2003. Query processing, approximation, and resource management in a data stream management system. In Proceedings of the 1st Biennial Conference on Innovative Data Systems Research (CIDR).
34. NAUGHTON ET AL. 2001. The Niagara Internet query system. IEEE Data Engin. Bull. 24, 2.
35. OLSTON, C. 2003. Approximate replication. Ph.D. thesis, Stanford University.
36. OLSTON, C., JIANG, J., AND WIDOM, J. 2003. Adaptive filters for continuous queries over distributed data streams. In Proceedings of the ACM SIGMOD International Conference on Management of Data.
37. RADOSLAVOV, P., GOVINDAN, R., AND ESTRIN, D. 2001. Topology-informed Internet replica placement. In Proceedings of the 6th International Workshop on Web Caching and Content Distribution (WCW'01).
38. RAMAN, V. AND HELLERSTEIN, J. M. 2002. Partial results for online query processing. In Proceedings of the ACM SIGMOD International Conference on Management of Data.
39. SAITO, Y. AND SHAPIRO, M. 2005. Optimistic replication. ACM Comput. Surv. 37, 1, 42-81.
40. SHAH, M., HELLERSTEIN, J., AND BREWER, E. 2004. Highly-available, fault-tolerant, parallel dataflows. In Proceedings of the ACM SIGMOD International Conference on Management of Data.
41. SRIVASTAVA, U. AND WIDOM, J. 2004. Flexible time management in data stream systems. In Proceedings of the 23rd ACM Symposium, on Principles of Database Systems (PODS).
42. STREAMBASE. http://www.streambase.com/.
43. STROM, R. E. 2004. Fault-tolerance in the SMILE stateful publish-subscribe system. In Proceedings of the 3rd International Workshop on Distributed Event-Based Systems (DEBS'04).
44. TANG, X., CHI, H., AND CHANSON, S. T. 2007. Optimal replica placement under TTL-based consistency. IEEE Trans. Parall. Distrib. Syst. 18, 3, 351-363.
45. TERRY, D. B., THEIMER, M., PETERSEN, K., DEMERS, A. J., SPREITZER, M., AND HAUSER, C. 1995. Managing update conflicts in Bayou, a weakly connected replicated storage system. In Proceedings of the 15th ACM Symposium on Operating Systems Principles (SOSP).
46. THE NTP PROJECT. NTP: The Network Time Protocol, http://ww.ntp.org/.
47. TUCKER, P. A. AND MAIER, D. 2003. Dealing with disorder. In Proceedings of the Workshop on Management and Processing of Data Streams (MPDS).
48. URBANO, R. 2003. Oracle Streams Replication Administrator's Guide, 10g Release 1(10.1). Oracle Corporation.