Detouring and replication for fast and reliable Internet-scale stream processing

HPDC 2010 - Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing

Volumn , Issue , 2010, Pages 737-745

  McConnel, Christopher ^a   Ping, Fan ^a   Hwang, Jeong Hyon ^a  

^a State University of New York   (United States)

Author keywords

Availability; Detouring; Fault tolerance; Replication; Stream processing

Indexed keywords

DETOURING; EVALUATION RESULTS; HIGH AVAILABILITY; LOW DEGREE; NETWORK CONGESTIONS; NETWORK FAILURE; REPLICATION; STREAM PROCESSING; SYSTEM CONDITIONS; TIME-CRITICAL APPLICATIONS; VOLUME DATA;

FAULT TOLERANCE; HYDRAULICS; INTERNET;

QUALITY ASSURANCE;

EID: 78650005377     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1851476.1851584     Document Type: Conference Paper

References (21)

1. Y. Ahmad and U.Çetintemel. Network-aware Query Processing for Distributed Stream-based Applications. In Proceedings of the 30th International Conference on Very Large Data Bases (VLDB), pages 456-467, 2004.
2. D. Anderson, H. Balakrishnan, F. Kaashoek, and R. Morris. Resilient Overlay Networks. In Proceedings of the 18th ACM Symposium on Operating System Principles (SOSP), pages 131-145, 2001.
3. B. Babcock, S. Babu, M. Datar, R. Motwani, and J. Widom. Models and Issues in Data Stream Systems. In Proceedings of the 21st ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems (PODS), pages 1-16, 2002.
4. M. Balazinska, H. Balakrishnan, S. Madden, and M. Stonebraker. Fault-Tolerance in the Borealis Distributed Stream Processing System. In Proceedings of the 2005 ACM SIGMOD International Conference on Management of Data, pages 13-24, 2005.
5. D. Carney, U. Çetintemel, M. Cherniack, C. Convey, S. Lee, G. Seidman, M. Stonebraker, N. Tatbul, and S. Zdonik. Monitoring Streams: A New Class of Data Management Applications. In Proceedings of the 28th International Conference on Very Large Data Bases (VLDB), pages 215-226, 2002.
6. S. Chandrasekaran, A. Deshpande, M. Franklin, and J. Hellerstein. TelegraphCQ: Continuous Dataow Processing for an Uncertain World. In Proceedings ofthe 1st Biennial Conference on Innovative Data Systems Research (CIDR), 2003.
7. M. Dahlin, B. B. V. Chandra, L. Gao, and A. Nayate. End-To-End WAN Service Availability. IEEE/ACM Transactions on Networking, 11(2):300-313, 2003.
8. K. P. Gummadi, H. V. Madhyastha, S. D. Gribble, H. M. Levy, and D. Wetherall. Improving the reliability of internet paths with one-hop source routing. In Proceedings of the 3rd Annual USENIX Symposium on Operating Systems Design and Implementation (OSDI), pages 183-198, 2004.
9. S. W. Ho, T. Haddow, J. Ledlie, M. Draief, and P. Pietzuch. Deconstructing internet paths: An approach for as-level detour route discovery. In Proceedings of the 8th International Workshop on Peer-to-Peer Systems (IPTPS), 2009.
10. J.-H. Hwang, M. Balazinska, A. Rasin, U. Çetintemel, M. Stonebraker, and S. Zdonik. High-Availability Algorithms for Distributed Stream Processing. In Proceedings of the 21st International Conference on Data Engineering (ICDE), pages 779-790, 2005.
11. J.-H. Hwang, U. Çetintemel, and S. Zdonik. A Cooperative, Self-Configuring High-Availability Solution for Stream Processing. In Proceedings of the 23rd International Conference on Data Engineering (ICDE), pages 176-185, 2007.
12. J.-H. Hwang, U. Çetintemel, and S. Zdonik. Fast and Highly-Available Stream Processing over Wide Area Networks. In Proceedings of the 24th International Conference on Data Engineering (ICDE), pages 804-813, 2008.
13. J.-H. Hwang, S. Cha, U. Çetintemel, and S. Zdonik. Borealis-R: A Replication-Transparent Stream Processing System for Wide-Area Monitoring Applications. In Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, pages 1303-1306, 2008.
14. Y. Kwon, M. Balazinska, and A. Greenberg. Fault-tolerant Stream Processing using a Distributed, Replicated File System. In Proceedings of the 34th International Conference on Very Large Data Bases (VLDB), pages 574-585, 2008.
15. C. Labovitz, A. Ahuja, and F. Jahanian. Experimental study of internet stability and backbone failures. In Proceedings of the the 29th International Symposium on Fault-Tolerant Computing (FTCS), pages 278-285, 1999.
16. C. Lumezanu, D. Levin, and N. Spring. Peerwise discovery and negotiation of faster paths. In Proceedings of the 6th Workshop on Hot Topics in Networks (HotNets-VI), 2007.
17. V. Paxon. End-to-End Routing Behavior in the Internet. IEEE ACM Transactions on Networking, 5(5):601-615, 1997.
18. P. Pietzuch, J. Ledlie, J. Shneidman, M. Roussopoulos, M. Welsh, and M. Seltzer. Network-Aware Operator Placement for Stream-Processing Systems. In Proceedings of the 22nd International Conference on Data Engineering (ICDE), pages 49-58, 2006.
19. PlanetLab. http://www.planet-lab.org.
20. M. A. Shah, J. M. Hellerstein, and E. Brewer. Highly-Available, Fault-Tolerant, Parallel Dataows. In Proceedings of the 2004 ACM SIGMOD International Conference on Management of Data, pages 827-838, 2004.
21. Y. Xing, J.-H. Hwang, U. Çetintemel, and S. Zdonik. Providing Resiliency to Load Variations in Distributed Stream Processing. In Proceedings of the 32nd International Conference on Very Large Data Bases (VLDB), pages 775-786, 2006.