Supporting fault-tolerance in streaming grid applications

IPDPS Miami 2008 - Proceedings of the 22nd IEEE International Parallel and Distributed Processing Symposium, Program and CD-ROM

Volumn , Issue , 2008, Pages

  Zhu, Qian ^a   Chen, Liang ^a   Agrawal, Gagan ^a  

^a The Ohio State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPLICATIONS; BASIC (PROGRAMMING LANGUAGE); COMPUTER NETWORKS; DATA STORAGE EQUIPMENT; DISTRIBUTED PARAMETER NETWORKS; FAULT TOLERANCE; MIDDLEWARE; QUALITY ASSURANCE; RECOVERY; RIVERS;

CHECK-POINTING;

DATA PROCESSING;

EID: 51049112289     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2008.4536296     Document Type: Conference Paper

References (39)

1. David Abramson and Jagan Kommineni. A Flexible IO Scheme for Grid Workflows . In Proceedings of the International Parallel and Distributed Processing Symposium (IPDPS), April 2004.
2. C. Aggarwal, J. Han, J. Wang, and P. Yu. A framework for clustering evolving data streams. In The 29th International Conference on Very Large Data Bases, 2003.
3. Rakesh Agrawal and Ramakrishnan Srikant. Fast algorithms for mining association rules. In Proc. 20th Int. Conf. Very Large Data Bases, VLDB, pages 487-499, 12-15 1994.
4. A. Arasu, S. Babu, and J. Widom. An abstract semantics and concrete language for continuous queries over streams and relations. In Proc. of the 9th International Conference on Data Base Programming Languages (DBPL '03), Sep 2003.
5. Michael D. Beynon, Tahsin Kurc, Alan Sussman, and Joel Saltz. Optimizing execution of component-based applications using group instances. In Proceedings of the Conference on Cluster Computing and the Grid (CCGRID), pages 56-63. IEEE Computer Society Press, May 2001.
6. E. Borovikov, A. Sussman, and L. Davis. A High-Performance Multi-Perspective Vision Studio. In Proceedings of the International Supercomputing Conference (ICS). ACM Press, June 2003.
7. D. Carney, U. Etintemel, M. Cherniak, C. Corvey, S. Lee, G. Seidman, M. Stonebraker, N. Tatbul, and S. Zodnik. Monitoring Streams - A New Class of Data Management Applications. In Proceedings of Conference on Very Large DataBases (VLDB), pages 215-226, 2002.
8. S. Chandrasekaran, O. Cooper, A. Deshpande, M. J. Franklin, J. M. Hellerstein, W. Hong, S. Krishnamurthy, S. R. Madden, V. Raman, F. Reiss, and Mehul A. Shah. Telegraphcq: Continuous dataflow processing for an uncertain world. In CIDR, pages 269-280, 2003.
9. Liang Chen and Gagan Agrawal. Supporting Self-Adaptation in Streaming Data Mining Applications. In Proceedings of the International Parallel and Distributed Processing Symposium (IPDPS). IEEE Computer Society Press, April 2006.
10. Liang Chen, Kolagatla Reddy, and Gagan Agrawal. GATES: A Grid-Based Middleware for Distributed Processing of Data Streams. In Proceedings of IEEE Conference on High Performance Distributed Computing (HPDC). IEEE Computer Society Press, 2004.
11. Liang Chen, Qian Zhu, and Gagan Agrawal. Supporting Dynamic Migration in Tightly Coupled Grid Applications. In Proceedings of SC 2006. IEEE Computer Society Press, November 2006.
12. M. Cherniack, H. Balakrishnan, M. Balazinska, D. Carney, U. Cetintemel, Y. Zing, and S. Zdonik. Scalable Distributed Stream Processing. In Proceedings of the Conference on Innovative Data Systems Research (CIDR), January 2003.
13. Ewa Deelman, Jim Blythe, Yolanda Gil, Carl Kesselman, Gaurang Mehta, Karan Vahi, Albert Lazzarini, Adam Arbree, Richard Cavanaugh, and Scott Koranda. Mapping Abstract Complex Workflows onto Grid Environments. In Journal of Grid Computing, pages 9-23, 2003.
14. P. Dokas, L. Ertoz, V. Kumar, A. Lazarevic, J. Srivastava, and P. Tan. Data Mining for Network Intrusion Detection . In Proc. of the NSF Workshop on Next Generation Data Mining, November 2002.
15. E.W.Dijkstra. A note on two problems in connexion with graphs. Numerische Mathematik, 1, 1959.
16. G.Bronevetsky, D.Marques, K.Pingali, and P.Stodghill. Automated application-level checkpointing of mpi programs. In Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP 2003), pages 84-94, Oct. 2003.
17. G.Bronevetsky, D.Marques, M.Schulz, P.Szwed, and K.Pingali. Application-level checkpointing for shared memory programs. In Proceedings of the 8th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 2004), pages 235-247, Oct. 2004.
18. G.Bronevetsky, K.Pingali, and P.Stodghill. Experimental evaluation of application-level checkpointing for openmp programs. In Proceedings of the 20th International Conference on SuperComputing (SC 2006), pages 2-13, Dec. 2006.
19. Phillip B. Gibbons and Yossi Matias. New Sampling-Based Summary Statistics for Improving Approximate Query Answers. In Proc. of the 1998 ACM SIGMOD, pages 331-342. ACM Press, June 1998.
20. L. Golab and M. Ozsu. Issues in data stream management. In SIGMOD Record, Vol. 32, No. 2, pages 5-14, June 2003.
21. J.Apostolopoulos, T.Wong, W.T.Tan, and S.Wee. On multiple description streaming with content delivery networks. In Proceedings of the 21st Annual Joint Conference of the IEEE Computer and Communications Societies(Infocom02), pages 1736-1745, June 2002.
22. J.H.Abawajy. Fault-tolerant scheduling policy for grid computing systems. In Proceedings of the 18th International Parallel and Distributed Processing Symposium (IPDPS), pages 238-245, April 2004.
23. J.H.Hwang, M.Balazinska, A.Rasin, U.Cetintemel, M.Stonebraker, and S.Zdonik. High-availability algorithms for distributed stream processing. In Proceedings of the 21st International Conference on Data Engineering (ICDE 2005), pages 779-790, April 2005.
24. J.Kangasharju, J.Roberts, and K.Ross. Object replication strategies in content distribution networks. Computer Communications, 25, 2002.
25. L.Cherkasova and J.Lee. Fastreplica: Efficient large file distribution within content delivery networks. In Proceedings of the 4th Usenix Symposium on Internet Technologies and Systems(USITS03), March 2003.
26. L.Kontothanassis, R.Sitaraman, J.Wein, D.Hong, R.Kleinberg, B.Mancuso, D.Shaw, and D.Stodolsky. A transport layer for live streaming in a content delivery network. Proceedings of IEEE, 92, 2004.
27. Amit Manjhi, Vladislav Shkapenyuk, Kedar Dhamdhere, and Christopher Olston. Finding (recently) frequent items in distributed data streams. In The 21st International Conference on Data Engineering, 2005.
28. Daniel Marques, Greg Bronevetsky, Rohit Fernandes, Keshav Pingali, and Paul Stodghill. Optimizing checkpoint size in the c3 system. In Proceedings of the 19th International Parallel and Distributed Processing Symposium (IPDPS), April 2005.
29. M.Balazinska, H.Balakrishnan, S. Madden, and M.Stonebraker. Fault-tolerance in the borealis distributed stream processing system. In Proceedings of the 2005 ACM SIGMOD International Conference on Management of Data, pages 13-24, June 2005.
30. M.Castro, P.Druschel, Y. Hu, and A. Rowstron. Topology-aware routing in structured peer-to-peer overlay networks. In Technical Report, Microsoft Research, 2002.
31. M.Litzkow and M.Solomon. Supporting checkpointing and process migration outside the Unix kernel. Usenix Winter Conference, 1992.
32. Beth Plale. Leveraging Runtime Knowledge about Event Rates to Improve Memory Utilization in Wide Area Data Stream Filtering. In IEEE High Performance Distributed Computing (HPDC), August 2002.
33. Beth Plale and Karsten Schwan. Dynamic Querying of Streaming Data with the dQUOB System. IEEE Transactions on Parallel and Distributed Systems, 14(3), April 2003.
34. R.Murty and M.Welsh. Towards a dependable architecture for internet-scale sensing. In Proceedings of the 2nd Workshop on Hot Topics in Dependability (HotDep06), Nov. 2006.
35. R.Wolski, N.T.Spring, and Jim Hayes. The network weather service: A distributed resource performance forecasting service for metacomputing. Future Generation Computer Systems, 15, 1999.
36. T.Tsuchiya, Y.Kakuda, and T. Kikuno. Fault-tolerant scheduling algorithm for distributed real-time systems. In Proceedings of the 3rd Workshop on Parallel and Distributed Real-Time Systems (WPDRTS 95), pages 99-103, April 1995.
37. S. Viglas and J. Naughton. Rate-based query optimization for streaming information sources. In Proc. of the 2002 ACM SIGMOD Intl. Conf. on Management of Data, June 2002.
38. X. Zhang, D. Zagorodnov, M. Hiltunen, K. Marzullo, and R. Schlichting. Fault-tolerant grid services using primary-backup: Feasibility and performance. In Proceedings of the 2004 IEEE International Conference on Cluster Computing, pages 105-114, September 2004.
39. Gengbin Zheng, Lixia Shi, and Laxmikant V.Kale. Ftc-charm++: An in-memory checkpoint-based fault tolerant runtime for charm++ and mpi. In Proceedings of the 2004 IEEE International Conference on Cluster Computing, pages 93-103, September 2004.