Fault tolerant clustering in scientific workflows

Proceedings - 2012 IEEE 8th World Congress on Services, SERVICES 2012

Volumn , Issue , 2012, Pages 9-16

  Chen, Weiwei ^a   Deelman, Ewa ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

clustering; fault tolerance; task failure; workflow

Indexed keywords

CLUSTERING; COMPUTATIONAL GRANULARITY; DISTRIBUTED RESOURCES; DYNAMIC ENVIRONMENTS; FAILURE MODEL; FAULT-TOLERANT; MAKESPAN; MODELING FRAMEWORKS; MULTIPLE TASKS; PERFORMANCE ISSUES; RUNTIME PERFORMANCE; SCIENTIFIC WORKFLOWS; SIGNIFICANT IMPACTS; THEORETIC ANALYSIS; WORK-FLOWS; WORKFLOW;

SCHEDULING ALGORITHMS;

FAULT TOLERANCE;

EID: 84867256440     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SERVICES.2012.5     Document Type: Conference Paper

References (19)

1. G. B. Berriman, etc., "Montage: A Grid Enabled Engine for Delivering Custom Science-Grade Mosaics On Demand," presented at SPIE Conference 5487: Astronomical Telescopes, 2004.
2. G. Singh, et al., Workflow Task Clustering for Best Effort Systems with Pegasus, Mardi Gras Conference, Baton Rouge, LA, Jan 2008.
3. C. Catlett, et al., The philosophy of TeraGrid: building an open, extensible, distributed TeraScale facility, CCGRID2002, 2002.
4. Amazon.com, "Elastic Compute Cloud (EC2)"; http://aws.amazon. com/ec2.
5. Y. Zhang, etc., Performance Implications of Failures in Large-Scale Cluster Scheduling, In 10th Workshop on Job Scheduling Strategies for Parallel Processing, June 2004.
6. Rodrigo N. Calheiros, et al., CloudSim: A Toolkit for Modeling and Simulation of Cloud Computing Environments and Evaluation of Resource Provisioning Algorithms, Software: Practice and Experience, Volume 41, Number 1, Pages: 23-50, ISSN: 0038-0644, Wiley Press, New York, USA, January 2011.
7. E. Deelman, et al., Pegasus: Mapping scientific workflows onto the Grid. Lecture Notes in Computer Science: Grid Computing, pp. 11-20, 2004
8. J. Blythe,S. Jain,E. Deelman, et al. Task Scheduling Strategies for Workflow-Based Applications in Grids. CCGrid, 2005.
9. G.C. Sih and E.A. Lee. A Compile-Time Scheduling Heuristic for Interconnection Constrained Heterogeneous Processor Architecture. IEEE Transactions on Parallel and Distributed Systems, 4(2), pp. 175-187, 1993.
10. Quan Liu, Yeqing Liao, Grouping-based Fine-grained Job Scheduling in Grid Computing, First International Workshop on Education Technology and Computer Science, 2009.
11. Nithiapidary Muthuvelu, et. al., A Dynamic Job Grouping-Based Scheduling for Deploying Applications with Fine-Grained Tasks on Global Grids, AusGrid 2005, newcastle, Australia.
12. Dong Tang, et al., Failure Analysis and Modeling of a VAXcluster System, FTCS-20, 1990.
13. B. Schroeder, et al., A large-scale study of failures in high-performance computing systems, DSN 2006, Philadelphia, PA, USA, Jun 2006.
14. R. K. Sahoo, et al., Failure Data Analysis of a Large-Scale Heterogeneous Server Environment, DSN 2004, Florence, Italy, Jul 2004.
15. David Oppenheimer, et al., Why do Internet services fail, and what can be done about it?, USITS'03, Seattle, USA, Mar 2003.
16. S.R. McConnel, D.P. Siewiorek, and M.M. Tsao, "The Measurement and Analysis of Transient Errors in Digital Compute Systems,'' Proc. 9th Int. Symp. Fault-Tolerant Computing, pp. 67-70, 1979.
17. Weiwei Chen, Ewa Deelman, Workflow Overhead Analysis and Optimizations, The 6th Workshop on Workflows in Support of Large-Scale Science, Seattle, USA, Nov 2011.
18. Taghrid Samak, et al., Failure Prediction and Localization in Large Scientific Workflows, The 6th Workshop on Workflows in Suppporting of Large-Scale Science, Seattle, USA, Nov 2011
19. Anne Benoit, et al., On the complexity of task graph scheduling with transient and fail-stop failures, Research report, LIP, Jan 2010