Improving workflow fault tolerance through provenance-based recovery

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 6809 LNCS, Issue , 2011, Pages 207-224

  Köhler, Sven ^a   Riddle, Sean ^a   Zinn, Daniel ^a   McPhillips, Timothy ^a   Ludäscher, Bertram ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONSISTENT STATE; DATA PROVENANCE; NETWORK FAILURE; PREMATURE TERMINATION; RE-EXECUTION; SCIENTIFIC WORKFLOWS; WORK-FLOW SYSTEMS; WORK-FLOWS; WORKFLOW ENGINES; WORKFLOW EXECUTION; WORKFLOW MODELS;

FAULT TOLERANCE; MANAGEMENT INFORMATION SYSTEMS;

MANAGEMENT;

EID: 79961177656     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-22351-8_12     Document Type: Conference Paper

References (23)

1. Hartman A., Riddle S., McPhillips T., Lud̈ascher B., Eisen J.: Introducing W.A.T.E.R.S.: a Workflow for the Alignment Taxonomy and Ecology of Ribo-somal Sequences. BMC Bioinformatics 11(1), 317 (2010).
2. Ceyhan, E., Allen, G., White, C., Kosar, T.: A grid-enabled workflow system for reservoir uncertainty analysis. In: Proceedings of the 6th Int'l Workshop on Challenges of Large Applications in Distributed Environments, CLADE 2008 (2008)
3. Podhorszki, N., Lud̈ascher, B., Klasky, S.A.: Workflow automation for processing plasma fusion simulation data. In: Proceedings of the 2nd Workshop on Workflows in Support of Large-Scale Science, WORKS 2007, New York, NY, USA, pp. 35-44 (2007) (Pubitemid 47291450)
4. Missier, P., Soiland-Reyes, S., Owen, S., Tan, W., Nenadic, A., Dunlop, I., Williams, A., Oinn, T., Goble, C.: Taverna, reloaded. In: Gertz, M., Lud̈ascher, B. (eds.) SSDBM 2010. LNCS, vol. 6187, pp. 471-481. Springer, Heidelberg (2010)
5. Bowers, S., McPhillips, T., Lud̈ascher, B., Cohen, S., Davidson, S.: A Model for User-Oriented Data Provenance in Pipelined Scientific Workflows. In: Moreau, L., Foster, I. (eds.) IPAW 2006. LNCS, vol. 4145, pp. 133-147. Springer, Heidelberg (2006) (Pubitemid 44577315)
6. Moreau, L., Freire, J., Futrelle, J., McGrath, R., Myers, J., Paulson, P.: The Open Provenance Model: An Overview. In: Freire, J., Koop, D., Moreau, L. (eds.) IPAW 2008. LNCS, vol. 5272, pp. 323-326. Springer, Heidelberg (2008)
7. Frey, J.: Condor DAGMan: Handling inter-job dependencies. Technical report, University of Wisconsin, Dept. of Computer Science (2002)
8. Deelman, E., Blythe, J., Gil, Y., Kesselman, C., Mehta, G., Patil, S., Su, M.-H., Vahi, K., Livny, M.: Pegasus: Mapping Scientific Workflows onto the Grid. In: Dikaiakos, M.D. (ed.) AxGrids 2004. LNCS, vol. 3165, pp. 11-20. Springer, Heidelberg (2004) (Pubitemid 39741759)
9. Hernandez, I., Cole, M.: Reliable DAG scheduling on grids with rewinding and migration. In: Proceedings of the First Int'l Conference on Networks for Grid Applications, GridNets 2007. pp. 3:1-3:8. ICST (2007)
10. Lee, E.A., Messerschmitt, D.G.: Static scheduling of synchronous data flow programs for digital signal processing. IEEE Trans. Comput. 36, 24-35 (1987)
11. Lee, E., Matsikoudis, E.: The semantics of dataflow with firing. In: From Semantics to Computer Science: Essays in Memory of Gilles Kahn. Cambridge University Press, Cambridge (2008)
12. Dou, L., Zinn, D., McPhillips, T., K̈ohler, S., Riddle, S., Bowers, S., Lud̈ascher, B.: Scientific Workflow Design 2.0: Demonstrating Streaming Data Collections in Kepler. In: 27th IEEE Int'l Conference on Data Engineering (2011)
13. Turi, D., Missier, P., Goble, C., De Roure, D., Oinn, T.: Taverna workflows: Syntax and semantics. In: IEEE Int'l Conference on e-Science and Grid Computing, pp. 441-448. IEEE, Los Alamitos (2008)
14. Kosar, T., Livny, M.: Stork: Making data placement a first class citizen in the grid. In: Proceedings of the 24th Int'l Conference on Distributed Computing Systems, 2004, pp. 342-349. IEEE, Los Alamitos (2005)
15. Kahn, G.: The Semantics of a Simple Language for Parallel Programming. In: Information Processing 1974: Proceedings of the IFIP Congress, pp. 471-475. North-Holland, New York (1974)
16. Crawl, D., Altintas, I.: A Provenance-Based Fault Tolerance Mechanism for Scientific Workflows. In: Freire, J., Koop, D., Moreau, L. (eds.) IPAW 2008. LNCS, vol. 5272, pp. 152-159. Springer, Heidelberg (2008)
17. Feng, T., Lee, E.: Real-Time Distributed Discrete-Event Execution with Fault Tolerance. In: Real-Time and Embedded Technology and Applications Symposium, RTAS 2008, pp. 205-214. IEEE, Los Alamitos (2008)
18. Lud̈ascher, B., Podhorszki, N., Altintas, I., Bowers, S., McPhillips, T.: From computation models to models of provenance: the RWS approach. Concurr. Comput.: Pract. Exper. 20, 507-518 (2008) (Pubitemid 351428364)
19. Lud̈ascher, B., Altintas, I., Berkley, C., Higgins, D., Jaeger, E., Jones, M., Lee, E.A., Tao, J., Zhao, Y.: Scientific workflow management and the Kepler system: Research Articles. Concurr. Comput.: Pract. Exper. 18, 1039-1065 (2006) (Pubitemid 44258497)
20. Zhao,Y., Hategan, M.,Clifford,B.,Foster,I.,VonLaszewski,G., Nefedova,V., Raicu, I., Stef-Praun, T., Wilde, M.: Swift: Fast, reliable, loosely coupled parallel computation. In: 2007 IEEE Congress on Services, pp. 199-206. IEEE, Los Alamitos (2007)
21. Wang, L., Lu, S., Fei, X., Chebotko, A., Bryant, H.V., Ram, J.L.: Atomicity and provenance support for pipelined scientific workflows. Future Generation Computer Systems 25(5), 568-576 (2009)
22. Zhou, G.: Dynamic dataflow modeling in Ptolemy II. PhD thesis, University of California (2004)
23. McPhillips, T., McPhillips, S.: RestFlow System and Tutorial (April 2011), https://sites.google.com/site/restflowdocs