Atomicity and provenance support for pipelined scientific workflows

Future Generation Computer Systems

Volumn 25, Issue 5, 2009, Pages 568-576

  Wang, Liqiang ^a   Lu, Shiyong ^b   Fei, Xubo ^b   Chebotko, Artem ^b,d   Victoria Bryant, H ^a   Ram, Jeffrey L ^c  

^a UNIVERSITY OF WYOMING   (United States)

^b Wayne State University   (United States)

^c WAYNE STATE UNIVERSITY   (United States)

^d UNIVERSITY OF TEXAS PAN AMERICAN   (United States)

Author keywords

Atomicity; e Science; Provenance; Scientific workflows; Transaction

Indexed keywords

INFORMATION THEORY; MANAGEMENT; WORK SIMPLIFICATION;

ATOMICITY; E-SCIENCE; PROVENANCE; SCIENTIFIC WORKFLOWS; TRANSACTION;

DATA FLOW ANALYSIS;

EID: 59849084762     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2008.06.007     Document Type: Article

References (51)

1. I. Altintas, O. Barney, E. Jaeger-Frank, Provenance collection support in the Kepler scientific workflow system, in: Proc. of the International Provenance and Annotation Workshop, IPAW, 2006, pp. 118-132
2. P. Bernstein, M. Hsu, B. Mann, Implementing recoverable requests using queues, in: Proc. of the 1990 ACM SIGMOD International Conference on Management of data, 1990, pp. 112-122
3. O. Biton, S.C. Boulakia, S.B. Davidson, C.S. Hara, Querying and managing provenance through user views in scientific workflows, in: Proc. of the International Conference on Data Engineering, ICDE, 2008, pp. 1072-1081
4. Bose R., and Frew J. Lineage retrieval for scientific data processing: A survey. ACM Comput. Surv. 37 1 (2005) 1-28
5. Bowers S., and Ludäscher B. Actor-oriented design of scientific workflows. 24th Intl. Conf. on Conceptual Modeling, ER'05. LNCS vol. 3716 (2005), Springer-Verlag
6. S. Bowers, T. McPhillips, B. Ludäscher, S. Cohen, S.B. Davidson, A model for user-oriented data provenance in pipelined scientific workflows, in: Proc. of the International Provenance and Annotation Workshop, IPAW'06, Chicago, Illinois, USA, May 2006
7. J. Broekstra, A. Kampman, F. van Harmelen, Sesame: A generic architecture for storing and querying RDF and RDF Schema, in: Proc. of the International Semantic Web Conference, ISWC, 2002, pp. 54-68
8. P. Buneman, S. Khanna, W.-C. Tan, Why and where: A characterization of data provenance. Proc. of the International Conference on Database Theory (ICDT), 1973, 2001, pp. 316-330
9. S.P. Callahan, J. Freire, E. Santos, C.E. Scheidegger, C.T. Silva, H.T. Vo, Vistrails: Visualization meets data management, in: Proc. of the SIGMOD International Conference on Management of Data, 2006, pp. 745-747
10. A. Chebotko, C. Lin, X. Fei, Z. Lai, S. Lu, J. Hua, F. Fotouhi, VIEW: A visual sciEntific workflow management system, in: Proc. of the International Workshop on Scientific Workflows, SWF, 2007
11. Churches D., Gombas G., Harrison A., Maassen J., Robinson C., Shields M., Taylor I., and Wang I. Programming scientific and distributed workflow with triana services: Research articles. Concurr. Comput. : Pract. Exper. 18 10 (2006) 1021-1037
12. Cohen S., Boulakia S.C., and Davidson S.B. Towards a model of provenance and user views in scientific workflows. Data Integration in the Life Sciences (2006) 264-279
13. Cui Y., and Widom J. Lineage tracing for general data warehouse transformations. The VLDB Journal (2001) 471-480
14. W. Derks, J. Dehnert, P. Grefen, W. Jonker, Customized atomicity specification for transactional workflows, in: Proceedings of the Third International Symposium on Cooperative Database Systems for Advanced Applications, CODAS'01, 2001, pp. 140-147
15. I. Foster, J. Vöckler, M. Wilde, Y. Zhao, Chimera: A virtual data system for representing, querying, and automating data derivation, in: Proc. of the International Conference on Scientific and Statistical Database Management, SSDBM, 2002, pp. 37-46
16. J. Freire, C.T. Silva, S.P. Callahan, E. Santos, C.E. Scheidegger, H.T. Vo, Managing rapidly-evolving scientific workflows, in: International Provenance and Annotation Workshop, Chicago, Illinois, U.S.A., May 2006, pp. 10-18
17. J.G. Frey, D.D. Roure, K.R. Taylor, J.W. Essex, H.R. Mills, E. Zaluska, CombeChem: A case study in provenance and annotation using the Semantic Web, in: Proc. of the International Provenance and Annotation Workshop, IPAW, 2006, pp. 270-277
18. H. Garcia-Molina, K. Salem, Sagas, in: SIGMOD '87: Proceedings of the 1987 ACM SIGMOD international conference on Management of data, 1987, pp. 249-259
19. Gil Y., Deelman E., Blythe J., Kesselman C., and Tangmunarunkit H. Artificial intelligence and grids: Workflow planning and beyond. IEEE Intelligent Systems 19 1 (2004) 26-33
20. J. Golbeck, Combining provenance with trust in social networks for Semantic Web content filtering, in: Proc. of the International Provenance and Annotation Workshop, IPAW, 2006, pp. 101-108
21. Golbeck J., and Hendler J. A Semantic Web approach to the provenance challenge. Concurr. Comput. : Pract. Exper. 20 5 (2008) 431-439
22. P. Groth, S. Miles, W. Fang, S. Wong, K. Zauner, L. Moreau, Recording and using provenance in a protein compressibility experiment, in: Proceedings of the 14th IEEE International Symposium on High Performance Distributed Computing, HPDC'05, Research Triangle Park, North Carolina, U.S.A., July 2005
23. S. Harris, N. Gibbins, 3store: Efficient bulk RDF storage, in: Proc. of the International Workshop on Practical and Scalable Semantic Systems, PSSS, 2003, pp. 1-15
24. Kim J., Deelman E., Gil Y., Mehta G., and Ratnakar V. Provenance trails in the Wings-Pegasus system. Concurr. Comput. : Pract. Exper. 20 5 (2008) 587-597
25. J. Kim, Y. Gil, V. Ratnakar, Semantic metadata generation for large scientific workflows. In Proc. of the International Semantic Web Conference, ISWC, 2006, pp. 357-370
26. Leymann F., and Roller D. Production Workflow: Concepts and Techniques (2000), Prentice-Hall
27. Cui Lin, Shiyong Lu, Zhaoqiang Lai, Artem Chebotko, Xubo Fei, Jing Hua, Farshad Fotouhi, Service-oriented architecture for VIEW: A visual scientific workflow management system, in: Proc. of the IEEE 2008 International Conference on Services Computing, SCC 2008, Honolulu, Hawaii, USA, July 2008, pp. 335-342
28. B. Ludäscher, Scientific workflows: Cyberinfrastructure for e-science. Pacific Neighborhood Consortium, PNC, Berkeley, October 2007
29. Ludäscher B., Altintas I., Berkley C., Higgins D., Jaeger E., Jones M., Lee E.A., Tao J., and Zhao Y. Scientific workflow management and the Kepler system. Concurr. Comput.: Pract. Exper. 18 10 (2006) 1039-1065
30. Ludäscher B., Altintas I., Berkley C., Higgins D., Jaeger E., Jones M., Lee E.A., Tao J., and Zhao Y. Scientific workflow management and the kepler system: Research articles. Concurr. Comput. : Pract. Exper. 18 10 (2006) 1039-1065
31. Ludäscher B., and Goble C. Guest editor's introduction to the special section on scientific workflows. SIGMOD Record 34 3 (2005) 3-4
32. Miles S., Groth P., Branco M., and Moreau L. The requirements of recording and using provenance in e-science experiments. J. Grid Computing (2006)
33. Oinn T., Greenwood M., Addis M., Alpdemir M.N., Ferris J., Glover K., Goble C., Goderis A., Hull D., Marvin D., Li P., Lord P., Pocock M.R., Senger M., Stevens R., Wipat A., and Wroe C. Taverna: Lessons in creating a workflow environment for the life sciences: Research articles. Concurr. Comput. : Pract. Exper. 18 10 (2006) 1067-1100
34. Oinn T.M., Addis M., Ferris J., Marvin D., Senger M., Greenwood R.M., Carver T., Glover K., Pocock M.R., Wipat A., and Li P. Taverna: A tool for the composition and enactment of bioinformatics workflows. Bioinformatics 20 17 (2004) 3045-3054
35. Ram J., Fei X., Danaher S., Lu S., Breithaupt T., and Hardege J. Finding females: Pheromone-guided reproductive tracking behavior by male Nereis succinea in the marine environment. J. Exp. Biol. 211 5 (2008) 757-765
36. Simmhan Y., Plale B., and Gannon D. A survey of data provenance in e-science. SIGMOD Record 34 3 (Sept.2005) 31-36
37. Y. Simmhan, B. Plale, D. Gannon, A framework for collecting provenance in data-centric scientific workflows, in: Proc. of the IEEE International Conference on Web Services, ICWS'06, Washington, DC, USA, 2006, pp. 427-436
38. Y.L. Simmhan, B. Plale, D. Gannon, A framework for collecting provenance in data-centric scientific workflows, in: Proc. of the IEEE International Conference on Web Services, ICWS'06, Washington, DC, USA, 2006, pp. 427-436
39. Simmhan Y.L., Plale B., and Gannon D. Query capabilities of the Karma provenance framework. Concurr. Comput. : Pract. Exper. 20 5 (2008) 441-451
40. Stevens R., Zhao J., and Goble C. Using provenance to manage knowledge of n silico experiments. Briefings in Bioinformatics 8 3 (2007) 183-194
41. Taylor K.R., Gledhill R.J., Essex J.W., Frey J.G., Harris S.W., and Roure D.D. Bringing chemical data onto the Semantic Web. J. Chem. Inf. Modeling 46 3 (2006) 939-952
42. W3C. OWL Web Ontology Language Reference. W3C Recommendation, 10 February 2004. M. Dean and G. Schreiber (Eds.). Available from: http://www.w3.org/TR/2004/REC-owl-ref-20040210/
43. W3C. Resource Description Framework (RDF): Concepts and Abstract Syntax. W3C Recommendation, 10 February 2004. G. Klyne, J. J. Carroll, and B. McBride (Eds.). 2004. Available from: http://www.w3.org/TR/2004/REC-rdf-concepts-20040210/
44. W3C. SPARQL Query language for RDF. W3C Candidate Recommendation, 15 January 2008. E. Prud'hommeaux and A. Seaborne (Eds.). 2008. Available from: http://www.w3.org/TR/2008/REC-rdf-sparql-query-20080115/
45. Wang L., Lu S., Fei X., and Ram J. A dataflow-oriented atomicity and provenance system for pipelined scientific workflows. Proc. 2nd International Workshop on Workflow Systems in e-Science (WSES 07), in conjunction with International Conference on Computational Science (ICCS) 2007. LNCS (2007), Springer
46. K. Wilkinson, C. Sayers, H. Kuno, D. Reynolds, Efficient RDF storage and retrieval in Jena2, in: Proc. of the International Workshop on Semantic Web and Databases, SWDB, 2003, pp. 131-150
47. Yu J., and Buyya R. A taxonomy of scientific workflow systems for grid computing. SIGMOD Record 34 3 (2005) 44-49
48. Zhao J., Goble C., Stevens R., and Turi D. Mining Taverna's semantic web of provenance. Concurr. Comput. : Pract. Exper. 20 5 (2008) 463-472
49. J. Zhao, C. Wroe, C.A. Goble, R. Stevens, D. Quan, R.M. Greenwood, Using Semantic Web technologies for representing e-science provenance, in: Proc. of the International Semantic Web Conference, ISWC, 2004
50. Y. Zhao, M. Hategan, B. Clifford, I. Foster, G. Laszewski, V. Nefedova, I. Raicu, T. Stef-Praun, M. Wilde, Swift: Fast, reliable, loosely coupled parallel computation. In IEEE International Workshop on Scientific Workflows, SWF 2007, 2007, pp. 199-206
51. Z. Zhao, A. Belloum, C. de Laat, P. Adriaans, B. Hertzberger, Distributed execution of aggregated multi domain workflows using an agent framework, in: Proc. of the International Workshop on Scientific Workflows, SWF, 2007, pp. 183-190