Provenance and scientific workflows: Challenges and opportunities

Proceedings of the ACM SIGMOD International Conference on Management of Data

Volumn , Issue , 2008, Pages 1345-1350

  Davidson, Susan B ^a   Freire, Juliana ^b  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b UNIVERSITY OF UTAH   (United States)

Author keywords

Provenance; Scientific workflows

Indexed keywords

DATABASE RESEARCHES; EMERGING APPLICATIONS; ESSENTIAL COMPONENTS; EXISTING SYSTEMS; OPEN PROBLEMS; PROTOTYPE SYSTEMS; PROVENANCE; REPRODUCIBILITY; RESEARCH ISSUES; RESEARCH PROJECTS; SCIENTIFIC COMMUNITIES; SCIENTIFIC DATUMS; SCIENTIFIC WORKFLOWS; WORKFLOWS;

KNOWLEDGE BASED SYSTEMS; PROJECT MANAGEMENT;

DATABASE SYSTEMS;

EID: 57149126952     PISSN: 07308078     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1376616.1376772     Document Type: Conference Paper

References (46)

1. W. Aalst and K. Hee. Workflow Management: Models, Methods, and Systems. MIT Press, 2002.
2. I. Altintas, O. Barney, and E. Jaeger-Frank. Provenance collection support in the kepler scientific workflow system. In Proceedings of the International Provenance and Annotation Workshop (IPAW), pages 118-132, 2006.
3. R. S. Barga and L. A. Digiampietri. Automatic capture and efficient storage of escience experiment provenance. Concurrency and Computation: Practice and Experience, 20(5):419-429, 2008.
4. C. Beeri, A. Eyal, S. Kamenkovich, and T. Milo. Querying business processes. In VLDB, pages 343-354, 2006.
5. O. Biton, S. Cohen-Boulakia, S. Davidson, and C. Hara. Querying and managing provenance through user views in scientific workflows. In Proceedings of ICDE, 2008. To appear.
6. R. Bose, I. Foster, and L. Moreau. Report on the International Provenance and Annotation Workshop. SIGMOD Rec., 35(3):51-53, 2006.
7. R. Bose and J. Frew. Lineage retrieval for scientific data processing: a survey. ACM Computing Surveys, 37(1):1-28, 2005.
8. S. Bowers, T. McPhillips, and B. Ludaescher. A provenance model for collection-oriented scientific workflows. Concurrency and Computation: Practice and Experience, 20(5):519-529, 2008.
9. Business Process Execution Language for Web Services. http://www.ibm.com/developerworks/library/specification/wsbpel/.
10. P. Buneman and W.Tan. Provenance in databases. In Proceedings of ACM SIGMOD, pages 1171 -1173, 2007.
11. B. Clifford, I. Foster, M. Hategan, T. Stef-Praun, M. Wilde, and Y. Zhao. Tracking provenance in a virtual data grid. Concurrency and Computation: Practice and Experience, 20(5):565-575, 2008.
12. S. Cohen, S. C. Boulakia, and S. B. Davidson. Towards a model of provenance and user views in scientific workflows. In DILS, pages 264-279, 2006.
13. S. Cohen-Boulakia, O. Biton, S. Cohen, and S. Davidson. Addressing the provenance challenge using zoom. Concurrency and Computation: Practice and Experience, 20(5):497-506, 2008.
14. S. B. Davidson, S. C. Boulakia, A. Eyal, B. Ludäscher, T. M. McPhillips, S. Bowers, M. K. Anand, and J. Freire. Provenance in scientific workflow systems. IEEE Data Eng. Bull., 30(4):44-50, 2007.
15. E. Deelman and Y. Gil. NSF Workshop on Challenges of Scientific Workflows. Technical report, NSF, 2006. http://vtcpc.isi.edu/wiki/index.php/ Main-Page.
16. E. Deelman, G. Singh, M.-H. Su, J. Blythe, Y. Gil, C. Kesselman, G. Mehta, K. Vahi, G. B. Berriman, J. Good, A. Laity, J. C. Jacob, and D. S. Katz. Pegasus: a Framework for Mapping Complex Scientific Workflows onto Distributed Systems. Scientific Programming Journal, 13(3):219-237, 2005.
17. I. Foster, J. Voeckler, M. Wilde, and Y. Zhao. Chimera: A virtual data system for representing, querying and automating data derivation. In Proceedings of SSDBM, pages 37-46, 2002.
18. J. Freire, D. Koop, E. Santos, and C. Silva. Provenance for computational tasks: A survey. Computing in Science & Engineering, 10(3), May/June 2008. To appear.
19. J. Freire and C. Silva. Towards enabling social analysis of scientific data. In CHI Social Data Analysis Workshop, 2008. To appear.
20. J. Freire, C. T. Silva, S. P. Callahan, E. Santos, C. E. Scheidegger, and H. T. Vo. Managing rapidly-evolving scientific workflows. In International Provenance and Annotation Workshop (IPAW), LNCS 4145, pages 10-18, 2006. Invited paper.
21. D. Gannon et al. A Workshop on Scientific and Scholarly Workflow Cyberinfrastructure: Improving Interoperability, Sustainability and Platform Convergence in Scientific And Scholarly Workflow. Technical report, NSF and Mellon Foundation, 2007. https://spaces.internet2.edu/display/SciSchWorkflow.
22. J. Golbeck and J. Hendler. A semantic web approach to tracking provenance in scientific workflows. Concurrency and Computation: Practice and Experience, 20(5):431-439, 2008.
23. L. Haas. Information for people. http://www.almaden.ibm.com/cs/people/ laura/Information For People keynote.pdf, 2007. Keynote talk at ICDE.
24. H. V. Jagadish. Making database systems usable. http://www.eecs.umich. edu/db/usable/ usability-sigmod.ppt, 2007. Keynote talk at SIGMOD.
25. The Kepler Project, http://kepler-project.org.
26. J. Kim, E. Deelman, Y. Gil, G. Mehta, and V. Ratnakar. Provenance trails in the wings/pegasus system. Concurrency and Computation: Practice and Experience, 20(5):587-597, 2008.
27. Microsoft Workflow Foundation. http://msdn2.microsoft.com/en-us/ netframework/aa663322.aspx.
28. S. Miles, P. Groth, S. Munroe, S. Jiang, T. Assandri, and L. Moreau. Extracting Causal Graphs from an Open Provenance Data Model. Concurrency and Computation: Practice and Experience, 20(5):577-586, 2008.
29. L. Moreau and I. Foster, editors. Provenance and Annotation of Data - International Provenance and Annotation Workshop, volume 4145. Springer-Verlag, 2006.
30. L. Moreau, J. Freire, J. Futrelle, R. McGrath, J. Myers, and P. Paulson. The open provenance model, December 2007. http://eprints.ecs.soton.ac.uk/14979.
31. S. G. Parker and C. R. Johnson. SCIRun: a scientific programming environment for computational steering. In Supercomputing, page 52, 1995.
32. First provenance challenge. http://twiki.ipaw.info/bin/view/Challenge/ FirstProvenanceChallenge, 2006. S. Miles, and L. Moreau (organizers).
33. Second provenance challenge. http://twiki.ipaw.info/bin/view/Challenge/ SecondProvenanceChallenge, 2007. J. Freire, S. Miles, and L. Moreau (organizers).
34. C. Scheidegger, D. Koop, H. Vo, J. Freire, and C. Silva. Querying and creating visualizations by analogy. IEEE Transactions on Visualization and Computer Graphics, 13(6):1560-1567, 2007. Papers from the IEEE Information Visualization Conference 2007.
35. C. Silva, J. Freire, and S. P. Callahan. Provenance for visualizations: Reproducibility and beyond. Computing in Science & Engineering, 9(5):82-89, 2007.
36. Y. L. Simmhan, B. Plale, and D. Gannon. A survey of data provenance in e-science. SIGMOD Record, 34(3):31-36, 2005.
37. Y. L. Simmhan, B. Plale, and D. Gannon. Karma2: Provenance management for data driven workflows. International Journal of Web Services Research, Idea Group Publishing, 5:1, 2008. To Appear.
38. Y. L. Simmhan, B. Plale, D. Gannon, and S. Marru. Performance evaluation of the karma provenance framework for scientific workflows. In L. Moreau and I. T. Foster, editors, International Provenance and Annotation Workshop (IPAW), Chicago, IL, volume 4145 of Lecture Notes in Computer Science, pages 222-236. Springer, 2006.
39. The Swift System, www.ci.uchicago.edu/swift.
40. W. C. Tan. Provenance in databases: Past, current, and future. IEEE Data Eng. Bull., 30(4):3-12, 2007.
41. The Taverna Project. http://taverna.sourceforge.net.
42. The Triana Project. http://www.trianacode.org.
43. VDS - The GriPhyN Virtual Data System. http://www.ci.uchieago.edu/wiki/ bin/view/VDS/VDSWeb/WebMain.
44. F. B. Viegas, M. Wattenberg, F. van Ham, J. Kriss, and M. McKeon. Manyeyes: a site for visualization at internet scale. IEEE Transactions on Visualization and Computer Graphics, 13(6):1121-1128, 2007.
45. The VisTrails Project. http://www.vistrails.org.
46. J. Zhao, C. Goble, R. Stevens, and D. Turi. Mining taverna's semantic web of provenance. Concurrency and Computation; Practice and Experience, 20(5):463-472, 2008.