Exploring provenance in a distributed job execution system

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4145 LNCS, Issue , 2006, Pages 237-245

  Reilly, Christine F ^a   Naughton, Jeffrey F ^a  

^a University of Wisconsin Madison   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA ACQUISITION; DATA REDUCTION; INFORMATION ANALYSIS; JOB ANALYSIS; SECURITY OF DATA;

INFORMATION CAPTURE; JOB EXECUTION SYSTEMS;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 33750085304     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11890850_24     Document Type: Conference Paper

References (20)

1. Bose, R., Frew, J.: Lineage retrieval for scientific data processing: A survey. ACM Computing Surveys 37 (2005) 1-28
2. Jagadish, H., Olken, F.: Data management for the biosciences: Report of the NSF/NLM workshop on data management for molecular and cell biology, national library of medicine. Technical Report LBNL Report LBNL-52767, Lawrence Berkeley National Laboratory (2003)
3. Simmhan, Y.L., Plale, B., Gannon, D.: A survey of data provenance in e-science. SIGMOD Record 34 (2005) 31-36
4. Simmhan, Y.L., Plale, B., Gannon, D.: A survey of data provenance techniques. Technical Report IUB-CS-TR618, Computer Science Department, Indiana University, Bloomington, Indiana (2005)
5. Condor: Project homepage, http://www.cs.wisc.edu/condor/ (2006)
6. Tannenbaum, T., Wright, D., Miller, K., Livny, M.: Condor - A distributed job scheduler. In Sterling, T., ed.: Beowulf Cluster Computing with Linux. MIT Press (2001)
7. Buneman, P., Khanna, S., Tan, W.C.: Why and where: A characterization of data provenance. In: International Conference on Database Theory (ICDT). (2001)
8. Cui, Y., Widom, J.: Lineage tracing for general data warehouse transformations. In: Proceedings of the 27th VLDB Conference, Roma, Italy. (2001)
9. Cui, Y., Widom, J.: Lineage tracing for general data warehouse transformations. Technical report, Stanford University Database Group (2001)
10. Cui, Y., Widom, J.: Lineage tracing for general data warehouse transformations. VLDB Journal 12 (2003) 41-58
11. Fan, H., Poulovassilis, A.: Tracing data lineage using schema transformation pathways. In B.Omelayenko, Klein, M., eds.: Knowledge Transformation for the Semantic Web. IOS Press (2003)
12. Foster, I., Vockler, J., Wilde, M., Zhao, Y.: Chimera: A virtual data system for representing, querying, and automating data derivation. In: 14th International Conference on Scientific and Statistical Database Management. (2002)
13. Frew, J., Bose, R.: Earth system science workbench: A data management infrastructure for earth science products. In: Thirteenth International Conference on Scientific and Statistical Database Management, Fairfax, Virginia. (2001) 180-189
14. Widom, J.: Trio: A system for integrated management of data, accuracy, and lineage. In: CIDR. (2005)
15. Woodruff, A., Stonebraker, M.: Supporting fine-grained data lineage in a database visualization environment. In: Proceedings of the 13th International Conference on Data Engineering, Birmingham, England. (April 1997) 91-102
16. Cui, Y., Widom, J.: Storing auxiliary data for efficient maintenance and lineage tracing of complex views. In: Proceedings of the International Workshop on Design and Management of Data Warehouses (DMDW), Stockholm, Sweden. (2000)
17. Szomszor, M., Moreau, L.: Recording and reasoning over data provenance in web and grid services. In Meersman, R., Tari, Z., Schmidt, D.C., eds.: On The Move to Meaningful Internet Systems 2003: CoopIS, DOA, and ODBASE- OTM Confederated International Conferences, CoopIS, DOA, and ODBASE 2003, Catania, Sicily, Italy, November 3-7, 2003. Volume 2888 of Lecture Notes in Computer Science., Springer (2003) 603-620
18. Barga, R.: Automatic generation of workflow execution provenance. In: International Provenance and Annotation Workshop (IPAW'06), Chicago, May 2006. (2006) http://www.ipaw.info/ipaw06.
19. Braun, U., Garfinkel, S., Holland, D.A., Muniswamy-Reddy, K.K., Seltzer, M.I: Issues in automatic provenance collection. In: International Provenance and Annotation Workshop (IPAW06), Chicago, May 2006. (2006) http://www.ipaw.info/ ipaw06.
20. Huang, J, Kini, A., Reilly, C., Robinson, E., Shankar, S., Shrinivas, L., DeWitt, D., Naughton, J.: An overview of Quill++: A passive operational data logging system for Condor. https://www.cs.wisc.edu/condordb (2006)