SubZero: A fine-grained lineage system for scientific databases

Proceedings - International Conference on Data Engineering

Volumn , Issue , 2013, Pages 865-876

  Wu, Eugene ^a   Madden, Samuel ^a   Stonebraker, Michael ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA ARRAY; DATA LINEAGE; GENOMICS; INPUT AND OUTPUTS; QUERY COSTS; RUNTIMES; SCIENTIFIC DATABASE; STORAGE OVERHEAD;

SEMANTICS;

DIGITAL STORAGE;

EID: 84881348674     PISSN: 10844627     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDE.2013.6544881     Document Type: Conference Paper

References (21)

1. Z. Ivezi, J. Tyson, E. Acosta, R. Allsman, S. Anderson, et al., "LSST: From science drivers to reference design and anticipated data products." [Online]. Available: http://lsst.org/files/docs/overviewV2.0.pdf
2. M. Stonebraker, J. Becla, D. J. DeWitt, K.-T. Lim, D. Maier, O. Ratzesberger, and S. B. Zdonik, "Requirements for science data bases and SciDB," in CIDR, 2009.
3. T. Oinn, M. Greenwood, M. Addis, N. Alpdemir, J. Ferris, K. Glover, C. Goble, A. Goderis, D. Hull, D. Marvin, P. Li, P. Lord, M. Pocock, M. Senger, R. Stevens, A. Wipat, and C. Wroe, "Taverna: lessons in creating a workflow environment for the life sciences," in Concurrency and Computation: Practice and Experience, 2006.
4. H. Kuehn, A. Liberzon, M. Reich, and J. P. Mesirov, "Using genepattern for gene expression analysis," Curr. Protoc. Bioinform., Jun 2008.
5. J. Widom, "Trio: A system for integrated management of data, accuracy, and lineage," Tech. Rep., 2004.
6. P. Tamayo, Y.-J. Cho, A. Tsherniak, H. Greulich, et al., "Predicting relapse in patients with medulloblastoma by integrating evidence from clinical and genomic features." Journal of Clinical Oncology, p. 29:14151423, 2011.
7. R. Ikeda and J. Widom, "Panda: A system for provenance and data," in IEEE Data Engineering Bulletin, 2010. [Online]. Available: http://ilpubs.stanford.edu:8090/972/
8. J. Cheney, L. Chiticariu, and W. C. Tan., "Provenance in databases: Why, how, and where," in Foundations and Trends in Databases, 2009.
9. S. Davidson, S. Cohen-Boulakia, A. Eyal, B. Ludscher, T. McPhillips, S. Bowers, M. K. Anand, and J. Freire, "Provenance in scientific workflow systems."
10. R. BOSE and J. FREW, "Lineage retrieval for scientific data processing: A survey," in ACM Computing Surveys, 2005.
11. J. Goecks, A. Nekrutenko, J. Taylor, and T. G. Team, "Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences." in Genome Biology, 2010.
12. R. Ikeda, H. Park, and J. Widom, "Provenance for generalized map and reduce workflows," in CIDR, 2011. [Online]. Available: http://ilpubs.stanford.edu:8090/985/
13. Y. Amsterdamer, S. Davidson, D. Deutch, T. Milo, J. Stoyanovich, and V. Tannen, "Putting lipstick on pig: Enabling database-style workflow provenance," in PVLDB, 2012.
14. C. Olston, B. Reed, U. Srivastava, R. Kumar, and A. Tomkins, "Pig latin: A not-so-foreign language for data processing," in SIGMOD, 2008.
15. I. Altintas, C. Berkley, E. Jaeger, M. Jones, B. Ludascher, and S. Mock, "Kepler: an extensible system for design and execution of scientific workflows," in SSDM, 2004.
16. M. K. Anand, S. Bowers, T. McPhillips, and B. Ludscher, "Efficient provenance storage over nested data collections," in EDBT, 2009.
17. P. Missier, N. Paton, and K. Belhajjame, "Fine-grained and efficient lineage querying of collection-based workflow provenance," in EDBT, 2010.
18. A. P. Chapman, H. Jagadish, and P. Ramanan, "Efficient provenance storage," in SIGMOD, 2008.
19. Y. Cui, J. Widom, and J. L. Viener, "Tracing the lineage of view data in a warehousing environment," in ACM Transactions on Database Systems, 1997.
20. K.-K. Muniswamy-Reddy, D. A. Holland, U. Braun, and M. Seltzer, "Provenance-aware storage systems," in NetDB, 2005.
21. K.-K. Muniswamy-Reddy, J. Barillariy, U. Braun, D. A. Holland, D. Maclean, M. Seltzer, and S. D. Holland, "Layering in provenance-aware storage systems," Tech. Rep., 2008.