HadoopProv: Towards provenance as a first class citizen in MapReduce

5th Workshop on the Theory and Practice of Provenance, TaPP 2013

Volumn , Issue , 2013, Pages

  Akoush, Sherif ^a   Sohan, Ripduman ^a   Hopper, Andy ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COST REDUCTION; QUERY PROCESSING; TANTALUM COMPOUNDS;

MAP TASK; MAP-REDUCE; PROTOTYPE IMPLEMENTATIONS; RUNTIMES;

PHOSPHORUS COMPOUNDS;

EID: 85044190689     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. “Hadoop MapReduce.” http://hadoop.apache.org/.
2. H. Park, R. Ikeda, and J. Widom, “RAMP: a system for capturing and tracing provenance in MapReduce workflows,” Proc. VLDB Endow., 2011.
3. D. Crawl, J. Wang, and I. Altintas, “Provenance for MapReduce-based data-intensive workflows,” in WORKS'11.
4. “Wikipedia Dumps.” http://dumps.wikimedia.org/.
5. P. Bhatotia, A. Wieder, R. Rodrigues, U. A. Acar, and R. Pasquin, “Incoop: MapReduce for incremental computations,” in SOCC'11.
6. G. Lee, J. Lin, C. Liu, A. Lorek, and D. Ryaboy, “The unified logging infrastructure for data analytics at Twitter,” VLDB Endow., 2012.
7. A. Oliner, A. Ganapathi, and W. Xu, “Advances and challenges in log analysis,” Commun. ACM, 2012.
8. J. Dittrich, J.-A. Quiané-Ruiz, S. Richter, S. Schuh, A. Jindal, and J. Schad, “Only aggressive elephants are fast elephants,” Proc. VLDB Endow., 2012.
9. J. Lin, D. Ryaboy, and K. Weil, “Full-text indexing for optimizing selection operations in large-scale data analytics,” in MapReduce'11.
10. S. Agarwal, S. Kandula, N. Bruno, M.-C. Wu, I. Stoica, and J. Zhou, “Re-optimizing data-parallel computing,” in NSDI'12.
11. J. Zhang, H. Zhou, R. Chen, X. Fan, Z. Guo, H. Lin, J. Y. Li, W. Lin, J. Zhou, and L. Zhou, “Optimizing data shuffling in data-parallel computation by understanding user-defined functions,” in NSDI'12.
12. J. Dittrich, J.-A. Quiané-Ruiz, A. Jindal, Y. Kargin, V. Setty, and J. Schad, “Hadoop++: making a yellow elephant run like a cheetah (without it even noticing),” Proc. VLDB Endow., 2010.
13. M. Y. Eltabakh, Y. Tian, F. Özcan, R. Gemulla, A. Krettek, and J. McPherson, “CoHadoop: flexible data placement and its exploitation in Hadoop,” Proc. VLDB Endow., 2011.
14. Y. Xie, D. Feng, Z. Tan, L. Chen, K.-K. Muniswamy-Reddy, Y. Li, and D. D. Long, “A hybrid approach for efficient provenance storage,” in CIKM'12.