ReStore: Reusing results of MapReduce jobs

Proceedings of the VLDB Endowment

Volumn 5, Issue 6, 2012, Pages 586-597

  Elghandour, Iman ^a   Aboulnaga, Ashraf ^a  

^a UNIVERSITY OF WATERLOO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

DIGITAL STORAGE; FILE ORGANIZATION; QUERY LANGUAGES; RESTORATION;

CURRENT PRACTICES; DISTRIBUTED FILE SYSTEMS; EXECUTION MODEL; HIGH-LEVEL QUERIES; INTERMEDIATE RESULTS; LARGE SCALE DATA; LARGE-SCALE DATA ANALYSIS; MAP-REDUCE PROGRAMMING;

HIGH LEVEL LANGUAGES;

EID: 84862655513     PISSN: None     EISSN: 21508097     Source Type: Conference Proceeding    
DOI: 10.14778/2168651.2168659     Document Type: Article

References (16)

1. Apache Hadoop. Available at: http://hadoop.apache.org/.
2. Apache Pig. Available at: http://pig.apache.org/.
3. Hadoop Distributed File System. Available at: http://hadoop.apache.org/hdfs/.
4. PigMix. Available at: https://cwiki.apache.org/confluence/display/PIG/PigMix.
5. P. Agrawal, D. Kifer, and C. Olston. Scheduling shared scans of large data files. Proc. VLDB Endow. (PVLDB), 1(1):958-969, 2008.
6. S. Agrawal et al. Database tuning advisor for Microsoft SQL Server 2005. In Proc. (VLDB), pages 1110-1121, 2004.
7. M. Ahuja et al. Peta-scale data warehousing at Yahoo! In Proc. ACM SIGMOD, pages 855-862, 2009.
8. K. S. Beyer et al. Jaql: A scripting language for large scale semistructured data analysis. Proc. VLDB Endow. (PVLDB), 4(12):1272-1283, 2011.
9. J. Dean and S. Ghemawat. MapReduce: Simplified data processing on large clusters. In Proc. OSDI, pages 137-150, 2004.
10. I. Elghandour and A. Aboulnaga. ReStore: Reusing results of MapReduce jobs in Pig (Demo). In Proc. ACM SIGMOD, 2012.
11. A. F. Gates et al. Building a high-level dataflow system on top of Map-Reduce: the Pig experience. Proc. VLDB Endow. (PVLDB), 2(2):1414-1425, 2009.
12. A. Y. Halevy. Answering queries using views: A survey. The VLDB Journal, 10(4):270-294, 2001.
13. T. Nykiel, M. Potamias, C. Mishra, G. Kollios, and N. Koudas. MRShare: sharing across multiple queries in MapReduce. Proc. VLDB Endow. (PVLDB), 3(1-2):494-505, 2010.
14. C. Olston et al. Pig Latin: a not-so-foreign language for data processing. In Proc. ACM SIGMOD, pages 1099-1110, 2008.
15. A. Thusoo et al. Hive: a warehousing solution over a Map-Reduce framework. Proc. VLDB Endow. (PVLDB), 2(2):1626-1629, 2009.
16. A. Thusoo et al. Data warehousing and analytics infrastructure at Facebook. In Proc. ACM SIGMOD, pages 1013-1020, 2010.