An optimization framework for map-reduce queries

ACM International Conference Proceeding Series

Volumn , Issue , 2012, Pages 26-37

  Fegaras, Leonidas ^a   Li, Chengkai ^a   Gupta, Upa ^a  

^a UNIVERSITY OF TEXAS AT ARLINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGEBRAIC OPTIMIZATION; ERROR PRONES; HIGHER ORDER; MAP-REDUCE; OPTIMIZATION FRAMEWORK; PLUG-INS; PROTOTYPE SYSTEM; QUERY ALGEBRAS; SMALL CLUSTERS; WORK-FLOWS;

ALGEBRA; OPTIMIZATION;

QUERY LANGUAGES;

EID: 84863507276     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2247596.2247601     Document Type: Conference Paper

References (28)

1. A. Abouzeid, et al. HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads. In VLDB'09.
2. S. Babu. Towards Automatic Optimization of MapReduce Programs. In SOCC'10.
3. D. Battre, et al. Nephele/PACTs: A Programming Model and Execution Framework for Web-Scale Analytical Processing. In SOCC'10.
4. A. Behm, V. Borkar, M. J. Carey, et al. ASTERIX: Towards a Scalable, Semistructured Data Platform for Evolving-World Models. Distrib Parallel Databases (2011) 29: 185-216.
5. V. Borkar, M. J. Carey, R. Grover, N. Onose, and R. Vernica. Hyracks: A Flexible and Extensible Foundation for Data-Intensive Computing. In ICDE'11.
6. Y. Bu, B. Howe, M. Balazinska, and M. D. Ernst. HaLoop: Efficient Iterative Data Processing on Large Clusters. In VLDB'10.
7. M. J. Cafarella and C. Re. Manimal: Relational Optimization for Data-Intensive Programs. In WebDB'10.
8. R. Chaiken, et al. SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets. In PVLDB'08.
9. D. Chakrabarti, Y. Zhan, and C. Faloutsos. R-MAT: A Recursive Model for Graph Mining. In SDM'04.
10. J. Dean and S. Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. In OSDI'04.
11. J. Dittrich, et al. Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing). In VLDB'10.
12. L. Fegaras. A New Heuristic for Optimizing Large Queries. In DEXA'98.
13. L. Fegaras, C. Li, U. Gupta, and J. J. Philip. XML Query Optimization in Map-Reduce. In WebDB'11.
14. A. F. Gates, et al. Building a High-Level Dataflow System on top of Map-Reduce: the Pig Experience. In PVLDB 2(2), 2009.
15. Hadoop. http://hadoop.apache.org/.
16. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly. Dryad: Distributed Data-Parallel Programs from Sequential Building Blocks. In EuroSys'07.
17. M. Isard and Y. Yu. Distributed Data-Parallel Computing Using a High-Level Programming Language. In SIGMOD'09.
18. E. Jahani, M. J. Cafarella, and C. Ré. Automatic Optimization for MapReduce Programs. In PVLDB'11, 4(6).
19. S. P. Jones and P.Wadler. Comprehensive Comprehensions (Comprehensions with Order by and Group by). In Haskell'07.
20. J. Lin and C. Dyer. Data-Intensive Text Processing with MapReduce. Book pre-production manuscript, April 2010.
21. MRQL. http://lambda.uta.edu/mrql/.
22. C. Olston, B. Reed, U. Srivastava, R. Kumar, and A. Tomkins. Pig Latin: a not-so-Foreign Language for Data Processing. In SIGMOD'08.
23. R. Pike, S. Dorward, R. Griesemer, and S. Quinlan. Interpreting the Data: Parallel Analysis with Sawzall. Scientific Programming 13(4), 2005.
24. M. Stonebraker, et al. MapReduce and Parallel DBMSs: Friends or Foes? In CACM 53(1), 2010.
25. A. Thusoo, et al. Hive: a Warehousing Solution over a Map-Reduce Framework. In PVLDB 2(2), 2009.
26. A. Thusoo, et al. Hive: A Petabyte Scale Data Warehouse Using Hadoop. In ICDE'10.
27. T. White. Hadoop: The Definitive Guide. O'Reilly, 2009.
28. H.-C. Yang, A. Dasdan, R.-L. Hsiao, and D.S. Parker. Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters. In SIGMOD'07.