Opening the black boxes in data flow optimization

Proceedings of the VLDB Endowment

Volumn 5, Issue 11, 2012, Pages 1256-1267

  Hueske, Fabian ^a   Peters, Mathias ^b   Sax, Matthias J ^b   Rheinländer, Astrid ^b   Bergmann, Rico ^b   Krettek, Aljoscha ^a   Tzoumas, Kostas ^a  

^a TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

^b HUMBOLDT UNIVERSITY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ABSTRACTING; ALGEBRA; DATA HANDLING; DATA TRANSFER; PARALLEL FLOW; PARALLEL PROCESSING SYSTEMS; RELATIONAL DATABASE SYSTEMS; SEMANTICS;

ALGEBRAIC PROPERTIES; ALGEBRAIC SEMANTIC; ALGEBRAIC SPECIFICATIONS; DESIGN AND IMPLEMENTS; LEVEL OF ABSTRACTION; PARALLEL DATA PROCESSING; QUERY OPTIMIZATION; USER DEFINED FUNCTIONS;

BIG DATA;

EID: 84873187154     PISSN: None     EISSN: 21508097     Source Type: Conference Proceeding    
DOI: 10.14778/2350229.2350244     Document Type: Article

References (33)

1. http://public.web.cern.ch/public/en/LHC/ Computing-en.html.
2. http://www.greenplum.com/technology/mapreduce.
3. http://www.sable.mcgill.ca/soot/.
4. http://stratosphere.eu.
5. A. V. Aho, M. S. Lam, R. Sethi, and J. D. Ullman. Compilers: Principles, Techniques and Tools. Pearson, 2006.
6. M. Baker. Next-generation sequencing: Adjusting to data overload. Nature Methods, 7(7):495-499, 2010.
7. D. Battré, S. Ewen, F. Hueske, O. Kao, V. Markl, and D. Warneke. Nephele/PACTs: A programming model and execution framework for web-scale analytical processing. In SoCC, pp. 119-130, 2010.
8. J. Becla, A. Hanushevsky, S. Nikolaev, G. Abdulla, A. S. Szalay, M. A. Nieto-Santisteban, A. Thakar, and J. Gray. Designing a multi-petabyte database for LSST. CoRR, abs/cs/0604112, 2006.
9. A. Behm, V. R. Borkar, M. J. Carey, R. Grover, C. Li, N. Onose, R. Vernica, A. Deutsch, Y. Papakonstantinou, and V. J. Tsotras. ASTERIX: Towards a scalable, semistructured data platform for evolving-world models. Distributed and Parallel Databases, 29(3):185-216, 2011.
10. K. S. Beyer, V. Ercegovac, R. Gemulla, A. Balmin, M. Y. Eltabakh, C.-C. Kanne, F. Özcan, and E. J. Shekita. Jaql: A scripting language for large scale semistructured data analysis. PVLDB, 4(12):1272-1283, 2011.
11. V. R. Borkar, M. J. Carey, R. Grover, N. Onose, and R. Vernica. Hyracks: A flexible and extensible foundation for data-intensive computing. In ICDE, pp. 1151-1162, 2011.
12. o. Larson, B. Ramsey, D. Shakib, S. Weaver, and J. Zhou. SCOPE: Easy and efficient parallel processing of massive data sets. PVLDB, 1(2):1265-1276, 2008.
13. S. Chaudhuri and K. Shim. Including group-by in query optimization. In VLDB, pp. 354-366, 1994.
14. S. Chaudhuri and K. Shim. An overview of cost-based optimization of queries with aggregates. IEEE Data Eng. Bull., 18(3):3-9, 1995.
15. S. Chaudhuri and K. Shim. Optimization of queries with user-defined predicates. ACM TODS, 24(2):177-228, 1999.
16. B. Chattopadhyay, L. Lin, W. Liu, S. Mittal, P. Aragonda, V. Lychagina, Y. Kwon, and M. Wong. Tenzing A SQL Implementation On The MapReduce Framework. PVLDB, 4(12):1318-1327, 2011.
17. J. Dean and S. Ghemawat. MapReduce: Simplified data processing on large clusters. In OSDI, pp. 137-150, 2004.
18. J. Dean and S. Ghemawat. MapReduce: Simplified data processing on large clusters. CACM, 51(1):107-113, 2008.
19. P. Fender and G. Moerkotte. A new, highly efficient, and easy to implement top-down join enumeration algorithm. In ICDE, pp. 864-875, 2011.
20. E. Friedman, P. M. Pawlowski, and J. Cieslewicz. SQL/MapReduce: A practical approach to self-describing, polymorphic, and parallelizable user-defined functions. PVLDB, 2(2):1402-1413, 2009.
21. G. Graefe. The Cascades framework for query optimization. IEEE Data Eng. Bull., 18(3):19-29, 1995.
22. T. Grust, M. Mayr, J. Rittinger, and T. Schreiber. Ferry: Database-supported program execution. In SIGMOD, pp. 1063-1066, 2009.
23. J. M. Hellerstein. Optimization techniques for queries with expensive methods. ACM TODS, 23(2):113-157, 1998.
24. H. Herodotou and S. Babu. Profiling, what-if analysis, and cost-based optimization of MapReduce programs. PVLDB, 4(11):1111-1122, 2011.
25. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly. Dryad: Distributed data-parallel programs from sequential building blocks. In EuroSys, pp. 59-72, 2007.
26. E. Jahani, M. J. Cafarella, and C. Ré. Automatic optimization for MapReduce programs. PVLDB, 4(6):385-396, 2011.
27. G. Moerkotte and T. Neumann. Dynamic programming strikes back. In SIGMOD, pp. 539-552, 2008.
28. C. Olston, B. Reed, U. Srivastava, R. Kumar, and A. Tomkins. Pig Latin: A not-so-foreign language for data processing. In SIGMOD, pp. 1099-1110, 2008.
29. P. G. Selinger, M. M. Astrahan, D. D. Chamberlin, R. A. Lorie, and T. G. Price. Access path selection in a relational database management system. In SIGMOD, pp. 23-34, 1979.
30. M. Stonebraker, C. Bear, U. Çetintemel, M. Cherniack, T. Ge, N. Hachem, S. Harizopoulos, J. Lifter, J. Rogers, and S. B. Zdonik. One size fits all? Part 2: Benchmarking studies. In CIDR, pp. 173-184, 2007.
31. A. Thusoo, J. S. Sarma, N. Jain, Z. Shao, P. Chakka, S. Anthony, H. Liu, P. Wyckoff, and R. Murthy. Hive - A warehousing solution over a map-reduce framework. PVLDB, 2(2):1626-1629, 2009.
32. D. Warneke and O. Kao. Nephele: Efficient parallel data processing in the cloud. In SC-MTAGS, 2009.
33. Y. Yu, M. Isard, D. Fetterly, M. Budiu, Ú. Erlingsson, P. K. Gunda, and J. Currey. DryadLINQ: A system for general-purpose distributed data-parallel computing using a high-level language. In OSDI, pp. 1-14, 2008.