Efficiently support MapReduce-like computation models inside parallel DBMS

ACM International Conference Proceeding Series

Volumn , Issue , 2009, Pages 43-53

  Qiming, Chen ^b   Therber, Andy ^a   Meichun, Hsu ^b   Zeller, Hans ^a   Bin, Zhang ^b   Ren, Wu ^b  

^a HP TSG SW NED ^*  (United States)

^b HEWLETT PACKARD LABORATORIES   (United States)

Author keywords

Map Reduce; Parallel database; Query executor; Relation valued function; User defined function

Indexed keywords

APPLICATION DEVELOPERS; APPLICATION LOGIC; COMPLEX APPLICATIONS; COMPLEX INTERACTION; COMPUTATION MODEL; ESSENTIAL PROBLEMS; GENERAL APPLICATIONS; MODEL COMPLEXES; PARALLEL DATABASE; PARALLEL QUERY PROCESSING; QUERY EXECUTION; QUERY EXECUTOR; RELATION VALUED FUNCTION; RELATIONAL OPERATOR; SYSTEM CALLS; SYSTEM INTERACTIONS; SYSTEM SUPPORTS; USER DEFINED FUNCTION; USER DEFINED FUNCTIONS;

DATA PROCESSING; DATA STRUCTURES; DATABASE SYSTEMS; QUERY PROCESSING;

PIPELINE PROCESSING SYSTEMS;

EID: 71049132740     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1620432.1620438     Document Type: Conference Paper

References (29)

1. Tasso Argyros, "How Aster In-Database MapReduce Takes UDF's to the next Level", http://www.asterdata.com/blog/index.php/2008/08/27/how-asters- in-database-mapreduce-takes-udfs-to-the-next-level/, 2008.
2. Peter Boncz, Marcin Zukowski, Niels Nes, MonetDB/X100: Hyper-Pipelining Query Execution", CIDR 2005.
3. F. Carino, W. O'Connell, "Plan-per-tuple Optimization Solution - Parallel Execution of Expensive User Defined Functions in Object-Relational DBMS, VLDB 1998.
4. R. Chaiken, B. Jenkins, P-Å. Larson, B. Ramsey, D. Shakib, S. Weaver, J. Zhou, "SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets", VLDB 2008.
5. Qiming Chen, Meichun Hsu, "Data-Continuous SQL Process Model ", Proc. 16th International Conference on Cooperative Information Systems (CoopIS'08), 2008.
6. Qiming Chen, Meichun Hsu, "Correlated Query Process and P2P Execution ", The 1th Int'l Conf on Data Management in Grid and P2P Systems (Globe-2008), 2008.
7. Qiming Chen, Meichun Hsu, "Inter-Enterprise Collaborative Business Process Management", Proc. of 17th Int'l Conf on Data Engineering (ICDE-2001), 2001, Germany.
8. Qiming Chen and Y. Kambayashi, "Nested Relation Based Database Knowledge Representation", Proc. of ACM SIGMOD'91 (ACM SIGMOD Rec. Vol.20, No.2), 1991.
9. B. F. Cooper, et.al, "PNUTS: Yahoo!'s Hosted Data Serving Platform", VLDB 2008.
10. U. Dayal, Meichun Hsu, R. Ladin, "A Transaction Model for Long-Running Activities", VLDB 1991.
11. J. Dean., "Experiences with MapReduce, an abstraction for large-scale computation", Int Conf on Parallel Architecture and Compilation Techniques. ACM, 2006.
12. D.J. DeWitt, E. Paulson, E. Robinson, J. Naughton, J. Royalty, S. Shankar, A. Krioukov, "Clustera: An Integrated Computation And Data Management System", VLDB 2008.
13. Goetz. Graefe, "Volcano - An Extensible and Parallel Query Processing System", IEEE Trans K&D Eng. 6(1), 1994.
14. Jim Gray; D.T. Liu; M. A. Nieto-Santisteban; A.S. Szalay; G.Heber; D. DeWitt, "Scientific Data Management in the Coming Decade", SIGMOD Record, Vol 34, No 4, 2005
15. Greenplum, "Greenplum MapReduce for the Petabytes Database", http://www.greenplum.com/resources/MapReduce/, 2008
16. HP Neoview enterprise data warehousing platform, http://h71028.www7.hp. com/enterprise/cache/414444-0-0-225-121.html
17. IBM DB2 Universal Database V8.1, http://www.ibm.com/software/data/db2, 2004.
18. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly, "Dryad: Distributed data-parallel programs from sequential building blocks", In EuroSys 2007, March 2007.
19. M. Jaedicke, B.Mitschang, "User-Defined Table Operators: Enhancing Extensibility of ORDBMS", VLDB 1999.
20. Brian Moran, "UDFs Endanger Performance", http://www.sqlmag. com/Article/ArticleID/42139/sql-server-42139.html
21. Andrew Novick, "Drilling Down into Performance Problem, in Chapter 11, Transact-SQL User-Defined Functions", pp235-244, Wordware Publishing, ISBN 1-55622, 2004.
22. W. O'Connell et.al. "A Teradata Content-Based Multimedia Object Manager for Massively Parallel Architectures," ACM-SIGMOD Conf, Canada, 1996.
23. Christopher Olston, Benjamin Reed, Utkarsh Srivastava, Ravi Kumar, Andrew Tomkins, "Pig Latin: A Not-So-Foreign Language for Data Processing", SIGMOD 2008
24. Oracle, "Oracle Pipelined Table Functions", Oracle 9i doc.
25. C. Ordonez, J. Garcia-Garcia, "vector and Matrix Operations Programmed with UDFs in a Relational DBMS", CIKM'06.
26. S. Padmanabhan, T. Malkemus, R. Agarwal, A. Jhingran, "Block oriented processing of Relational Database operations in modern Computer Architectures", ICDE, 2001.
27. Andrew Therber, "User Defined Function Interfaces for SAS In-Database Processing", HP Confidential Document, 2008.
28. Hung-chih Yang, Ali Dasdan, Ruey-Lung Hsiao, D. Stott Parker, "Map-reduce-merge: simplified relational data processing on large clusters", ACM SIGMOD 2007.
29. J. Zhou,, K.A. Ross, "Buffering Database Operations for enhanced Instruction Cache Performance", SIGMOD 2004.