Map-reduce-merge: Simplified relational data processing on large clusters

Proceedings of the ACM SIGMOD International Conference on Management of Data

Volumn , Issue , 2007, Pages 1029-1040

  Yang, Hung Chih ^a   Dasdan, Ali ^a   Hsiao, Ruey Lung ^b   Parker, D Stott ^b  

^a YAHOO INC   (United States)

^b University of California   (United States)

Author keywords

Cluster; Data processing; Distributed; Join; Map reduce; Map reduce merge; Parallel; Relational; Search engine

Indexed keywords

CLUSTER ANALYSIS; DATA STRUCTURES; LEARNING SYSTEMS; MATHEMATICAL MODELS; PARALLEL PROGRAMMING; SEARCH ENGINES;

MAP REDUCE MERGE; PROGRAMMING MODELS;

RELATIONAL DATABASE SYSTEMS;

EID: 35448944021     PISSN: 07308078     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1247480.1247602     Document Type: Conference Paper

References (18)

1. Apache. Hadoop. http://lucene.apache.org/hadoop/, 2006.
2. A. C. Arpaci-Dusseau et al. High-Performance Sorting on Networks of Workstations. In SIGMOD 1997, pages 243-254, 1997.
3. E. A. Brewer. Combining Systems and Databases: A Search Engine Retrospective. In J. M. Hellerstein and M. Stonebraker, editors, Bladings in Database Systems, Fourth Edition, Cambridge, MA, 2005. MIT Press.
4. F. Chang et al. Bigtable: A Distributed Storage System for Structured Data. In OSDI, pages 205-218, 2006.
5. L. Chu et al. Optimizing Data Aggregation for Cluster-Based Internet Services. In PPOPP, pages 119-130. ACM, 2003.
6. J. Dean and S. Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. In OSDI, pages 137-150, 2004.
7. D. J. DeWitt et al. GAMMA - A High Performance Dataflow Database Machine. In VLDB 1986, pages 228-237, 1986.
8. D. J. DeWitt and Gerber.R. Multiprocessor Hash-Based Join Algorithms. In VLDB 1985, 1985.
9. D. J. DeWitt and J. Gray. Parallel Database Systems: The Future of High Performance Database Systems. Commun. ACM, 35(6):85-98, 1992.
10. S. Ghemawat, H. Gobioff, and S.-T. Leung. The Google file system. In SOSP, pages 29-43, 2003.
11. J. Gray. Sort Benchmark. http://research.microsoft.com/barc/ SortBenchmark/, 2006.
12. J. Gray et al. Scientific data management in the coming decade. SIGMOD Record, 34(4):34-41, 2005.
13. M. Isard et al. Dryad: Distributed Data-Parallel Programs from Sequential Building Blocks. In EuroSys, 2007.
14. R. Lämmel. Google's MapReduce Programming Model - Revisited. Draft; Online since 2 January, 2006; 26 pages, 22 Jan. 2006.
15. R. Pike et al. Interpreting the Data: Parallel Analysis with Sawzall. Scientific Programming Journal, 13(4):227-298, 2005.
16. Teradata. Teradata. http://www.teradata.com/t/go.aspx, 2006.
17. TPC. TPC-H. http://www.tpc.org/tpch/default.asp, 2006.
18. Wikipedia. Redundant Array of Inexpensive Nodes. http://en.wikipedia. org/wiki/Redundant_Array_of_Inexpensive-Nodes, 2006.