SCOPE: Easy and efficient parallel processing of massive data sets

Proceedings of the VLDB Endowment

Volumn 1, Issue 2, 2008, Pages 1265-1276

  Chaiken, Ronnie ^a   Jenkins, Bob ^a   Larson, Per Åke ^a   Ramsey, Bill ^a   Shakib, Darren ^a   Weaver, Simon ^a   Zhou, Jingren ^a  

^a MICROSOFT   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

METADATA;

MASSIVE DATA SETS; PARALLEL EXECUTIONS; PARALLEL PROCESSING; PROGRAMMING MODELS; ROW-WISE PROCESSING; SCRIPTING LANGUAGES; SHARED NOTHING; UNDERLYING SYSTEMS;

DATA HANDLING;

EID: 84860560293     PISSN: None     EISSN: 21508097     Source Type: Conference Proceeding    
DOI: 10.14778/1454159.1454166     Document Type: Article

References (13)

1. Apache. Hadoop. http://lucene.apache.org/hadoop/, 2008.
2. Apache. Pig. http://incubator.apache.org/pig/, 2008.
3. Fay Chang et al, Bigtable: a distributed storage system for structured data, OSDI 2006, 205-218.
4. Chu, L., Tang, H., Yang, T., and Shen, K. 2003. Optimizing data aggregation for cluster-based internet services. In Proceedings of the Ninth ACM SIGPLAN Symposium on Prin- ciples and Practice of Parallel Programming, 2003.
5. Jeffrey Dean, Sanjay Ghemawat: MapReduce: simplified data processing on large clusters. OSDI 2004: 137-149.
6. Michael Isard, Mihai Budiu, Yuan Yu, Andrew Birrell, Dennis Fetterly: Dryad: distributed data-parallel programs from sequential building blocks. EuroSys 2007: 59-72.
7. G. Graefe. The Cascades framework for query optimization. IEEE Data Eng. Bull., 18(3): 1995.
8. Sanjay Ghemawat, Howard Gobioff, Shun-Tak Leung: The Google file system. SOSP 2003: 29-43.
9. Lu, Ooi, Tan, Query Processing in Parallel Relational Database Systems, IEEE Computer Society Press, 1994.
10. Christopher Olston, Benjamin Reed, Utkarsh Srivastava, Ravi Kumar, Andrew Tomkins: Pig Latin: A Not-So-Foreign Language for Data Processing, SIGMOD 2008.
11. Rob Pike, Sean Dorward, Robert Griesemer, Sean Quinlan: Interpreting the data: Parallel analysis with Sawzall. Scientific Programming 13(4): 277-298 (2005)
12. Hung-Chih Yang, Ali Dadsdan, Ruey-Lung Hsiao, D. Stott Parker, Map-Reduce-Merge: simplified relational data processing on large clusters, SIGMOD 2007, 1029-1040.
13. Yahoo! Research, PNUTS - Platform for Nimble Universal Table Storage, http://research.yahoo.com/node/212, 2008