Pig Latin: A not-so-foreign language for data processing

Proceedings of the ACM SIGMOD International Conference on Management of Data

Volumn , Issue , 2008, Pages 1099-1110

  Olston, Christopher ^a   Reed, Benjamin ^a   Srivastava, Utkarsh ^a   Kumar, Ravi ^a   Tomkins, Andrew ^a  

^a YAHOO RESEARCH   (United States)

Author keywords

Languages

Indexed keywords

DATABASE SYSTEMS; LINGUISTICS; MAPS; QUERY LANGUAGES;

COMMODITY HARDWARES; DATA ANALYSIS; DEBUGGING ENVIRONMENTS; FOREIGN LANGUAGES; LANGUAGES; LARGE DATA SETS; PARALLEL DATABASES; PRODUCTIVITY GAINS; PROGRAMMING MODELS; SCALABLE IMPLEMENTATIONS; SWEET SPOTS; USER CODES;

DATA PROCESSING;

EID: 55349148888     PISSN: 07308078     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1376616.1376726     Document Type: Conference Paper

References (14)

1. G. E. Blelloch. Programming parallel algorithms. Communications of the ACM, 39(3):85-97, March 1996.
2. F. Chang et al. Bigtable: A distributed storage system for structured data. In Proc. OSDI, pages 205-218. USENIX Association, 2006.
3. S. Chaudhuri, R, Motwani, and V. Narasayya. On random sampling over joins. In Proc. ACM SIGMOD, 1999.
4. J. Dean and S. Ghemawat. MapReduee: Simplified data processing on large clusters. In Proc. OSDI, 2004.
5. G. DeCandia et al. Dynamo: Amazon's highly available key-value store. In Proc. SOSP, 2007.
6. Dryad LINQ. http://research.microsoft.com/research/sv/DryadLINQ/2007.
7. R. Elmasri and S. Navathe. Fundamentals of Database Systems. Benjamin/Cummings, 1989.
8. J. Gray et al. Data cube: A relational aggregation operator generalizing group-by, cross-tab, and sub totals. Data Min. Knowl. Discov., 1(1):29-53, 1997.
9. C. S. Group. Community Systems Research at Yahoo! SIGMOD Record, 36(3):47-54, September 2007.
10. Hadoop. http://lucene.apache.org/hadoop/, 2007.
11. R. Hull. A survey of theoretical research on typed complex database objects. In XP7.52 Workshop on Database Theory, 1986.
12. M. Isard et al. Dryad: Distributed data-parallel programs from sequential building blocks. In European Conference on Computer Systems (EuroSys), pages 59-72, Lisbon, Portugal, March 21-23 2007.
13. R. Pike, S. Dorward, R. Griesemer, and S. Quinlan. Interpreting the data: Parallel analysis with Sawzall. Scientific Programming Journal, 13(4), 2005.
14. H.-C. Yang, A. Dasdan, R.-L. Hsiao, and D. S. Parker. Map-reduce-merge: Simplified relational data processing on large clusters. In Proc. ACM SIGMOD, 2007.