Optimizing joins in a map-reduce environment

Advances in Database Technology - EDBT 2010 - 13th International Conference on Extending Database Technology, Proceedings

Volumn , Issue , 2010, Pages 99-110

  Afrati, Foto N ^a   Ullman, Jeffrey D ^b  

^a NATIONAL TECHNICAL UNIVERSITY OF ATHENS   (Greece)

^b STANFORD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DIMENSION TABLES; FIXED NUMBERS; KEY ATTRIBUTES; MAP PROCESS; NEW APPROACHES; SOCIAL NETWORKS; STAR JOIN; VERY LARGE DATUM;

DATABASE SYSTEMS; OPTIMIZATION;

TECHNOLOGY;

EID: 77952265514     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1739041.1739056     Document Type: Conference Paper

References (23)

1. F. N. Afrati and J. D. Ullman. Optimizing joins in a map-reduce environment. Technical report, Stanford, http://ilpubs.stanford.edu:8090/952/, 2009.
2. Apache. Hadoop. http://hadoop.apache.org/, 2006.
3. R. Avnur and J. M. Hellerstein. Eddies: Continuously adaptive query processing. In SIGMOD Conference, pages 261-272, 2000.
4. S. Babu, K. Munagala, J. Widom, and R. Motwani. Adaptive caching for continuous queries. In ICDE, pages 118-129, 2005.
5. S. Babu and J. Widom. Streamon: an adaptive engine for stream query processing. In SIGMOD Conference, pages 931-932, New York, NY, USA, 2004. ACM.
6. S. Brin and L. Page. The anatomy of a large-scale hypertextual web search engine. Computer Networks, 30(1-7):107-117, 1998. (Pubitemid 128666929)
7. F. Chang, J. Dean, S. Ghemawat, W. C. Hsieh, D. A. Wallach, M. Burrows, T. Chandra, A. Fikes, and R. E. Gruber. Bigtable: A distributed storage system for structured data. ACM Trans. Comput. Syst., 26(2), 2008.
8. H. chih Yang, A. Dasdan, R.-L. Hsiao, and D. S. Parker. Map-reduce-merge: simplified relational data processing on large clusters. In SIGMOD Conference, pages 1029-1040, New York, NY, USA, 2007. ACM.
9. B. F. Cooper, R. Ramakrishnan, U. Srivastava, A. Silberstein, P. Bohannon, H.-A. Jacobsen, N. Puz, D. Weaver, and R. Yerneni. Pnuts: Yahoo!'s hosted data serving platform. PVLDB, 1(2):1277-1288, 2008.
10. J. Dean and S. Ghemawat. Mapreduce: simplified data processing on large clusters. Commun. ACM, 51(1):107-113, 2008.
11. A. Deshpande and L. Hellerstein. Flow algorithms for parallel query optimization. In ICDE, pages 754-763, 2008.
12. D. J. DeWitt, J. F. Naughton, D. A. Schneider, and S. Seshadri. Practical skew handling in parallel joins. In VLDB, pages 27-40, 1992.
13. D. J. DeWitt, E. Paulson, E. Robinson, J. F. Naughton, J. Royalty, S. Shankar, and A. Krioukov. Clustera: an integrated computation and data management system. PVLDB, 1(1):28-41, 2008.
14. S. Ghemawat, H. Gobioff, , and S.-T. Leung. The google file system. In 19th ACM Symposium on Operating Systems Principles, 2003.
15. Z. G. Ives, D. Florescu, M. Friedman, A. Y. Levy, and D. S. Weld. An adaptive query execution system for data integration. In SIGMOD Conference, pages 299-310, 1999.
16. H. Jacobsson. Tree-based techniques for query evaluation. Ph.D. thesis, Dept. of CS, Stanford Univ., Stanford CA USA, STAN-CS-93-1492, 1993.
17. J. M. Kleinberg. Authoritative sources in a hyperlinked environment. Journal of the ACM, 46:668-677, 1999.
18. S. Madden, M. A. Shah, J. M. Hellerstein, and V. Raman. Continuously adaptive continuous queries over streams. In SIGMOD Conference, pages 49-60, 2002.
19. C. Olston, B. Reed, U. Srivastava, R. Kumar, and A. Tomkins. Pig latin: a not-so-foreign language for data processing. In SIGMOD Conference, pages 1099-1110, 2008.
20. K. A. Ross and J. Cieslewicz. Optimal splitters for database partitioning with size bounds. In ICDT, pages 98-110, New York, NY, USA, 2009. ACM.
21. U. Srivastava, K. Munagala, J. Widom, and R. Motwani. Query optimization over web services. In VLDB, pages 355-366, 2006.
22. K.-L. Tan and H. Lu. A note on the strategy space of multiway join query optimization problem in parallel systems. SIGMOD Rec., 20(4):81-82, 1991.
23. S. D. Viglas, J. F. Naughton, and J. Burger. Maximizing the output rate of multi-way join queries over streaming information sources. In VLDB, pages 285-296, 2003.