Handling data skew in parallel joins in shared-nothing systems

Proceedings of the ACM SIGMOD International Conference on Management of Data

Volumn , Issue , 2008, Pages 1043-1052

  Yu, Xu ^a   Kostamaa, Pekka ^a   Zhou, Xin ^a   Chen, Liang ^b  

^a TERADATA CORPORATION   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Data skew; Parallel joins; Shared nothing

Indexed keywords

ADMINISTRATIVE DATA PROCESSING; DATA HANDLING; DATA PROCESSING; DATA STORAGE EQUIPMENT; DATABASE SYSTEMS; EARTH SCIENCES; INFORMATION THEORY; MANAGEMENT INFORMATION SYSTEMS; MODELS; PARALLEL ALGORITHMS; PARALLEL PROCESSING SYSTEMS; QUERY PROCESSING; WAREHOUSES;

APPLICATIONS.; BUSINESS PROBLEMS; COMPLEX QUERIES; DATA SKEW; DATA SKEWS; MULTIPLE DIMENSIONS; OVERALL SYSTEMS; PARALLEL DATABASES; PARALLEL JOINS; PARALLEL PROCESSING; PHYSICAL DATUMS; RESPONSE TIMES; SCALE-UP; SHARED NOTHING; SKEWED DATUMS; WHOLE SYSTEMS;

DATA WAREHOUSES;

EID: 57149139815     PISSN: 07308078     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1376616.1376720     Document Type: Conference Paper

References (21)

1. TPC Benchmark H (decision support) standard specification http://www.tpc.org.
2. K. Alsabti and S. Ranka. Skew-insensitive parallel algorithms for relational join. In HIPC, page 367, 1998.
3. M. Bamha and G. Hains. Frequency-adaptive join for shared nothing machines. Progress in computer research, pages 227-241, 2001.
4. J. L. Carter and M. N. Wegman. Universal classes of hash functions. Journal of Computer and System Sciences, 18:143-154, 1979.
5. H. M. Dewan, M. A. Hernández, K. W. Mok, and S. J. Stolfo. Predictive dynamic load balancing of parallel hash-joins over heterogeneous processors in the presence of data skew. In PDIS, pages 40-49, 1994.
6. D. DeWitt and J. Gray. Parallel database systems: the future of high performance database systems. Cornrnun. ACM, 35(6):85-98, 1992.
7. D. J. DeWitt, J. F. Naughton, D. A. Schneider, and S. Seshadri. Practical skew handling in parallel joins. In VLDB, 1992.
8. FrankǎOlken and DoronǎRotem. Random sampling from databases: a survey. Statistics and Computing, 5(1):25-42, 1995.
9. R. L. Graham. Bounds on multiprocessing timing anomalies. SIAM Journal on Applied Mathematics, 17(2):416-429, 1969.
10. L. Harada and M. Kitsuregawa. Dynamic join product skew handling for hash-joins in shared-nothing database systems. In DASFAA, pages 246-255, 1995.
11. K. A. Hua and C. Lee. Handling data skew in multiprocessor database computers using partition tuning. In VLDB, pages 525-535, 1991.
12. E. G. C. Jr., M. R. Garey, and D. S. Johnson. An application of bin-packing to multiprocessor scheduling. SIAM J. Comput., 7(1):1-17, 1978.
13. M. Kitsuregawa and Y. Ogawa. Bucket spreading parallel hash: A new, robust, parallel hash join method for data skew in the super database computer (sdc). In VLDB, pages 210-221, 1990.
14. M. S. Lakshmi and P. S. Yu. Effectiveness of parallel joins. IEEE Transactions on Knowledge and Data Engineering, 2(4):410-424, 1990.
15. A. Shatdal and J. F. Naughton. Using shared virtual memory for parallel join processing. In SIGMOD Conference, pages 119-128, 1993.
16. M. Stonebraker. The case for shared nothing. IEEE Database Eng. Bull., 9(1):4-9, 1986.
17. C. B. Walton, A. G. Dale, and R. M. Jenevein. A taxonomy and performance model of data skew effects in parallel joins. In VLDB, pages 537-548, 1991.
18. J. L. Wolf, D. M. Dias, and P. S. Yu. A parallel sort merge join algorithm for managing data skew. IEEE Trans. Parallel Distnb. Syst., 4(1):70-86, 1993.
19. J. L. Wolf, D. M. Dias, P. S. Yu, and J. Turek. An effective algorithm for parallelizing hash joins in the presence of data skew. In ICDE, pages 200-209, 1991.
20. J. L. Wolf, D. M. Dias, P. S. Yu, and J. Turek. New algorithms for parallelizing relational database joins in the presence of data skew. IEEE Trans. Knowl. Data Eng., 6(6):990-997, 1994.
21. X. Zhou and M. E. Orlowska. Handling data skew in parallel hash join computation using two-phase scheduling. In IEEE 1st International Conference on Algorithm and Architecture for Parallel Processing, pages 527-536 vol.2, 1995.