Efficient outer join data skew handling in parallel DBMS

Proceedings of the VLDB Endowment

Volumn 2, Issue 2, 2009, Pages 1390-1396

  Xu, Yu ^a   Kostamaa, Pekka ^a  

^a TERADATA CORPORATION   (United States)

Author keywords

Data skew; Outer join; Parallel DBMS

Indexed keywords

COMPUTER SUPPORTED COOPERATIVE WORK; DATABASE SYSTEMS; INFORMATION MANAGEMENT; OPTIMIZATION; QUERY LANGUAGES; QUERY PROCESSING; SCALABILITY;

DATA SKEW; OUTER JOINS; PARALLEL DATABASE; PARALLEL DBMS; PERFORMANCE AND SCALABILITIES; QUERY RESPONSE TIME; SCALABILITY AND PERFORMANCE; SKEW OPTIMIZATION;

DATA HANDLING;

EID: 82655170727     PISSN: None     EISSN: 21508097     Source Type: Conference Proceeding    
DOI: 10.14778/1687553.1687565     Document Type: Article

References (26)

1. K. Alsabti and S. Ranka. Skew-insensitive parallel algorithms for relational join. In HIPC, page 367, 1998.
2. M. Bamha and G. Hains. Frequency-adaptive join for shared nothing machines. Progress in computer research, pages 227-241, 2001.
3. G. Bhargava, P. Goel, and B. R. Iyer. Simplification of outer joins. In CASCON '95: Proceedings of the 1995 conference of the Centre for Advanced Studies on Collaborative research, page 7. IBM Press, 1995.
4. G. Bhargava, P. Goel, and B. R. Iyer. Efficient processing of outer joins and aggregate functions. In ICDE, pages 441-449, 1996.
5. A. L. P. Chen. Outerjoin optimization in multidatabase systems. In DPDS '90: Proceedings of the second international symposium on Databases in parallel and distributed systems, pages 211-218, New York, NY, USA, 1990. ACM.
6. H. M. Dewan, M. A. Hernández, K. W. Mok, and S. J. Stolfo. Predictive dynamic load balancing of parallel hash-joins over heterogeneous processors in the presence of data skew. In PDIS, pages 40-49, 1994.
7. D. DeWitt and J. Gray. Parallel database systems: the future of high performance database systems. Commun. ACM, 35(6):85-98, 1992.
8. D. J. DeWitt, J. F. Naughton, D. A. Schneider, and S. Seshadri. Practical skew handling in parallel joins. In VLDB, 1992.
9. A. Ghazal, A. Crolotte, and R. Bhashyam. Outer join elimination in the teradata rdbms. In DEXA, pages 730-740, 2004.
10. R. L. Graham. Bounds on multiprocessing timing anomalies. SIAM Journal on Applied Mathematics, 17(2):416-429, 1969.
11. A. Gupta, H. V. Jagadish, and I. S. Mumick. Maintenance and self maintenance of outer-join views. In NGITS, pages 0-, 1997.
12. L. Harada and M. Kitsuregawa. Dynamic join product skew handling for hash-joins in shared-nothing database systems. In DASFAA, pages 246-255, 1995.
13. K. A. Hua and C. Lee. Handling data skew in multiprocessor database computers using partition tuning. In VLDB, pages 525-535, 1991.
14. E. G. C. Jr., M. R. Garey, and D. S. Johnson. An application of bin-packing to multiprocessor scheduling. SIAM J. Comput., 7(1):1-17, 1978.
15. M. Kitsuregawa and Y. Ogawa. Bucket spreading parallel hash: A new, robust, parallel hash join method for data skew in the super database computer (sdc). In VLDB, pages 210-221, 1990.
16. P.-Å. Larson and J. Zhou. View matching for outer-join views. In VLDB, pages 445-456, 2005.
17. P.-Å. Larson and J. Zhou. Efficient maintenance of materialized outer-join views. In ICDE, pages 56-65, 2007.
18. P.-Å. Larson and J. Zhou. View matching for outer-join views. VLDB J., 16(1):29-53, 2007.
19. A. Shatdal and J. F. Naughton. Using shared virtual memory for parallel join processing. In SIGMOD Conference, pages 119-128, 1993.
20. M. Stonebraker. The case for shared nothing. IEEE Database Eng. Bull., 9(1):4-9, 1986.
21. C. B. Walton, A. G. Dale, and R. M. Jenevein. A taxonomy and performance model of data skew effects in parallel joins. In VLDB, pages 537-548, 1991.
22. J. L. Wolf, D. M. Dias, and P. S. Yu. A parallel sort merge join algorithm for managing data skew. IEEE Trans. Parallel Distrib. Syst., 4(1):70-86, 1993.
23. J. L. Wolf, D. M. Dias, P. S. Yu, and J. Turek. An effective algorithm for parallelizing hash joins in the presence of data skew. In ICDE, pages 200-209, 1991.
24. J. L. Wolf, D. M. Dias, P. S. Yu, and J. Turek. New algorithms for parallelizing relational database joins in the presence of data skew. IEEE Trans. Knowl. Data Eng., 6(6):990-997, 1994.
25. Y. Xu, P. Kostamaa, X. Zhou, and L. Chen. Handling data skew in parallel joins in shared-nothing systems. In SIGMOD Conference, pages 1043-1052, 2008.
26. X. Zhou and M. E. Orlowska. Handling data skew in parallel hash join computation using two-phase scheduling. In IEEE 1st International Conference on Algorithm and Architecture for Parallel Processing, pages 527-536 vol.2, 1995.