Fully dynamic partitioning: Handling data skew in parallel data cube computation

Distributed and Parallel Databases

Volumn 13, Issue 2, 2003, Pages 181-202

  Lu, Hongjun ^a   Yu, Jeffrey Xu ^b   Feng, Ling ^c   Li, Zhixian ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^c TILBURG UNIVERSITY   (Netherlands)

Author keywords

Data cube; Hashing; OLAP; Parallel processing

Indexed keywords

DISTRIBUTED DATABASE SYSTEMS; PARALLEL ALGORITHMS; PARALLEL PROCESSING SYSTEMS; RELATIONAL DATABASE SYSTEMS;

ON-LINE ANALYTICAL PROCESSING (OLAP);

DATA PROCESSING;

EID: 0037372473     PISSN: 09268782     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1021567425133     Document Type: Article

References (18)

1. S. Agarwal, R. Agrawal, P.M. Deshpande, A. Gupta, J.F. Naughton, R. Ramakrishnan, and S. Sarawagi, "On the computation of multidimensional aggregates," in Proceedings of the 22nd International Conference on Very Large Data Bases, Bombay, India, January 1996, pp. 506-521.
2. K.P. Brown, M.J. Carey, and M. Livny, "Managing memory to meet multiclass workload response time goal," in Proceedings of the 19th International Conference on Very Large Data Bases, Brighton, England, September 1993, pp. 328-341.
3. P.M. Deshpande et al., "Computation of multidimensional aggregates," Technical Report 1314, University of Wisconsin-Madison, 1996.
4. D.J. DeWitt and J. Gray, "Parallel database systems: The future of high performance database systems," CACM, vol. 35, no. 6, pp. 85-98, 1992.
5. D.J. DeWitt, J.F. Naughhton, D.A. Schneider, and Seshadri, "Practical skew handling in parallel joins," Technical Report, Department of Computer Sciences, University of Wisconsin-Madison, July 1992.
6. G. Grafe, "Query evaluation techniques for large databases," ACM Computing Surveys, vol. 25, no. 2, pp. 73-170, 1993.
7. J. Gray, A. Bosworth, A. Layman, and H. Pirahesh, "Data cube: A relational aggregation operator generalizing group-by, cross-tab, and sub-totals," in Proceedings of the 12th International Conference on Data Engineering, 1996, pp. 152-159.
8. K.A. Hua and C. Lee, "Handling data skew in multiprocessor database computers using partition tuning," in Proceedings of the 17th Conference on Very Large Data Bases, Barcelona, Spain, September 1991, pp. 525-535.
9. M. Kitsuregawa and Y. Ogawa, "Bucket spreading parallel hash: A new, robust, parallel hash join method for data skew in the super database computer (sdc)," in Proceedings of the 16th Conference on Very Large Data Bases, Brisbane, Australia, August 1990, pp. 210-221.
10. H. Lu, Beng Chin Ooi, and Kina-Lee Tan, Query Processing in Parallel Relational Database Systems, IEEE Press: New York, 1993.
11. H. Lu, Xiaohui Huang, and Zhixian Li, "Computing data cubes using massively parallel processors," in Proceedings of the Parallel Computing Workshop 1997 (PCW'97), Canberra, September 1997.
12. K.A. Ross and D. Srivastava, "Fast computation of sparse datacubes," in Proceedings of the 23rd International Conference on Very Large Data Bases, August 1997, pp. 116-125.
13. S. Sarawagi, R. Agrawal, and A. Gupta, "On computing the data cube," Technical Report Research Report RJ 10026, IBM Almaden Research Center, 1996.
14. S. Sesshadri and J.F. Naughton, "Sampling issues in parallel database system," in Proceedings of Conference on extending Database Technology, 1992.
15. A. Shatdal and J.F. Naughton, "Processing aggregates in parallel database systems," Technical Report-1233, Computer Sciences Department, University of Wisconsin-Madison, 1994.
16. B.A. Shirazi, A.R. Hurson, and K.M. Kavi, Scheduling and Load Balancing in Parallel and Distributed Systems, IEEE Computer Society Press: Los Alamitos, CA, 1995.
17. C.B. Walton, A.G. Dale, and R.M. Jenevein, "A taxonomy and performance model of data skew effects in parallel joins," in Proceedings of the 17th Conference on Very Large Data Bases, Barcelona, Spain, September 1991, pp. 537-548.
18. Y. Zhao, P.M. Deshpande, and J.F. Naughton, "An array-based algorithm for simultaneous multidimensional aggregations," in Proceedings of the 1997 ACM-SIGMOD International Conference on Management of Data, 1997, pp. 159-170.