Dynamic query scheduling in parallel data warehouses

Concurrency and Computation: Practice and Experience

Volumn 15, Issue 11-12, 2003, Pages 1169-1190

  Märtens, Holger ^a,c   Rahm, Erhard ^b   Stöhr, Thomas ^b  

^a University of Applied Sciences Braunschweig   (Germany)

^b UNIVERSITY OF LEIPZIG   (Germany)

^c UNIVERSITY OF APPLIED SCIENCES   (Germany)

Author keywords

Data warehousing; Disk contention; Load balancing; Parallel database systems; Query optimization; Shared Disk architecture

Indexed keywords

COMPUTER ARCHITECTURE; COMPUTER SIMULATION; DATA STORAGE EQUIPMENT; OPTIMIZATION; PARALLEL PROCESSING SYSTEMS; QUERY LANGUAGES; SCHEDULING;

LOAD BALANCING;

DATA WAREHOUSES;

EID: 18844469834     PISSN: 15320626     EISSN: None     Source Type: Journal    
DOI: 10.1002/cpe.786     Document Type: Conference Paper

References (44)

1. Gray J et al. Data cube; A relational aggregation operator generalizing group-by, cross-tab, and sub-totals. Data Mining and Knowledge Discovery, vol. 1, Fayyad U, Mannila H, Piatetsky-Shapiro G (eds.), 1997; 29-53.
2. O'Neil P, Graefe G. Multi-table joins through bitmapped join indices. ACM SIGMOD Record 1995; 24(3):8-11.
3. O'Neil P, Quass D. Improved query performance with variant indexes. Proceedings of the ACM SIGMOD Conference, Tucson, AZ, 1997. ACM Press, 1997.
4. Stöhr T, Märtens H, Rahm E. Multi-dimensional database allocation for parallel data warehouses. Proceedings of the 26th VLDB Conference, Cairo, 2000. Morgan Kaufmann: San Francisco, CA, 2000.
5. Baralis E, Paraboschi S, Teniente E. Materialized view selection in a multidimensional database. Proceedings of the 23rd VLDB Conference, Athens, 1997. Morgan Kaufmann: San Francisco, CA, 1997.
6. Gupta A, Mumick IS. Maintenance of materialized view: Problems, techniques, and applications. Data Engineering Bulletin 1995; 18(2):3-18.
7. Chaudhuri S, Dayal U. An overview of data warehousing and OLAP technology. SIGMOD Record 1997; 26(1):65-74.
8. DeWitt DJ, Gray J. Parallel database systems: The future of high performance database systems. Communications of the ACM 1992; 35(6):85-98.
9. Bouganim L, Florescu D, Valduriez P. Dynamic load balancing in hierarchical parallel database systems. Proceedings of the 22nd VLDB Conference, Bombay, 1996. Morgan Kaufmann: San Francisco, CA, 1996.
10. DeWitt DJ, Naughton JF, Schneider DA, Seshadri S. Practical skew handling in parallel joins. Proceedings of the 18th VLDB Conference, Vancouver, 1992. Morgan Kaufmann: San Francisco, CA, 1992.
11. Lu H, Tan KL. Dynamic and load-balanced task-oriented database query processing in parallel systems. Proceedings of the 3rd EDBT Conference, Vienna, 1992 (Lecture Notes in Computer Science, vol. 580). Springer: Berlin, 1992.
12. Manegold S, Obermaier JK, Waas F. Load balanced query evaluation in shared-everything environments. Proceedings of the 3rd Euro-Par Conference, Passau, 1997 (Lecture Notes in Computer Science, vol. 1300). Springer: Berlin, 1997.
13. Nodine MH, Vitter JS. Deterministic distribution sort in shared and distributed memory multiprocessors. Proceedings of the 5th ACM SPAA, Velen, 1993. ACM Press, 1993.
14. Rahm E, Stöhr T. Analysis of parallel scan processing in parallel shared disk database systems. Proceedings of the 1st Euro-Par Conference, Stockholm, 1995 (Lecture Notes in Computer Science, vol. 966). Springer: Berlin, 1995.
15. Brown KP, Mehta M, Carey MJ, Livny M. Towards automated performance tuning for complex workloads. Proceedings of the 20th VLDB Conference, Santiago, 1994. Morgan Kaufmann: San Francisco, CA, 1994.
16. Rahm E, Marek R. Dynamic multi-resource load balancing in parallel database systems. Proceedings of the 21th VLDB Conference, Zurich, 1995. Morgan Kaufmann: San Francisco, CA, 1995.
17. Spiliopoulou M, Freytag JC. Modelling resource utilization in pipelined query execution. Proceedings of the 2nd Euro-Par Conference, Lyon, 1996 (Lecture Notes in Computer Science, vol. 1123/1124). Springer: Berlin, 1996.
18. Avnur R, Hellerstein JM. Eddies: Continuously adaptive query processing. Proceedings of ACM SIGMOD Conference, Dallas, TX, 2000. ACM Press, 2000.
19. Märtens H. Skew-insensitive join processing in shared-disk database systems. Proceedings of the 3rd IDPT Conference, Berlin, 1998. Society for Design and Process Science: Austin, TX, 1998.
20. 3PP Conference, Brisbane, 1995. IEEE Computer Society Press: Washington, DC, 1995.
21. Chen PM, Lee EL, Gibson GA, Katz RH, Patterson DA. RAID: High-performance, reliable secondary storage. ACM Computing Survey's 1994; 26(2): 145-185.
22. Ghandeharizadeh S, DeWitt DJ, Qureshi W. A performance analysis of alternative multi-attribute declustering strategies. Proceedings of the ACM SIGMOD Conference, San Diego, CA, 1992. ACM Press, 1992.
23. Mehta M, DeWitt DJ. Data placement in shared-nothing parallel database systems. VLDB Journal 1997; 6(1):53-72.
24. Rahm E, Märtens H, Stöhr T. On flexible allocation of index and temporary data in parallel database systems. Proceedings of the 8th HPTS Workshop, Asilomar, 1999. http://research.microsoft.com/̃gray/hpts99/.
25. Scheuermann P, Weikum G, Zabback P. Data partitioning and load balancing in parallel disk systems. VLDB Journal 1998; 7(1):48-66.
26. Wu K-L, Yu PS, Chung J-Y, Teng JZ. A performance study of workfile disk management for concurrent mergesorts in a multiprocessor database system. Proceedings of the 21st VLDB Conference, Zurich, 1995. Morgan Kaufmann: San Francisco, CA, 1995.
27. Rahm E. Parallel query processing in shared disk database systems. Proceedings of the 5th HPTS Workshop, Asilomar, 1993.
28. Reuter A. Load control and load balancing in a shared database management system. Proceedings 2nd ICDE Conference, Los Angeles, CA, 1986. IEEE Computer Society Press: Washington, DC, 1986.
29. Mohan C, Narang I. Recovery and coherency-control protocols for fast intersystem page transfer and fine-granularity locking in a shared disks transaction environment. Proceedings of the 17th VLDB Conference, Barcelona, 1991. Morgan Kaufmann: San Francisco, CA, 1991.
30. Rahm E. Empirical evaluation of concurrency and coherency control protocols for database sharing systems. ACM Trans. Database Systems 1993; 18(2):333-377.
31. International Business Machines Corp. IBM DB2 Universal Database for OS/390 and z/OS Administration Guide Version 7. Part No. SC26-9931-02, October, 2002. IBM Corp.: White Plains, NY, 2002.
32. Oracle Corp. Oracle9i Data Warehousing Guide. Part No. A96520-01, March. Oracle Corp.: Redwood Shores, CA, 2002.
33. Sybase, Inc. Sybase Adaptive Server IQ 12.4.3 Administration and Performance Guide. Document ID 38152-01-1243-01, May, 2001. Sybase Corp.: Dublin, CA, 2001.
34. International Business Machines Corp. Performance Guide for IBM Informix Extended Parallel Server Version 8.40. Part No. 000-9083, August, 2002. IBM Corp.: White Plains, NY, 2002.
35. International Business Machines Corp. IBM Red Brick Warehouse Version 6.20 Query Performance Guide. Part No. 000-9045, August, 2002. IBM Corp.: White Plains, NY, 2002.
36. Berenson H, Delaney K. Microsoft SQL Server Query Processor Internals and Architecture. White Paper, Microsoft Corp. Microsoft Corp.: Redwood, WA, 2000.
37. NCR Corp. Teradata RDBMS Performance Optimization V2R4.1. Part No. B035-1097-061A, October, 2001. NCR Corp.: Dayton, OH, 2001.
38. Graham RL. Bounds on multiprocessing timing anomalies. SIAM Journal of Applied Mathematics 1969; 17(3):416-429.
39. Gardy D, Némirovski L. Urn models and Yao's formula. Proceedings of the 7th ICDT Conference, Jerusalem, 1999 (Lecture Notes in Computer Science, vol. 1540). Springer: Berlin, 1999.
40. Yao SB. Approximating block accesses in data base organizations. Communications of the ACM 1977; 20(4):260-261.
41. APB-1 OLAP Benchmark, Release II. OLAP Council, November 1998. http://www/olapcouncil.org.
42. Wu M-C, Buchmann AP. Encoded bitmap indexing for data warehouses. Proceedings 14th ICDE Conference, Orlando, FL, 1998. IEEE Computer Society Press: Washington, DC, 1998.
43. Wallon CB, Dale AG, Jenevein RM. A taxonomy and performance model of data skew effects in parallel joins. Proceedings of the 17th VLDB Conference, Barcelona, 1991. Morgan Kaufmann: San Francisco, CA, 1991.
44. Märtens H. On parallel join processing in object-relational database systems. Proceedings of the 9th BTW Conference, Oldenburg, 2001. Springer: Berlin, 2001.