An overview of parallel query optimization in relational systems

Proceedings - International Workshop on Database and Expert Systems Applications, DEXA

Volumn 2000-January, Issue , 2000, Pages 629-634

  Hameurlain, A ^a   Morvan, F ^a  

^a UNIVERSITÉ PAUL SABATIER   (France)

Author keywords

Cost function; Data mining; Delay; Design optimization; Optimization methods; Query processing; Relational databases; Resource management; Statistics; Throughput

Indexed keywords

COST ESTIMATING; COST FUNCTIONS; DATA MINING; EXPERT SYSTEMS; INFORMATION MANAGEMENT; QUERY LANGUAGES; QUERY PROCESSING; RESOURCE ALLOCATION; STATISTICS; THROUGHPUT;

DELAY; DESIGN OPTIMIZATION; OPTIMIZATION METHOD; RELATIONAL DATABASE; RESOURCE MANAGEMENT;

RELATIONAL DATABASE SYSTEMS;

EID: 70349467120     PISSN: 15294188     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/DEXA.2000.875090     Document Type: Conference Paper

References (64)

1. A. Aboulnaga and S. Chaudhuri, "Self-tuning Histograms: Building Histograms Without Looking of Data", Proc. of ACM SIGMOD, Vol. 28, ACM Press, NY, 1999, pp. 181-192.
2. S. Bonneau and A. Hameurlain, "A Greedy Modifiable Mapping Heuristic of a SQL Query onto a Shared-Nothing Parallel Architecture" (in French), Revue Calculateurs Parallèles, Vol. 9, Hermès, Paris, 1997, pp. 285-304.
3. S. Bonneau and A. Hameurlain, "Query Mapping onto a Shared-Nothing Multiprocessor Architecture: from Static to Dynamic", Proc. of the 2 rd National Conf. on Dynamic Mapping and Load Partitioning, Lille, France, 1998, pp. 87-91, and Technical Report (in French), No. IRIT/98-17-R, IRIT, Toulouse, 1998, 19 pages.
4. S. Bonneau, "SQL Query Mapping onto a Shared-Nothing Multiprocessor Architecture: from Static to Dynamic", Ph.D. Thesis (in French), Univ. P. Sabatier/IRIT, Toulouse, 1999, 220 pages.
5. S. Bonneau and A. Hameurlain, "Hybrid Simultaneous Scheduling and Mapping in SQL Multi-Query Parallelization", Proc. of the 10th int'l. Conf. on Database and Expert Systems Applications DEXA, LNCS, Vol.1677, Florence, 1999, pp. 88-99.
6. L. Bouganim and P. Valduiriez, "Dynamic Load Balancing Hierarchical Parallel Database Systems", Proc. of the 23rd VLDB Conf., Morgan Kaufmann, CA, 1996, pp. 436-447.
7. L. Bouganim, O. Kapitskaia, and P. Valduriez, "Memory-Adative Scheduling for large Query", Proc. of the 7th int'l. Conf. on Information and Knowledge Management CIKM'98, ACM Press, NY, 1998, pp. 105-115.
8. L. Bouganim, D. Florescu, and P. Valduiriez, "Load Balancing for Prallel Query Execution on NUMA Multiprocesors", Distributed and Parallel Databases, Vol. 7, Kluwer Academic, Amsterdam, 1999, pp. 99-121.
9. L. Brunie and H. Kosch, "Integration of Scheduling Heuristics into Parallel Relational Query Optimization" (in French), Revue Calculateurs Parallèles, Vol. 9, Hermès, Paris, 1997, pp. 327-346.
10. L. Brunie and H. Kosch, and W. Wohner, "From the modeling of parallel relational query processing to query optimization and simulation", Parallel Processing Letters, Vol. 8, World Scientific, Singapore, 1998, p. 2-24.
11. S. Chaudhuri, R. Motwani, and V. Narasayya, "Random Sampling for Histgram Construction: How much is enough?", Proc. of ACM SIGMOD, Vol. 27, ACM Press, NY, 1998, pp. 436-447.
12. S. Chaudhuri, "An Overview of Query Optimization in Relational Systems", Symposium in Principles of Database Systems PODS'98, ACM Press, Seattle, 1998, pp. 34-43.
13. C. Chekuri and W. Hasan, "Scheduling Problem in Parallel Query Optimization", Symposium in Principles of Database Systems PODS, ACM Press, NY, 1995, pp. 255-265.
14. M.S. Chen et al., "Using Segmented Right-Deep Trees for the Execution of Pipelined Hash Joins", Proc. of the 18th VLDB Conf., Morgan Kaufmann, CA, 1992, pp. 15-26.
15. D.J. DeWitt and J. Gray, "Parallel Database Systems: The Future of High Performance Database Systems", Communication of the ACM, Vol. 35, ACM Press, NY, 1992, pp. 85-98.
16. D.J. DeWitt, N. Kabra, J. Luo, J.M. Patel, and J.-B. Yu, "Client-Server Paradise", Proc. of the 20th VLDB Conf., Morgan Kaufmann, CA, 1994, 558-569.
17. S. Ganguly, W. Hasan, and R. Krishnamurthy, "Query Optimization for Parallel Execution", Proc. of ACM SIGMOD, Vol. 21, ACM Press, NY, 1992, pp. 9-18.
18. S. Ganguly, A. Goel, and A. Silberschatz, "Efficient and Accurate Cost Models for Parallel Query Optimization", Proc. of PODS, ACM Press, NY, 1996, pp. 172-182.
19. M. N. Garofalakis and Y. E. Ioannidis, "Multi-dimensional Resource Scheduling for Parallel Queries", Proc. of ACM SIGMOD, Vol. 25 , ACM Press, NY, 1996, pp. 365-376.
20. M.N. Garofalakis and Y. E. Ioannidis, "Parallel Query Scheduling and Optimization with Time- and Space- Shared Resources", Proc. of the 23rd VLDB Conf., Morgan Kaufmann, CA, 1997, pp. 296-305.
21. G. Graefe and H. ward, "Dynamic Query Evaluation Plans", Proc. of ACM SIGMOD, Vol. 18, ACM Press, NY, 1989, pp. 337-388.
22. G. Graefe and R. Cole, "Optimization of Dynamic Query Evakuation Plans", Proc. of ACM SIGMOD, Vol. 23, ACM Press, NY, 1994, pp. 150-160.
23. A. Hameurlain and F. Morvan, "An Analytical Method to Allocate Processors in High Performance Parallel Execution of Recursive Queries", Proc of the 3rd int'l. Conf., DEXA, Springer, Berlin, 1992, pp. 44-47.
24. A. Hameurlain and F. Morvan, "A Cost Evaluator for Parallel Database Systems", Proc of the 6th int'l. Conf., DEXA '95, LNCS, Vol. 978, Springer, Berlin, 1995, pp. 146-156.
25. A. Hameurlain, F. Morvan, "Scheduling and Mapping for Parallel Execution of Extended SQL Queries", Proc. of the 4th int'l. Conf., CIKM'95, ACM Press, NY, 1995, pp. 197-204.
26. W. Hasan and R. Motwani, "Optimization Algorithms for Exploiting the Parallelism-Communication Tradeoff in Pipelined Parallelism", Proc. of the 20th VLDB Conf., Morgan Kaufmann, CA, 1994, pp. 36-47.
27. W. Hasan, "Optimization of SQL Queries for Parallel Machines", Ph.D. Thesis, Stanford University, 1995, 239 pages.
28. W. Hasan, D. Floresco and P. Valduriez, "Open Issues in Parallel Query Optimization", Proc. of ACM SIGMOD, Vol. 25, ACM Press, NY, 1996, pp. 28-33.
29. A. Helal, D. Yuan, and H El-Rewini, "Dynamic Data Reallocation for Skew Management in Shared-Nothing Parallel Databases", Distributed and Parallel Databases, Vol. 5, Kluwer Academic, Amsterdam, 1997, pp. 271-288.
30. W. Hong and M. Stonebracker, "Optimization of Parallel Query Execution Plans in XPRS", Proc. of the first int'l. Conf. on Parallel and Distribued information Systems PDIS, IEEE CS Press, CA, 1991, pp, 218-225.
31. W. Hong, "Exploiting Inter-Operation Parallelism in XPRS", Proc. of ACM SIGMOD, ACM Press, NY, 1992, pp. 19-28.
32. H.-L. Hsiao, M. S. Chen, and P. S. Yu, "On Parallel Execution of Multiple Pipelined Hash Joins", Proc. of the 1994 ACM SIGMOD, Vol. 23, ACM Press, NY, pp. 185-196.
33. K. A. Hua. C. Lee, and J.-K. Peir, "Interconnecting Shared-Everything Systems for Efficient Parallel Query Processing", Proc. of the first int'l. Conf. on Parallel Distributed Information Systems, IEEE CS. Press, CA, 1991, pp. 262-270.
34. Z.G. Ives, D. Florescu, M. Friedman, A. Levy, and D. S. Weld, "An Adaptive Query Execution System for Data Integration", Proc. of the 1999 ACM SIGMOD, Vol. 28, ACM Press, NY, pp. 299-310.
35. Y.E. Ioannidis and S. Christodoulakis, "On the Propagation of Errors in the Size of Join Results", Proc. of the 1991 ACM SIGMOD, Vol. 20, ACM Pres, NY, pp. 268-277.
36. Y. Ionnadis, R.T. Ng, K. Shim, and T. Sellis, "Parametric Query Optimization", Proc. of the 18th VLDB Conf., Morgan Kaufmann, CA, 1992, pp. 103-114.
37. Ioannidis, Y. E., Poosala, V., "Balancing Histogram Optimality and Practicality for Query Result Size Estimation", Proc. of the 1995 ACM SIGMOD Conf., CA, pp. 233-244.
38. H. V. Jagadish, N. Koudas, S. Muthukrishnan, V. Poosala, K. C. Sevcik, and T. Suel, "Optimal Histograms with Quality Guarantees", Proc. of the 24th VLDB Conf., Morgan Kaufmann, CA, 1998, pp. 275-286.
39. N. Kabra and D. - J. DeWitt, "Efficient Mid-Query Re-Optimization of Sub-Optimal Query Execution Plans", Proc. of the 1998 ACM SIGMOD, Vol. 27, ACM Press, NY, pp. 106-117.
40. N. Kabra and D. - J. DeWitt, "OPT++: An Object-Oriented Implementation for Extensible Database Query Optimization", VLDB Journal, Vol. 8, Springer, Berlin, 1999, pp. 55-78.
41. M.F. Khan, R. Paul, I. Ahmed, and A. Ghafoor, "Intensive Data Management in Parallel Systems: A Survey", Distributed and Parallel Databases, Vol. 7, Kluwer Academic, Boston, 1999, pp. 383-414.
42. M. Kitsuregawa and Y. Ogawa, "Bucket Spreading Parallel Hash: A New, Robust, Parallel Hash Join Method for Data Skew in the Super Database Computer", Proc. of the 16th VLDB, Morgan Kaufmann, CA, 1990, pp. 210-221.
43. H. Kosch, "Exploiting Serialized Bushy Trees for Parallel Relational Query Optimization", Ph.D. Thesis, Ecole Normale Supérieure de Lyon LIP, Lyon, 1997, 189 pages.
44. H. Kosch, "Managing the operator ordering problem in parallel databases", Future Generation Computer Systems, Vol. 14, Elsevier, Amsterdam, 1999.
45. J.-H. Lee, D.-H. Kim and C.-W. Chung , "Multi-dimensional Selectivity Estimation Using Comrpressed Histogram Information", Proc. of the 1999 ACM SIGMOD, Vol. 28, ACM Press, NY, pp. 205-214.
46. T. Leighton and E.J. Schwabe, "Efficient Algorithms for Dynamic Allocation of Distributed Memory", Algoritmica, Vol. 24, Springer, NY, 1999, pp. 139-171.
47. Y. Lin, W. Sun, N.D. Rishe, and X. Xiang, "A Hybrid Estimator for Selectivity Estimation", IEEE TKDE, Vol. 11, IEEE CS Press, 1999, pp. 338-354.
48. H. Lu and K.L. Tan, "Dynamic and Load-Balanced Task-Oriented Database Query Processing in Parallel Systems", Proc. 3rd Int'l Conf. Extending Data Base Technology, 1992, pp. 357-372.
49. H. Lu, B.C. Ooi, and K.L. Tan, Query Processing in Parallel Relational Database Systems, IEEE CS Press, CA, 1994.
50. M. Mehta and D.-J. DeWitt, "Managing Intra-Operator Parallelism in Parallel Database Systems", Proc. of the 21th Int'l. Conf. on VLDB, Morgan Kaufmann, CA, 1995, pp. 382-394.
51. M. Mehta and D.-J. DeWitt, "Data Placement in Shared-Nothing Parallel Database Systems", The VLDB Journal, Vol.6, Springer, Berlin, 1997, pp. 53-72.
52. B. Nag and D.-J. DeWitt., "Memory Allocation Strategies for Complex Decision Support Queries", Proc. of the 7th Int'l. Conf. on Information and Knowledge Management CIKM'98, ACM Press, NY, 1998, p. 116-123.
53. Piatetsky-Shapiro, G., Connel, C., "Accurate Estimation of the Number of Tuples Satisfying a Condition", Proc. of ACM SIGMOD, ACM Press, NY, 1984, pp. 256-276.
54. V. Poosala and Y.E. Ioannidis, "Estimation of Query-Result Distribution and its Application in Parallel-Join Load Balancing", Proc. of the 23rd VLDB Conf., Morgan Kaufmann, CA, 1996, pp. 448-459.
55. E. Rahm and R. Marek, "Analysis of Dynamic Load Balncing Strategies for Parallel Shared Nothing Database Systems", Proc. of the 19 th VLDB Conf., Morgan Kaufmann, CA, 1993, pp.182-193.
56. E. Rahm and R. Marek, "Dynamic Multi-Resource Load Balancing in Parallel Database Systems", Proc. of the 21st VLDB Conf., Morgan Kaufmannn, CA, 1995, pp. 395-406.
57. D. Schneider and D.-J. DeWitt, "A Performance Evaluation of four Parallel Join Algorithms in a Shared-Nothing Multiprocessor Environment", Proc. of the 1989 ACM SIGMOD, ACM Press, NY, pp. 110-121.
58. D. Schneider and D.J. DeWitt, "Tradeoffs in Processing Complex Join Queries via Hashing in Multiprocessor Database Machines", Proc. of the 16th VLDB Conf., Morgan Kaufmann, CA, 1990, pp. 469-480.
59. P. G. Selinger, M. Astrshan, D. Chamberlin, R. Lorie, and T. Price, "Access Path Selection in a Relational Database Management System", Proc. of the 1979 ACM SIGMOD, ACM Press, NY, pp. 23-34.
60. K.-L. Tan and H. Lu, "On Resource Scheduling of Multi-Join Queries in Parallel Database Systems", Information Processing Letters, Vol. 48, Elsevier, Amsterdam, 1993, pp. 189-195.
61. P. Valduriez, "Parallel Database Systems: Open Problems and News Issues", Distributed and Parallel Databases, Vol. 1, Kluwer Academic, Boston, 1993, pp. 137-165.
62. C.B. Walton and A.G. Dale, and R.M. Jenevin, "A Taxonomy and Performance Model of Data Skew Effects in Parallel Join", Proc. of the 17th int'l. Conf. on VLDB, Morgan Kaufmann, CA, 1991, pp. 537-548.
63. E. Wong, and, K. Youssefi, "Decomposition: A Strategy for Query Processing", ACM Transaction on Database Systems, Vol. 1, ACM Press, CA, 1976, pp. 223-241.
64. M. Ziane, M. Zait, and P. Borlat-Salamet, "Parallel Query Processing in DBS3", 2nd Intl. Conf. on Parallel and Distribued Information Systems, CA, IEEE CS Press, 1993, pp. 93-102