Consistently estimating the selectivity of conjuncts of predicates

VLDB 2005 - Proceedings of 31st International Conference on Very Large Data Bases

Volumn 1, Issue , 2005, Pages 373-384

  Markl, V ^a   Megiddo, N ^a   Kutsch, M ^b   Tran, T M ^a   Haas, P ^a   Srivastava, U ^c  

^a IBM ALMADEN RESEARCH CENTER   (United States)

^b IBM   (Germany)

^c STANFORD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

JOINT DISTRIBUTION; MAXIMUM ENTROPY (ME); MULTIVARIATE STATISTICS (MVS);

COSTS; DATABASE SYSTEMS; OPTIMIZATION; PROBLEM SOLVING; SOFTWARE PROTOTYPING; STATISTICAL METHODS;

QUERY LANGUAGES;

EID: 33745614938     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (33)

1. AC99 A. Aboulnaga, S. Chaudhuri: Self-tuning Histograms: Building Histograms Without Looking at Data. SIGMOD 1999: 181-192
2. AHL+04 A. Aboulnaga, P. Haas, S. Lightstone, et al.: Automated Statistics Collection in DB2 UDB. VLDB 2004: 1146-1157
3. ATL-03 M. Ault, M. Tumma, D. Liu, et al.. Oracle Database 10g New Features: Oracle 10g Reference for Advanced Tuning and Administration. Rampant TechPress, 2003.
4. BCG01 N. Bruno, S. Chaudhuri, L. Gravano: STHoles: A Multidimensional Workload-Aware Histogram. SIGMOD 2001
5. BC02 N. Bruno and S. Chaudhuri: Exploiting Statistics on Query Expressions for Optimization. SIGMOD 2002
6. BC03 N. Bruno, S. Chaudhuri: Efficient Creation of Statistics over Query Expressions. ICDE 2003:
7. BC04 N. Bruno, S. Chaudhuri: Conditional Selectivity for Statistics on Query Expressions. SIGMOD 2004: 311-322
8. Chr83 S. Christodoulakis: Estimating record selectivities. Inf. Syst. 8(2): 105-115 (1983)
9. CN00 S. Chaudhuri, V. Narasayya: Automating Statistics Management for Query Optimizers. ICDE 2000: 339-348
10. CWC91 D. Chiu, A. Wong, B. Cheung: Information Discovery through Hierarchical Maximum-entropy Discretization and Synthesis. Knowledge Discovery in Databases 1991: 125-140
11. DGR01 A. Deshpande, M. Garofalakis, R. Rastogi: Independence is Good: Dependency-Based Histogram Synopses for High-Dimensional Data. SIGMOD 2001
12. DR72 J.N. Darroch and D. Ratcliff: Generalized iterative scaling for log-linear models. The Annals of Mathematical Statistics (43), 1972:1470-1480.
13. DR99 D. Donjerkovic and R. Ramakrishnan: Probabilistic Optimization of Top N Queries. VLDB 1999: 411-422
14. Gel93 A. Van Gelder: Multiple Join Size Estimation by Virtual Domains, PODS 1993.
15. GJW+03 C. Galindo-Legaria, M. Joshi, F. Waas, et al: Statistics on Views. VLDB 2003: 952-962
16. GON-01 I. García-Varea, F. Och, H. Ney, et al: Refined Lexikon Models for Statistical Machine Translation Using a Maximum-entropy Approach. ACL 2001: 204-211
17. GP00 W. Greiff, J. Ponte: The maximum-entropy approach and probabilistic IR models. ACM TIS. 18(3): 246-287, 2000
18. GS85 S. Guiasu and A. Shenitzer. The principle of maximum-entropy. The Mathematical Intelligencer, 7(1), 1985.
19. GTK01 L. Getoor, B. Taskar, D. Koller: Selectivity Estimation using Probabilistic Models. SIGMOD 2001
20. HS95 P. Haas and A. Swami: Sampling-Based Selectivity Estimation for Joins Using Augmented Frequent-Value Statistics. ICDE 1995.
21. IBM02 DB2 Universal Database for iSeries: Database Performance and Query Optimization. IBM Corp., 2002.
22. IBM04 DB2 v8.2 Performance Guide. IBM Corp., 2004.
23. IC91 Y.E.Ioannidis and S.Christodoulakis: Propagation of Errors in the Size of Join Results. SIGMOD 1991
24. IMH+04 I. F. Ilyas, V. Markl, P. J. Haas, P. G. Brown, A. Aboulnaga: CORDS: Automatic discovery of correlations and soft functional dependencies. Proc. 2004 ACM SIGMOD, June 2004.
25. Lyn88 C. A. Lynch: Selectivity Estimation and Query Optimization in Large Databases with Highly Skewed Distribution of Column Values. VLDB 1988: 240-251
26. Mic04 SQL Server 2000 Books Online v8.00.02. Microsoft Corp., 2004.
27. PC84 G. Piatetsky-Shapiro, C. Connell: Accurate Estimation of the Number of Tuples Satisfying a Condition. SIGMOD Conference 1984: 256-276
28. PM+96 V. Poosala, et. al: Improved histograms for selectivity estimation of range predicates. SIGMOD 1996
29. PI97 V. Poosala and Y. Ioannidis: Selectivity Estimation without value independence. VLDB 1997
30. SAC+79 P.G. Selinger et al: Access Path Selection in a Relational DBMS. SIGMOD 1979
31. Sha48 C. E. Shannon: A mathematical theory of communication, Bell System Technical Journal, vol. 27, pp. 379-423 and 623-656, July and October, 1948
32. SLM+01 M. Stillger, G. Lohman, V. Markl, and M. Kandil: LEO - DB2's Learning Optimizer. VLDB 2001
33. SS94 A. N. Swami and K. B. Schiefer,:On the Estimation of Join Result Sizes. EDBT 1994