Consistent selectivity estimation via maximum entropy

VLDB Journal

Volumn 16, Issue 1, 2007, Pages 55-76

  Markl, V ^a   Haas, P J ^a   Kutsch, M ^b   Megiddo, N ^a   Srivastava, U ^c   Tran, T M ^a  

^a IBM ALMADEN RESEARCH CENTER   (United States)

^b IBM   (Germany)

^c STANFORD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 33750457703     PISSN: 10668888     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00778-006-0030-1     Document Type: Conference Paper

References (35)

1. Aboulnaga, A., Chaudhuri, S.: Self-tuning histograms: Building histograms without looking at data. SIGMOD 181-192 (1999)
2. Aboulnaga, A., Haas, P., Lightstone, S., et al.: Automated statistics collection in DB2 UDB. VLDB 1146-1157 (2004)
3. Ault, M., Tumma, M., Liu, D., et al.: Oracle Database 10 g new features: Oracle10g reference for advanced tuning and administration. Rampant TechPress (2003)
4. Bruno, N., Chaudhuri, S., Gravano, L.: STHoles: a multi-dimensional workload-aware histogram. SIGMOD 211-222 (2001)
5. Bruno, N., Chaudhuri, S.: Exploiting statistics on query expressions for optimization. SIGMOD 263-274 (2002)
6. Bruno, N., Chaudhuri, S.: Efficient creation of statistics over query expressions. ICDE 201-212 (2003)
7. Bruno, N., Chaudhuri, S.: Conditional selectivity for statistics on query expressions. SIGMOD 311-322 (2004)
8. Chaudhuri, S., Narasayya, V.: Automating statistics management for query optimizers. ICDE 339-348 (2000)
9. Chiu, D., Wong, A., Cheung, B.: Information discovery through hierarchical maximum-entropy discretization and synthesis. In: Piatesky-Shapiro, G., Fracley, W.J., (eds.), Knowledge Discovery in Databases, pp. 125-140 MIT Press, Cambridge (1991)
10. Christodoulakis, S.: Estimating record selectivities. Inf. Syst. 8(2):105-115 (1983)
11. Darroch, J.N., Ratcliff, D.: Generalized iterative scaling for log-linear models. Ann. Math. Statist. 43:1470-1480 (1972)
12. Deshpande, A., Garofalakis, M., Rastogi, R.: Independence is good: dependency-based histogram synopses for high-dimensional data. SIGMOD 199-210 (2001)
13. Galindo-Legaria, C., Joshi, M., Waas, F., et al.: Statistics on views. VLDB 952-962 (2003)
14. García-Varea, I., Och, F., Ney, H., et al.: Refined Lexikon models for statistical machine translation using a maximum-entropy approach. ACL 204-211 (2001)
15. Getoor, L., Taskar, B., Koller, D.: Selectivity estimation using probabilistic models. SIGMOD 461-472 (2001)
16. Greiff, W., Ponte, J.: The maximum-entropy approach and probabilistic IR models. ACM Trans. Inform. Sys. 18(3):246-287 (2000)
17. Guiasu, S., Shenitzer, A.: The principle of maximum-entropy. Math. Intell. 7(1):42-48 (1985)
18. Haas, P., Swami, A.: Sampling-based selectivity estimation for joins using augmented frequent-value statistics. ICDE 522-531 (1995)
19. IBM Corp.: DB2 Universal Database for iSeries: Database Performance and Query Optimization (2002)
20. IBM Corp.: DB2 v8.2 Performance Guide (2004)
21. Ilyas, I.F., Markl, V., Haas, P.J., Brown, P.G., Aboulnaga, A.: CORDS: automatic discovery of correlations and soft functional dependencies. SIGMOD 647-458 (2004)
22. Ioannidis, Y.E., Christodoulakis, S.: Propagation of errors in the size of join results. SIGMOD 268-277 (1991)
23. Kutsch, M., Haas, P.J., Markl, V., Megiddo, N., Tran, T.M.: Integrating a maximum-entropy cardinality estimator into DB2 UDB. EDBT 1092-1096 (2006)
24. Lynch, C.A.: Selectivity estimation and query optimization in large databases with highly skewed distribution of column values. VLDB 240-251 (1988)
25. Markl, V., Megiddo, N., Kutsch, M., Tran, T.M., Haas, P.J., Srivastava, U.: Consistently estimating the selectivity of conjuncts of predicates. VLDB 378-384 (2005)
26. Microsoft Corp.: SQL Server 2000 Books Online v8.00.02 (2004)
27. Piatetsky-Shapiro, G., Connell, C.: Accurate estimation of the number of tuples satisfying a condition. SIGMOD 256-276 (1984)
28. Poosala, V., et al.: Improved histograms for selectivity estimation of range predicates. SIGMOD 294-305 (1996)
29. Poosala, V., Ioannidis, Y.: Selectivity estimation without the attribute value independence assumption. VLDB 486-495 (1997)
30. Selinger, P.G., et al.: Access path selection in a relational DBMS. SIGMOD 23-34 (1979)
31. Shannon, CE.: A mathematical theory of communication. Bell Sys. Tech. I 27, 379-423 623-656 (1948)
32. Srivastava, U., Haas, P.J., Markl, V., Megiddo, N.: ISOMER: consistent histogram construction using query feedback. ICDE 6 (2006)
33. Stillger, M., Lohman, G., Markl, V., Kandil, M.: LEO - DB2's learning optimizer. VLDB 19-28 (2001)
34. Swami, A.N., Schiefer, K.B.: On the estimation of join result sizes. EDBT 287-300 (1994)
35. Van Gelder, A.: Multiple join size estimation by virtual domains. PODS 180-189 (1993)