Cardinality estimation using sample views with quality assurance

Proceedings of the ACM SIGMOD International Conference on Management of Data

Volumn , Issue , 2007, Pages 175-186

  Larson, Per Ake ^a   Lehner, Wolfgang ^b   Zhou, Jingren ^a   Zabback, Peter ^c  

^a MICROSOFT RESEARCH   (United States)

^b DRESDEN UNIVERSITY OF TECHNOLOGY   (Germany)

^c MICROSOFT   (United States)

Author keywords

Cardinality estimation; Query optimization; Sample views; Sequential sampling; Statistical quality control

Indexed keywords

CARDINALITY ESTIMATION; QUERY OPTIMIZATION; SEQUENTIAL SAMPLING; STATISTICAL QUALITY CONTROL;

FEEDBACK CONTROL; OPTIMIZATION; PARAMETER ESTIMATION; SEQUENTIAL SWITCHING; STATISTICAL PROCESS CONTROL; USER INTERFACES;

QUERY PROCESSING;

EID: 35448981538     PISSN: 07308078     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1247480.1247502     Document Type: Conference Paper

References (30)

1. M. Abramowitz and I. Stegun. Handbook of Mathematical Functions. Dover Publications, 1966.
2. S. Acharya, P. B. Gibbons, V. Poosala, and S. Ramaswamy. The Aqua approximate query answering system. In SIGMOD, pages 574-576, 1999.
3. S. Acharya, P. B. Gibbons, V. Poosala, and S. Ramaswamy. Join Synopses for Approximate Query Answering. In SIGMOD, pages 275-286, 1999.
4. L. D. Brown, T. Cai, and A. DasGupta. Interval estimation for a binomial proportion. Statistical Science, 16:101-133, 2001.
5. J. Bunge and M. Fitzpatrick. Estimating the number of species: A review. Journal of the American Statistical Association, 88:364-373, 1993.
6. A. Chao. Nonparametric estimation of the number of classes in a population. Scandinavian Journal of Statistics, Theory and Applications, 11:265-270, 1984.
7. A. Chao and S.-M. Lee. Estimating the number of classes via, sample coverage. Journal of the American Statistical Association, 87:210-217, 1990.
8. M. Charikar, S. Chaudhuri, R. Motwani, and V. R. Narasayya. Towards estimation error guarantees for distinct values. In PODS, pages 268-279, 2000.
9. S. Chaudhuri, R., Motwani, and V. Narasayya. Random sampling for histogram construction: how much is enough? In SIGMOD, pages 436-447, 1998.
10. S. Chaudhuri, R. Motwani, and V. Narasayya. On Random Sampling over Joins. In SIGMOD, pages 263-274, 1999.
11. C. A. Galindo-Legaria, M. Joshi, F. Waas, and M.-C. Wu. Statistics on views. In VLDB, pages 952-962, 2003.
12. R. Gemulla, W. Lehner, and P. J. Haas. A dip in the reservoir: Maintaining sample synopses of evolving dataseis. In VLDB, pages 595-606, 2006.
13. P. J. Haas. Large-Sample and Deterministic Confidence Intervals for Online Aggregation. In SSDBM, pages 51-63, 1997.
14. P. J. Haas and C. Koenig. A bi-level Bernoulli scheme for database sampling. In SIGMOD, pages 275-286, 2004.
15. P. J. Haas, J. Naughton, S. Seshadri, and L. Stokes. Sampling-based estimation of the number of distinct values of an attribute. In VLDB, pages 311-322, 1995.
16. P. J. Haas and L. Stokes. Estimating the number of classes in a finite population. Journal of the American Statistical Association, 93:1475-1587, 1998.
17. P. J. Haas and A. N. Swami. Sequential sampling procedures for query size estimation. In SIGMOD, pages 341-350, 1992.
18. I. F. Ilyas, V. Mark!, P. J. Haas, P. Brown, and A. Aboulnaga. Cords: Automatic discovery of correlations and soft functional dependencies. In SIGMOD, pages 647-658, 2004.
19. V. Markl and G. M. Lohman. Learning table access cardinalities with LEO. In SIGMOD, page 613, 2002.
20. V. Markl, V. Raman, D. E. Simmen, G. M. Lohman, and H. Pirahesh. Robust query processing through progressive optimization. In SIGMOD, pages 659-670, 2004.
21. Y. Matias, J. S. Vitter, and M. Wang. Wavelet-based histograms for selectivity estimation. In SIGMOD, pages 448-459, 1998.
22. N.N. Engineering Statistics Handbook. National Institute of Standards and Technology, http://www.itl.nist.gov/div898/handbook, 2006.
23. F. Olken and D. Rotem. Random sampling from database files: A survey. In SSDBM, pages 92-111, 1990.
24. F. Olken and D. Rotem. Maintenance of Materialized Views of Sampling Queries. In ICDE, pages 632-641, 1992.
25. J. K. Ord and G. A. Whitmore. The Poisson-inverse Gaussian distribution as a model for species abundance. Communications in Statistics, 15(3), 1986.
26. J. Sauro and J. R., Lewis. Estimation completion rates from small samples using binomial confidence intervals: Comparison and recommendations. In Proc. Human and Ergonomics Society 49th Annual Meeting, pages 2100-2104, 2005.
27. A. Shlosser. On estimation of the size of the dictionary of a long text on the basis of a sample. Engineering Cybernetics, 19:97-102, 1981.
28. G. B. Wetherill and K. D. Glazebrook. Sequential methods in statistics, 3rd, ed. Chapman & Hall, 1986.
29. E. Wilson. Probable inference, the law of succession, and statistical inference. Journal of the American Statistical Association, 22:209-212, 1927.
30. D. Zelterman. Robust estimation in truncated discrete distributions with applications to capture-recapture experiments. Journal of Statistical Planning and Inference, 18:225-237, 1988.