Statistical Profile Estimation in Database Systems

ACM Computing Surveys (CSUR)

Volumn 20, Issue 3, 1988, Pages 191-221

  Mannino, Michael V ^a   Chu, Paicheng ^b   Sager, Thomas ^a  

^a UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^b OHIO STATE UNIVERSITY   (United States)

Author keywords

Access plan; Boolean expressions; database profile; relational model

Indexed keywords

MATHEMATICAL TECHNIQUES--ESTIMATION; STATISTICAL METHODS;

BOOLEAN EXPRESSIONS; DATABASE PROFILE; STATISTICAL PROFILE ESTIMATION;

DATABASE SYSTEMS;

EID: 0024073536     PISSN: 03600300     EISSN: 15577341     Source Type: Journal    
DOI: 10.1145/62061.62063     Document Type: Article

References (64)

1. Apers, P. M. G., Hevner, A. R., and Yao, S. B. 1983. Optimization algorithms for distributed queries. IEEE Trans. Softw. Eng. SE-9, 1, 57–68.
2. Astrahan, M., Schkolnick, M., And Whang, K. 1985. Counting unique values of an attribute without sorting. Tech. Rep. RJ 4960, IBM Research Division.
3. Batory, D., and Mannino, M. 1986. Panel on extensible database systems. In Proceedings of the ACM SIGMOD Conference (Washington, D.C., May). ACM, New York, pp. 187–190.
4. Bernstein, P., Goodman, N., Wong, E., Reeve, C., and Rothnie, J. 1981. Query processing in SDD-1: A system for distributed databases. ACM Trans. Database Syst. 6, 4 (Dec), 602–625.
5. Breiman, L., Meisel, W., and Purcell, E. 1977. Variable kernel estimates of multivariate densities. Technometrics 19, 135–144.
6. Cacoullos, T., 1966. Estimation of a multivariate density. Ann. Inst. Stat. Math. 18, 178–189.
7. Cardenas, A. 1975. Analysis and performance of inverted data-base structures. Commun. ACM 18, 5 (May), 253–263.
8. Ceri, S., and Pelagatti, G. 1984. Distributed Databases: Principles & Systems. McGraw-Hill, New York.
9. Chamberlin, D., Astrahan, M., King, W., Lorie, R., Mehl, J., Price, T., Schkolnick, M., Griffiths Selinger, P., Slutz, D., Wade, B., and Yost, R. 1981. Support for repetitive transactions and ad hoc queries in system R. ACM Trans. Database Syst. 6, 1 (Mar.), 70–94.
10. Cheung, T. 1982. Estimating block accesses and number of records in file management. Commun. ACM 25, 7 (July), 484–487.
11. Christodoulakis, S. 1981. Estimating selectivities in data bases. Ph.D. dissertation, CSRG-136, Computer Systems Research Group, Univ. of Toronto.
12. Christodoulakis, S. 1983a. Estimating record selectivities. Inf. Syst. 8, 2 105–115.
13. Christodoulakis, S. 1983b. Estimating block transfers and join sizes. In Proceedings of the ACM SIGMOD Conference (May). ACM, New York, pp. 40–54.
14. Christodoulakis, S. 1984a. Estimating block selectivities. Inf. Syst. 9, 1, 69–79.
15. Christodoulakis, S. 1984b. Implications of certain assumptions in database performance evaluation. ACM Trans. Database Syst. 9, 2 (June), 163–186.
16. Clark, C., and Schkade, L. 1983. Statistical Analysis for Administrative Decisions. South-Western, Cincinnati.
17. Copeland, G., Khoshafian, S., Smith, M., and Valduriez, P. 1986. Buffering schemes for permanent data. In Proceedings of the Conference on Data Engineering (COMPDEC) (Los Angeles, Calif., Feb.). IEEE, New York, pp. 214–221.
18. Devroye, L. 1985. A note on the L1 consistency of variable kernel estimates. Ann. Stat. 13, 1041–1049.
19. Dewitt, D., Katz, R., Olren, F., Shapiro, L., Stonebraker, M., and Wood, D. 1984. Implementation techniques for main memory database systems. In Proceedings of the ACM SIGMOD Conference (Boston, Mass. June). ACM, New York, pp. 1–8.
20. Fedorowicz, J. 1984. Database evaluation using multiple regression techniques. In Proceedings of the ACM SIGMOD Conference (Boston, Mass., June). ACM, New York, pp. 70–76.
21. Fedorowicz, J. 1987. Database performance evaluation in an indexed file environment. ACM Trans. Database Syst. 12, 1 (Mar.), 85–110.
22. Finkelstein, S., Schkolnick, M., and Tiberio, P. 1988. Physical database design for relational databases. ACM Trans. Database Syst. 13, 1 (Mar.), 91–128.
23. Fraser, D. 1957. Nonparametric Methods in Statistics. Wiley, New York.
24. Gelenbe, E., and Gardy, D. 1982. The size of projections of relations satisfying a functional dependency. In Proceedings of the 8th International Conference on Very Large Data Bases (Mexico City). Very Large Data Base Endowment, Saratoga, Calif., pp. 325–333.
25. Hevner, A., and Yao, S. B. 1979. Query processing in distributed database systems. IEEE Trans. Softw. Eng. SE-3, 3.
26. Ijbema, A., and Blanken, H. 1986. Estimating bucket accesses: A practical approach. In Proceedings of the Conference on Data Engineering (COMPDEC) (Los Angeles, Calif., Feb.), pp. 30–37.
27. Jarke, M., and Koch, J. 1984. Query optimization in database systems. ACM Comput. Surv. 16, 2 (June), 111–152.
28. Johnson, N., and Kotz, S. 1970. Distributions in Statistics: Continuous Univariate Distributions, vols. 1 and 2. Houghton Mifflin, Boston.
29. Kamel, N., and King, R. 1985. A model of data distribution based on texture analysis. In Proceedings of the ACM SIGMOD Conference (Austin, Tex., May). ACM, New York, pp. 319–325.
30. Kerschberg, L. Ting, P. D., and Yao, S. B. 1982. Query optimization in star computer networks. ACM Trans. Database Syst. 7, 4 (Dec), 678–711.
31. Kooi, R. 1980. The optimization of queries in relational databases. Ph.D. dissertation, Case Western Reserve Univ., Cleveland, Ohio.
32. Kotz, S., and Johnson, N. 1977. Urn Models and Their Application. Wiley, New York.
33. Kumar, A., and Stonebraker, M. 1987. The effect of join selectivities on optimal nesting order. SIGMOD Rec. 16, 1 (Mar.), 28–41.
34. Lohman, G., Mohan, C., Haas, L., Lindsay, B., Selinger, P., Wilms, P., and Daniels, D. 1985. Query processing in R&. In Query Processing in Database Systems, W. Kim, D. Batory, and D. Reiner, Eds. Springer-Verlag, New York, pp. 31–47.
35. Luk, W. 1983. On estimating block accesses in database organizations. Commun. ACM 26, 11 (Nov.), 945–947.
36. Mackert, L., and Lohman, G. 1985. Index scans using a finite LRU buffer: A validated I/O model. IBM Research Rep. RJ4836, Almaden Research Center, San Jose, Calif.
37. Mackert, L., and Lohman, G. 1986a. R& optimizer validation and performance evaluation for local queries. In Proceedings of the ACM SIGMOD Conference (Washington, D.C., May). ACM, New York, pp. 84–95.
38. Mackert, L., and Lohman, G. 1986b. R& Optimizer validation and performance evaluation for distributed queries. In Proceedings of the 12th International Conference on Very Large Databases (Kyoto, Japan, Aug.). Morgan Kaufmann Publishers, Inc. (Also IBM Research Report RJ5050, Alamaden Research Center, San Jose, Calif.)
39. Mahalanobis, P. 1936. On the generalized distance in statistics. In Proceedings of the National Institute of Sciences of India 12, pp. 35–49.
40. Mannino, M. 1986. Selectivity estimation in unify SQL. Tech. Rep. Dept. of Management Science and Information Systems, Univ. of Texas, Austin.
41. Mannino, M., and Rivera, A. 1988. An extensible model of selectivity estimation. Inf. Sci.-An International Journal. Special issue on database systems to appear Spring 1988.
42. Merrett, T. H., and Otoo, E. 1979. Distribution models of relations. In Proceedings of the 5th International Conference on Very Large Data Bases (Rio de Janeiro, Brazil, Oct.). ACM, New York, pp. 418–425.
43. Montgomery, A., D'souza, D., and Lee, S. 1983. The cost of relational algebraic operations on skewed data: Estimates and experiments. In Information Processing Letters 83. Elsevier North-Holland, New York, pp. 235–241.
44. Moore, D., and Yackel, J. 1977. Consistency properties of nearest neighbor density function estimates. Ann. Stat. 5, 143–154.
45. Muralikrishna, M., and Dewitt, D. 1988. Equidepth histograms for estimating selectivity factors for multi-dimensional queries. In Proceedings of the ACM SIGMOD Conference (Chicago, 111., June). ACM, New York, pp. 28–36.
46. Muthuswamy, B., and Kerschberg, G. 1985. A DDSM for relational query optimization. Tech. Rep., Univ. of South Carolina, Columbia. Also in Proceedings of the ACM Annual Conference (Denver, Colo., Oct.). ACM, New York.
47. Piatetsky-Shapiro, G., and Connell, G. 1984. Accurate estimation of the number of tuples satisfying a condition. In Proceedings of the ACM SIGMOD Conference (Boston, Mass., June). ACM, New York, pp. 256–276.
48. Piatetsky-Shapiro, G. 1985. Estimating the number of distinct attribute values by using sampling. Submitted for publication.
49. Rowe, N. 1985. Antisampling for estimation: An overview. IEEE Trans. Softw. Eng. 11,10 (Oct.)., 1081–1091.
50. Samson, W., and Bendell, A. 1983. Rank order distributions and secondary key indexing (extended abstract). In Proceedings of the 2nd International Conference on Databases, (Cambridge, England).
51. Selinger, P., Astrahan, M., Chamberlin, D., Lorie, R., and Price, T. 1979. Access path selection in a relational database management system. In Proceedings of the ACM SIGMOD Conference (San Jose, Calif.). ACM, New York, pp. 23–34.
52. Schkolnick, M., and Tiberio, P. 1979. Considerations in developing a design tool for a relational DBMS. In Proceedings of the IEEE COMPSAC Conference (Chicago, 111., Nov.). IEEE Press, New York, pp. 228–235.
53. Stonebraker, M., Rubenstein, B., and Gutmann, A. 1983. Application of abstract data types and abstract indices to CAD databases. In Proceedings of Database Week: Engineering Design Applications (San Jose, Calif., May), pp. 107–113.
54. Sturges, H. 1926. The choice of class interval. J. Am. Stat. Assoc. 65–66.
55. Tapia, R., and Thompson, J. 1978. Nonparametric Probability Density Estimation. John Hopkins University Press, Baltimore, Md.
56. Teorey, T. and Fry, J. 1982. Design of Database Structures. Prentice-Hall, Englewood, Cliffs, N.J.
57. Unify Corporation. 1985. Unix Relational Database Management System—Reference Manual. Release 3.2. Portland, Oreg.
58. Vander Zander, B., Taylor, H., and Biton, D. 1986. Estimating block accesses when attributes are correlated. In Proceedings of the 12th International Conference on Very Large Databases (Kyoto, Japan, Aug.). Morgan Kaufmann Publishers, Inc., pp. 119–127.
59. Wegman, E. 1983. Density estimation. In Encyclopedia of Statistical Sciences, Vol. 2, S. Kotz and N. Johnson, Eds. Wiley, New York.
60. Wertz, W. 1978. Statistical Density Estimation: A Survey. Vandenhoeck and Ruprecht, Gottingen.
61. Whang, K., Wiederhold, G., and Sagalowicz, D. 1983. Estimating block accesses in database organizations: A closed noniterative formula. Commun. ACM 26, 11 (Nov.), 940–944.
62. Yao, S. 1977. Approximating block accesses in database organizations. Commun. ACM 20,4 (Apr.), 260–261.
63. Zahorjan, J., Bell. B., and Sevcik, K. 1983. Estimating block transfers when record access probabilities are non-uniform. Inf. Process. Lett. 16, 5 (June), 249–252.
64. Zipf, G. 1949. Human Behavior and the Principle of Least Effort. Addison-Wesley, Cambridge, Mass.