Hierarchical synopses with optimal error guarantees

ACM Transactions on Database Systems

Volumn 33, Issue 3, 2008, Pages

  Karras, Panagiotis ^a   Mamoulis, Nikos ^b  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Approximate query processing; Data synopses; Summarization

Indexed keywords

APPROXIMATE QUERY PROCESSING; DATA SYNOPSES; HAAR WAVELET DECOMPOSITION; INDEX STRUCTURES; SUMMARIZATION;

MODEL STRUCTURES; WAVELET TRANSFORMS;

WAVELET DECOMPOSITION;

EID: 51149084988     PISSN: 03625915     EISSN: 15574644     Source Type: Journal    
DOI: 10.1145/1386118.1386124     Document Type: Article

References (66)

1. ABOULNAGA, A. AND CHAUDHURI, S. 1999. Self-tuning histograms: Building histograms without looking at data. In Proceedings of the ACM International Conference on Management of Data (SlGMOD'99). ACM, New York.
2. ACHARYA, S., GIBBONS, P. B., POOSALA, V., AND RAMASWAMY, S. 1999. Join synopses for approximate query answering. In Proceedings of the ACM International Conference on Management of Data (SIGMOD'99). ACM, New York.
3. AGARWAL, D., BARMAN, D., GUNOPULOS, D., YOUNG, N. E., KORN, F., AND SRIVASTAVA, D. 2007. Efficient and effective explanation of change in hierarchical summaries. In Proceedings of the ACM International Conference on Knowledge Discovery and Data Mining (KDD'07). ACM, New York.
4. BELLMAN, R. 1961. Onthe approximationofcurvesbyline segments usingdynamic programming. Comm. ACM 4, 6, 284.
5. BRUNO, N., CHAUDHURI, S., AND GRAVANO, L. 2001. STHoles: A multidimensional workloadaware histogram. In Proceedings of the ACM International Conference on Management of Data (SIGMOD'01). ACM, New York.
6. BURAGOHAIN, C., SHRIVASTAVA, N., AND SURI, S. 2007. Space efficient streaming algorithms for the maximum error histogram. In Proceedings of the IEEE International Conference on Data Engineering (ICDE'07).
7. CHAKRABARTI, K., GAROFALAKIS, M., RASTOGI, R., AND SHIM, K. 2001. Approximate query processing using wavelets. VLDB J. 10, 2-3, 199-223.
8. CHAKRABARTI, K., KEOGH, E., MEHROTRA, S., AND PAZZANI, M. 2002. Locally adaptive dimensionality reduction for indexing large time series databases. ACM Trans. Datab. Syst. 27, 2, 188-228.
9. CHEN, S. AND NUCCI, A. 2007. Dynamic nonuniform data approximation in databases with Haar wavelet. J. Computers 2, 8, 64-76.
10. CORMODE, G., GAROFALAKIS, M., AND SACHARIDIS, D. 2006. Fast approximate wavelet tracking on streams. In Proceedings of the 10th International Conference on Extending Database Technology. Springer, Berlin, Germany.
11. DELIGIANNAKIS, A., GAROFALAKIS, M., AND ROUSSOPOULOS, N. 2005. A fast approximation scheme for probabilistic wavelet synopses. In Proceedings of the International Conference on Scientific and Statistical Database Management (SSDBM'05).
12. DELIGIANNAKIS, A., GAROFALAKIS, M., AND ROUSSOPOULOS, N. 2007. Extended wavelets for multiple measures. ACM Trans. Datab. Syst. 32, 1.
13. DESHPANDE, A., GAROFALAKIS, M., AND RASTOGI, R. 2001. Independence is good: Dependency-based histogram synopses for high-dimensional data. In Proceedings of the ACM International Conference on Management of Data (SIGMOD'01). ACM, New York.
14. FURFARO, F., MAZZEO, G. M., SACCÀ, D., AND SIRANGELO, C. 2005. Hierarchical binary histograms for summarizing multidimensional data. In Proceedings of the ACM Symposium on Applied Computing. ACM, New York.
15. GAROFALAKIS, M. AND GIBBONS, P. B. 2004. Probabilistic wavelet synopses. ACM Trans. Database Systems 29, 1 (March), 43-90.
16. GAROFALAKIS, M. AND KUMAR, A. 2004. Deterministic wavelet thresholding for maximum-error metrics. In Proceedings of the 23rd ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems. ACM, New York.
17. GAROFALAKIS, M. AND KUMAR, A. 2005. Wavelet synopses for general error metrics. ACM Trans. Datab. Syst. 30, 4, 888-928.
18. GIBBONS, P. B. AND MATIAS, Y. 1999. Synopsis data structures for massive data sets. In Proceedings of the 10th Annual ACM-SIAM Symposium on Discrete Algorithms. ACM, New York.
19. GIBBONS, P. B., MATIAS, Y., AND POOSALA, V. 2002. Fast incremental maintenance of approximate histograms. ACM Trans. Datab. Syst. 27, 3, 261-298.
20. GILBERT, A. C., GUHA, S., INDYK, P., KOTIDIS, Y., MUTHUKRISHNAN, S., AND STRAUSS, M. J. 2002. Fast, small-space algorithms for approximate histogram maintenance. In Proceedings of the 34th Annual ACM Symposium on Theory of Computing. ACM, New York.
21. GILBERT, A. C., KOTIDIS, Y., MUTHUKRISHNAN, S., AND STRAUSS, M. 2001. Optimal and approximate computation of summary statistics for range aggregates. In Proceedings of the 20th ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Sysfems. ACM, New York.
22. GILBERT, A. C., KOTIDIS, Y., MUTHUKRISHNAN, S., AND STRAUSS, M. J. 2003. One-pass wavelet decompositions of data streams. IEEE Trans. Knowl. Data Engin. 15, 3, 541-554.
23. GRAPS, A. 1995. An introduction to wavelets. IEEE Computat. Sci. Engin. 2, 2, 50-61.
24. GUHA, S. 2008. Onthe space-time ofoptimal, approximate and streaming algorithms for synopsis construction problems. VLDB J. To appear.
25. GUHA, S. AND HARB, B. 2008. Approximation algorithms for wavelet transform coding of data streams. IEEE Trans. Inform. Theory 54, 2, 811-830.
26. GUHA, S., KOUDAS, N., AND SHIM, K. 2006. Approximation and streaming algorithms for histogram construction problems. ACM Trans. Datab. Syst. 37, 1, 396-438.
27. GUHA, S., KOUDAS, N., AND SRIVASTAVA, D. 2002. Fast algorithms for hierarchical range histogram construction. In Proceedings of the 21st ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems. ACM, New York.
28. GUHA, S., PARK, H., AND SHIM, K. 2008. Wavelet synopsis for hierarchical range queries with workloads. VLDB J. To appear.
29. GUHA, S., SHIM, K., AND WOO, J. 2004. REHIST: Relative error histogram construction algorithms. In Proceedings of the 13th International Conference on Very Large Data Bases (VLDB'04).
30. GUNOPULOS, D., KOLLIOS, G., TSOTRAS, V. J., AND DOMENICONI, C. 2005. Selectivity estimators for multidimensional range queries over real attributes. VLDB J. 14, 2, 137-154.
31. HAAR, A. 1910. Zur theorie der orthogonalen functionsysteme. Mathematische Annalen 69, 331-371.
32. IOANNIDIS, Y. E. 1993. Universality of serial histograms. In Proceedings of the 19th International Conference on Very Large Data Bases (VLDB'93).
33. IOANNIDIS, Y. E. 2003. Approximations in database systems. In Proceedings of the International Conference on Database Theory (ICDT'03).
34. IOANNIDIS, Y. E. AND POOSALA, V. 1995. Balancing histogram optimality and practicality for query result size estimation. In Proceedings of the ACM International Conference on Management of Data (SIGMOD'95). ACM, New York.
35. IOANNIDIS, Y. E. AND POOSALA, V. 1999. Histogram-based approximation of set-valued query-answers. In Proceedings of the International Conference on Very Large Data Bases (VLDB'99).
36. JAGADISH, H. V., KOUDAS, N., MUTHUKRISHNAN, S., POOSALA, V., SEVCIK, K. C., AND SUEL, T. 1998. Optimal histograms with quality guarantees. In Proceedings of the International Conference on Very Large Data Bases (VLDB'98).
37. JAHANGIRI, M., SACHARIDIS, D., AND SHAHABI, C. 2005. SHIFT-SPLIT: I/O efficient maintenance of wavelet-transformed multidimensional data. In Proceedings of the ACM International Conference on Management of Data (SIGMOD'05). ACM, New York.
38. JAWERTH, B. AND SWELDENS, W. 1994. An overview of wavelet based multiresolution analyses. SIAM Rev. 36, 3, 377-412.
39. KARRAS, P. AND MAMOULIS, N. 2005. One-pass wavelet synopses for maximum-error metrics. In Proceedings of the International Conference on Very Large Data Bases (VLDB'05).
40. + tree: A refined synopsis data structure. In Proceedings of the IEEE 23rd International Conference on Data Engineering (ICDE'07).
41. KARRAS, P. AND MAMOULIS, N. 2008. Lattice histograms: A resilient synopsis structure. In Proceedings of the IEEE 24th International Conference on Data Engineering (ICDE'08).
42. KARRAS, P., SACHARIDIS, D., AND MAMOULIS, N. 2007. Exploiting duality in summarization with deterministic guarantees. In Proceedings of the 13th ACM International Conference on Knowledge Discovery and Data Mining (KDD'07). ACM, New York.
43. KHANNA, S., MUTHUKRISHNAN, S., AND SKIENA, S. 1997. Efficient array partitioning. In Proceedings of the 24th International Colloquium on Automata, Languages and Programming (ICALP'97).
44. KOUDAS, N., MUTHUKRISHNAN, S., AND SRIVASTAVA, D. 2000. Optimal histograms for hierarchical range queries. In Proceedings of the 19th ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems. ACM, New York.
45. MATHIOUDAKIS, M., SACHARIDIS, D., AND SELLIS, T. 2006. A study on workload-aware wavelet synopses for point and range-sum queries. In Proceedings of the 9th ACM International Workshop on Data Warehousing and OLAP. ACM, New York.
46. MATIAS, Y. AND URIELI, D. 2006. Inner-product based wavelet synopses for range-sum queries. In Proceedings of the European Symposium on Algorithms Conference (ESA'06). Springer, Berlin, Germany.
47. MATIAS, Y. AND URIELI, D. 2007. Optimal workload-based weighted wavelet synopses. Theor. Comput. Sci. 371, 3, 227-246.
48. MATIAS, Y., VITTER, J. S., AND WANG, M. 1998. Wavelet-based histograms for selectivity estimation. In Proceedings of the ACM International Conference on Management Data (SIGMOD'98). ACM, New York.
49. MATIAS, Y., VITTER, J. S., AND WANG, M. 2000. Dynamic maintenance of wavelet-based histograms. In Proceedings of the International Conference on Very Large Data Bases (VLDB'00).
50. MCLEOD, A. 1994. Diagnostic checking of periodic autoregression models with application. J. Time Series Anal. 15, 2, 221-233.
51. MURALIKRISHNA, M. AND DEWITT, D. J. 1988. Equi-depth histograms for estimating selectivity factors for multidimensional queries. In Proceedings of the ACM International Conference on Management Data (SIGMOD'98). ACM, New York.
52. MUTHUKRISHNAN, S. 2005. Subquadratic algorithms for workload-aware Haar wavelet synopses. In Proceedings of Foundation of Software Technology and Theoretical Computer Science (FSTTCS'05). Springer, Berlin, Germany.
53. MUTHUKRISHNAN, S., POOSALA, V., AND SUEL, T. 1999. On rectangular partitionings in two dimensions: Algorithms, complexity, and applications. In Proceedings of the 7th International Conference on Database Theory (ICDT'99).
54. MUTHUKRISHNAN, S. AND STRAUSS, M. 2003a. Maintenance of multidimensional histograms. In Proceedings of Foundation of Software Technology and Theoretical Computer Science (FSTTCS'03). Springer, Berlin, Germany.
55. MUTHUKRISHNAN, S. AND STRAUSS, M. 2003b. Rangesum histograms. In Proceedings of the 14th Annual ACM-SIAM Symposium on Discrete Algorithms (SODA'03). ACM, New York.
56. MUTHUKRISHNAN, S., STRAUSS, M., AND ZHENG, X. 2005. Workload-optimal histograms on streams. In Proceedings of the European Symposium on Algorithms Conference (ESA'05). Springer, Berlin, Germany, 734-745.
57. MUTHUKRISHNAN, S. AND SUEL, T. 2005. Approximation algorithms for array partitioning problems. J. Algor. 54, 1, 85-104.
58. POOSALA, V., GANTI, V., AND IOANNIDIS, Y. E. 1999. Approximate query answering using histograms. IEEE Data Eng. Bull. 22, 4, 5-14.
59. POOSALA, V. AND IOANNIDIS, Y. E. 1997. Selectivity estimation without the attribute value independence assumption. In Proceedings of the International Conference on Very Large Data Bases (VLDB'97).
60. POOSALA, V., IOANNIDIS, Y. E., HAAS, P. J., AND SHEKITA, E. J. 1996. Improved histograms for selectivity estimation of range predicates. In Proceedings of the ACM International Conference on Management of Data (SIGMOD'96). ACM, New York.
61. REISS, F., GAROFALAKIS, M., AND HELLERSTEIN, J. M. 2006. Compact histograms for hierarchical identifiers. In Proceedings of the International Conference on Very Large Data Bases (VLDB'06).
62. SRIVASTAVA, U., HAAS, P. J., MARKL, V., KUTSCH, M., AND TRAN, T. M. 2006. In Proceedings of the 22nd IEEE International Conference on Data Engineering (ICDE'06).
63. TERZI, E. AND TSAPARAS, P. 2006. Efficient algorithms for sequence segmentation. In Proceedings of the 6th SIAM International Conference on Data Mining (SDM).
64. THAPER, N., GUHA, S., INDYK, P., AND KOUDAS, N. 2002. Dynamic multidimensional histograms. In Proceedings of the ACM International Conference on Management of Data (SIGMOD'2). ACM, New York.
65. VITTER, J. S. AND WANG, M. 1999. Approximate computation of multidimensional aggregates of sparse data using wavelets. In Proceedings of the ACM International Conference on Management of Data (SIGMOD'99). ACM, New York.
66. VITTER, J. S., WANG, M., AND IYER, B. 1998. Data cube approximation and histograms via wavelets. In Proceedings of the Conference on Information and Knowledge Management (CIKM'98).