The design of a query monitoring system

ACM Transactions on Database Systems

Volumn 34, Issue 1, 2009, Pages

  Mishra, Chaitanya ^a   Koudas, Nick ^a  

^a UNIVERSITY OF TORONTO   (Canada)

Author keywords

Progress estimation; Query monitoring

Indexed keywords

ADAPTIVE QUERY PROCESSING; CARDINALITY; INFORMATION COLLECTIONS; MULTI-WAY JOIN; ONLINE TECHNIQUE; OPEN-SOURCE; PROGRESS ESTIMATION; PROTOTYPE IMPLEMENTATIONS; QUERY EXECUTION TIME; QUERY MONITORING; RELATIONAL OPERATOR;

DATABASE SYSTEMS; DISTRIBUTED COMPUTER SYSTEMS; ESTIMATION; MONITORING; PLANNING; RESOURCE ALLOCATION; SOFTWARE PROTOTYPING;

INDEXING (OF INFORMATION);

EID: 67649227399     PISSN: 03625915     EISSN: 15574644     Source Type: Journal    
DOI: 10.1145/1508857.1508858     Document Type: Article

References (42)

1. ALON, N., GIBBONS, P. B., MATIAS, Y., AND SZEGEDY, M. 2002. Tracking join and self-join sizes in limited storage. J. Comput. Syst. Sci. 64, 3, 719-747.
2. BABU, S., BIZARRO, P., AND DEWITT, D. 2005. Proactive re-optimization. In Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM, New York, 107-118.
3. BICKEL, P. AND DOKSUM, K. 2000. Mathematical Statistics: Basic Ideas and Selected Topics. Prentice Hall, Englewood Cliffs, NJ.
4. BLOOM, B. H. 1970. Space/time trade-offs in hash coding with allowable errors. Communun. ACM 13, 7, 422-426.
5. BONEH, S., BONEH, A., AND CARON, R. 1998. On estimating the prediction function and the number of unseen species in sampling with replacement. J. Amer. Statist. Assoc. 93, 441, 372-379.
6. BRUNO, N. AND CHAUDHURI, S. 2002. Exploiting statistics on query expressions for optimization. In Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM, New York, 263-274.
7. CHARIKAR, M., CHAUDHURI, S., MOTWANI, R., AND NARASAYYA, V. 2000. Towards estimation error guarantees for distinct values. In Proceedings of the ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems. ACM, New York, 268-279.
8. CHAUDHURI, S., KAUSHIK, R., AND RAMAMURTHY, R. 2005. When can we trust progress estimators for SQL queries? In Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM, New York, 575-586.
9. CHAUDHURI, S., MOTWANI, R., AND NARASAYYA, V. 1999. On random sampling over joins. In Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM, New York, 263-274.
10. CHAUDHURI, S. AND NARASAYYA, V. 2009. Program for TPC-D data generation with skew. ftp://ftp.research.microsoft.com/users/ viveknar/tpcdskew.
11. CHAUDHURI, S., NARASAYYA, V., AND RAMAMURTHY, R. 2004. Estimating progress of execution for SQL queries. In Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM, New York, 803-814.
12. CHEN, S., AILAMAKI, A., GIBBONS, P. B., AND MOWRY, T. C. 2005. Inspector joins. In Proceedings of the 31st International Conference on Very Large Data Bases (VLDB'05). VLDB Endowment, 817-828.
13. DEMAINE, E. D., LÓPEZ-ORTIZ, A., AND MUNRO, J. I. 2002. Frequency estimation of Internet packet streams with limited space. In Proceedings of the 10th Annual European Symposium on Algorithms (ESA '02). Springer-Verlag, 348-360.
14. ESTAN, C. AND VARGHESE, G. 2003. New directions in traffic measurement and accounting: Focusing on the elephants, ignoring the mice. ACM Trans. Comput. Syst. 21, 3, 270-313.
15. GANGULY, S., GIBBONS, P. B., MATIAS, Y., AND SILBERSCHATZ, A. 1996. Bifocal sampling for skew-resistant join size estimation. In Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM, New York, 271-281.
16. HAAS, P. AND STOKES, L. 1998. Estimating the number of classes in a finite population. J. Amer. Statist. Assoc. 93, 444, 1475-1487.
17. HAAS, P. J. 1997. Large-Sample and deterministic confidence intervals for online aggregation. In Proceedings of the 9th International Conference on Scientific and Statistical Database Management (SSDBM'97). IEEE Computer Society, 51-63.
18. HAAS, P. J., NAUGHTON, J. F., SESHADRI, S., AND STOKES, L. 1995. Sampling-Based estimation of the number of distinct values of an attribute. In Proceedings of the 21st International Conference on Very Large Data Bases (VLDB'95). Morgan Kaufmann, San Francisco, CA, 311-322.
19. HAAS, P. J., NAUGHTON, J. F., SESHADRI, S., AND SWAMI, A. N. 1993. Fixed-Precision estimation of join selectivity. In Proceedings of the 12th ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems (PODS '93). ACM, New York, 190-201.
20. HAAS, P. J., NAUGHTON, J. F., SESHADRI, S., AND SWAMI, A. N 1996. Selectivity and cost estimation for joins based on random sampling. J. Comput. Syst. Sci. 52, 3, 550-569.
21. HAAS, P. J. AND SWAMI, A. N 1992. Sequential sampling procedures for query size estimation. In Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM, New York, 341-350.
22. HELLERSTEIN, J. M., HAAS, P. J., AND WANG, H. J. 1997. Online aggregation. In Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM, New York, 171-182.
23. IOANNIDIS, Y 2003. The history of histograms (abridged). In Proceedings of the 29th International Conference on Very Large Data Bases (VLDB "03). VLDB Endowment, 19-30.
24. IOANNIDIS, Y. E. 1993. Universality of serial histograms. In Proceedings of the 19th International Conference on Very Large Data Bases (VLDB '93). Morgan Kaufmann, San Francisco, CA, 256-267.
25. IOANNIDIS, Y. E. AND CHRISTODOULAKIS, S. 1993. Optimal histograms for limiting worst-case error propagation in the size of join results. ACM Trans. Database Syst. 18, 4, 709-748.
26. IOANNIDIS, Y. E. AND POOSALA, V. 1995. Balancing histogram optimality and practicality for query result size estimation. In Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM, New York, 233-244.
27. JAGADISH, H. V., KOUDAS, N., MUTHUKRISHNAN, S., POOSALA, V., SEVCIK, K. C., AND SUEL, T. 1998. Optimal histograms with quality guarantees. In Proceedings of the 24th International Conference on Very Large Data Bases (VLDB '98). Morgan Kaufmann, San Francisco, CA, USA, 275-286.
28. KABRA, N. AND DEWITT, D. J. 1998. Efficient mid-query re-optimization of sub-optimal query execution plans. In Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM, New York, 106-117.
29. KARP, R. M., SHENKER, S., AND PAPADIMITRIOU, C. H. 2003. A simple algorithm for finding frequent elements in streams and bags. ACM Trans. Database Syst. 28, 51-55.
30. LUO, G., CHEN, T., AND YU, H. 2007. Toward a progress indicator for program compilation. Soft. Practice Exper. 37, 9, 909-933.
31. LUO, G., NAUGHTON, J. F., ELLMANN, C. J., AND WATZKE, M. W. 2004. Toward a progress indicator for database queries. In Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM, New York, 791-802.
32. LUO, G., NAUGHTON, J. F., ELLMANN, C. J., AND WATZKE, M. W. 2005. Increasing the accuracy and coverage of SQL progress indicators. In Proceedings of the 21st International Conference on Data Engineering (ICDE '05). IEEE Computer Society, 853-864.
33. LUO, G., NAUGHTON, J. F., AND YU, P. S. 2006. Multi-Query SQL progress indicators. In Advances in Database Technology, Proceedings of the 10th International Conference on Extending Database Technology. Springer-Verlag, 921-941.
34. MANKU, G. S. AND MOTWANI, R. 2002. Approximate frequency counts over data streams. In Proceedings of the 28th International Conference on Very Large Data Bases (VLDB'02). VLDB Endowment, 346-357.
35. MARKL, V., RAMAN, V., SIMMEN, D., LOHMAN, G., PIRAHESH, H., AND CILIMDZIC, M. 2004. Robust query processing through progressive optimization. In Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM, New York, 659-670.
36. MISHRA, C. AND KOUDAS, N 2007. A lightweight online framework for query progress indicators. In Proceedings of the 23rd International Conference on Data Engineering, (ICDE). IEEE, 1292-1296.
37. MISHRA, C. AND VOLKOVS, M. 2007. Conex: A system for monitoring queries. In Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM, New York, 1076-1078.
38. MYERS, B. A. 1985. The importance of percent-done progress indicators for computer-human interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '85). ACM, New York, 11-17.
39. STILLGER, M., LOHMAN, G M., MARKL, V., AND KANDIL, M. 2001. Leo - DB2's learning optimizer. In Proceedings of the 27th International Conference on Very Large Data Bases (VLDB '01). Morgan Kaufmann, San Francisco, CA, 19-28.
40. THAPER, N., GUHA, S., INDYK, P., AND KOUDAS, N 2002. Dynamic multidimensional histograms. In Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM, New York, 428-439.
41. THOMPSON, S. K 2002. Sampling. Wiley Interscience.
42. VITTER, J. S. 1985. Random sampling with a reservoir. ACM Trans. Math. Softw. 11, 1, 37-57.