Estimating query result sizes for proxy caching in scientific database federations

Proceedings of the 2006 ACM/IEEE Conference on Supercomputing, SC'06

Volumn , Issue , 2006, Pages

  Malik, Tanu ^a   Burns, Randal ^a   Chawla, Nitesh V ^b   Szalay, Alex ^c  

^a Whiting School of Engineering

^b University of Notre Dame

^c JOHNS HOPKINS UNIVERSITY   (United States)

Author keywords

Data mining; Proxy caching; Scientific federations

Indexed keywords

CACHING DECISION; PROXY CACHING; SCIENTIFIC DATABASES; SCIENTIFIC FEDERATIONS;

CACHE MEMORY; CLASSIFICATION (OF INFORMATION); DATA MINING; DATABASE SYSTEMS; DECISION MAKING; REGRESSION ANALYSIS;

QUERY PROCESSING;

EID: 34548227466     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1188455.1188562     Document Type: Conference Paper

References (40)

1. ABOULNAGA, A., AND CHAUDHURI, S. 1999. Self-tuning histograms: Building histograms without looking at data. In Proceedings of the ACM SIGMOD International Conference on Management of Data, 181-192.
2. AMBITE, J. L., AND KNOBLOCK, C. A. 1998. Flexible and scalable query planning in distributed and heterogeneous environments. In Conference on Artificial Intelligence Planning Systems, 3-10.
3. AMIRI, K., PARK, S., TEWARI, R., AND PADMANABHAN, S. 2003. Scalable template-based query containment checking for Web semantic caches. In Proceedings of the International Conference, on Data Engineering, 493-504.
4. BRUNO, N., AND CHAUDHURI, S. 2002. Exploiting statistics on query expressions for optimization. In Proceedings of the ACM SIGMOD International Conference on Management of Data, 263-274.
5. BRUNO, N., CHAUDHURI, S., AND GRAVANO, L. 2001. STHoles: A multidimensional workload-aware histogram. In Proceedings of the ACM SIGMOD International Conference on Management of Data.
6. CAO, P., AND IRANI, S. 1997. Cost-aware WWW proxy caching algorithms. In Proceedings of the USENIX Symposium on Internet Technology and Systems.
7. CHAKRABARTI, K., GAROFALAKIS, M. N., RASTOGI, R., AND SHIM., K. 2000. Approximate query processing using wavelets. In Proceedings of the International Conference on Very Large Data Bases, 111-122.
8. CHEN, C. M., AND ROUSSOPOULOS, N. 1994. Adaptive selectivity estimation using query feedback. In Proceedings of the ACM SIGMOD International Conference on Management of Data, 161-172.
9. CHRISTODOULAKIS.S. 1983. Estimating block transfers and join sizes. In Proceedings of the ACM SIGMOD International Conference on Management of Data, 40-54.
10. DREWRY, M., CON OVER, H., MCCOY, S., AND GRAVES, S. 1997. Meta-data: quality vs. quantity. In Second IEEE Metadata Conference.
11. FEDCACHE. FedCache: Proxy Caching in Wide-Area Scientifi c Federations, http://hssl.cs.jhu.edu/fedcache.
12. FUJIWARA, H., AND lWAMA, K. 2002. Average-case competitive analyses for ski-rental problems. In Intl. Symposium on Algorithms and Computation.
13. GUNOPULOS, D., KOLLIOS, G., TSOTRAS, V., AND DOMENICONI, C. 2000. Approximating multi-dimensional aggregate range queries over real attributes. In Proceedings of the 19th ACM-SIGMOD Intl. Conference on Management of Data.
14. HAM.ERLY, G., AND ELKAN, C. 2003. Learning the k in k-means. In NIPS.
15. HARANGSRI, B., SHEPHERD, J., AND NGU, A. H. H. 1997. Query size estimation using machine learning. In Database Systems for Advanced Applications, 97-106.
16. IOANNIDIS, Y. E. 2003. The history of histograms (abridged). In Proceedings of the International Conference on Very Large Data Bases, 19-30.
17. LIM, L., WANG, M., AND VITTER, J. S. 2005. CXHist : An on-line classifi cation-based histogram for XML string selectivity estimation. In Proceedings of the International Conference on Very Large Data Bases, 1187-1198.
18. LIPTON, R., AND NAUGHTON, J. 1995. Query size estimation by adaptive sampling. Journal of Computer and System Science 51, 18-25.
19. LUO, Q., AND NAUGHTON, J. F. 2001. Form-based proxy caching for database-backed web sites. In Proceedings of the International Conference on Very Large Data Bases, 191-200.
20. LUO, Q., AND XUE, W. 2004. Template-based proxy caching for table-valued functions. In Proceedings of the International Conference on Database Systems for Advanced Applications, 339-351.
21. MALIK, T., SZALAY, A. S., BUDAVRI, A. S., AND THAKAR, A. R. 2003. SkyQuery: A WebService Approach to Federate Databases. In Proceedings of the Conference on Innovative Data Systems Research.
22. MALIK, T., BURNS, R. C., AND CHAUDHARY, A. 2005. Bypass caching: Making scientifi c databases good network citizens. In Proceedings of the International Conference of Data Engineering, 94-105.
23. MITCHELL, T. 1997. Machine Learning. McGraw Hill.
24. OLSTON, C., AND WLDOM, J. 2002. Best-effort cache synchronization with source cooperation. In Proceedings of the ACM SIGMOD International Conference on Management of Data, 73-84.
25. OLSTON, C., LOO, B., AND WIDOM., J. 2001. Adaptive precision setting for cached approximate values. In Proceedings of the ACM SIGMOD International Conference on Management of Data, 355-366.
26. OSQ. The Open Skyquery, http://www.openskyquery.net.
27. PELLEG, D., AND MOORE, A. 2000. X-means: Extending kmeans with effi cient estimation of the number of clusters. In Proceedings of the Seventeenth International Conference on Machine Learning, Morgan Kaufmann, San Francisco, 727-734.
28. POOSALA, V., AND IOANNIDIS, Y E. 1996. Estimation of queryresult distribution and its application in parallel-join load balancing. In The VLDB Journal, 448-459.
29. POOSALA, V., IOANNIDIS, Y. E., HAAS, P. J., AND SHEKITA, E. J. 1996. Improved histograms for selectivity estimation of range predicates. In Proceedings of the ACM SIGMOD International Conference on Management of Data, 294-305.
30. QUINLAN, J. R. 1993. C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.
31. SDSS. The Sloan Digital Sky Survey, http://www.sdss.org.
32. SELINGER, P., ASTRAHANAND, M., CHAMBERLIN, D., A.R.LORIE, AND PRICE, T. 1979. Access path selection in a relational database management system. In Proceedings of the ACM SlGMOD International Conference on Management of Data.
33. SERAFINI, L., STOCKINGER, H., STOCKINGER, K., AND ZINI, F. 2001. Agent-based query optimisation in a grid environment. In Proceedings of IASTED International Conference on Applied Informatics.
34. SHETH, A. P., AND LARSON, J. A. 1990. Federated database systems for managing distributed, heterogeneous, and autonomous databases. ACM Computing Surveys 22, 3, 183-236.
35. STILLGER, M., LOHMAN, G. M., MARKL, V., AND KANDIL, M. 2001. LEO - DB2's LEarning Optimizer. In Proceedings of the International Conference on Very Large Data Bases, 19-28.
36. SZALAY, A. S., GRAY, J., THAKAR, A. R., KUNSZT, P. Z., MALIK, T., RADDICK, J., STOUGHTON, C., AND VANDENBERG, J. 2002. The SDSS SkyServer: Public access to the Sloan Digital Sky Server data. In Proceedings of the ACM SIGMOD International Conference on Management of Data, 570-581.
37. VITTER, J. S., AND WANG, M. 1999. Approximate computation of multidimensional aggregates of sparse data using wavelets. In Proceedings of the ACM SIGMOD International Conference on Management of Data, 193-204.
38. W. SUN, Y. LING, N. R., AND DENG, Y. 1993. An instant and accurate size estimation method for joins and selection in a retrieval-intensive environment. In Proceedings of the ACM SIGMOD International Conference on Management of Data, 79-88.
39. WEKA. The Weka Machine Learning Project, http://www.es.waikato.ac.nz/ml/ index.html.
40. ZHANG, S., QIN, Z., LING, C. X., AND SHENG, S. 2005. Missing is useful: Missing values in cost-sensitive decision trees. In IEEE Transactions on Knowledge and Data Engineering, vol. 17, 1689 - 1693.