Network-aware join processing in global-scale database federations

Proceedings - International Conference on Data Engineering

Volumn , Issue , 2008, Pages 586-595

  Xiaodan, Wang ^a   Burns, Randal ^a   Terzis, Andreas ^a   Deshpande, Amol ^b  

^a JOHNS HOPKINS UNIVERSITY   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; DATABASE SYSTEMS; TECHNOLOGY;

COMPUTATIONAL OVERHEADS; DATA ENGINEERING; EXCESS CAPACITY; INTERNATIONAL CONFERENCES; JOIN PROCESSING; LONG-HAUL; NETWORK PATHS; NETWORK UTILIZATION; PARALLEL SCHEDULING; POLYNOMIAL-TIME ALGORITHMS; RESOURCE USAGE; SCHEDULING ALGORITHMS;

PARALLEL ALGORITHMS;

EID: 52649103423     PISSN: 10844627     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDE.2008.4497467     Document Type: Conference Paper

References (40)

1. S. Ganguly, W. Hasan, and R. Krishnamurthy, "Query Optimization for Parallel Execution," in SIGMOD, 1992.
2. T. Malik, A. S. Szalay, A. S. Budavri, and A. R. Thakar, "SkyQuery: A Web Service Approach to Federate Databases," in CIDR, 2003.
3. T. Malik, R. Burns, and A. Chaudhary, "Bypass Caching: Making Scientific Databases Good Network Citizens," in ICDE, 2005.
4. A. Szalay, J. Gray, A. Thakar, P. Kuntz, T. Malik, J. Raddick, C. Stoughton, and J. Vandenberg, "The SDSS SkyServer - Public Access to the Sloan Digital Sky Server Data," in SIGMOD, 2002.
5. A. Deshpande and J. Hellerstein, "Decoupled Query Optimization for Federated Database Systems," in ICDE, 2002.
6. D. Bertsekas and R. Gallager, Data Networks, 2nd ed. Prentice Hall, 1992.
7. B. Chun, D. Culler, T. Roscoe, A. Bavier, L. Peterson, M. Wawrzoniak, and M. Bowman, "PlanetLab: An Overlay Testbed for Broad-Coverage Services," SIGCOMM Comput. Commun. Rev., vol. 33, no. 3, pp. 3-12, 2003.
8. The Human Brain Project Database. [Online]. Available: http://ycmihbp.med.yale.edu/hbpdb/
9. Chronos. [Online]. Available: http://www.chronos.org/index.html
10. P. A. Bernstein, N. Goodman, E. Wong, C. L. Reeve, and J. James B. Rothnie, "Query Processing in a System for Distributed Databases (SDD-1)," ACM Trans. Database Syst., vol. 6, no. 4, pp. 602-625, 1981.
11. M. Stonebraker, "The Design and Implementation of Distributed INGRES," in The INGRES Papers: Anatomy of a Relational Database System. Addison-Wesley Longman Publishing Co., Inc., 1986, pp. 187-196.
12. D. Kossmann, "The State of the Art in Distributed Query Processing," ACM Comput. Surv., vol. 32, no. 4, pp. 422-469, 2000.
13. D. Kossmann and K. Stocker, "Iterative Dynamic Programming: A New Class of Query Optimization Algorithms," ACM Trans. on Database Systems, vol. 25, no. 1, pp. 43-82, 2000.
14. P. G. Selinger, M. M. Astrahan, D. D. Chamberlin, R. A. Lorie, and T. G. Price, "Access Path Selection in a Relational Database Management System," in SIGMOD, 1979.
15. A. L. P. Chen and V. O. K. Li, "Optimizing Star Queries in a Distributed Database System," in VLDB, 1984.
16. P. Scheuermann and E. I. Chong, "Distributed Join Processing Using Bipartite Graphs," in ICDCS, 1995.
17. A. Chen, D. Brill, M. Templeton, and C. Yu, "Distributed Query Processing in a Multiple Database System," IEEE J. Select. Areas Commun., vol. 7, no. 3, pp. 390-398, 1989.
18. C. Evrendilek, A. Dogac, S. Nural, and F. Ozcan, "Multidatabase Query Optimization," Distributed Parallel Databases, vol. 5, no. 1, pp. 77-114, 1997.
19. D.-M. Chiu, P. A. Bernstein, and Y.-C. Ho, "Optimizing Chain Queries in a Distributed Database System," SIAM J. Comput., vol. 13, no. 1, pp. 116-134, 1984.
20. Y. Kambayashi, M. Yoshikawa, and S. Yajima, "Query Processing for Distributed Databases using Generalized Semi-Joins," in SIGMOD, 1982.
21. H. Lu and M. J. Carey, "Some Experimental Results on Distributed Join Algorithms in a Local Network," in VLDB, 1985.
22. C. Intanagonwiwat, R. Govindan, and D. Estrin, "Directed Diffusion: A Scalable and Robust Communication Paradigm for Sensor Networks," in MOBICOM, 2000.
23. B. Krishnamachari, D. Estrin, and S. B. Wicker, "The Impact of Data Aggregation in Wireless Sensor Networks," in ICDCSW, 2002.
24. N. Shrivastava, C. Buragohain, D. Agrawal, and S. Suri, "Medians and Beyond: New Aggregation Techniques for Sensor Networks," in SenSys, 2004.
25. A. Meliou, D. Chu, J. Hellerstein, C. Guestrin, and W. Hong, "Data Gathering Tours in Sensor Networks," in IPSN, 2006.
26. T. Malik, R. Burns, and N. Chawla, "A Black-Box Approach to Query Cardinality Estimation," in CIDR, 2007.
27. R. Prasad, C. Dovrolis, M. Murray, and K. Claffy, "Bandwidth Estimation: Metrics, Measurement Techniques, and Tools," IEEE Network, vol. 17, no. 6, pp. 27-35, 2003.
28. Y. Chu, S. G. Rao, S. Seshan, and H. Zhang, "A Case for End-System Multicast," IEEE J. Select. Areas Commun., vol. 20, no. 8, pp. 1456-1471, 2002.
29. P. Pietzuch, J. Ledlie, J. Shneidman, M. Roussopoulos, M. Welsh, and M. Seltzer, "Network-Aware Operator Placement for Stream-Processing Systems," in ICDE, 2006.
30. J. Padhye, V. Firoiu, D. Towsley, and J. Krusoe, "Modeling TCP Throughput: A Simple Model and its Empirical Validation," in ACM SIGCOMM, 1998.
31. The Netperf Benchmark. [Online]. Available: http://www.netperf.org/ netperf/
32. S. Savage, A. Collins, E. Hoffman, J. Snell, and T. Anderson, "The End-to-End Effects of Internet Path Selection," in SIGCOMM, 1999.
33. N. Christofides, "Worst-case Analysis of a New Heuristic for the Traveling Salesman Problem," in Symposium on New Directions and Recent Results in Algorithms and Complexity, 1976.
34. J. Hoffer and D. Severance, "The Use of Cluster Analysis in Physical Database Design," in VLDB, 1975.
35. P. W. Shor, "A New Proof of Cayley's Formula for Counting Labeled Trees," J. Comb. Theory Ser. A, vol. 71, no. 1, pp. 154-158, 1995.
36. The Sloan Digital Sky Survey. [Online]. Available: http://www.sdss.org
37. J. Gray and A. Szalay. (2003) Online Science: The World-Wide Telescope as a Prototype for the New Computational Science. Presentation at the Supercomputing Conference. [Online]. Available: http://research. microsoft.com/ Gray/JimGrayTalks.htm
38. VOTable: An XML-based Encoding Scheme for Astronomical Tables and Catalogs. [Online]. Available: http://www.us-vo.org/VOTable/
39. J. M. Hellerstein, M. Stonebraker, and R. Caccia, "Independent, Open Enterprise Data Integration," IEEE Data Engineering Bulletin, vol. 22, no. 1, pp. 43-49, 1999.
40. M. Stonebraker, P. M. Aoki, W. Litwin, A. Pfeffer, A. Sah, J. Sidell, C. Staelin, and A. Yu, "Mariposa: A Wide-Area Distributed Database System," VLDB Joumrnal, vol. 5, no. 1, pp. 48-63, 1996.