Optimizing state-intensive non-blocking queries using run-time adaptation

Proceedings - International Conference on Data Engineering

Volumn , Issue , 2007, Pages 614-623

  Liu, Bin ^a   Jbantova, Mariana ^a   Rundensteiner, Elke A ^a  

^a WORCESTER POLYTECHNIC INSTITUTE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTATION TECHNIQUES; CRITICAL RESOURCES; DATA ENGINEERING; DISTRIBUTED SYSTEMS; INTERNATIONAL CONFERENCES; KEY FACTORS; MAIN MEMORIES; MEMORY DEMANDS; MEMORY SHORTAGE; NON-BLOCKING; PARALLEL PROCESSING; QUERY PROCESSING SYSTEMS; REAL-TIME RESPONSES; RUN-TIME; RUN-TIME ADAPTATIONS;

CHLORINE COMPOUNDS; DECISION MAKING; DISKS (STRUCTURAL COMPONENTS); EMBEDDED SYSTEMS; PROBLEM SOLVING; QUERY PROCESSING; TECHNOLOGY;

DATA STORAGE EQUIPMENT;

EID: 48349095182     PISSN: 10844627     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDEW.2007.4401048     Document Type: Conference Paper

References (27)

1. D. Abadi, Y. Ahmad, and et. al. The design of the Borealis stream processing engine. In CIDR, pages 277-289, 2005.
2. D. J. Abadi, D. Carney, and et al. Aurora: a new model and architecture for data stream management. The VLDB Journal, 12(2):120-139, 2003.
3. J. F. Annita N. Wilchut and P. Apers. Parallel evaluation of multi-join queries. In SIGMOD, pages 58-67, 1995.
4. B. Babcock, S. Babu, M. Datar, R. Motwani, and J. Widom. Models and issues in data stream systems. In ACM PODS, pages 1-16, 2002.
5. J. Chen, D. J. DeWitt, F. Tian, and Y. Wang. Niagaracq: a scalable continuous query system for internet databases. In ACM SIGMOD, pages 379-390, 2000.
6. M.-S. Chen, M.-L. Lo, P. S. Yu, and H. C. Young. Using segmented right-deep trees for the execution of pipelined hash joins. In VLDB, pages 15-26, 1992.
7. D. J. DeWitt, J. F. Naughton, D. A. Schneider, and S. Seshadri. Practical skew handling in parallel joins. In VLDB. pages 27-40, 1992.
8. L. Ding, N. Mehta, E. Rundensteiner, and G. Heineman. Joining punctuated streams. In EDBT. pages 587-604, 2004.
9. S. Ganguly, W. Hasan, and R. Krishnamurthy. Query optimization for parallel execution. In ACM SIGMOD, pages 9-18. ACM Press, 1992.
10. G. Graefe. Encapsulation of parallelism in the volcano query processing system. In ACM SIGMOD, pages 102-111, 1990.
11. J. Kang, J. F. Naughton, and S. Viglas. Evaluating window joins over unbounded streams. In ICDE, pages 341-352, 2003.
12. D. Kossmann. The state of the art in distributed query processing. ACM Computing Surveys (CSUR). 32(4):422-469, 2000.
13. W. J. Labio, R. Yerneni, and H. García-Molina. Shrinking the warehouse updated window. In ACM SIGMOD, pages 383-395, June 1999.
14. B. Liu and E. A. Rundensteiner. Revisiting parallel mulll-join query processing via hashing. In VLDB, pages 829-840, 2005.
15. B. Liu, Y. Zhu, and E. A. Rundensteiner. Run-time operator slate spilling for memory intensive long-running queries. In SIGMOD, pages 347-358, 2006.
16. S. Madden, M. Shah, J. M. Hellerstein, and V. Raman. Continuously adaptive continuous queries over streams. In ACM SIGMOD, pages 49-60, 2002.
17. M. Mokbel, M. Lu, and W. Aref. Hash-merge join: A non-blocking join algorithm for producing fust and early join results. In ICDE, page 251, 2004.
18. D. A. Schneider and D. J. DeWitt. A performance evaluation of four parallel join algorithms in a shared-nothing multiprocessor environment. In ACM SIGMOD, pages 110-121, 1989.
19. D. A. Schneider and D. J. DeWitt. Tradeoffs in processing complex join queries via hashing in multiprocessor database machines. In VLDB, pages 469-480, 1990.
20. M. A. Shah, J. M. Hellerstein, and et. al. Flux: An adaptive partitioning operator for continuous query systmes. In ICDE, pages 25-36, 2003.
21. T. Sutherland, B. Liu, M. Jbantova, and E. Rundensteiner. D-CAPE: Distributed and self-tuned continuous query-processing. In CIKM, pages 217-218, 2005.
22. Y. Tao, M. Yiu, and D. Poradias. RPJ: Producing fast join results on streams through rate-based optimization. In SIGMOD, pages 371-382, 2005.
23. N. Tatbul, U. Cetintemel, S. B. Zdonik, M. Cherniack, and M. Stonebraker. Load shedding in a data stream manager. In VLDB, pages 309-320, 2003.
24. F. Tian and D. J. DeWitt. Tuple routing strategies for distributed eddies. In VLDB, pages 333-344, 2003.
25. T. Urhan and M. J. Franklin. Xjoin: A reactively-scheduled pipelined join operator. IEEE Data Engineering Bulletin, 23(2):27-33, 2000.
26. S. Viglas, J. F. Naughton, and J. Burger. Maximizing the output rate of multi-way join queries over streaming information sources. In VLDB, pages 285-296, 2003.
27. Y. Xing, S. Zdonik, and J.-H. Hwang. Dynamic load distribution in the Borealis stream processor. In ICDE, pages 791-802, 2005.