Adaptive load diffusion for multiway windowed stream joins

Proceedings - International Conference on Data Engineering

Volumn , Issue , 2007, Pages 146-155

  Gu, Xiaohui ^a   Yu, Philip S ^a   Wang, Haixun ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLUSTER ANALYSIS; DATA PROCESSING; RESOURCE ALLOCATION; ROUTING ALGORITHMS; SEMANTICS;

LOAD DIFFUSION; MULTIWAY WINDOWED STREAM JOINS (MWSJS); PARALLEL JOIN PROCESSING;

MATHEMATICAL OPERATORS;

EID: 34548776960     PISSN: 10844627     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDE.2007.367860     Document Type: Conference Paper

References (30)

1. A. Arasu, S. Babu, and J. Widom. The CQL Continuous Query Language: Semantic Foundations and Query Execution. Standford University Technical Report 2003-67, 2003.
2. R. Avnur and J. M. Hellerstein. Eddies: Continuously Adaptive Query Processing. Proc. of SIGMOD, 2000.
3. B. Babcock, S. Babu, M. Datar, R. Motawani, and J.Widom. Models and Issues in Data Stream Systems. Proc. of PODS, 2002.
4. S. Babu, R. Motwani, K. Munagala, I. Nishizawa, and J. Widom. Adaptive Ordering of Pipelined Stream Filters. Proc. of SIGMOD, 2004.
5. V. Chvatal. A Greedy-Heuristic for the Set Covering Problem. Mathematics of Operations Research, 4:233-235, 1979.
6. A. Das, J. Gehrke, and M. Riedewald. Approximate Join Processing Over Data Streams. Proc. of SIGMOD, 2003.
7. A. Deshpande. An Initial Study of Overheads of Eddies. Proc. of SIGMOD Record, 2004.
8. A. Deshpande and J. M. Hellerstein. Lifting the Burden of History from Adaptive Query Processing. Proc. of VLDB, 2004.
9. S. Ganguly, M. Garofalakis, and R. Rastogi. Processing Data-Stream Join Aggregates Using Skimmed Sketches. Proc. of EDBT, 2004.
10. L. Golab and M. Tamer Ozsu. Issues in Data Stream Management. Proc. of VLDB, 2003.
11. L. Golab and M. Tamer Ozsu. Processing Sliding Window Multi-Joins in Continuous Queries over Data Streams. Proc. of VLDB, 2003.
12. G. Graefe. Encapsulation of Parallelism in the Volcano Query Processing System. Proc. of SIGMOD, 1990.
13. The STREAM Group. STREAM: The Stanford Stream Data Manager. IEEE Data Engineering Bulletin, 26(1), 2003.
14. X. Gu, Z. Wen, C.-Y. Lin, and P. S. Yu. ViCo: An Adaptive Distributed Video Correlation System. Proc. of ACM Multimedia, 2006.
15. X. Gu, P. S. Yu, and H. Wang. Adaptive Load Diffusion for Multiway Windowed Stream Joins. http://www.research.ibm.com/people/x/xgu/LD.pdf, IBM Research Technical Report, 2006.
16. M. A. Hammad, M. Franklin, W. G. Aref, and A. K. Elmagarmid. Scheduling for shared window joins over data streams. Proc. of VLDB, 2003.
17. M. Ivanova and T Risch. Customizable Parallel Execution of Scientific Stream. Queries. Proc. of VLDB, 2005.
18. N. Jain, L. Amini, H. Andrade, R. King, Y. Park, P. Selo, and C. Venkatramani. Design, Implementation, and Evaluation of the Linear Road. Benchmark on the Stream. Processing Core. Proc. of SIGMOD, 2006.
19. S. Krishnamurthy and et al. TelegraphCQ: An Architectural Status Report. IEEE Data Engineering Bulletin, 26(1), 2003.
20. R. Lawrence. Early Hash Join: A Configurable Algorithm for the Efficient and Early Production of Join Results. Proc. of VLDB, 2005.
21. S. Madden, M. Shah, J. Hellerstein, and V. Raman. Continuously Adaptive Continuous Queries Over Streams. Proc. of SIGMOD, 2002.
22. M. A. Shah, J. M. Hellerstein, S. Chandrasekaran, and M. J. Franklin. Flux: An Adaptive Partitioning Operator for Continuous Query Systems. Proc. of ICDE, 2003.
23. U. Srivastava and J. Widom. Memory Limited Execution of Windowed Stream Joins. Proc. of VLDB, 2004.
24. Y. Tao, M. L. Yiu, D. Papadlas, M. Hadjieleftheriou, and N. Mamoulis. RPJ: Producing Fast Join Results on Streams through Rate-based Optimization. Proc. of SIGMOD, 2005.
25. N. Tatbul, U. Cetintemel, S. Zdonik, M. Cherniack, and M. Stonebraker. Load Shedding in a Data Stream Manager. Proc. of VLDB, 2003.
26. F. Tian and D. J. DeWitt. Tuple Routing Strategies for Distributed Eddies. Proc. of VLDB, 2003.
27. T. Urhan and M. J. Franklin. XJoin: A Reactively-Scheduled Pipelined Join Operator. IEEE Data Engineering Bulletin, 2000.
28. S. D. Viglas, J. F. Naughton, and J. Burger. Maximizing the Output Rate of Multi-Way Join Queries over Streaming Information Sources. Proc. of VLDB, 2003.
29. Y. Xing, S. B. Zdonik, and J.-H. Hwang. Dynamic Load Distribution in the Borealis Stream Processor. Proc. of ICDE, April 2005.
30. S. Zdonik and et al. The Aurora and Medusa Projects. IEEE Data Engineering Bulletin, 26(1), 2003.