Efficiently filtering duplicates over distributed data streams

Proceedings - International Conference on Computer Science and Software Engineering, CSSE 2008

Volumn 4, Issue , 2008, Pages 631-634

  Xiaowei, Wang ^a   Qiang, Zhang ^a   Yan, Jia ^a  

^a NATIONAL UNIVERSITY OF DEFENSE TECHNOLOGY   (China)

Author keywords

Bloom filter; Distributed data stream; Duplicate items

Indexed keywords

BLOOM FILTERS; COMMUNICATION OVERHEADS; DISTRIBUTED DATA STREAMS; DUPLICATE ITEMS; EFFICIENT DATA STRUCTURES; FILTERING ALGORITHM; HIGH-SPEED DATA; REAL TIME MONITORING; SPACE AND TIME;

BLOOMS (METAL); DATA STRUCTURES; SOFTWARE ENGINEERING;

DATA COMMUNICATION SYSTEMS;

EID: 79951544291     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CSSE.2008.1367     Document Type: Conference Paper

References (10)

1. Graham Cormode, S. Muthukrishnan, Wei Zhang, What's Different: Distributed, Continuous Monitoring of Duplicate-Resilient Aggregates on Data Streams. In ICDE, 2006.
2. S. R. Jeffery, M. Garofalakis, and M. J. Franklin. Adaptive cleaning for RFID data streams. In Proc. 2006 Int. Conf. Very Large Data Bases (VLDB'06), Seoul, Korea, Sept. 2006.
3. C. Olston, J. Jiang, J. Widom, Adaptive Filters for Continuous Queries over Distributed Data Streams. In ACM SIGMOD international conference on Management of data. San Diego, California, 2003. 563-574.
4. C. Olston, B. T. Loo, J. Widom, Adaptive Precision Setting for Cached Approximate Values. In ACM SIGMOD international conference on Management of data. Santa Barbara, California, 2001. 355-366.
5. A. Jain, E. Y. Chang, Y. F. Wang, Adaptive Stream Resource Management Using Kalman Filters. In ACM SIGMOD international conference on Management of data. Paris, France, 2004. 11-22.
6. Tian Xia, Cheqing Jin, Xiaofang Zhou, and Aoying Zhou, Filtering Duplicate Items over Distributed Data Streams. In WAIM, 2005.
7. B. Babcock, S. Babu, M. Datar, R Motwani, and J. Widom. Models and Issues in Data Stream Systems. In Proc. of 2002 ACM Symp. on Principles of Database Systems, 2002.
8. B. Bloom. " Space/ Time Tradeoffs in Hash Coding with Allowable Errors." Communications of the ACM 13:7(1970), 422426.
9. M. Mitzenmacher. Compressed Bloom filters. IEEE/ACM Trans. Netw, 10(5): 604-612, 2002.
10. Approximately Detecting Duplicates for Streaming Data using Stable Bloom Filters. In ACM SIGMOD international conference on Management of data. Chicago, Illinois, USA, 2006.