Query-aware partitioning for monitoring massive network data streams

Proceedings of the ACM SIGMOD International Conference on Management of Data

Volumn , Issue , 2008, Pages 1135-1146

  Johnson, Theodore ^a   Muthukrishnan, S ^b   Shkapenyuk, Vladislav ^a   Spatscheck, Oliver ^a  

^a AT AND T LABS RESEARCH   (United States)

^b RUTGERS UNIVERSITY   (United States)

Author keywords

Data streams; Partitioning; Query optimization

Indexed keywords

ALTERNATIVE APPROACHES; CENTRALIZED SERVERS; CENTRALIZED SYSTEMS; DATA STREAM MANAGEMENT SYSTEMS; DATA STREAM PARTITIONING; DATA STREAMS; DISTRIBUTED PROCESSING; HIGH SPEEDS; INPUT DATUMS; MILLION PACKETS PER SECONDS; NETWORK DATUMS; NETWORK TRAFFICS; PARTITIONING; PRESENT METHODS; PROCESSING NODES; QUERY EXECUTION PLANS; QUERY OPTIMIZATION; REAL TIMES; SMALL CLUSTERS;

DATA MINING; DATABASE SYSTEMS; INTERNET; MULTIPROCESSING SYSTEMS; NETWORK MANAGEMENT; PROCESS ENGINEERING; REAL TIME SYSTEMS;

COMPUTER NETWORKS;

EID: 57149138292     PISSN: 07308078     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1376616.1376730     Document Type: Conference Paper

References (21)

1. D. J. Abadi et al. The Design of the Borealis Stream Processing Engine, CIDR 2005.
2. D. J. Abadi et al.. Aurora: A new model and architecture for data stream management. VLDB Journal, 12(2):120-139, 2003.
3. D. J. Abadi W. Lindner, S. Madden, and J. Schuler. An Integration Framework for Sensor Networks and Data Stream Management Systems. Demonstration. VLDB 2004
4. A. Arasu et al. STREAM: The Stanford stream data manager. IEEE Data Engineering Bulletin, 26(1): 19-26, 2003.
5. B. Babcock, S. Babu, M. Datar, R. Motwani, and J. Widom. Models and issues in data stream systems. In Proc. ACM PODS, pages 1-16,2002.
6. M. Balazinska, H. Balakrishnan, M. Stonebraker. Contract-Based Load Management in Federated Distributed Systems. NSDI 2004, San Francisco, CA, March 2004.
7. S. Chandrasekaran et al. TelegraphCQ: Continuous dataflow processing for an uncertain world. CIDR 2003.
8. J. Chen, D.J. DeWitt, F. Tian and Y. Wang, NiagaraCQ: A Scalable Continuous Query System for Internet Databases. SIGMOD 2000 pg. 379-390.
9. M. Cherniack, H. Balakrishnan, M. Balazinska, D. Carney, U. Cetintemel, Y. Xing, and S. Zdonik. Scalable Distributed Stream Processing. CIDR 2003.
10. G. Cormode, T. Johnson, F. Kom, S. Muthukrishnan, O. Spatscheck, and D. Srivastava. Holistic UDAFs at streaming speeds. SIGMOD Conference, pages 35-46. ACM, 2004.
11. C. Cranor, T. Johnson, O. Spatscheck, and V. Shkapenyuk. Gigascope: A stream database for network applications. ACM SIGMOD, pages 647-651, 2003.
12. D. DeWitt, J. Gray. Parallel database systems: the future of high performance database systems. Communications of the ACM, v.35 n.6, p.85-98, June 1992.
13. M. Ivanova and T. Risch. Customizable Parallel Execution of Scientific Stream Queries. VLDB 2005.
14. R. R. Kompella, S. Singh, and G. Varghese. On scalable attack detection in the network. In ACM Internet Measurement Conference IMC 2004, pages 187 - 200.
15. D. Kossmann. The state of the art in distributed query processing. ACM Computing Surveys, 32(4):422--469, 2000.
16. Per-Ake Larson. Data Reduction by Partial Preaggregation. 18th International Conference on Data Engineering (ICDE'02), 2002.
17. J. Li, D. Maier, K. Tufte, V. Papadimos, P. A. Tucker: No pane, no gain: efficient evaluation of sliding-window aggregates over data streams. SIGMOD Record 34(1): 39-44 (2005)
18. S. Muthukrishnan. Data Streams: Algorithms and Applications. Foundations and Trends in Theoretical Computer Science, Vol 2,2005.
19. J. Rao, C. Zhang, N. Megiddo, G. M. Lohman: Automating physical database design in a parallel database. SIGMOD Conference 2002: 558-569
20. M. A. Shah, J. M. Hellerstein, S. Chandrasekaran, M. J. Franklin. Flux: An Adaptive Partitioning Operator for Continuous Query Systems. ICDE 2003
21. M. Sullivan and A. Heybey. Tribeca: A system for managing large databases of network traffic. In Proc.USENIX Annual Technical Conf., 1998