Enabling real-time querying of live and historical stream data

Proceedings of the International Conference on Scientific and Statistical Database Management, SSDBM

Volumn , Issue , 2007, Pages

  Reiss, Frederick ^a,b,c   Stockinger, Kurt ^a   Wu, Kesheng ^a   Shoshani, Arie ^a   Hellerstein, Joseph M ^b  

^a LAWRENCE BERKELEY NATIONAL LABORATORY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c IBM ALMADEN RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AD HOC NETWORKS; ADMINISTRATIVE DATA PROCESSING; DATABASE SYSTEMS; FINANCIAL DATA PROCESSING; INDEXING (OF INFORMATION); INTERNET; MANAGEMENT INFORMATION SYSTEMS; PUBLIC WORKS; STATISTICAL METHODS; STATISTICS;

(OTDR) TECHNOLOGY; ARCHIVED DATA; BITMAP INDEXES; COMBINED SYSTEMS; COMPLEX QUERIES; CURRENT BEHAVIORS; DATABASE MANAGEMENT; DATASTREAM (CO); HIGH DATA RATE (HDR); HISTORICAL DATA; IN ORDER; INDEX UPDATE; INTERNATIONAL CONFERENCES; PERFORMANCE EVALUATION (PE); PROTOTYPE SYSTEMS; QUERY PROCESSORS; REAL NETWORK TRAFFIC; REAL TIME; STREAM DATA; TRAFFIC INFORMATION;

RIVERS;

EID: 46649089153     PISSN: 10993371     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SSDBM.2007.34     Document Type: Conference Paper

References (29)

1. A. Arasu, S. Babu, and J. Widom. The CQL continuous query language: Semantic foundations and query execution. Technical Report 2003-67, Stanford University, 2003.
2. E. W. Bethel, S. Campbell, E. Dart, K. Stockinger, and K. Wu. Accelerating Network Traffic Analysis Using Query-Driven Visualization. In 2006 IEEE Symposium on Visual Analytics Science and Technology (to appear), 2006.
3. C. Y. Chan and Y. E. Ioannidis. An Efficient Bitmap Encoding Scheme for Selection Queries. In SIGMOD, 1999.
4. S. Chandrasekaran and M. Franklin. Remembrance of Streams Past: Overload-Sensitive Management of Archived Streams. In VLDB, 2004.
5. S. Chandrasekaran and O. Cooper et al. TelegraphCQ: Continuous Dataflow Processing for an Uncertain World. In CIDR, 2003.
6. B.-C. Chen, V. Yegneswaran, P. Barford, and R. Ramakrishnan. Toward a Query Language for Network Attack Data. In NetDB Workshop, 2006.
7. C. D. Cranor, T. Johnson, O. Spatscheck, and V. Shkapenyuk. Gigascope: A Stream Database for Network Applications. In SIGMOD, 2003.
8. H. Dreger, A. Feldmann, V. Paxson, and R. Sommer. Operational experiences with high-volume network intrusion detection. In CCS, pages 2-11. ACM Press, 2004.
9. M. Franklin, S. Jeffery, S. Krishnamurthy, F. Reiss, S. Rizvi, E. Wu, O. Cooper, A. Edakkunni, and W. Hong. Design Considerations for High Fan-in Systems: The HiFi Approach. In CIDR, 2005.
10. L. Golab and M. T. Özsu. Issues in Data Stream Management. SIGMOD Record, 32(2), 2003.
11. G. Graefe. Goetz graefe. SIGMOD Record, 18(9):509-516, 2006.
12. P. J. Haas and J. M. Hellerstein. Ripple joins for online aggregation. In A. Delis, C. Faloutsos, and S. Ghandeharizadeh, editors, SIGMOD, pages 287-298. ACM Press, 1999.
13. G. Iannaccone. CoMo: An Open Infrastructure for Network Monitoring - Research Agenda, 2005.
14. S. Kornexl, V. Paxson, H. Dreger, A. Feldmann, and R. Sommer. Building a Time Machine for Efficient Recording and Retrieval of High-Volume Network Traffic. In Internet Measurement Conference, 2005.
15. P. O'Neil and D. Quass. Improved Query Performance with Variant Indices. In SIGMOD, 1997.
16. V. Paxson. Bro: A System for Detecting Network Intruders in Real-Time. In USENIX Security Symposium, January 1998.
17. T. Plagemann, V. Goebel, A. Bergamini, G. Tolu, G. Urvoy-Keller, and E. W. Biersack. Using Data Stream Management Systems for Traffic Analysis - A Case Study. In Passive and Active Measurements, 2004.
18. F. Reiss. Data Triage. PhD thesis, University of California, Berkeley, 2006.
19. F. Reiss and J. M. Hellerstein. Declarative Network Monitoring with an Underprovisioned Query Processor. In ICDE, 2006.
20. M. Roesch. Snort-Lightweight Intrusion Detection for Networks. In USENIX LISA, 1999.
21. D. Rotem, K. Stockinger, and K. Wu. Optimizing Candidate Check Costs for Bitmap Indices. In CIKM, 2005.
22. M. A. Shah, J. M. Hellerstein, and E. Brewer. Highly Available, Fault-Tolerant, Parallel Dataflows. In SIGMOD, 2004.
23. A. Shoshani, L. Bernardo, H. Nordberg, D. Rotem, and A. Sim. Multidimensional Indexing and Query Coordination for Tertiary Storage Management. In SSDBM, July 1999.
24. M. Siekkinen, E. W. Biersack, V. Goebel, T. Plagemann, and G. Urvoy-Keller. InTraBase: Integrated Traffic Analysis Based on a Database Management System. In Workshop on End-to-End Monitoring Techniques and Services, May 2005.
25. K. Stockinger and K.Wu et al. Network Traffic Analysis With Query Driven Visualization - SC 2005 HPC Analytics Results. In Super Computing, 2005.
26. M. Sullivan and A. Heybey. Tribeca: A system for Managing Large Databases of Network Traffic. In USENIX, 1998.
27. K. Wu, E. Otoo, and A. Shoshani. A Performance Comparison of Bitmap Indices. In CIKM, 2001.
28. K. Wu, E. Otoo, and A. Shoshani. On the Performance of Bitmap Indices for High Cardinality Attributes. In VLDB, 2004.
29. K. Wu, E. J. Otoo, and A. Shoshani. An Efficient Compression Scheme For Bitmap Indices. ACM Transactions on Database Systems, 31:1-38, 2006.