Fast data stream algorithms using associative memories

Proceedings of the ACM SIGMOD International Conference on Management of Data

Volumn , Issue , 2007, Pages 247-256

  Bandi, Nagender ^a   Metwally, Ahmed ^a   Agrawal, Divyakant ^a   El Abbadi, Amr ^a  

^a University of California   (United States)

Author keywords

Data streams; Hardware; TCAMS

Indexed keywords

CLICK-FRAUD DETECTION; DATA STREAM ALGORITHMS; DATA STREAMS; NETWORK PROCESSING UNITS (NPU);

DATA STRUCTURES; FAULT TOLERANCE; HIGH SPEED NETWORKS; NETWORK ARCHITECTURE; ONLINE SYSTEMS; QUERY LANGUAGES;

ASSOCIATIVE STORAGE;

EID: 35449003310     PISSN: 07308078     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1247480.1247510     Document Type: Conference Paper

References (26)

1. Intel network processing units. http://www.intel.com/, 2006.
2. Teja networking systems, http://www.teja.com, 2006.
3. D. J. Abadi, D. Carney, U. Cetintemel, M. Cherniack, C. Convey, S. Lee, M. Stonebraker, N. Tatbul, and S. Zdonik. Aurora: a new model and architecture for data stream management. The VLDB Journal, 12(2): 120-139, 2003.
4. N. Bandi, D. Agrawal, and A. E. Abbadi. Fast algorithms for heavy distinct hitters using associative memories. In International Conference on Distributed Computing Systems (ICDCS), 2007.
5. N. Bandi, S. Schnieder, D. Agrawal, and A. E. Abbadi. Hardware acceleration of database operations using content-addressable memories. In DaMoN, 2005.
6. S. Chandrasekaran. Telegraphcq: Continuous dataflow processing for an uncertain world, 2003.
7. M. Charikar, K. Chen, and M. Farach-Colton. Finding frequent items in data, streams. In ICALP'02, pages 693-703, 2002.
8. G. Cormode and S. Muthukrishnan. What's hot and what's not: tracking most frequent items dynamically. In PODS '03, pages 296-306, 2003.
9. C. Cranor, T. Johnson, O. Spataschek, and V. Shkapenyuk. Gigascope: a stream database for network applications. In SIGMOD '03: Proceedings of the 2003 ACM SIGMOD international conference on Management of data, pages 647-651, New York, NY, USA, 2003. ACM Press.
10. E. D. Demaine, A. López-Ortiz, and J. I. Munro. Frequency estimation of internet packet streams with limited space. In Proceedings of the 10th Annual European Symposium on Algorithms (ESA '02), volume 2461, pages 348-360, 2002.
11. C. Estan and G. Varghese. New directions in traffic measurement and accounting: Focusing on the elephants, ignoring the mice. ACM Trans. Comput. Syst., 21(3):270-313, 2003.
12. R. H. K. Fang Yu. Efficient Multi-Match Packet Classification with TCAM. In IEEE Hot Interconnects, 2004.
13. B. T. Gold, A. Ailamaki, L. Huston, and B. Falsafi. Accelerating database operations using a network processor. In DaMoN, 2005.
14. M. Greenwald and S. Khanna. Space-efficient online computation of quantile summaries. In SIGMOD Conference, 2001.
15. J. Hershberger, N. Shrivastava, S. Suri, and C. D. Tóth. Adaptive spatial partitioning for multidimensional data streams. In ISAAC, pages 522-533, 2004.
16. R. M. Karp, S. Shenker, and C. H. Papadimitriou. A simple algorithm for finding frequent elements in streams and bags. ACM Trans. Database Syst., 28(1):51-55, 2003.
17. K. Lakshminarayanan, A. Rangarajan, and S. Venkatachary. Algorithms for advanced packet classification with ternary cams. In SIGCOMM '05, pages 193-204, New York, NY, USA, 2005. ACM Press.
18. G. S. Manku and R. Motwani. Approximate frequency counts over data streams, 2002.
19. G. S. Manku, S. Rajagopalan, and B. G. Lindsay. Approximate medians and other quantiles in one pass and with limited memory. In SIGMOD'98, pages 426-435, 1998.
20. A. Metwally, D. Agrawal, and A. E. Abbadi. Efficient computation of frequent and top-k elements in data streams. In ICDT, pages 398-412, 2005.
21. J. Misra and D. Gries. Finding repeated elements. Sci. Comput. Program., 2(2):143-152, 1982.
22. S. Mysore, B. Agrawal, T. Sherwood, N. Shrivastava, and S. Suri. Profiling over adaptive ranges. In CGO '06: Proceedings of the International Symposium on Code Generation and Optimization, pages 147-158, 2006.
23. G. J. Narlikar, A. Basu, and F. Zane. Coolcams: Power-efficient tcams for forwarding engines. In INFOCOM, 2003.
24. R. Panigrahy and S. Sharma. Sorting and Searching using Ternary CAMs. In IEEE Micro., 2003.
25. J. Widom and R. Motwani. Query processing, resource management, and approximation in a data stream management system, 2003.
26. F. Yu, R. H. Katz, and T. V. Lakshman. Gigabit rate packet pattern-matching using tcam. In ICNP '04, pages 174-183, 2004.