SpamWatcher: A streaming social network analytic on the IBM wire-speed processor

DEBS'11 - Proceedings of the 5th ACM International Conference on Distributed Event-Based Systems

Volumn , Issue , 2011, Pages 267-277

  Zou, Qiong ^a   Gedik, Buǧra ^b   Wang, Kun ^a  

^a IBM Research   (China)

^b IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

pattern matching accelerator; social network analytic; stream processing

Indexed keywords

AS RELATIONSHIPS; CO-PROCESSORS; COMMERCIAL GRADE; CUSTOMER EXPERIENCE; HIGH THROUGHPUT; IMPLEMENTATION TECHNIQUES; INTEGRATED NETWORKS; LOW-LATENCY; MASSIVE DATA; MOBILE CARRIERS; MOBILE COMMUNICATIONS; MOBILE USERS; ONLINE INTERACTION; PATTERN MATCHING ACCELERATORS; PERFORMANCE IMPROVEMENTS; REAL TIME FILTERING; REAL WORLD DATA; REAL-TIME DETECTION; SERVICE PROVIDER; SHORT MESSAGE; SOCIAL NETWORK ANALYSIS; SOCIAL NETWORK ANALYTIC; SOCIAL NETWORKS; SPAM DETECTION; STREAM PROCESSING; SYSTEM-ON-A-CHIP; THREAD SYNCHRONIZATION; WEB APPLICATION;

APPLICATION SPECIFIC INTEGRATED CIRCUITS; ELECTRIC NETWORK ANALYSIS; GLOBAL SYSTEM FOR MOBILE COMMUNICATIONS; INTERNET; MICROPROCESSOR CHIPS; MIDDLEWARE; MOBILE DEVICES; ONLINE SYSTEMS; PATTERN MATCHING; SCALABILITY; SOFTWARE ARCHITECTURE; USER INTERFACES; VIRTUAL REALITY; WIRE;

DATA HANDLING;

EID: 80051940649     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2002259.2002295     Document Type: Conference Paper

References (32)

1. N. Alon, R. Yuster, and U. Zwick. Finding and counting given length cycles (extended abstract). In ESA '94: Proceedings of the Second Annual European Symposium on Algorithms, pages 354-364, London, UK, 1994. Springer-Verlag.
2. L. Amini, H. Andrade, R. Bhagwan, F. Eskesen, R. King, P. Selo, Y. Park, and C. Venkatramani. SPC: A distributed, scalable platform for data mining. In Proceedings of the Workshop on Data Mining Standards, Services and Platforms, DM-SSP, 2006.
3. N. Anastopoulos and N. Koziris. Facilitating efficient synchronization of asymmetric threads on hyper-threaded processors. In Proceedings of the IPDPS Conference, IPDPS, 2008.
4. L. Becchetti, P. Boldi, C. Castillo, and A. Gionis. Efficient algorithms for large-scale local triangle counting. ACM Trans. Knowl. Discov. Data, 4(3):1-28, 2010.
5. P. Bohrer, J. Peterson, M. Elnozahy, R. Rajamony, A. Gheith, R. Rockhold, C. Lefurgy, H. Shafi, T. Nakra, R. Simpson, E. Speight, K. Sudeep, E. Van Hensbergen, and L. Zhang. Mambo: a full system simulator for the powerpc architecture. SIGMETRICS Perform. Eval. Rev., 31(4):8-12, 2004.
6. P. O. Boykin and V. P. Roychowdhury. Leveraging social networks to fight spam. Computer, 38(4):61-68, 2005.
7. D. Coppersmith and S. Winograd. Matrix multiplication via arithmetic progressions. In STOC '87: Proceedings of the nineteenth annual ACM symposium on Theory of computing, pages 1-6, New York, NY, USA, 1987. ACM.
8. W. De Pauw and H. Andrade. Visualizing large-scale streaming applications. Information Visualization, 8(2), 2009.
9. J. Dean and S. Ghemawat. MapReduce: simplified data processing on large clusters. In OSDI'04: Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation, pages 10-10, Berkeley, CA, USA, 2004. USENIX Association.
10. D. Ediger, K. Jiang, J. Riedy, and D. Bader. Massive streaming data analytics: A case study with clustering coefficients. In Parallel Distributed Processing, Workshops and Phd Forum (IPDPSW), 2010 IEEE International Symposium on, pages 1-8, April 2010.
11. K. Fan, M. Kudlur, G. Dasika, and S. mahlke. Bridging the computation gap between programmable processors and hardwired accelerators. In Proceedings of the 2009 High Performance Computer Architecture (HPCA 2009), 2009.
12. H. Franke, J. Xenidis, C. Basso, B. M. . Bass, S. S. Woodward, J. D. Brown, and C. L. Johnson. Introduction to the wire-speed processor and architecture. JRD IBM Journal of Research and Development, 54, 2010.
13. B. Gedik, H. Andrade, A. Frenkiel, W. De Pauw, M. Pfeifer, P. Allen, N. Cohen, and K.-L. Wu. Debugging tools and strategies for distributed stream processing applications. Software: Practice and Experience, 39(16), 2009.
14. B. Gedik, H. Andrade, and K.-L. Wu. A code generation approach to optimizing high-performance distributed data stream processing. In Proceedings of the 2009 Conference on Information and Knowledge Management (CIKM 2009), 2009.
15. B. Gedik, H. Andrade, K.-L. Wu, P. S. Yu, and M. Doo. SPADE: The System S declarative stream processing engine. In Proceedings of the ACM International Conference on Management of Data (SIGMOD 2008), 2008.
16. M. Hirzel, H. Andrade, B. Gedik, V. Kumar, G. Losa, M. Mendell, H. Nasgaard, R. Soulé, and K.-L. Wu. Spade - language specification. Technical Report RC24987, IBM Research, 2009.
17. Intel 64 and ia-32 architectures software developer manual vol. 3a: System programming guide, part 1. http://www.intel.com/products/processor.
18. A. Itai and M. Rodeh. Finding a minimum circuit in a graph. In STOC '77: Proceedings of the ninth annual ACM symposium on Theory of computing, pages 1-10, New York, NY, USA, 1977. ACM.
19. G. Jacques-Silva, B. Gedik, H. Andrade, and K.-L. Wu. Language level checkpointing support for stream processing applications. In Proocedings of the 2009 International Conference on Dependable Systems and Networks (DSN 2009), 2009.
20. N. Jain, L. Amini, H. Andrade, R. King, Y. Park, P. Selo, and C. Venkatramani. Design, implementation, and evaluation of the linear road benchmark on the stream processing core. In Proceedings of the International Conference on Management of Data (SIGMOD 2006), 2006.
21. R. Kalla, B. SinHaroy, and J. Tendler. A smt implementation in power5. In Hot Chips, 2003.
22. R. Kallman, H. Kimura, J. Natkins, A. Pavlo, A. Rasin, S. Zdonik, E. P. C. Jones, S. Madden, M. Stonebraker, Y. Zhang, J. Hugg, and D. J. Abadi. H-store: a high-performance, distributed main memory transaction processing system. Proc. VLDB Endow., 1(2):1496-1499, 2008.
23. T. Kawano, S. Kusakabe, R.-I. Taniguchi, and M. Amamiya. Fine-grain multi-thread processor architecture for massively parallel processing. High-Performance Computer Architecture, International Symposium on, 0:308, 1995.
24. Z. Liu, C.Wang, Q. Zou, and H.Wang. Clustering coefficient queries on massive dynamic social networks. In Conference on Web-Age Information Management (WAIM), 2010.
25. Powerpc user instruction set architecture, book i. http://www.ibm.com/ developerworks/systems/library.
26. T. Schank and D. Wagner. Approximating clustering coefficient and transitivity. Journal of Graph Algorithms and Applications, 9:2005, 2005.
27. T. Schank and D. Wagner. Finding, counting, and listing all triangles in large graphs, an experimental study. In Workshop on Experimental and Efficient Algorithms (WEA), 2005.
28. M. Stonebraker, S. Madden, D. J. Abadi, S. Harizopoulos, N. Hachem, and P. Helland. The end of an architectural era: (it's time for a complete rewrite). In VLDB '07: Proceedings of the 33rd international conference on Very large data bases, pages 1150-1160. VLDB Endowment, 2007.
29. L. Weitao. China's mobile phone users hit 650 million. http://www.chinadaily.com.cn/bizchina/2009-03/06/content-7547876.htm, 2009.
30. K.-L. Wu, P. S. Yu, B. Gedik, K. W. Hildrum, C. C. Aggarwal, E. Bouillet, W. Fan, D. A. George, X. Gu, G. Luo, and H. Wang. Challenges and experience in prototyping a multi-modal stream analytic and monitoring application on System S. In Proceedings of the Very Large Data Bases Conference (VLDB 2007), 2007.
31. F. Yu, Z. Chen, Y. Diao, T. V. Lakshman, and R. H. Katz. Fast and memory-efficient regular expression matching for deep packet inspection. In ANCS'06, pages 93-102, 2006.
32. Q. Zou, H. Wang, R. Soule, M. Hirzel, H. Andrade, B. Gedik, and K.-L. Wu. From a stream of relational queries to distributed stream processing. In Proceedings of the Very Large Data Bases Conference (VLDB 2010), 2010.