CellJoin: A parallel stream join operator for the cell processor

VLDB Journal

Volumn 18, Issue 2, 2009, Pages 501-519

  Gedik, Buǧra ^a   Bordawekar, Rajesh R ^a   Yu, Philip S ^b  

^a IBM RESEARCH   (United States)

^b 1120 Science and Engineering Offices   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AGGREGATE PROCESSING; CELL PROCESSORS; CO-PROCESSORS; DATA PARALLELISMS; DATA STREAM MANAGEMENT SYSTEMS; DATA STREAMS; DESIGN GUIDELINES; HETEROGENEOUS MULTI CORES; HIGH THROUGHPUTS; IMPLEMENTATION TECHNIQUES; INPUT STREAMS; JOIN OPERATORS; LOCAL MEMORIES; LOW LATENCIES; MULTI-CORE PROCESSORS; OUTPUT RATES; PARALLEL STREAMS; PROCESSING ELEMENTS; PROCESSING RATES; PROGRAMMING MODELS; SCATTERED DATUM; SINGLE INSTRUCTION MULTIPLE DATUM;

COMPUTER HARDWARE DESCRIPTION LANGUAGES; DATA TRANSFER; MATHEMATICAL OPERATORS; WINDOWS;

COMPUTER ARCHITECTURE;

EID: 63449107138     PISSN: 10668888     EISSN: 0949877X     Source Type: Journal    
DOI: 10.1007/s00778-008-0116-z     Document Type: Article

References (36)

1. ALF for Cell BE programmer's guide and API reference. Retrieved on 15th July 2008, http://www-01.ibm.com/chips/techlib/techlib.nsf/techdocs/ 41838EDB5A15CCCD002573530063D465 (2008)
2. Arasu, A., Babcock, B., Babu, S., Datar, M., Ito, K., Motwani, R., Nishizawa, I., Srivastava, U., Thomas, D., Varma, R., Widom, J.: STREAM: the Stanford stream data manager. IEEE Data Eng. Bull. 26(1) (2003)
3. Ayad, A.M., Naughton, J.F.: Static optimization of conjunctive queries with sliding windows over infinite streams. In: ACM International Conference on Management of Data (SIGMOD) (2004)
4. Backus, J.: Can programming be liberated from the von neumann style? Communications of the ACM, 21(8) (1978)
5. Bader, D., Agarwal, V., Madduri, K.: On the design and analysis of irregular algorithms on the Cell processor: a case study on list ranking. In: IEEE International Parallel and Distributed Processing Symposium (IPDPS) (2007)
6. Balakrishnan, H., Balazinska, M., Carney, D., Cetintemel, U., Cherniack, M., Convy, C., Galvez, E., Salz, J., Stonebraker, M., Tatbul, N., Tibbetts, R., Zdonik, S.: Retrospective on Aurora. VLDB J. Special Issue on Data Stream Processing (2004)
7. Bandi, N., Sun, C., Abbadi, A.E., Agrawal, D.: Hardware acceleration for spatial selections and joins. In: International Conference on Very Large Data Bases (VLDB) (2004)
8. Chandrasekaran, S., Cooper, O., Deshpande, A., Franklin, M.J., Hellerstein, J.M., Hong, W., Krishnamurthy, S., Madden, S.R., Raman, V., Reiss, F., Shah, M.A.: TelegraphCQ: Continuous dataflow processing for an uncertain world. In: Conference on Innovative Data Systems Research (CIDR) (2003)
9. Das, A., Gehrke, J., Riedewald, M.: Approximate join processing over data streams. In: ACM International Conference on Management of Data (SIGMOD) (2003)
10. DeWitt, D.J., Gerber, R.H., Graefe, G., Heytens, M.L., Kumar, K.B., Muralikrishna, M.: GAMMA-a high performance dataflow database machine. In: International Conference on Very Large Data Bases (VLDB) (1986)
11. DeWitt, D.J., Naughton, J.F., Schneider, D.A.: An evaluation of non-equijoin algorithms. In: International Conference on Very Large Data Bases (VLDB) (1991)
12. Eichenberger, A.E., O'Brien, K., O'Brien, K., Wu, P., Chen, T., Oden, P.H., Prener, D.A., Shepherd, J.C., So, B., Sura, Z., Wang, A., Zhang, T., Zhao, P., Gschwind, M.: Optimizing compiler for a Cell processor. In: International Conference on Parallel Architectures and Compilation Techniques (PACT) (2005)
13. Gedik, B., Wu, K.-L., Yu, P.S., Liu, L.: Cpu load shedding for binary stream joins. Springer Knowledge and Information Systems, 13(3) (2007)
14. Golab, L., Özsu, M.T.: Processing sliding window multi-joins in continuous queries over data streams. In: International Conference on Very Large Data Bases (VLDB) (2003)
15. Gold, B., Ailamaki, A., Huston, L., Falsafi, B.: Accelerating database operators using a network processor. In: Proceedings of the 1st international workshop on Data management on new hardware (DAMON) (2005)
16. Govindaraju, N.K., Gray, J., Kumar, R., Manocha, D.: GPUTeraSort: High performance graphics co-processor sorting for large database management. In: ACM International Conference on Management of Data (SIGMOD) (2006)
17. Govindaraju, N.K., Raghuvanshi, N., Manocha, D.: Fast and approximate stream mining of quantiles and frequencies using graphics processors. In: ACM International Conference on Management of Data (SIGMOD) (2005)
18. Gu, X., Wen, Z., Lin, C., Yu, P.S.: ViCo: an adaptive distributed video correlation system. In: ACM International Conference on Multimedia (2006)
19. Hammad, M.A., Aref, W.G., Elmagarmid, A.K.: Stream window join: Tracking moving objects in sensor-network databases. In: Scientific and Statistical Database Management Conference (SSDBM) (2003)
20. IBM.: Cell broadband engine architecture. Technical Report Version 1.0, IBM Systems and Technology Group (2005)
21. IBM full-system simulator for the cell broadband engine processor. Retrieved on 12th October 2006, http://www.alphaworks.ibm.com/tech/ cellsystemsim/ (2006)
22. Intel. IXP2400 network processor hardware reference manual. Technical report, Intel Corporation, May 2003
23. Jain, N., Amini, L., Andrade, H., King, R., Park, Y., Selo, P., Venkatramani, C.: Design, implementation, and evaluation of the linear road benchmark on the stream processing core. In: ACM International Conference on Management of Data (SIGMOD) (2006)
24. Jain, N., Amini, L., Andrade, H., King, R., Park, Y., Selo, P., Venkatramani, C.: Design, implementation, and evaluation of the linear road benchmark on the stream processing core. In: ACM International Conference on Management of Data, (SIGMOD) (2006)
25. Kang, J., Naughton, J., Viglas, S.: Evaluating window joins over unbounded streams. In: IEEE International Conference on Data Engineering (ICDE) (2003)
26. Kistler, M., Perrone, M., Petrini, F.: Cell multiprocessor interconnection network: Built for speed. IEEE Micro, 26(3) 2006
27. Lakshmi, M.S., Yu, P.S.: Limiting factors of join performance on parallel processors. In: IEEE International Conference on Data Engineering (ICDE) (1989)
28. Mercury Systems Dual Cell-based Blade. Feburary 2007, http://www.mc.com/literature/literature-files/Cell-blade-ds.pdf (2007)
29. Petrini, F., Fossum, G., Fernandez, J., Varbanescu, A.L., Kistler, M., Perrone, M.: Multicore surprises: Lessons learned from optimizing Sweep3D on the Cell Broadband Engine. In: IEEE International Parallel and Distributed Processing Symposium (IPDPS) (2007)
30. Srivastava, U., Widom, J.: Memory-limited execution of windowed stream joins. In: International Conference on Very Large Data Bases (VLDB) (2004)
31. Stonebraker, M.: The case for shared nothing architecture. IEEE Database Eng. Bull. 9(1) (1986)
32. Stonebraker, M., Abadi, D., Batkin, A., Chen, X., Cherniack, M., Ferreira, M., Lau, E., Lin, A., Madden, S., O'Neil, E., O'Neil, P., Rasin, A., Tran, N., Zdonik, S.: C-Store: A column oriented DBMS. In: International Conference on Very Large Data Bases (VLDB) (2005)
33. Streambase systems. Retrieved on May 2005, http://www.streambase.com/ (2005)
34. Tatbul, N., Cetintemel, U., Zdonik, S., Cherniack, M., Stonebraker, M.: Load shedding in a data stream manager. In: Very Large Databases Conference (VLDB) (2003)
35. Viglas, S.D., Naughton, J.F., Burger, J.: Maximizing the output rate of m-way join queries over streaming information sources. In: Very Large Databases Conference (VLDB) (2003)
36. Wu, K.-L., Yu, P.S., Gedik, B., Hildrum, K.W., Aggarwal, C., Bouillet, E., Fan, W., George, D.A., Gu, X., Luo, G., Wang, H.: Challenges and experience in prototyping a multi-modal stream analytic and monitoring application on System S. In: Very Large Data Bases Conference (2007)