C-MR: Continuously executing MapReduce workflows on multi-core processors

MapReduce '12 - 3rd International Workshop on MapReduce and Its Applications

Volumn , Issue , 2012, Pages 1-8

  Backman, Nathan ^a   Pattabiraman, Karthik ^a   Fonseca, Rodrigo ^a   Çetintemel, Uǧur ^a  

^a Brown University   (United States)

Author keywords

MapReduce; Multi core; Stream processing

Indexed keywords

ADAPTIVE QUERY PROCESSING; APPLICATION LOGIC; ASYNCHRONOUS PROCESSING; COMPLEX WORKFLOWS; DATA DISTRIBUTION; DATA STREAM; EXECUTION SEMANTICS; INCREMENTAL PROCESSING; MAP-REDUCE; MULTI CORE; MULTI PROCESSOR ARCHITECTURE; MULTI-CORE PROCESSOR; PARALLEL STREAMS; PARALLEL TASK; PIPELINED PARALLELISM; PROCESSING MODEL; PROGRAMMING INTERFACE; PROGRAMMING MODELS; REDUNDANT COMPUTATION; SCHEDULING POLICIES; STREAM ORDER; STREAM PROCESSING; SUB-QUERIES; WORK-FLOWS; WORKFLOW SCHEDULING;

C (PROGRAMMING LANGUAGE); MICROPROCESSOR CHIPS; SCHEDULING; SEMANTICS;

MULTICORE PROGRAMMING;

EID: 84863932133     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2287016.2287018     Document Type: Conference Paper

References (10)

1. Monthly TAQ, http://www.nyxdata.com, New York Stock Exchange, Inc., 2010.
2. D. J. Abadi, Y. Ahmad, M. Balazinska, U. Çetintemel, M. Cherniack, J.-H. Hwang, W. Lindner, A. Maskey, A. Rasin, E. Ryvkina, N. Tatbul, Y. Xing, and S. B. Zdonik. The design of the Borealis stream processing engine. In CIDR, pages 277-289, 2005.
3. N. Backman, K. Pattabiraman, and U. Çetintemel. C-MR: A continuous MapReduce processing model for low latency stream processing on multi-core architectures. Technical Report CS-10-01, Computer Science Department, Brown University, Feb 2010.
4. T. Condie, N. Conway, P. Alvaro, J. M. Hellerstein, K. Elmeleegy, and R. Sears. MapReduce online. In NSDI, pages 313-328. USENIX Association, 2010.
5. J. Dean and S. Ghemawat. MapReduce: Simplified data processing on large clusters. In OSDI, pages 137-150, 2004.
6. V. Kumar, H. Andrade, B. Gedik, and K.-L. Wu. Deduce: at the intersection of MapReduce and stream processing. In EDBT '10: Proceedings of the 13th International Conference on Extending Database Technology, pages 657-662, New York, NY, USA, 2010. ACM.
7. J. Li, D. Maier, K. Tufte, V. Papadimos, and P. A. Tucker. No pane, no gain: efficient evaluation of sliding-window aggregates over data streams. SIGMOD Record, 34:39-44, March 2005.
8. D. Logothetis, C. Trezzo, K. C. Webb, and K. Yocum. In-situ MapReduce for log processing. In Proceedings of the 2011 USENIX conference on USENIX annual technical conference, USENIXATC'11, pages 9-9, Berkeley, CA, USA, 2011. USENIX Association.
9. J. Talbot, R. M. Yoo, and C. Kozyrakis. Phoenix++: modular MapReduce for shared-memory systems. In Proceedings of the second international workshop on MapReduce and its applications, MapReduce '11, pages 9-16, New York, NY, USA, 2011. ACM.
10. P. A. Tucker, D. Maier, T. Sheard, and L. Fegaras. Exploiting punctuation semantics in continuous data streams. IEEE Trans. on Knowl. and Data Eng., 15(3):555-568, 2003.