DEDUCE: At the intersection of MapReduce and stream processing

Advances in Database Technology - EDBT 2010 - 13th International Conference on Extending Database Technology, Proceedings

Volumn , Issue , 2010, Pages 657-662

  Kumar, Vibhore ^a   Andrade, Henrique ^a   Gedik, Buǧra ^a   Wu, Kun Lung ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONFIGURATION PARAMETERS; DATAFLOW; NUMBER OF DATUM; PERIODIC ANALYSIS; RUNTIME SUPPORT; SHARED RESOURCES; STOCK TRADING; STREAM PROCESSING; STREAM PROCESSING SYSTEMS;

COMPUTER HARDWARE DESCRIPTION LANGUAGES; DATABASE SYSTEMS; HYDRAULICS; MIDDLEWARE; TECHNOLOGY;

DATA PROCESSING;

EID: 77952270709     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1739041.1739120     Document Type: Conference Paper

References (22)

1. D. J. Abadi et al. The Design of the Borealis Stream Processing Engine. In CIDR, 2005.
2. L. Amini et al. Spc: a distributed, scalable platform for data mining. In DMSSP, 2006.
3. A. Arasu et al. Stream: the stanford stream data manager (demonstration description). In SIGMOD, 2003.
4. M. Balazinska, H. Balakrishnan, S. R. Madden, and M. Stonebraker. Fault-tolerance in the borealis distributed stream processing system. ACM Transansactions on Database Systems, 33(1), 2008.
5. S. Chandrasekaran, O. Cooper, A. Deshpande, M. J. Franklin, J. M. Hellerstein, W. Hong, S. Krishnamurthy, S. R. Madden, F. Reiss, and M. A. Shah. Telegraphcq: continuous dataflow processing. In SIGMOD, 2003.
6. S. Chaudhuri and U. Dayal. An overview of data warehousing and olap technology. SIGMOD Record, 26(1), 1997.
7. J. Dean and S. Ghemawat. MapReduce: simplified data processing on large clusters. In OSDI, 2004.
8. IBM - financial markets. http://ibm.com/financialmarkets/.
9. B. Gedik et al. SPADE: the System S declarative stream processing engine. In SIGMOD, 2008.
10. S. Ghemawat, H. Gobioff, and S.-T. Leung. The google file system. SIGOPS Oper. Syst. Rev., 37(5).
11. Hadoop. http://hadoop.apache.org/core.
12. The hadoop distributed file system: Architecture and design. http://hadoop.apache.org/core/docs/current/hdfs-design.html.
13. High performance scalable storage. http://kosmosfs.sourceforge.net.
14. V. Kumar et al. Implementing diverse messaging models with self-managing properties using IFLOW. In ICAC, 2006.
15. Apache mahout. http://lucene.apache.org/mahout.
16. Mapreduce: A major step backwards. http://www.databasecolumn.com/2008/01/ mapreduce-a-major-step-back.html.
17. S.-H. Oh, J.-S. Kang, Y.-C. Byun, G.-L. Park, and S.-Y. Byun. Intrusion detection based on clustering a data stream. International Conference on Software Engineering Research, Management and Applications, 0, 2005.
18. C. Olston et al. Pig latin: a not-so-foreign language for data processing. In SIGMOD, New York, NY, USA, 2008.
19. R. Pike et al. Interpreting the data: Parallel analysis with Sawzall. Scientific Programming Journal: Special Issue on Grids and Worldwide Computing Programming Models and Infrastructure, 2005.
20. Square kilometer array. http://www.skatelescope.org.
21. Y. Xing, S. Zdonik, and J.-H. Hwang. Dynamic load distribution in the borealis stream processor. In ICDE, 2005.
22. H.-C. Yang, A. Dasdan, R.-L. Hsiao, and D. S. Parker. Map-reduce-merge: simplified relational data processing on large clusters. In SIGMOD, 2007.