TimeStream: Reliable stream computation in the cloud

Proceedings of the 8th ACM European Conference on Computer Systems, EuroSys 2013

Volumn , Issue , 2013, Pages 1-14

  Qian, Zhengping ^a   He, Yong ^a,b   Su, Chunzhi ^a,c   Wu, Zhuojie ^a,c   Zhu, Hongyu ^a,c   Zhang, Taizhi ^a,d   Zhou, Lidong ^a   Yu, Yuan ^e   Zhang, Zheng ^a  

^a MICROSOFT RESEARCH ASIA   (China)

^b SOUTH CHINA UNIVERSITY OF TECHNOLOGY   (China)

^c SHANGHAI JIAO TONG UNIVERSITY   (China)

^d PEKING UNIVERSITY   (China)

^e MICROSOFT RESEARCH   (United States)

Author keywords

cluster computing; distributed stream processing; dynamic reconfiguration; fault tolerance; real time; resilient substitution; StreamInsight

Indexed keywords

CONTINUOUS PROCESSING; DECLARATIVE PROGRAMMING; DISTRIBUTED STREAM PROCESSING; DISTRIBUTED SYSTEMS; DYNAMIC RE-CONFIGURATION; EMERGING APPLICATIONS; REAL-TIME; STREAMINSIGHT;

BATCH DATA PROCESSING; CLUSTER COMPUTING; COMPUTER PROGRAMMING; DISTRIBUTED PARAMETER CONTROL SYSTEMS; FAULT TOLERANCE;

DYNAMIC MODELS;

EID: 84877690081     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2465351.2465353     Document Type: Conference Paper

References (28)

1. Hadoop. http://hadoop.apache.org/.
2. Storm. https://github.com/nathanmarz/storm/wiki.
3. Trident. https://github.com/nathanmarz/storm/wiki/Trident-tutorial.
4. Streambase systems. http://streambase.com/.
5. MEIJER, E., BECKMAN, B., AND BIERMAN, G. LINQ: Reconciling object, relations and xml in the. NET framework. In SIGMOD, 2006.
6. ALI, M. H., GEREA, C., RAMAN, B. S., SEZGIN, B., TARNAVSKI, T., VERONA, T., WANG, P., ZABBACK, P., ANANTHANARAYAN, A., KIRILOV, A., LU, M., RAIZMAN, A., KRISHNAN, R., SCHINDLAUER, R., GRABS, T., BJELETICH, S., CHANDRAMOULI, B., GOLDSTEIN, J., BHAT, S., LI, Y., D I NICOLA, V., WANG, X., MAIER, D., GRELL, S., NANO, O., AND SANTOS, I. Microsoft CEP server and online behavioral targeting. In VLDB, 2009.
7. ANDRADE, H., GEDIK, B., WU, K. L., AND Y U, P. S. Processing high data rate streams in system S. J. Parallel Distrib. Comput. 71, 2 (2011), 145-156.
8. BALAZINSKA, M., BALAKRISHNAN, H., MADDEN, S., AND STONEBRAKER, M. Fault-tolerance in the Borealis distributed stream processing system. In SIGMOD 2005.
9. BARGA, R., GOLDSTEIN, J., ALI, M., AND HONG, M. Consistent streaming through time: A vision for event stream processing. In CIDR, 2007.
10. DEAN, J., AND GHEMAWAT, S. MapReduce: Simplified data processing on large clusters. In OSDI, 2004.
11. BHATOTIA, P., WIEDER, A., RODRIGUES, R., ACAR, U. A., AND PASQUIN, R. Incoop: MapReduce for incremental computations. In SOCC, 2011.
12. BIEM, A., BOUILLET, E., FENG, H., RANGANATHAN, A., RIABOV, A., VERSCHEURE, O., KOUTSOPOULOS, H., AND MORAN, C. IBM InfoSphere Streams for scalable, real-time, intelligent transportation services. In SIGMOD, 2010.
13. CHAIKEN, R., JENKINS, B., LARSON, P., RAMSEY, B., SHAKIB, D., WEAVER, S., AND ZHOU, J. Scope: Easy and efficient parallel processing of massive data sets. In VLDB, 2008.
14. CHAMBERS, C., RANIWALA, A., PERRY, F., ADAMS, S., HENRY, R. R., BRADSHAW, R., AND WEIZENBAUM, N. FlumeJava: Easy, efficient data-parallel pipelines. In PLDI, 2010.
15. GUNDA, P. K., RAVINDRANATH, L., THEKKATH, C. A., YU, Y., AND ZHUANG, L. Nectar: Automatic management of data and computation in datacenters. In OSDI, 2010.
16. HUNT, P., KONAR, M., JUNQUEIRA, F. P., AND REED, B. Zookeeper: Wait-free coordination for internet-scale systems. In USENIXATC, 2010.
17. HWANG, J. H., BALAZINSKA, M., RASIN, A., CETINTEMEL, U., STONEBRAKER, M., AND ZDONIK, S. High-availability algorithms for distributed stream processing. In ICDE, 2005.
18. LAMPORT, L. Paxos made simple, fast, and byzantine. In OPODIS, 2002.
19. LIU, C., CORREA, R., GILL, H., GILL, T., LI, X., MUTHUKUMAR, S., SAEED, T., LOO, B. T., AND BASU, P. Puma: Policy-based unified multi-radio architecture for agile mesh networking. In COMSNETS, 2012).
20. NEUMEYER, L., ROBBINS, B., NAIR, A., AND KESARI, A. S4: Distributed stream computing platform. In ICDM Workshops, 2010.
21. OLSTON, C., REED, B., SRIVASTAVA, U., KUMAR, R., AND TOMKINS, A. Pig Latin: A not-so-foreign language for data processing. In SIGMOD, 2008.
22. POPA, L., BUDIU, M., YU, Y., AND ISARD, M. DryadInc: Reusing work in large-scale computations. In HotCloud, 2009.
23. QIAN, Z., CHEN, X., KANG, N., CHEN, M., YU, Y., MOSCIBRODA, T., AND ZHANG, Z. MadLINQ: Large-scale distributed matrix computation for the cloud. In EuroSys, 2012.
24. SHAH, M. A., HELLERSTEIN, J. M., AND BREWER, E. Highly available, fault-tolerant, parallel dataflows. In SIGMOD, 2004.
25. THUSOO, A., SARMA, J. S., JAIN, N., SHAO, Z., CHAKKA, P., ANTHONY, S., LIU, H., WYCKOFF, P., AND MURTHY, R. Hive: A warehousing solution over a MapReduce framework. In VLDB, 2009.
26. XING, Y., ZDONIK, S., AND HWANG, J. H. Dynamic load distribution in the Borealis stream processor. In ICDE, 2005.
27. YU, Y., ISARD, M., FETTERLY, D., BUDIU, M., ERLINGSSON, U., GUNDA, P. K., AND CURREY, J. DryadLINQ: A system for general-purpose distributed data-parallel computing using a high-level language. In OSDI, 2008.
28. ZAHARIA, M., DAS, T., LI, H., SHENKER, S., AND STOICA, I. Discretized Streams: An efficient and fault-tolerant model for stream processing on large clusters. In HotCloud, 2012.