Stream bench: Towards benchmarking modern distributed stream computing frameworks

Proceedings - 2014 IEEE/ACM 7th International Conference on Utility and Cloud Computing, UCC 2014

Volumn , Issue , 2014, Pages 69-78

  Lu, Ruirui ^a   Wu, Gang ^a   Xie, Bin ^b   Hu, Jingtong ^c  

^a SHANGHAI JIAO TONG UNIVERSITY   (China)

^b NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^c OKLAHOMA STATE UNIVERSITY   (United States)

Author keywords

Benchmark; Big data; Distributed stream computing

Indexed keywords

BENCHMARKING; BIG DATA; DATA HANDLING; DIGITAL STORAGE; FAULT TOLERANCE; FAULT TOLERANT COMPUTER SYSTEMS; STORMS; UBIQUITOUS COMPUTING;

BENCHMARK DEFINITION; BENCHMARK PROGRAMS; DATA STREAM; MESSAGE SYSTEMS; PERFORMANCE OF SYSTEMS; STREAM COMPUTING; STREAM DATA;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 84946688481     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/UCC.2014.15     Document Type: Conference Paper

References (25)

1. B. Babcock, S. Babu, M. Datar, R. Motwani, and J. Widom, "Models and issues in data stream systems," in Proceedings of the twenty-first ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems. ACM, 2002, pp. 1-16
2. L. Golab and M. T. Ozsu, "Issues in data stream management," ACM Sigmod Record, vol. 32, no. 2, pp. 5-14, 2003
3. M. Stonebraker, U. Ç etintemel, and S. Zdonik, "The 8 requirements of real-time stream processing," ACM SIGMOD Record, vol. 34, no. 4, pp. 42-47, 2005
4. Z. Qian, Y. He, C. Su, Z. Wu, H. Zhu, T. Zhang, L. Zhou, Y. Yu, and Z. Zhang, "Timestream: Reliable stream computation in the cloud," in Proceedings of the 8th ACM European Conference on Computer Systems. ACM, 2013, pp. 1-14
5. Z. Shao, "Real-time analytics at facebook," in Proceedings of the 8th ACM European Conference on Computer Systems, 2011, pp. http://www-conf. slac. stanford. edu
6. K. Thomas, C. Grier, J. Ma, V. Paxson, and D. Song, "Design and evaluation of a real-time url spam filtering service," in Security and Privacy (SP), 2011 IEEE Symposium on. IEEE, 2011, pp. 447-462
7. U. Cetintemel, "The aurora and medusa projects," Data Engineering, vol. 51, no. 3, 2003
8. D. J. Abadi, D. Carney, U. Ç etintemel, M. Cherniack, C. Convey, S. Lee, M. Stonebraker, N. Tatbul, and S. Zdonik, "Aurora: a new model and architecture for data stream management," vol. 12, no. 2, pp. 120-139, 2003
9. J. Dean and S. Ghemawat, "Mapreduce: simplified data processing on large clusters," Communications of the ACM, vol. 51, no. 1, pp. 107-113, 2008
10. L. Neumeyer, B. Robbins, A. Nair, and A. Kesari, "S4: Distributed stream computing platform," in Data Mining Workshops (ICDMW), 2010 IEEE International Conference on. IEEE, 2010, pp. 170-177
11. "Storm: Distributed and fault-tolerant realtime computation." http://storm. incubator. apache. org/
12. "Samza." http://samza. incubator. apache. org/
13. M. Zaharia, T. Das, H. Li, S. Shenker, and I. Stoica, "Discretized streams: an efficient and fault-tolerant model for stream processing on large clusters," in Proceedings of the 4th USENIX conference on Hot Topics in Cloud Ccomputing. USENIX Association, 2012, pp. 10-10
14. A. Arasu, M. Cherniack, E. Galvez, D. Maier, A. S. Maskey, E. Ryvkina, M. Stonebraker, and R. Tibbetts, "Linear road: a stream data management benchmark," in Proceedings of the Thirtieth international conference on Very large data bases-Volume 30. VLDB Endowment, 2004, pp. 480-491
15. A. Rajaraman and J. D. Ullman, Mining of massive datasets. Cambridge University Press, 2012
16. W. Gao, Y. Zhu, Z. Jia, C. Luo, L. Wang, Z. Li, J. Zhan, Y. Qi, Y. He, S. Gong et al., "Bigdatabench: a big data benchmark suite from web search engines," arXiv preprint arXiv:1307. 0320, 2013
17. S. Huang, J. Huang, J. Dai, T. Xie, and B. Huang, "The hibench benchmark suite: Characterization of the mapreduce-based data analysis," in Data Engineering Workshops (ICDEW), 2010 IEEE 26th International Conference on. IEEE, 2010, pp. 41-51
18. A. Ghazal, T. Rabl, M. Hu, F. Raab, M. Poess, A. Crolotte, and H.-A. Jacobsen, "Bigbench: Towards an industry standard benchmark for big data analytics," in Proceedings of the 2013 international conference on Management of data. ACM, 2013, pp. 1197-1208
19. "TPC-DS benchmark." http://www. tpc. org/tpcds/
20. "AOL Search Data." http://www. researchpipeline. com/ mediawiki/index. php?title=AOL Search Query Logs
21. CAIDA, "The CAIDA UCSD Statistical information for the CAIDA Anonymized Internet Traces," http://www. caida. org/ data/passive/passive trace statistics. xml
22. "Kafka Wiki." https://cwiki. apache. org/confluence/display/ KAFKA/Powered+By
23. J. Kreps, N. Narkhede, and J. Rao, "Kafka: A distributed messaging system for log processing," in Proceedings of the NetDB, 2011
24. "apache/incubator-storm." https://github. com/apache/ incubator-storm
25. S. Zhong, "Storm performance cannot be scaled up by adding more CPU cores." https://issues. apache. org/jira/ secure/attachment/12641867/Storm performance fix. pdf.