Scheduling decisions in stream processing on heterogeneous clusters

Proceedings - 2014 8th International Conference on Complex, Intelligent and Software Intensive Systems, CISIS 2014

Volumn , Issue , 2014, Pages 614-619

  Rychly, Marek ^a   Koda, Petr ^a   Mr, Pavel ^a  

^a BRNO UNIVERSITY OF TECHNOLOGY   (Czech Republic)

Author keywords

Apache Storm; benchmarking; heterogeneous clusters; resource awareness; scheduling; stream processing

Indexed keywords

BENCHMARKING; COMPUTER HARDWARE DESCRIPTION LANGUAGES; SCHEDULING;

ALLOCATION AND SCHEDULING; BENCHMARKING TECHNIQUES; HETEROGENEOUS CLUSTERS; PROCESSING CLUSTERS; RESOURCE AWARENESS; SAMPLE APPLICATIONS; SCHEDULING DECISIONS; STREAM PROCESSING;

DATA STREAMS;

EID: 84908884597     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CISIS.2014.94     Document Type: Conference Paper

References (18)

1. J. Dean and S. Ghemawat, "Mapreduce: simplified data processing on large clusters," Communications of the ACM, vol. 51, no. 1, pp. 107-113, 2008.
2. B. Babcock, S. Babu, M. Datar, R. Motwani, and J. Widom, "Models and issues in data stream systems," in Proceedings of the twenty-first ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems. ACM, 2002, pp. 1-16.
3. A. Brito, A. Martin, T. Knauth, S. Creutz, D. Becker, S. Weigert, and C. Fetzer, "Scalable and low-latency data processing with stream mapreduce," in 2011 IEEE Third International Conference on Cloud Computing Technology and Science (CloudCom). IEEE, 2011, pp. 48-58.
4. L. Neumeyer, B. Robbins, A. Nair, and A. Kesari, "S4: Distributed stream computing platform," in 2010 IEEE International Conference on Data Mining Workshops (ICDMW). IEEE, 2010, pp. 170-177.
5. N. Marz, "Apache Storm," https://git-wipus. apache.org/repos/asf'p=incubator-storm.git, 2014, Git repository.
6. V. Vinothina, S. Rajagopal, and P. Ganapathi, "A survey on resource allocation strategies in cloud computing," International Journal of Advanced Computer Science and Applications, vol. 3, no. 6, 2012.
7. M. Cherniack, H. Balakrishnan, M. Balazinska, D. Carney, U. Cetintemel, Y. Xing, and S. B. Zdonik, "Scalable distributed stream processing," in CIDR, vol. 3, 2003, pp. 257-268.
8. D. J. Abadi, Y. Ahmad, M. Balazinska, U. C' etintemel, M. Cherniack, J.-H. Hwang, W. Lindner, A. S. Maskey, A. Rasin, E. Ryvkina, N. Tatbul, Y. Xing, , and S. Zdonik, "The design of the borealis stream processing engine," in CIDR, vol. 5, 2005, pp. 277-289.
9. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly, "Dryad: distributed data-parallel programs from sequential building blocks," ACM SIGOPS Operating Systems Review, vol. 41, no. 3, pp. 59-72, 2007.
10. V. Borkar, M. Carey, R. Grover, N. Onose, and R. Vernica, "Hyracks: A flexible and extensible foundation for data-intensive computing," in 2011 IEEE 27th International Conference on Data Engineering (ICDE). IEEE, 2011, pp. 1151-1162.
11. D. G. Murray, M. Schwarzkopf, C. Smowton, S. Smith, A. Madhavapeddy, and S. Hand, "CIEL: a universal execution engine for distributed data-flow computing," in Proceedings of the 8th USENIX Conference on Networked Systems Design and Implementation. USENIX Association, 2011.
12. G. Bosilca, A. Bouteiller, A. Danalis, T. Herault, P. Lemarinier, and J. Dongarra, "DAGuE: A generic distributed dag engine for high performance computing," Parallel Computing, vol. 38, no. 1, pp. 37-51, 2012.
13. D. Warneke and O. Kao, "Exploiting dynamic resource allocation for efficient parallel data processing in the cloud," IEEE Transactions on Parallel and Distributed Systems, vol. 22, no. 6, pp. 985-997, 2011.
14. T. Condie, N. Conway, P. Alvaro, J. M. Hellerstein, K. Elmeleegy, and R. Sears, "Mapreduce online," in Proceedings of the 7th USENIX Conference on Networked Systems Design and Implementation. USENIX Association, 2010.
15. B. Li, E. Mazur, Y. Diao, A. McGregor, and P. Shenoy, "A platform for scalable one-pass analytics using MapReduce," in Proceedings of the 2011 ACM SIGMOD International Conference on Management of data. ACM, 2011, pp. 985-996.
16. W. Lam, L. Liu, S. Prasad, A. Rajaraman, Z. Vacheri, and A. Doan, "Muppet: MapReduce-style processing of fast data," Proceedings of the VLDB Endowment, vol. 5, no. 12, pp. 1814-1825, 2012.
17. M. Balazinska, H. Balakrishnan, and M. Stonebraker, "Load management and high availability in the Medusa distributed stream processing system," in Proceedings of the 2004 ACM SIGMOD international conference on Management of data. ACM, 2004, pp. 929-930.
18. L. Aniello, R. Baldoni, and L. Querzoni, "Adaptive online scheduling in Storm," in Proceedings of the 7th ACM international conference on Distributed event-based systems. ACM, 2013, pp. 207-218.