A predictive scheduling framework for fast and distributed stream data processing

Proceedings - 2015 IEEE International Conference on Big Data, IEEE Big Data 2015

Volumn , Issue , 2015, Pages 333-338

  Li, Teng ^a   Tang, Jian ^a   Xu, Jielong ^a  

^a Syracuse University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA FLOW ANALYSIS; DATA HANDLING; DIRECTED GRAPHS; FLOW GRAPHS; FORECASTING; SCHEDULING; STORMS; TOPOLOGY;

EFFECTIVE ALGORITHMS; PERFORMANCE PREDICTION; PREDICTION METHODS; PREDICTIVE SCHEDULING; PROCESSING TIME; PROCESSING UNITS; STREAM DATA PROCESSING; STREAM PROCESSING;

BIG DATA;

EID: 84963717832     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/BigData.2015.7363773     Document Type: Conference Paper

References (18)

1. J. Dean and S. Ghemawat, MapReduce: simplified data processing on large clusters, Proceedings of USENIX OSDI'2004.
2. Apache Storm, http://storm. Apache. org/
3. S4, http://incubator. Apache. org/s4/
4. M. Nicola and M. Jarke, Performance modeling of distributed and replicated databases, IEEE Transactions on Knowledge Discovery and Data Engineering, 2000, Vol. 12, No. 4, pp. 645-672.
5. T. Akidau, A. Balikov, K. Bejiroglu, S. Chernyak, J. Haberman, R. Lax, S. McVeety, D. Mills, P. Nordstrom and S. Whittle, MillWheel: faulttolerant stream processing at internet scale. Proceedings of the VLDB Endowment, 2013, pp. 1033-1044.
6. Z. Qian, Y. He, C. Su, Z. Wu, H. Zhu, T. Zhang, L. Zhou, Y. Yu, and Z. Zhang, Timestream: reliable stream computation in the cloud, Proceedings of EuroSys'2013.
7. V. Jakkula, Tutorial on support vector machine (SVM), School of EECS, Washington State University, 2006.
8. J. Xu, Z. Chen, J. Tang and S. Su, T-Storm: Traffic-aware online scheduling in Storm, Proceedings of IEEE ICDCS'2014.
9. Hazelcast, http://hazelcast. com/products/hazelcast/
10. PTP daemon-Precision Time Protocol daemon, http://ptpd. sourceforge. net/
11. Storm 0. 9. 2 on Apache Software Foundation, https://storm. Apache. org/2014/06/25/storm092-released. html
12. Logstash-Open Source Log Management, http://logstash. net/
13. P. Bakkum and K. Skadron, Accelerating SQL database operations on a GPU with CUDA, Proceedings of the 3rd Workshop on General-Purpose Computation on GPU (GPGPU'10), pp. 94-103.
14. Q. Jiang and S. Chakravarthy, Scheduling strategies for a data stream management system, Technical Report CSE-2003-30.
15. L. Aniello, R. Baldoni and L. Querzoni, Adaptive online scheduling in Storm, Proceedings of ACM DEBS'2013.
16. P. Bellavista, A. Corradi, A. Reale and N. Ticca, Priority-based resource scheduling in distributed stream processing systems for big data applications, IEEE/ACM International Conference on Utility and Cloud Computing, 2014, pp. 363-370.
17. Y. Wei, V. Prasad, S. Son and J. Stankovic, Prediction-based QoS management for real-time data streams, Proceedings of IEEE RTSS'2006.
18. A. Khoshkbarforoushha, R. Ranjan, R. Gaire, P. P. Jayaraman, J. Hosking and E. Abbasnejad, Resource usage estimation of data stream processing workloads in datacenter clouds, 2015, http://arxiv. org/abs/1501. 07020.