Auto-scaling techniques for elastic data stream processing

Proceedings - International Conference on Data Engineering

Volumn , Issue , 2014, Pages 296-302

  Heinze, Thomas ^a   Pappalardo, Valerio ^a   Jerzak, Zbigniew ^a   Fetzer, Christof ^b  

^a SAP RESEARCH   (Germany)

^b DRESDEN UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

TECHNICAL PRESENTATIONS;

CHANGING WORKLOAD; DATA STREAM PROCESSING; ELASTIC SYSTEMS; OVER PROVISIONING; SYSTEM CHARACTERISTICS;

DATA COMMUNICATION SYSTEMS;

EID: 84901786411     PISSN: 10844627     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDEW.2014.6818344     Document Type: Conference Paper

References (19)

1. R. Gencay, M. Dacorogna, U. A. Muller, O. Pictet, and R. Olsen, An introduction to high-frequency finance, 2001.
2. Z. Jerzak, T. Heinze, M. Fehr, D. Grober, R. Hartung, and N. Stojanovic, "The DEBS 2012 Grand Challenge," in DEBS 2012: 6th ACM International Conference on Distributed Event-Based Systems. Berlin, Germany: ACM, July 2012.
3. J. Dean and S. Ghemawat, "MapReduce: simplified data processing on large clusters," Communications of the ACM, vol. 51, no. 1, pp. 107-113, 2008.
4. A. Alexandrov, D. Battre, S. Ewen, M. Heimel, F. Hueske, O. Kao, V. Markl, E. Nijkamp, and D. Warneke, "Massively parallel data analysis with pacts on nephele," PVLDB, vol. 3, no. 2, pp. 1625-1628, 2010.
5. D. J. Abadi, Y. Ahmad, M. Balazinska, U. Cetintemel, M. Cherniack, J. H. Hwang, W. Lindner, A. S. Maskey, A. Rasin, E. Ryvkina, N. Tatbul, Y. Xing, and S. Zdonik, "The design of the borealis stream processing engine," in CIDR05, 2005, pp. 277-289.
6. E. Wu, Y. Diao, and S. Rizvi, "High-performance complex event processing over streams," in SIGMOD 06: Proceedings of the 2006 ACM SIGMOD international conference on Management of data. New York, NY, USA: ACM, 2006, pp. 407-418.
7. M. Armbrust, A. Fox, R. Griffith, A. D. Joseph, R. Katz, A. Konwinski, G. Lee, D. Patterson, A. Rabkin, I. Stoica, and M. Zaharia, "A view of cloud computing," Communications of the ACM, vol. 53, no. 4, pp. 50-58, April 2010.
8. R. Castro Fernandez, M. Migliavacca, E. Kalyvianaki, and P. Pietzuch, "Integrating scale out and fault tolerance in stream processing using operator state management," in Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data, 2013, pp. 725-736.
9. V. Gulisano, R. Jimenez-Peris, M. Patino-Martinez, C. Soriente, and P. Valduriez, "Streamcloud: An elastic and scalable data streaming system," IEEE Transactions on Parallel and Distributed Systems, vol. 23, no. 12, pp. 2351-2365, 2012.
10. T. Heinze, Y. Ji, Y. Pan, F. J. Grueneberger, Z. Jerzak, and C. Fetzer, "Elastic complex event processing under varying query load," in First International Workshop on Big Dynamic Distributed Data (BD3), 2013, pp. 25-31.
11. T. Lorido-Botran, J. Miguel-Alonso, and J. A. Lozano, "Auto-scaling techniques for elastic applications in cloud environments," Department of Computer Architecture and Technology, University of Basque Country, Tech. Rep. EHU-KAT-IK-09-12, 2012.
12. S. Martello and P. Toth, Knapsack Problems: Algorithms and Computer Implementations. John Wiley &Sons, 1990.
13. E. G. Coffman Jr, M. R. Garey, and D. S. Johnson, "Approximation algorithms for bin packing: A survey," in Approximation algorithms for NP-hard problems. PWS Publishing Co., 1996, pp. 46-93.
14. M. A. Shah, J. M. Hellerstein, S. Chandrasekaran, and M. J. Franklin, "Flux: An adaptive partitioning operator for continuous query systems," in Data Engineering, 2003. Proceedings. 19th International Conference on. IEEE, 2003, pp. 25-36.
15. R. Das, G. Tesauro, and W. E. Walsh, "Model-based and model-free approaches to autonomic resource allocation," IBM Ressearch Report, RC, vol. 23802, 2005.
16. J. Cervino, E. Kalyvianaki, J. Salvachua, and P. Pietzuch, "Adaptive provisioning of stream processing systems in the cloud," in Data Engineering Workshops (ICDEW), 2012 IEEE 28th International Conference on. IEEE, 2012, pp. 295-301.
17. P. Lama and X. Zhou, "Autonomic provisioning with self-adaptive neural fuzzy control for end-to-end delay guarantee," in Modeling, Analysis &Simulation of Computer and Telecommunication Systems (MASCOTS), 2010 IEEE International Symposium on. IEEE, 2010, pp. 151-160.
18. Y. Xing, S. Zdonik, and J.-H. Hwang, "Dynamic load distribution in the borealis stream processor," in Data Engineering, 2005. ICDE 2005. Proceedings. 21st International Conference on. IEEE, 2005, pp. 791-802.
19. J. Wolf, N. Bansal, K. Hildrum, S. Parekh, D. Rajan, R. Wagle, K.-L. Wu, and L. Fleischer, "Soda: An optimizing scheduler for large-scale stream-based distributed computer systems," Middleware 2008, pp. 306-325, 2008.