Optimization of load adaptive distributed stream processing services

Proceedings - 2014 IEEE International Conference on Services Computing, SCC 2014

Volumn , Issue , 2014, Pages 504-511

  Wu, Xing ^a   Liu, Yan ^a  

^a Gina Cody School of Engineering and Computer Science   (Canada)

Author keywords

Load optimization; Software as a Service; Stream processing

Indexed keywords

APPLICATION PROGRAMS; COMPUTER PROGRAMMING; DISTRIBUTED PARAMETER CONTROL SYSTEMS; INFRASTRUCTURE AS A SERVICE (IAAS); SOFTWARE AS A SERVICE (SAAS); WEB SERVICES;

ASSOCIATED SOFTWARES; CLOUD COMPUTING INFRASTRUCTURES; DISTRIBUTED STREAM PROCESSING; OPTIMIZATION METHOD; REALTIME PROCESSING; RESOURCE UTILIZATIONS; RUNTIME MANAGEMENT; STREAM PROCESSING;

DATA STREAMS;

EID: 84919659134     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SCC.2014.73     Document Type: Conference Paper

References (21)

1. N. D. Mickulicz, P. Narasimhan, and R. Gandhi, "To auto scale or not to auto scale," in Presented as part of the 10th International Conference on Autonomic Computing. Berkeley, CA: USENIX, 2013, pp. 145-151. [Online]. Available: https://www.usenix.org/conference/ icac13/auto-scale-or-not-auto-scale
2. D. J. Abadi, Y. Ahmad, M. Balazinska, U. Cetintemel, M. Cherniack, J.-H. Hwang, W. Lindner, A. Maskey, A. Rasin, E. Ryvkina et al., "The design of the borealis stream processing engine." in CIDR, vol. 5, 2005, pp. 277-289.
3. B. Gedik, H. Andrade, K.-L. Wu, P. S. Yu, and M. Doo, "Spade: the system s declarative stream processing engine," in Proceedings of the 2008 ACM SIGMOD international conference on Management of data. ACM, 2008, pp. 1123-1134.
4. L. Neumeyer, B. Robbins, A. Nair, and A. Kesari, "S4: Distributed stream computing platform," in Data Mining Workshops (ICDMW), 2010 IEEE International Conference on, 2010, pp. 170-177.
5. B. A. Shirazi, K. M. Kavi, and A. R. Hurson, Scheduling and load balancing in parallel and distributed systems. IEEE Computer Society Press, 1995.
6. D. Gupta and P. Bepari, "Load sharing in distributed systems," in Proceedings of the National Workshop on Distributed Computing, 1999.
7. K. Gorlach and F. Leymann, "Dynamic service provisioning for the cloud," in Services Computing (SCC), 2012 IEEE Ninth International Conference on. IEEE, 2012, pp. 555-561.
8. S. Loesing, M. Hentschel, T. Kraska, and D. Kossmann, "Stormy: An elastic and highly available streaming service in the cloud," in Proceedings of the 2012 Joint EDBT/ICDT Workshops. ACM, 2012, pp. 55-60.
9. B. Satzger, W. Hummer, P. Leitner, and S. Dustdar, "Esc: Towards an elastic stream computing platform for the cloud," in Cloud Computing (CLOUD), 2011 IEEE International Conference on. IEEE, 2011, pp. 348-355.
10. R. E. Korf, "Multi-way number partitioning." in IJCAI, 2009, pp. 538-543.
11. C. Balkesen, N. Tatbul, and M. T. O zsu, "Adaptive input admission and management for parallel stream processing," in Proceedings of the 7th ACM International Conference on Distributed Event-based Systems, ser. DEBS '13. New York, NY, USA: ACM, 2013, pp. 15-26. [Online]. Available: http://doi.acm.org/10.1145/2488222.2488258
12. V. Gulisano, R. Jimenez-Peris, M. Patino-Martinez, C. Soriente, and P. Valduriez, "Streamcloud: An elastic and scalable data streaming system," IEEE Transactions on Parallel and Distributed Systems, vol. 23, no. 12, pp. 2351-2365, 2012.
13. Y. Xing, S. Zdonik, and J.-H. Hwang, "Dynamic load distribution in the borealis stream processor," in Data Engineering, 2005. ICDE 2005. Proceedings. 21st International Conference on. IEEE, 2005, pp. 791-802.
14. R. Khandekar, K. Hildrum, S. Parekh, D. Rajan, J. Wolf, K.-L. Wu, H. Andrade, and B. Gedik, "Cola: Optimizing stream processing applications via graph partitioning," in Middleware 2009. Springer, 2009, pp. 308-327.
15. L. Yang, J. Cao, Y. Yuan, T. Li, A. Han, and A. Chan, "A framework for partitioning and execution of data stream applications in mobile cloud computing," ACM SIGMETRICS Performance Evaluation Review, vol. 40, no. 4, pp. 23-32, 2013.
16. J. Zhang, K. Mouratidis, and H. Pang, "Heuristic algorithms for balanced multi-way number partitioning," in Proceedings of the Twenty-Second international joint conference on Artificial Intelligence-Volume Volume One. AAAI Press, 2011, pp. 693-698.
17. X. Wu and Y. Liu, "Enabling a load adaptive distributed stream processing platform on synchronized clusters," in Cloud Engineering (IC2E), 2014 IEEE International Conference on, 2014.
18. P. Hunt, M. Konar, F. P. Junqueira, and B. Reed, "Zookeeper: Wait-free coordination for internet-scale systems," in Proceedings of the 2010 USENIX Conference on USENIX Annual Technical Conference, ser. USENIXATC'10. Berkeley, CA, USA: USENIX Association, 2010, pp. 11-11.
19. J. Hoeksema and S. Kotoulas, "High-performance distributed stream reasoning using s4," in Ordring Workshop at ISWC, 2011.
20. F. Morstatter, J. Pfeffer, H. Liu, and K. M. Carley, "Is the sample good enough? comparing data from twitter's streaming api with twitter's firehose," Proceedings of ICWSM, 2013.
21. B. White, J. Lepreau, L. Stoller, R. Ricci, S. Guruprasad, M. Newbold, M. Hibler, C. Barb, and A. Joglekar, "An integrated experimental environment for distributed systems and networks," in Proc. of the Fifth Symposium on Operating Systems Design and Implementation. Boston, MA: USENIX Association, Dec. 2002, pp. 255-270.