Dynamically scaling apache storm for the analysis of streaming data

Proceedings - 2015 IEEE 1st International Conference on Big Data Computing Service and Applications, BigDataService 2015

Volumn , Issue , 2015, Pages 154-161

  Van Der Veen, Jan Sipke ^a,b   Van Der Waaij, Bram ^a   Lazovik, Elena ^a   Wijbrandi, Wilco ^a   Meijer, Robert J ^a,b  

^a TNO   (Netherlands)

^b UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Analysis Platform; Apache Storm; Big Data; Cloud Computing; Dynamic Scaling; Elasticity; Streaming Data

Indexed keywords

APPLICATION PROGRAMS; CLOUD COMPUTING; CLUSTER COMPUTING; ELASTICITY; OPEN SOURCE SOFTWARE; OPEN SYSTEMS; SECURITY SYSTEMS; STORMS;

ANALYSIS PLATFORM; COMPUTING RESOURCE; DESIGN AND IMPLEMENTATIONS; DYNAMIC SCALING; PROCESSING APPLICATIONS; STREAM PROCESSING; STREAMING DATA; VIDEO SURVEILLANCE;

BIG DATA;

EID: 84959490287     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/BigDataService.2015.56     Document Type: Conference Paper

References (29)

1. S. Sakr and M. Gaber, Large Scale and Big Data: Processing and Management. CRC Press, 2014.
2. B. Pengel, G. Shirshov, V. Krzhizhanovskaya, N. Melnikova, A. Koelewijn, A. Pyayt, and I. Mokhov, "Flood Early Warning System: Sensors and Internet," in Floods: From Risk to Opportunity, 2013, pp. 445-453.
3. S. Aramvith, S. Pumrin, T. Chalidabhongse, and S. Siddhichai, "Video processing and analysis for surveillance applications," in Intelligent Signal Processing and Communication Systems, 2009. ISPACS 2009. International Symposium on, 2009, pp. 607-610.
4. "Storm," http://storm.apache.org.
5. "Apache Software Foundation," http://www.apache.org.
6. "Storm Deployment," http://storm.apache.org/about/deployment.html.
7. T. Lorido-Botran, J. Miguel-Alonso, and J. A. Lozano, "A review of auto-scaling techniques for elastic applications in cloud environments," Journal of Grid Computing, pp. 559-592, 2014.
8. D. Trihinas, G. Pallis, and M. Dikaiakos, "Jcatascopia: Monitoring elas-tically adaptive applications in the cloud," in Cluster, Cloud and Grid Computing (CCGrid), 2014 14th IEEE/ACM International Symposium on, 2014, pp. 226-235.
9. P. SaiKrishna and R. Pasumarthy, "Automated control of webserver performance in a cloud environment," in Intelligent Computational Systems (RAICS), 2013 IEEE Recent Advances in, 2013, pp. 239-244.
10. F. Al-Haidari, M. Sqalli, and K. Salah, "Impact of cpu utilization thresholds and scaling size on autoscaling cloud resources," in Cloud Computing Technology and Science (CloudCom), 2013 IEEE 5th International Conference on, 2013, pp. 256-261.
11. Z. Zhenghuan, X. Hongsheng, and S. Chen, "Dynamic optimal resource provisioning for VoD services under Amazon EC2's pricing models," in Control Conference (CCC), 2014 33rd Chinese, 2014, pp. 5527-5532.
12. S. Heinzl and C. Metz, "Toward a cloud-ready dynamic load balancer based on the apache web server," in Enabling Technologies: Infrastructure for Collaborative Enterprises (WETICE), 2013 IEEE 22nd International Workshop on, 2013, pp. 342-345.
13. A. Nikravesh, S. Ajila, and C.-H. Lung, "Cloud resource auto-scaling system based on hidden markov model (hmm)," in Semantic Computing (ICSC), 2014 IEEE International Conference on, 2014, pp. 124-127.
14. R. Moreno-Vozmediano, R. S. Montero, and I. M. Llorente, "Elastic management of cluster-based services in the cloud," in Proceedings of the 1st Workshop on Automated Control for Datacenters and Clouds, 2009, pp. 19-24.
15. K. Salah and J. Alcaraz Calero, "Achieving elasticity for cloud mapre-duce jobs," in Cloud Networking (CloudNet), 2013 IEEE 2nd International Conference on, 2013, pp. 195-199.
16. "Hadoop," http://hadoop.apache.org.
17. Z. Fadika and M. Govindaraju, "Delma: Dynamically elastic mapreduce framework for cpu-intensive applications," in Cluster, Cloud and Grid Computing (CCGrid), 2011 11th IEEE/ACM International Symposium on, 2011, pp. 454-463.
18. J. S. van der Veen, E. Lazovik, M. X. Makkes, and R. J. Meijer, "Deployment Strategies for Distributed Applications on Cloud Computing Infrastructures," in 5th IEEE International Conference and Workshops on Cloud Computing Technology and Science (CloudCom), 2013, pp. 228-233.
19. "Trident," https://storm.apache.org/documentation/Trident-tutorial.html.
20. "Highly Available Nimbus," https://github.com/apache/storm/pull/61.
21. "ZooKeeper," http://zookeeper.apache.org.
22. J. Kephart and D. Chess, "The vision of autonomic computing," Computer, pp. 41-50, 2003.
23. "MongoDB," http://www.mongodb.org.
24. J. S. van der Veen, B. van der Waaij, and R. J. Meijer, "Sensor Data Storage Performance: SQL or NoSQL, Physical or Virtual," in 5th IEEE International Conference on Cloud Computing (CLOUD), 2012, pp. 431-438.
25. "collectd," http://www.collectd.org.
26. "jclouds," http://jclouds.apache.org.
27. "Puppet," http://www.puppetlabs.com.
28. "Amazon Web Services (AWS)," http://aws.amazon.com.
29. "ActiveMQ," http://activemq.apache.org.