Edge-computing-aware deployment of stream processing tasks based on topology-external information: Model, algorithms, and a storm-based prototype

Proceedings - 2016 IEEE International Congress on Big Data, BigData Congress 2016

Volumn , Issue , 2016, Pages 259-266

  Papageorgiou, Apostolos ^a   Poormohammady, Ehsan ^a   Cheng, Bin ^a  

^a NEC LABORATORIES EUROPE   (Germany)

Author keywords

Deployment; IoT; Latency; Stream Processing

Indexed keywords

DATA HANDLING; ELECTRONIC DATA INTERCHANGE; INTERNET OF THINGS; STORMS; TOPOLOGY;

CONTINUOUS DATA; DATA INTENSIVE; DEPLOYMENT; EDGE BANDWIDTH; EDGE COMPUTING; EXTERNAL INFORMATIONS; LATENCY; STREAM PROCESSING;

BIG DATA;

EID: 84994589363     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/BigDataCongress.2016.40     Document Type: Conference Paper

References (16)

1. T. Akidau, A. Balikov, K. Bekiroglu, S. Chernyak, J. Haberman, R. Lax, S. McVeety, D. Mills, P. Nordstrom, and S. Whittle. MillWheel: Fault-tolerant Stream Processing at Internet Scale. VLDB Endowment, 6(11): 1033-1044, Aug. 2013.
2. I. Al-Anbagi, M. Erol-Kantarci, and H. T. Mouftah. A Low Latency Data Transmission Scheme for Smart Grid Condition Monitoring Applications. In IEEE Electrical Power and Energy Conference, EPEC '12, page 20-25, Oct 2012.
3. L. Aniello, R. Baldoni, and L. Querzoni. Adaptive Online Scheduling in Storm. In Proceedings of the 7th ACM International Conference on Distributed Event-based Systems, DEBS '13, page 207-218. ACM, 2013.
4. Apache Software Foundation. Apache Storm project. http://storm. Apache. org/ (last visited in March 2016).
5. V. Cardellini, V. Grassi, F. Lo Presti, and M. Nardelli. Distributed QoS-aware Scheduling in Storm. In Proceedings of the 9th ACM International Conference on Distributed Event-Based Systems, DEBS '15, page 344-347. ACM, 2015.
6. J. Dean and S. Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. ACM Communications, 51(1): 107-113, Jan. 2008.
7. G. P. Fettweis. The Tactile Internet: Applications and Challenges. IEEE Vehicular Technology Magazine, 9(1): 64-70, March 2014.
8. M. Hirzel, R. Soulé, S. Schneider, B. Gedik, and R. Grimm. A Catalog of Stream Processing Optimizations. ACM Computing Surveys, 46(4): 1-34, Mar. 2014.
9. S. Kulkarni, N. Bhagat, M. Fu, V. Kedigehalli, C. Kellogg, S. Mittal, J. M. Patel, K. Ramasamy, and S. Taneja. Twitter Heron: Stream Processing at Scale. In ACM SIGMOD International Conference on Management of Data, SIGMOD '15, page 239-250. ACM, 2015.
10. M. Kuzlu, M. Pipattanasomporn, and S. Rahman. Communication network requirements for major smart grid applications in HAN, NAN and WAN. Computer Networks, 67: 74-88, 2014.
11. Nokia. 5G Use Cases and Requirements. Technical report. http://networks. nokia. com/sites/default/files/document/ 5g requirements white paper. pdf (last visited in March 2016), product code C401-01016-WP-201407-1-EN.
12. P. Pietzuch, J. Ledlie, J. Shneidman, M. Roussopoulos, M. Welsh, and M. Seltzer. Network-Aware Operator Placement for Stream-Processing Systems. In 22nd International Conference on Data Engineering, ICDE '06 PP. 49-. IEEE Computer Society, 2006.
13. M. Rychlý, P. Skoda, and P. Smrz. Scheduling Decisions in Stream Processing on Heterogeneous Clusters. In Eighth International Conference on Complex, Intelligent and Software Intensive Systems, CISIS '14, page 614-619, July 2014.
14. T. White. Hadoop: The Definitive Guide. O'Reilly Media, Inc., 1st edition, 2009.
15. Y. Xing, J. Hwang, U. C etintemel, and S. B. Zdonik. Providing Resiliency to Load Variations in Distributed Stream Processing. In 32nd International Conference on Very Large Data Bases, page 775-786, September 2006.
16. Y. Xing, S. Zdonik, and J.-H. Hwang. Dynamic Load Distribution in the Borealis Stream Processor. In 21st International Conference on Data Engineering, ICDE '05, page 791-802. IEEE Computer Society, 2005.