Distributed data stream processing and edge computing: A survey on resource elasticity and future directions

Journal of Network and Computer Applications

Volumn 103, Issue , 2018, Pages 1-17

  Dias de Assunção, Marcos ^a   da Silva Veith, Alexandre ^a   Buyya, Rajkumar ^b  

^a UNIV LYON   (France)

^b UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

Big Data; Cloud computing; Resource elasticity; Stream processing

Indexed keywords

CLOUD COMPUTING; DATA HANDLING; DECISION SUPPORT SYSTEMS; ELASTICITY; ENGINES; ENTERPRISE RESOURCE MANAGEMENT; SMART CITY; SURVEYS;

DATA STREAM PROCESSING; DISTRIBUTED DATA STREAM PROCESSING; DISTRIBUTED ENVIRONMENTS; EMERGING APPLICATIONS; ENTERPRISE APPLICATIONS; OPERATIONAL MONITORING; STREAM PROCESSING; STREAM PROCESSING ENGINES;

BIG DATA;

EID: 85037546359     PISSN: 10848045     EISSN: 10958592     Source Type: Journal    
DOI: 10.1016/j.jnca.2017.12.001     Document Type: Article

References (128)

1. Abadi, D.J., Carney, D., Çetintemel, U., Cherniack, M., Convey, C., Lee, S., Stonebraker, M., Tatbul, N., Zdonik, S., 2003. Aurora: A new model and architecture for data stream management. Vol. 12, Springer-Verlag New York, Inc., Secaucus, USA, pp. 120–139.
2. Abadi, D.J., Ahmad, Y., Balazinska, M., Cetintemel, U., Cherniack, M., Hwang, J.-H., Lindner, W., Maskey, A., Rasin, A., Ryvkina, E., Tatbul, N., Xing, Y., Zdonik, S., 2005. The design of the borealis stream processing engine. In: Conference on Innovative Data Systems Research (CIDR), vol. 5, pp. 277–289.
3. Ahmad, Y., Çetintemel, U., 2004. Network-aware query processing for stream-based applications. In: Proceedings of the 13th International Conference on Very Large Data Bases - Volume 30, VLDB ’04, VLDB Endowment, pp. 456–467.
4. Akidau, T., Balikov, A., Bekiroğlu, K., Chernyak, S., Haberman, J., Lax, R., McVeety, S., Mills, D., Nordstrom, P., Whittle, S., Millwheel: fault-tolerant stream processing at internet scale. VLDB Endow. 6 (2013), 1033–1044, 10.14778/2536222.2536229.
5. Allen, S.T., Jankowski, M., Pathirana, P., Storm Applied: Strategies for Real-time Event Processing. 1st edition, 2015, Manning Publications Co., Greenwich, USA.
6. Amazon CloudWatch, 〈 https://aws.amazon.com/cloudwatch/〉2015.
7. Amazon EC2 Container Service, 〈 https://aws.amazon.com/ecs/〉2015.
8. Amazon Kinesis Firehose, 〈 https://aws.amazon.com/kinesis/firehose/〉2015.
9. Amini, L., Andrade, H., Bhagwan, R., Eskesen, F., King, R., Selo, P., Park, Y., Venkatramani, C., 2006. SPC: A distributed, scalable platform for data mining. In: Proceedings of the 4th International Workshop on Data Mining Standards, Services and Platforms, DMSSP ’06, ACM, New York, USA, pp. 27–37.
10. Aniello, L., Baldoni, R., Querzoni, L., 2013. Adaptive Online Scheduling in Storm, pp. 207–218.
11. Apache ActiveMQ, 〈 http://activemq.apache.org/〉2016.
12. Apache Beam, 〈 http://beam.incubator.apache.org/〉2016.
13. Apache Edgent, 〈 https://edgent.apache.org〉2017.
14. Apache Flink, 〈 http://flink.apache.org/〉2015.
15. Apache flink - iterative graph processing, API Documentation 2017. URL 〈 https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/libs/gelly/iterative_graph_processing.html〉.
16. Apache Kafka, 〈 http://kafka.apache.org/〉2016.
17. Apache Samza, 〈 https://samza.apache.org〉2017.
18. Apache Thrift, 〈 https://thrift.apache.org/〉2016.
19. Apache Zookeeper, 〈 http://zookeeper.apache.org/〉2016.
20. Arasu, A., Babcock, B., Babu, S., Cieslewicz, J., Datar, M., Ito, K., Motwani, R., Srivastava, U., Widom, J., 2004. Stream: The stanford data stream management system, Book chapter. Stanford InfoLab.
21. Armbrust, M., Fox, A., Griffith, R., Joseph, A.D., Katz, R.H., Konwinski, A., Lee, G., Patterson, D.A., Rabkin, A., Stoica, I., Zaharia, M., 2009. Above the Clouds: A Berkeley View of Cloud Computing, Technical report UCB/EECS-2009–28. Electrical Engineering and Computer Sciences, University of California at Berkeley, Berkeley, USA (February).
22. Atzori, L., Iera, A., Morabito, G., The internet of things: A survey. Comput. Netw. 54:15 (2010), 2787–2805.
23. Azure IoT Hub, 〈 https://azure.microsoft.com/en-us/services/iot-hub/〉2016.
24. Azure Stream Analytics, 〈 https://azure.microsoft.com/en-us/services/stream-analytics/〉2015.
25. Babcock, B., Babu, S., Datar, M., Motwani, R., Widom, J., 2002. Models and issues in data stream systems. In: Proceedings of the 21st ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems, PODS ’02, ACM, New York, USA, pp. 1–16. http://dx.doi.org/10.1145/543613.543615.URL 〈 http://doi.acm.org/10.1145/543613.543615〉.
26. Babcock, B., Babu, S., Motwani, R., Datar, M., 2003. Chain: Operator scheduling for memory minimization in data stream systems. In: ACM SIGMOD International Conference on Management of Data, SIGMOD ’03, ACM, New York, USA, pp. 253–264.
27. Balazinska, M., Balakrishnan, H., Stonebraker, M., 2004. Contract-based load management in federated distributed systems. In: Proceedings of the 1st Symposium on Networked Systems Design and Implementation (NSDI), USENIX Association, San Francisco, USA, pp. 197–210.
28. Basanta-Val, P., Fernndez-Garca, N., Wellings, A., Audsley, N., Improving the predictability of distributed stream processors. Future Gener. Comput. Syst. 52 (2015), 22–36, 10.1016/j.future.2015.03.023 (special Section: Cloud Computing: Security, Privacy and Practice).
29. Benoit, A., Dobrila, A., Nicod, J.-M., Philippe, L., Scheduling linear chain streaming applications on heterogeneous systems with failures. Future Gener. Comput. Syst. 29:5 (2013), 1140–1151, 10.1016/j.future.2012.12.015 (special section: Hybrid Cloud Computing).
30. Borthakur, D., Gray, J., Sarma, J.S., Muthukkaruppan, K., Spiegelberg, N., Kuang, H., Ranganathan, K., Molkov, D., Menon, A., Rash, S., Schmidt, R., Aiyer, A., 2011. Apache Hadoop Goes Realtime at Facebook. In: Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD 2011), ACM, New York, USA, pp. 1071–1080.
31. Boykin, O., Ritchie, S., O'Connell, I., A framework for integrating batch and online MapReduce computations. Proc. VLDB Endow. 7:13 (2014), 1441–1451.
32. Cardellini, V., Grassi, V., Presti, F.L., Nardelli, M., 2015. Distributed QoS-aware scheduling in Storm. In: Proceedings of the 9th ACM International Conference on Distributed Event-Based Systems, DEBS ’15, ACM, New York, USA, pp. 344–347.
33. Cardellini, V., Grassi, V., Presti, F.L., Nardelli, M., 2016. Optimal operator placement for distributed stream processing applications. In: Proceedings of the 10th ACM International Conference on Distributed and Event-based Systems, DEBS ’16, ACM, New York, USA, pp. 69–80.
34. Centenaro, M., Vangelista, L., Zanella, A., Zorzi, M., 2016. Long-range Communications in Unlicensed Bands: The Rising Stars in the Iot and Smart City Scenarios, 23, pp. 60–67. http://dx.doi.org/10.1109/MWC.2016.7721743.
35. Chan, S., 2016. Apache quarks, watson, and streaming analytics: Saving the world, one smart sprinkler at a time. Bluemix Blog (June).URL 〈 https://www.ibm.com/blogs/bluemix/2016/06/better-analytics-with-apache-quarks/〉.
36. Chen, W., Paik, I., Li, Z., 2017. Cost-aware streaming workflow allocation on geo-distributed data centers. IEEE Transactions on Computers, in press. https://doi.org/10.1109/TC.2016.2595579.
37. Chen, J., DeWitt, D.J., Tian, F., Wang, Y., 2000. NiagaraCQ: A scalable continuous query system for internet databases. In: ACM SIGMOD International Conference on Management of Data, SIGMOD ’00, ACM, New York, USA, pp. 379–390.
38. Chen, Y., Alspaugh, S., Borthakur, D., Katz, R., 2012. Energy efficiency for large-scale MapReduce workloads with significant interactive analysis. In: Proceedings of the 7th ACM European Conference on Computer Systems (EuroSys 2012), ACM, New York, USA, pp. 43–56.
39. Cheng, B., Papageorgiou, A., Bauer, M., 2016. Geelytics: Enabling on-demand edge analytics over scoped data sources. In: IEEE International Congress on Big Data (BigData Congress), pp. 101–108.
40. Unlocking Game-Changing Wireless Capabilities: Cisco and SITA help Copenhagen Airport Develop New Services for Transforming the Passenger Experience, Customer case study. CISCO 2012. URL 〈 http://www.cisco.com/en/US/prod/collateral/wireless/c36_696714_00_copenhagen_airport_cs.pdf〉.
41. Clifford, S., Hardy, Q., 2013. Attention, shoppers: Store is tracking your cell. New York Times. URL 〈 http://www.nytimes.com/2013/07/15/business/attention-shopper-stores-are-tracking-your-cell.html〉.
42. Cloud Foundry, 〈 https://www.cloudfoundry.org/〉2016.
43. Dabek, F., Cox, R., Kaashoek, F., Morris, R., 2004. Vivaldi: A decentralized network coordinate system. In: Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications, SIGCOMM ’04, ACM, New York, USA, pp. 15–26.
44. de Assuncao, M.D., Calheiros, R.N., Bianchi, S., Netto, M.A.S., Buyya, R., Big data computing and clouds: trends and future directions. J. Parallel Distrib. Comput. 79–80:0 (2015), 3–15.
45. Dean, J., Ghemawat, S. MapReduce: Simplified data processing on large clusters. Communications of the ACM 51 (1).
46. DistributedLog, 〈 http://distributedlog.io/〉2016.
47. Ellis, B., Real-time Analytics: Techniques to Analyze and Visualize Streaming Data. 2014, John Wiley&Sons, Indianapolis, USA.
48. Fernandez, R.C., Migliavacca, M., Kalyvianaki, E., Pietzuch, P., 2013. Integrating scale out and fault tolerance in stream processing using operator state management. In: ACM SIGMOD International Conference on Management of Data, SIGMOD ’13, ACM, New York, USA, pp. 725–736.
49. Gai, K., Qiu, M., Zhao, H., Tao, L., Zong, Z., Dynamic energy-aware cloudlet-based mobile cloud computing model for green computing. J. Netw. Comput. Appl. 59:Supplement C (2016), S46–S54, 10.1016/j.jnca.2015.05.016 (URL 〈 http://www.sciencedirect.com/science/article/pii/S108480451500123X〉).
50. Gai, K., Qiu, M., Zhao, H., Cost-aware multimedia data allocation for heterogeneous memory using genetic algorithm in cloud computing. IEEE Trans. Cloud Comput., 99, 2016, 10.1109/TCC.2016.2594172 (1–1).
51. Gedik, B., Schneider, S., Hirzel, M., Wu, K.-L., Elastic scaling for data stream processing. IEEE Trans. Parallel Distrib. Syst. 25:6 (2014), 1447–1463.
52. Gedik, B., Özsema, H., Öztürk, O., Pipelined fission for stream programs with dynamic selectivity and partitioned state. J. Parallel Distrib. Comput. 96 (2016), 106–120, 10.1016/j.jpdc.2016.05.003.
53. Golab, L., Özsu, M.T., Issues in data stream management. SIGMOD Rec. 32:2 (2003), 5–14, 10.1145/776985.776986 (URL 〈 http://doi.acm.org/10.1145/776985.776986〉).
54. Google Cloud Dataflow, 〈 https://cloud.google.com/dataflow/〉 2015.
55. Google Cloud Storage, 〈 https://cloud.google.com/storage/〉2015.
56. Google Compute Engine, 〈 https://cloud.google.com/compute/〉2015.
57. Gu, L., Zeng, D., Guo, S., Xiang, Y., Hu, J., A general communication cost optimization framework for big data stream processing in geo-distributed data centers. IEEE Trans. Comput. 65:1 (2016), 19–29.
58. Gulisano, V., Jiménez-Peris, R., Patiño-Martínez, M., Soriente, C., Valduriez, P., StreamCloud: an elastic and scalable data streaming system. IEEE Trans. Parallel Distrib. Syst. 23:12 (2012), 2351–2365.
59. Gyllstrom, D., Wu, E., Chae, H., Diao, Y., Stahlberg, P., Anderson, G., 2007. SASE: complex event processing over streams (demo). In: Proceedings of the Third Biennial Conference on Innovative Data Systems Research (CIDR 2007), pp. 407–411.
60. Ha, K., Chen, Z., Hu, W., Richter, W., Pillai, P., Satyanarayanan, M., 2014. Towards wearable cognitive assistance. In: Proceedings of the 12th Annual International Conference on Mobile Systems, Applications, and Services, MobiSys ’14, ACM, New York, USA. pp. 68–81. http://dx.doi.org/10.1145/2594368.2594383.URL 〈 http://doi.acm.org/10.1145/2594368.2594383〉.
61. Han, J., H.E, Le, G., Du, J., 2011. Survey on NoSQL database. In: Proceedings of the 6th International Conference on Pervasive Computing and Applications (ICPCA 2011), IEEE, Port Elizabeth, South Africa, pp. 363–366.
62. He, B., Yang, M., Guo, Z., Chen, R., Su, B., Lin, W., Zhou, L., 2010. Comet: Batched stream processing for data intensive distributed computing. In: Proceedings of the 1st ACM Symposium on Cloud Computing, SoCC ’10, ACM, New York, USA, pp. 63–74. http://dx.doi.org/10.1145/1807128.1807139.
63. Heinze, T., Jerzak, Z., Hackenbroich, G., Fetzer, C., 2014. Latency-aware elastic scaling for distributed data stream processing systems. In: Proceedings of the 8th ACM International Conference on Distributed Event-Based Systems, DEBS ’14, ACM, New York, USA, pp. 13–22.
64. Hidalgo, N., Wladdimiro, D., Rosas, E., 2017. Self-adaptive processing graph with operator fission for elastic stream processing. Journal of Systems and Software, in press. https://doi.org/10.1016/j.jss.2016.06.010.
65. Hindman, B., Konwinski, A., Zaharia, M., Ghodsi, A., Joseph, A.D., Katz, R., Shenker, S., Stoica, I., 2011. Mesos: a platform for fine-grained resource sharing in the data center. In: NSDI, 11, pp. 22–22.
66. Hirzel, M., Soulé, R., Schneider, S., Gedik, B., Grimm, R., A catalog of stream processing optimizations. ACM Comput. Surv. 46:4 (2014), 1–34.
67. Hirzel, M., Schneider, S., Gedik, B., An, S.P.L., extensible language for distributed stream processing. ACM Trans. Program. Lang. Syst. 39:1 (2017), 5:1–5:39, 10.1145/3039207 (URL 〈 http://doi.acm.org/10.1145/3039207〉).
68. Hochreiner, C., Vogler, M., Waibel, P., Dustdar, S., 2016. VISP: An ecosystem for elastic data stream processing for the internet of things. In: Proceedings of the 20th IEEE International Enterprise Distributed Object Computing Conference (EDOC 2016), pp. 1–11.
69. Hu, L., Schwan, K., Amur, H., Chen, X., 2014. ELF: Efficient lightweight fast stream processing at scale. In: USENIX Annual Technical Conference, USENIX Association, Philadelphia, USA, pp. 25–36.
70. Hu, Y.C., Patel, M., Sabella, D., Sprecher, N., Young, V., 2015 Mobile edge computing: A key technology towards 5G, Whitepaper ETSI White Paper No. 11. European Telecommunications Standards Institute (ETSI) (September).
71. Hu, W., Gao, Y., Ha, K., Wang, J., Amos, B., Chen, Z., Pillai, P., Satyanarayanan, M., 2016. Quantifying the impact of edge computing on mobile applications. In: Proceedings of the 7th ACM SIGOPS Asia-Pacific Workshop on Systems, APSys ’16, ACM, New York, USA, pp. 5:1–5:8. http://dx.doi.org/10.1145/2967360.2967369.URL 〈 http://doi.acm.org/10.1145/2967360.2967369〉.
72. Ismail, B.I., Goortani, E.M., Karim, M.B.A., Tat, W.M., Setapa, S., Luke, J.Y., Hoe, O.H., 2015. Evaluation of docker as edge computing platform. In: IEEE Conference on Open Systems (ICOS 2015), pp. 130–135.
73. Kestrel, 〈 https://github.com/twitter-archive/kestrel〉2016.
74. Kreutz, D., Ramos, F.M.V., Verissimo, P.E., Rothenberg, C.E., Azodolmolky, S., Uhlig, S., Software-defined networking: a comprehensive survey. Proc. IEEE 103:1 (2015), 14–76.
75. Krishnamurthy, B., Sen, S., Zhang, Y., Chen, Y., 2003. Sketch-based change detection: Methods, evaluation, and applications. In: Proceedings of the 3rd ACM SIGCOMM Conference on Internet Measurement, IMC ’03, ACM, New York, USA, pp. 234–247.
76. Kubernetes: Production-grade Container Orchestration, 〈 http://kubernetes.io/〉2015.
77. Kulkarni, S., Bhagat, N., Fu, M., Kedigehalli, V., Kellogg, C., Mittal, S., Patel, J.M., Ramasamy, K., Taneja, S., 2015. Twitter Heron: Stream processing at scale. In: ACM SIGMOD International Conference on Management of Data, SIGMOD ’15, ACM, New York, USA, pp. 239–250.
78. Lakshmanan, G.T., Li, Y., Strom, R., Placement strategies for internet-scale data stream systems. IEEE Internet Comput. 12:6 (2008), 50–60.
79. Liu, X., Dastjerdi, A.V., Buyya, R., 2016. Internet of Things: Principles and Paradigms, Morgan Kaufmann, Burlington, USA. Ch. Stream Processing in IoT: Foundations, State-of-the-art, and Future Directions.
80. Lohrmann, B., Janacik, P., Kao, O., 2015. Elastic stream processing with latency guarantees. In: Proceedings of the 35th IEEE International Conference on Distributed Computing Systems (ICDCS), pp. 399–410.
81. Lorido-Botran, T., Miguel-Alonso, J., Lozano, J.A., A review of auto-scaling techniques for elastic applications in cloud environments. J. Grid Comput. 12:4 (2014), 559–592.
82. Mehdipour, F., Javadi, B., Mahanti, A., 2016. FOG-Engine: Towards big data analytics in the fog. In: IEEE Proceedings of the 14th International Conference on Dependable, Autonomic and Secure Computing, 14th International Conference on Pervasive Intelligence and Computing, 2nd International Conference on Big Data Intelligence and Computing and Cyber Science and Technology Congress (DASC/PiCom/DataCom/CyberSciTech), pp. 640–646.
83. Morabito, R., Beijar, N., 2016. Enabling data processing at the network edge through lightweight virtualization technologies. In: 2016 IEEE International Conference on Sensing, Communication and Networking (SECON Workshops), pp. 1–6.
84. Morales, J., Rosas, E., Hidalgo, N., 2014. Symbiosis: Sharing mobile resources for stream processing. In: IEEE Symposium on Computers and Communications (ISCC 2014), Workshops, pp. 1–6.
85. Muthukrishnan, S., 2005. Data streams: Algorithms and applications. Now Publishers Inc.,.
86. Netto, M.A.S., Cardonha, C., Cunha, R., de Assuncao, M.D., 2014. Evaluating auto-scaling strategies for cloud computing environments. In: 22nd IEEE International Symp. on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS 2014), IEEE, pp. 187–196.
87. Neumeyer, L., Robbins, B., Nair, A., Kesari, A., 2010. S4: distributed stream computing platform. In: IEEE International Conference on Data Mining Workshops (ICDMW), pp. 170–177.
88. Novo, O., Beijar, N., Ocak, M., Kjallman, J., Komu, M., Kauppinen, T., 2015. Capillary networks - bridging the cellular and iot worlds. In: IEEE 2nd World Forum on Internet of Things (WF-IoT), pp. 571–578.
89. Ottenwälder, B., Koldehofe, B., Rothermel, K., Ramachandran, U., 2013. MigCEP: Operator migration for mobility driven distributed complex event processing. In: Proceedings of the 7th ACM International Conference on Distributed Event-based Systems, DEBS ’13, ACM, New York, USA, pp. 183–194.
90. Pahl, C., Lee, B., 2015. Containers and clusters for edge cloud architectures - a technology review. In: Proceedings of the 3rd International Conference on Future Internet of Things and Cloud, pp. 379–386.
91. Pahl, C., Helmer, S., Miori, L., Sanin, J., Lee, B., 2016. A container-based edge cloud paas architecture based on raspberry pi clusters. In: IEEE Proceedings of the 4th International Conference on Future Internet of Things and Cloud Workshops (FiCloudW), pp. 117–124.
92. Peng, B., Hosseini, M., Hong, Z., Farivar, R., Campbell, R., 2015. R-storm: Resource-aware scheduling in storm. In: Proceedings of the 16th Annual Middleware Conference, Middleware ’15, ACM, New York, USA, pp. 149–161.
93. Petrolo, R., Morabito, R., Loscrì, V., Mitton, N., The design of the gateway for the cloud of things. Ann. Telecommun., 2016, 1–10.
94. Pietzuch, P., Ledlie, J., Shneidman, J., Roussopoulos, M., Welsh, M., Seltzer, M., 2006. Network-aware operator placement for stream-processing systems. In: Proceedings of the 22nd International Conference on Data Engineering (ICDE'06), pp. 49–49.
95. Pisani, F., Brunetta, J.R., do Rosario, V.M., Borin, E., 2017. Beyond the fog: Bringing cross-platform code execution to constrained iot devices. In: Proceedings of the 29th International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD 2017), Campinas, Brazil, pp. 17–24.
96. Protocol Buffers, 〈 https://developers.google.com/protocol-buffers/〉2016.
97. Qian, Z., He, Y., Su, C., Wu, Z., Zhu, H., Zhang, T., Zhou, L., Yu, Y., Zhang, Z., 2013. Timestream: Reliable stream computation in the cloud. In: Proceedings of the 8th ACM European Conference on Computer Systems, EuroSys ’13, ACM, New York, USA, pp. 1–14. doi:10.1145/2465351.2465353.
98. RabbitMQ, 〈 https://www.rabbitmq.com/〉2016.
99. Rettig, L., Khayati, M., Cudré-Mauroux, P., Piórkowski, M., 2015. Online anomaly detection over big data streams. In: IEEE International Conference on Big Data (Big Data 2015), IEEE, Santa Clara, USA, pp. 1113–1122.
100. Roh, H., Jung, C., Kim, K., Pack, S., Lee, W., Joint flow and virtual machine placement in hybrid cloud data centers. J. Netw. Comput. Appl. 85 (2017), 4–13, 10.1016/j.jnca.2016.12.006 (intelligent Systems for Heterogeneous Networks. URL 〈 http://www.sciencedirect.com/science/article/pii/S1084804516303101〉).
101. Saha, B., Shah, H., Seth, S., Vijayaraghavan, G., Murthy, A., Curino, C., 2015. Apache Tez: A unifying framework for modeling and building data processing applications. In: 2015 ACM SIGMOD International Conference on Management of Data, SIGMOD ’15, ACM, New York, USA, pp. 1357–1369. doi:10.1145/2723372.2742790.
102. Sajjad, H.P., Danniswara, K., Al-Shishtawy, A., Vlassov, V., 2016. SpanEdge: Towards unifying stream processing over central and near-the-edge data centers. In: IEEE/ACM Symposium on Edge Computing (SEC), pp. 168–178.
103. Sarkar, S., Chatterjee, S., Misra, S., Assessment of the suitability of fog computing in the context of internet of things. IEEE Trans. Cloud Comput., 99, 2015 (1–1).
104. Sattler, K.-U., Beier, F., 2013. Towards elastic stream processing: Patterns and infrastructure. In: Proceedings of the 1st International Workshop on Big Dynamic Distributed Data (BD3), Riva del Garda, Italy, pp. 49–54.
105. Satyanarayanan, M., 2017. Edge computing: Vision and challenges, USENIX Association, Santa Clara, USA.
106. Satzger, B., Hummer, W., Leitner, P., Dustdar, S., 2011. Esc: Towards an elastic stream computing platform for the cloud. In: IEEE International Conference on Cloud Computing (CLOUD), pp. 348–355.
107. Shah, M.A., Hellerstein, J.M., Chandrasekaran, S., Franklin, M.J., 2003. Flux: An adaptive partitioning operator for continuous query systems. In: Proceedings of the 19th International Conference on Data Engineering (ICDE 2003), IEEE Computer Society, pp. 25–36.
108. Shen, Z., Kumaran, V., Franklin, M.J., Krishnamurthy, S., Bhat, A., Kumar, M., Lerche, R., Macpherson, K., Streaming, C.S.A., engine for internet of things. IEEE Data Eng. Bull. 38:4 (2015), 39–50.
109. Tang, Y., Gedik, B., Autopipelining for data stream processing. IEEE Trans. Parallel Distrib. Syst. 24:12 (2013), 2344–2354, 10.1109/TPDS.2012.333.
110. Tatbul, N., Çetintemel, U., Zdonik, S., 2007. Staying FIT: Efficient load shedding techniques for distributed stream processing. In: Proceedings of the 33rd International Conference on Very Large Data Bases, VLDB ’07, VLDB Endowment, pp. 159–170.
111. Tolosana-Calasanz, R., çngel Ba-ares, J., Pham, C., Rana, O.F., Resource management for bursty streams on multi-tenancy cloud environments. Future Gener. Comput. Syst. 55 (2016), 444–459, 10.1016/j.future.2015.03.012.
112. Toshniwal, A., Taneja, S., Shukla, A., Ramasamy, K., Patel, J.M., Kulkarni, S., Jackson, J., Gade, K., Fu, M., Donham, J., Bhagat, N., Mittal, S., Ryaboy, D., 2014. Storm@twitter. In: ACM SIGMOD International Conference on Management of Data, SIGMOD ’14, ACM, New York, USA, pp. 147–156.
113. Tran, D.-H., Gaber, M.M., Sattler, K.-U., Change detection in streaming data in the era of big data: models and issues. SIGKDD Explor. Newsl. 16:1 (2014), 30–38.
114. Tudoran, R., Costan, A., Nano, O., Santos, I., Soncu, H., Antoniu, G., Jetstream: enabling high throughput live event streaming on multi-site clouds. Future Gener. Comput. Syst. 54 (2016), 274–291, 10.1016/j.future.2015.01.016.
115. Tziritas, N., Loukopoulos, T., Khan, S.U., Xu, C.Z., Zomaya, A.Y., On improving constrained single and group operator placement using evictions in big data environments. IEEE Trans. Serv. Comput. 9:5 (2016), 818–831.
116. Vavilapalli, V.K., Murthy, A.C., Douglas, C., Agarwal, S., Konar, M., Evans, R., Graves, T., Lowe, J., Shah, H., Seth, S., Saha, B., Curino, C., O'Malley, O., Radia, S., Reed, B., Baldeschwieler, E., 2013. Apache Hadoop YARN: Yet another resource negotiator. In: Proceedings of the 4th Annual Symposium on Cloud Computing, SOCC ’13, ACM, New York, USA, pp. 5:1–5:16. http://dx.doi.org/10.1145/2523616.2523633.
117. Viglas, S.D., Naughton, J.F., 2002. Rate-based query optimization for streaming information sources. In: ACM SIGMOD International Conference on Management of Data, SIGMOD ’02, ACM, New York, USA, pp. 37–48.
118. Vulimiri, A., Curino, C., Godfrey, P.B., Jungblut, T., Padhye, J., Varghese, G., 2015. Global analytics in the face of bandwidth and regulatory constraints. In: Proceedings of the 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI 15), USENIX Association, Oakland, USA, pp. 323–336.
119. Wu, Y., Tan, K.L., 2015. ChronoStream: Elastic stateful stream computation in the cloud. In: 2015 IEEE Proceedings of the 31st International Conference on Data Engineering, pp. 723–734.
120. Wu, E., Diao, Y., Rizvi, S., 2006. High-performance complex event processing over streams. In: ACM SIGMOD International Conference on Management of Data, SIGMOD ’06, ACM, New York, USA, pp. 407–418.
121. Xu, J., Chen, Z., Tang, J., Su, S., 2014. T-Storm: Traffic-aware online scheduling in storm. In: IEEE Proceedings of the 34th International Conference on Distributed Computing Systems (ICDCS), pp. 535–544.
122. Xu, L., Peng, B., Gupta, I., 2016. Stela: Enabling stream processing systems to scale-in and scale-out on-demand, IEEE International Conference on Cloud Engineering (IC2E 2016) 00, pp. 22–31.
123. Yangui, S., Ravindran, P., Bibani, O., Glitho, R.H., Hadj-Alouane, N.B., Morrow, M.J., Polakos, P.A., 2016. A platform as-a-service for hybrid cloud/fog environments. In: IEEE International Symposium on Local and Metropolitan Area Networks (LANMAN), pp. 1–7.
124. Zaharia, M., Chowdhury, M., Das, T., Dave, A., Ma, J., McCauley, M., Franklin, M.J., Shenker, S., Stoica, I., 2012. Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing. In: Proceedings of the 9th USENIX Conference on Networked Systems Design and Implementation, NSDI'12, USENIX Association, Berkeley, USA, pp. 2–2.
125. Zaharia, M., Das, T., Li, H., Hunter, T., Shenker, S., Stoica, I., 2013. Discretized streams: Fault-tolerant streaming computation at scale. In: Proceedings of the 24th ACM Symposium on Operating Systems Principles, SOSP ’13, ACM, New York, USA, pp. 423–438.
126. Zhao, X., Garg, S., Queiroz, C., Buyya, R., 2017. Software Architecture for Big Data and the Cloud, Elsevier – Morgan Kaufmann. Ch. A Taxonomy and Survey of Stream Processing Systems.
127. Zhou, Y., Ooi, B.C., Tan, K.-L., Wu, J., Efficient Dynamic Operator Placement in a Locally Distributed Continuous Query System. 2006, Springer Berlin Heidelberg, Berlin, Heidelberg, 54–71.
128. Zhu, Y., Shasha, D., 2003. Efficient elastic burst detection in data streams. In: Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD ’03, ACM, New York, USA, pp. 336–345.