Distributed scheduling of event analytics across edge and cloud

ACM Transactions on Cyber-Physical Systems

Volumn 2, Issue 4, 2018, Pages

  Ghosh, Rajrup ^a   Simmhan, Yogesh ^a  

^a INDIAN INSTITUTE OF SCIENCE   (India)

Author keywords

Big data platforms; Cloud computing; Complex event processing (CEP); Distributed scheduling; Edge computing; Energy aware scheduling; Internet of things (IoT); Low power processing; Meta heuristics; Query partitioning

Indexed keywords

CLOUD COMPUTING; COMPLEX NETWORKS; DIGITAL STORAGE; EDGE COMPUTING; GENETIC ALGORITHMS; INTERNET OF THINGS; POWER MANAGEMENT; REAL TIME SYSTEMS; SCHEDULING;

BIG DATA PLATFORMS; COMPLEX EVENT PROCESSING (CEP); DISTRIBUTED SCHEDULING; ENERGY-AWARE SCHEDULING; INTERNET OF THINGS (IOT); LOW-POWER PROCESSING; META HEURISTICS; QUERY PARTITIONING;

BIG DATA;

EID: 85048329455     PISSN: 2378962X     EISSN: 23789638     Source Type: Journal    
DOI: 10.1145/3140256     Document Type: Article

References (43)

1. Karl Aberer, Philippe Cudré-Mauroux, Anwitaman Datta, Zoran Despotovic, Manfred Hauswirth, Magdalena Punceva, and Roman Schmidt. 2003. P-Grid: A self-organizing structured P2P system. SIGMOD Rec. 32, 3 (Sept. 2003), 29-33.
2. Yanif Ahmad and Uğur Çetintemel. 2004. Network-aware query processing for stream-based applications. In Proceedings of the International Conference on Very Large Data Bases (VLDB'04). VLDB Endowment, Toronto, Canada, 456-467.
3. Mert Akdere, Uǧur Çetintemel, and Nesime Tatbul. 2008. Plan-based complex event detection across distributed sources. Proc. VLDB Endow. 1, 1 (Aug. 2008), 66-77.
4. Flavio Bonomi, Rodolfo Milito, Preethi Natarajan, and Jiang Zhu. 2014. Fog Computing: A Platform for Internet of Things and Analytics. Springer International Publishing, Cham, 169-186.
5. Badrish Chandramouli, Suman Nath, and Wenchao Zhou. 2013. Supporting distributed feed-following apps over edge devices. Proc. VLDB Endow. 6, 13 (Aug. 2013), 1570-1581.
6. Brent Chun, David Culler, Timothy Roscoe, Andy Bavier, Larry Peterson, Mike Wawrzoniak, and Mic Bowman. 2003. PlanetLab: An overlay testbed for broad-coverage services. SIGCOMM Comput. Commun. Rev. 33, 3 (Jul. 2003), 3-12.
7. Byung-Gon Chun, Sunghwan Ihm, Petros Maniatis, Mayur Naik, and Ashwin Patti. 2011. CloneCloud: Elastic execution between mobile device and cloud. In Proceedings of the Conference on Computer Systems (EuroSys'11). ACM, New York, NY, 301-314.
8. Gianpaolo Cugola and Alessandro Margara. 2012. Processing flows of information: From data stream to complex event processing. ACM Comput. Surv. 44, 3, Article 15 (Jun. 2012), 62 pages.
9. Pedro A. Diaz-Gomez and Dean F. Hougen. 2009. Three interconnected parameters for genetic algorithms. In Proceedings of the Conference on Genetic and Evolutionary Computation. ACM, New York, NY, 763-770.
10. Lionel Eyraud-Dubois and Przemyslaw Uznanski. 2012. Bedibe: Datasets and software tools for distributed bandwidth prediction. In Proceedings of the Rencontres Francophones sur les Aspects Algorithmiques des Télécommunications (Al-goTel'12). HAL Archives, La Grande Motte, France, 1-5.
11. Niroshinie Fernando, Seng W. Loke, and Wenny Rahayu. 2013. Mobile cloud computing. Future Gener. Comput. Syst. 29, 1 (Jan. 2013), 84-106.
12. Michael R. Garey and David S. Johnson. 1975. Complexity results for multiprocessor scheduling under resource constraints. SIAM J. Comput. 4, 4 (1975), 397-411.
13. Nithyashri Govindarajan, Yogesh Simmhan, Nitin Jamadagni, and Prasant Misra. 2014. Event processing across edge and the cloud for internet of things applications. In Proceedings of the International Conference on Management of Data (COMAD'14). Computer Society of India, Mumbai, India, 101-104.
14. Rania Hassan, Babak Cohanim, Olivier De Weck, and Gerhard Venter. 2005. A comparison of particle swarm optimization and the genetic algorithm. In Proceedings of the AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference. American Institute of Aeronautics and Astronautics, 1897.
15. Keqiang He, Alexis Fisher, Liang Wang, Aaron Gember, Aditya Akella, and Thomas Ristenpart. 2013. Next stop, the cloud: Understanding modern web service deployment in EC2 and azure. In Proceedings of the Conference on Internet Measurement Conference (IMC'13). ACM, NY, 177-190.
16. Martin Hirzel. 2012. Partition and compose: Parallel complex event processing. In Proceedings of the ACM International Conference on Distributed Event-Based Systems (DEBS). ACM, New York, NY, 191-200.
17. Alexander Hogenboom, Viorel Milea, Flavius Frasincar, and Uzay Kaymak. 2009. RCQ-GA: RDF chain query optimization using genetic algorithms. In Proceedings of the 10th International Conference on Electronic Commerce and Web Technologies. Springer, Berlin, 181-192.
18. Daniel R. Karrels, Gilbert L. Peterson, and Barry E. Mullins. 2013. Large-scale cooperative task distribution on peer-to-peer networks. Web Intelli. Agent Sys. 11, 1 (Jan. 2013), 67-79.
19. Yu-Kwong Kwok and Ishfaq Ahmad. 1999. Static scheduling algorithms for allocating directed task graphs to multiprocessors. ACM Comput. Surv. 31, 4 (Dec. 1999), 406-471.
20. Zbigniew Michalewicz. 1996. Genetic Algorithms + Data Structures = Evolution Programs (3rd ed.). Springer-Verlag, London, UK.
21. Christopher Mutschler, Holger Ziekow, and Zbigniew Jerzak. 2013. The DEBS grand challenge. In Proceedings of the International Conference on Distributed Event-based Systems (DEBS'13). ACM, New York, NY, 289-294.
22. Jorge Nocedal and Stephen J. Wright. 2006. Numerical Optimization (2nd ed.). Springer, New York, NY.
23. Charith Perera, Arkady Zaslavsky, Peter Christen, and Dimitrios Georgakopoulos. 2014. Sensing as a service model for smart cities supported by internet of things. Trans. Emerg. Telecommun. Technol. 25, 1 (Jan. 2014), 81-93.
24. Peter Pietzuch, Jonathan Ledlie, Jeffrey Shneidman, Mema Roussopoulos, Matt Welsh, and Margo Seltzer. 2006. Network-aware operator placement for stream-processing systems. In Proceedings of the International Conference on Data Engineering (ICDE'06). IEEE Computer Society, Washington, DC, 49-61.
25. Mahadev Satyanarayanan, Paramvir Bahl, Ramón Caceres, and Nigel Davies. 2009. The case for VM-based cloudlets in mobile computing. IEEE Perv. Comput. 8, 4 (Oct. 2009), 14-23.
26. Rishad A. Shafik, Bashir M. Al-Hashimi, and Krishnendu Chakrabarty. 2010. Soft error-aware design optimization of low power and time-constrained embedded systems. In Proceedings of the Conference on Design, Automation and Test in Europe (DATE'10). EDAA, Leuven, Belgium, 1462-1467.
27. R. Shea, J. Liu, E. C. H. Ngai, and Y. Cui. 2013. Cloud gaming: Architecture and performance. IEEE Netw. 27, 4 (Jul. 2013), 16-21.
28. Cong Shi, Vasileios Lakafosis, Mostafa H. Ammar, and Ellen W. Zegura. 2012. Serendipity: Enabling remote computing among intermittently connected mobile devices. In Proceedings of the ACM International Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc'12). ACM, New York, NY, 145-154.
29. A. Shukla, H. M. Pandey, and D. Mehrotra. 2015. Comparative review of selection techniques in genetic algorithm. In Proceedings of the International Conference on Futuristic Trends on Computational Analysis and Knowledge Management (ABLAZE'15). IEEE, 515-519.
30. Anshu Shukla and Yogesh Simmhan. 2016. Benchmarking distributed stream processing platforms for IoT applications. In Proceedings of the 8th TPC Technology Conference (TCPC'16). Springer International, Cham, 90-106.
31. Yogesh Simmhan, Viktor Prasanna, Saima Aman, Alok Kumbhare, Rongyang Liu, Samuel Stevens, and Qunzhi Zhao. 2013. Cloud-based software platform for big data analytics in smart grids. Comput. Sci. Eng. 15, 4 (Jul. 2013), 38-47.
32. SmartX. 2016. IISc Smart Campus: Closing the loop from Network to Knowledge. Rectreived from http://smartx.cds.iisc.ac.in.
33. Utkarsh Srivastava, Kamesh Munagala, and Jennifer Widom. 2005. Operator placement for in-network stream query processing. In Proceedings of the ACM Symposium on Principles of Database Systems (PODS'05). ACM, New York, NY, 250-258.
34. Michael Steinbrunn, Guido Moerkotte, and Alfons Kemper. 1997. Heuristic and randomized optimization for the join ordering problem. VLDB J. 6, 3 (Aug. 1997), 191-208.
35. Sriskandarajah Suhothayan, Kasun Gajasinghe, Isuru Loku Narangoda, Subash Chaturanga, Srinath Perera, and Vishaka Nanayakkara. 2011. Siddhi: A second look at complex event processing architectures. In Proceedings of the Workshop on Gateway Computing Environments. ACM, New York, NY, 43-50.
36. Ankit Toshniwal, Siddarth Taneja, Amit Shukla, Karthik Ramasamy, Jignesh M. Patel, Sanjeev Kulkarni, Jason Jackson, Krishna Gade, Maosong Fu, Jake Donham, Nikunj Bhagat, Sailesh Mittal, and Dmitriy Ryaboy. 2014. Storm@Twitter. In Proceedings of the ACM International Conference on Management of Data (SIGMOD'14). ACM, New York, NY, 147-156.
37. Prateeksha Varshney and Yogesh Simmhan. 2017. Demystifying fog computing: Characterizing architectures, applications and abstractions. In Proceedings of the IEEE International Conference on Fog and Edge Computing. IEEE Computer Society, New York, NY, 115-124.
38. J. Wei. 2014. How wearables intersect with the cloud and the internet of things: Considerations for the developers of wearables.IEEE Consum. Electr. Mag. 3, 3 (Jul. 2014), 53-56.
39. Louis Woods, Jens Teubner, and Gustavo Alonso. 2010. Complex event detection at wire speed with FPGAs. Proc. VLDB Endow. 3, 1-2 (Sept. 2010), 660-669.
40. L. Yang, J. Cao, S. Tang, T. Li, and A. T. S. Chan. 2012. A framework for partitioning and execution of data stream applications in mobile cloud computing. In Proceedings of the IEEE International Conference on Cloud Computing (CLOUD'12). IEEE, Los Alamitos, CA, 794-802.
41. Yong Yao and Johannes Gehrke. 2003. Query Processing in sensor networks. In Proceedings of the 1st Biennial Conference on Innovative Data Systems (CIDR'03). CIDR, Asilomar, CA, 233-244.
42. Qunzhi Zhou, Yogesh Simmhan, and Viktor Prasanna. 2012. Incorporating semantic knowledge into dynamic data processing for smart power grids. In Proceedings of the International Semantic Web Conference (ISWC'12). Springer, Berlin, 257-273.
43. R. Zhu, B. Liu, D. Niu, Z. Li, and H. V. Zhao. 2017. Network latency estimation for personal devices: A matrix completion approach. IEEE/ACM Trans. Netw. 25, 2 (Apr. 2017), 724-737.