ECO: Harmonizing edge and cloud with ML/DL orchestration

USENIX Workshop on Hot Topics in Edge Computing, HotEdge 2018, co-located with USENIX ATC 2018

Volumn , Issue , 2018, Pages

  Talagala, Nisha ^a   Sundararaman, Swaminathan ^a   Sridhar, Vinay ^a   Arteaga, Dulcardo ^a   Luo, Qianmei ^a   Subramanian, Sriram ^a   Ghanta, Sindhu ^a   Khermosh, Lior ^a   Roselli, Drew ^a  

^a ParallelM   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EDGE COMPUTING;

CONTROL PATH; DATA PATHS; EDGE CLOUDS; KILLER-APPLICATION;

DIGITAL STORAGE;

EID: 85084160117     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (55)

1. CYCLONE: A Platform for Data Intensive Scientific Applications in Heterogeneous Multi-cloud/Multi- provider Environment (Apr. 2016), Zenodo. Supported by CYCLONE project.
2. Apache. airflow. Internet draft, 2017.
3. Apache. flink. Internet draft, 2017.
4. Amazon web services, 2018. https://aws.amazon.com.
5. Dataiku, 2018. https://www.dataiku.com.
6. Microsoft azure, 2018. https://azure.microsoft.com.
7. Pipelineai, 2018. https://pipeline.ai.
8. ABADI, M., AND ET AL. Tensorflow: Large-scale machine learning on heterogeneous systems. Internet draft, 2015.
9. ALSHEIKH, M. A., LIN, S., TAN, H.-P., AND NIYATO, D. Toward a robust sparse data representation for wireless sensor networks. In Proceedings of the 2015 IEEE 40th Conference on Local Computer Networks (LCN 2015) (Washington, DC, USA, 2015), LCN’15, IEEE Computer Society, pp. 117–124.
10. AMAZON. Internet Draft, 2018.
11. ATZORI, L., IERA, A., AND MORABITO, G. The internet of things: A survey. Comput. Netw. 54, 15 (Oct. 2010), 2787–2805.
12. BAYLOR, D., BRECK, E., CHENG, H.-T., FIEDEL, N., FOO, C. Y., HAQUE, Z., HAYKAL, S., ISPIR, M., JAIN, V., KOC, L., KOO, C. Y., LEW, L., MEWALD, C., MODI, A. N., POLYZOTIS, N., RAMESH, S., ROY, S., WHANG, S. E., WICKE, M., WILKIEWICZ, J., ZHANG, X., AND ZINKEVICH, M. Tfx: A tensorflow-based production-scale machine learning platform. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (New York, NY, USA, 2017), KDD’17, ACM, pp. 1387–1395.
13. BURKARD, C., AND LAGESSE, B. Analysis of causative attacks against svms learning from data streams. In Proceedings of the 3rd ACM on International Workshop on Security And Privacy Analytics (New York, NY, USA, 2017), IWSPA’17, ACM, pp. 31–36.
14. CHATTERJEE, M., AND LEUSKI, A. CRMActive: An Active Learning Based Approach for Effective Video Annotation and Retrieval. In Proceedings of ACM International Conference on Multimedia Retrieval (ICMR) (Shanghai, China, June 2015), ACM, pp. 535–538.
15. DAECHER, A. Internet of things: From sensing to doing. Wall Street Journal, 2016.
16. DAI, W., YANG, Q., XUE, G.-R., AND YU, Y. Boosting for transfer learning. In Proceedings of the 24th International Conference on Machine Learning (New York, NY, USA, 2007), ICML’07, ACM, pp. 193–200.
17. FAMILIAR, B. Microservices, IoT, and Azure: Leveraging DevOps and Microservice Architecture to Deliver SaaS Solutions, 1st ed. Apress, Berkely, CA, USA, 2015.
18. FENG, L., KORTOÇI, P., AND LIU, Y. A multi-tier data reduction mechanism for iot sensors. In Proceedings of the Seventh International Conference on the Internet of Things (New York, NY, USA, 2017), IoT’17, ACM, pp. 6:1–6:8.
19. GARTNER, I. Managing the data tsunami: How ai and edge computing will enhance iot analytics. Internet Draft, 2017. https://www.gartner.com/doc/3817038/managing-datatsunami-ai-edge.
20. GUBBI, J., BUYYA, R., MARUSIC, S., AND PALANISWAMI, M. Internet of things (iot): A vision, architectural elements, and future directions. Future Gener. Comput. Syst. 29, 7 (Sept. 2013), 1645–1660.
21. HAMANN, H. F. From smart sensors to smarter solutions with physical analytics. In Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems (New York, NY, USA, 2015), SenSys’15, ACM, pp. 3–3.
22. HIPP, D. R. Sqlite, 2015. https://www.sqlite.org/download.html.
23. HUNT, P., KONAR, M., JUNQUEIRA, F. P., AND REED, B. Zookeeper: Wait-free coordination for internet-scale systems. In Proceedings of the 2010 USENIX Conference on USENIX Annual Technical Conference (Berkeley, CA, USA, 2010), USENIXATC’10, USENIX Association, pp. 11–11.
24. INFUXDB. Storage engine and time-structured merge trees (tsm), 2017.
25. ISARD, M., PRABHAKARAN, V., CURREY, J., WIEDER, U., TALWAR, K., AND GOLDBERG, A. Quincy: Fair scheduling for distributed computing clusters. In Proceedings of the ACMSIGOPS22NdSymposiumonOperatingSystemsPrinciples (New York, NY, USA, 2009), SOSP’09, ACM, pp. 261–276.
26. KING, M. C. Edge mlmachine learning on the edge, 2018. https://www.foghorn.io/edge-ml-machine-learning-edge/.
27. KUMAR, A., GOYAL, S., AND VARMA, M. Resource-efficient machine learning in 2 KB RAM for the internet of things. In Proceedings of the 34th International Conference on Machine Learning, ICML 2017, Sydney, NSW, Australia, 6-11 August 2017 (2017), pp. 1935–1944.
28. LAMPSON, B. W. A scheduling philosophy for multi-processing systems. In Proceedings of the First ACM Symposium on Operating System Principles (New York, NY, USA, 1967), SOSP’67, ACM, pp. 8.1–8.24.
29. LITZKOW, M., LIVNY, M., AND MUTKA, M. Condor - a hunter of idle workstations. In Proceedings of the 8th International Conference of Distributed Computing Systems (June 1988).
30. LUAN, T. H., GAO, L., LI, Z., XIANG, Y., AND SUN, L. Fog computing: Focusing on mobile users at the edge. CoRR abs/1502.01815 (2015).
31. MA, C., SMITH, V., JAGGI, M., JORDAN, M. I., RICHTÁRIK, P., AND TAKÁČ, M. Adding vs. averaging in distributed primal-dual optimization. In Proceedings of the 32Nd International Conference on International Conference on Machine Learning - Volume 37 (2015), ICML’15, JMLR.org, pp. 1973–1982.
32. MAYER, C., MAYER, R., AND ABDO, M. Streamlearner: Distributed incremental machine learning on event streams: Grand challenge. In Proceedings of the 11th ACM International Conference on Distributed and Event-based Systems (New York, NY, USA, 2017), DEBS’17, ACM, pp. 298–303.
33. MERKEL, D. Docker: Lightweight linux containers for consistent development and deployment. Linux J. 2014, 239 (Mar. 2014).
34. METZEN, J. H., KIRCHNER, F., EDGINGTON, M., AND KASSAHUN, Y. Towards efficient online reinforcement learning using neuroevolution. In Proceedings of the 10th Annual Conference on Genetic and Evolutionary Computation (New York, NY, USA, 2008), GECCO’08, ACM, pp. 1425–1426.
35. OUSTERHOUT, J. Scheduling techniques for concurrent systems. In Proceedings of the 3rd International Conference on Distributed Computing Systems (1982), pp. 22–30.
36. OVENDEN, J. Edge computing and the future of machine learning. Internet Draft, 2018.
37. PAN, S. J. Transfer learning with applications on text, sensors and images. In Proceedings of the 2Nd Workshop on Machine Learning for Interactive Systems: Bridging the Gap Between Perception, Action and Communication (New York, NY, USA, 2013), MLIS’13, ACM, pp. 7–7.
38. PAPAGEORGIOU, A., CHENG, B., AND KOVACS, E. Real-time data reduction at the network edge of internet-of-things systems. In Proceedings of the 2015 11th International Conference on Network and Service Management (CNSM) (Washington, DC, USA, 2015), CNSM’15, IEEE Computer Society, pp. 284–291.
39. POLYZOTIS, N., ROY, S., WHANG, S. E., AND ZINKEVICH, M. Data management challenges in production machine learning. In Proceedings of the 2017 ACM International Conference on Management of Data (New York, NY, USA, 2017), SIGMOD ’17, ACM, pp. 1723–1726.
40. RAINA, R., BATTLE, A., LEE, H., PACKER, B., AND NG, A. Y. Self-taught learning: Transfer learning from unlabeled data. In Proceedings of the 24th International Conference on Machine Learning (New York, NY, USA, 2007), ICML’07, ACM, pp. 759–766.
41. SCHELTER, S., SOTO, J., MARKL, V., BURDICK, D., REINWALD, B., AND EVFIMIEVSKI, A. Efficient sample generation for scalable meta learning. In 2015 IEEE 31st International Conference on Data Engineering (April 2015), pp. 1191–1202.
42. SMITH, V., CHIANG, C., SANJABI, M., AND TALWALKAR, A. Federated multi-task learning. CoRR abs/1705.10467 (2017).
43. SMITH, V., CHIANG, C., SANJABI, M., AND TALWALKAR, A. Federated multi-task learning. CoRR abs/1705.10467 (2017).
44. SPOTIFY. Luigi, 2018. https://github.com/spotify/luigi.
45. SRIDHAR, V., SUBRAMANIAN, S., SUNDARARAMAN, S., ROSELLI, D., AND TALAGALA, N. Model governance: Reducing the anarchy of production ml. In Proceedings of the 2018 USENIX Conference on USENIX Annual Technical Conference (Berkeley, CA, USA, 2018), USENIXATC’18, USENIX Association.
46. SWIM. Edge computing and machine learning: Two sides of the same coin. Internet Draft, 2018.
47. SWIM. Swim edge learning. Internet Draft, 2018.
48. TAYLOR, M. E., AND STONE, P. Cross-domain transfer for reinforcement learning. In Proceedings of the 24th International Conference on Machine Learning (New York, NY, USA, 2007), ICML’07, ACM, pp. 879–886.
49. TAYLOR, M. E., STONE, P., AND LIU, Y. Transfer learning via inter-task mappings for temporal difference learning. J. Mach. Learn. Res. 8 (Dec. 2007), 2125–2167.
50. VAVILAPALLI, V. K., MURTHY, A. C., DOUGLAS, C., AGARWAL, S., KONAR, M., EVANS, R., GRAVES, T., LOWE, J., SHAH, H., SETH, S., SAHA, B., CURINO, C., O’MALLEY, O., RADIA, S., REED, B., AND BALDESCHWIELER, E. Apache hadoop yarn: Yet another resource negotiator. In Proceedings of the 4th Annual Symposium on Cloud Computing (New York, NY, USA, 2013), SOCC’13, ACM, pp. 5:1–5:16.
51. YANG, Q. When deep learning meets transfer learning. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management (New York, NY, USA, 2017), CIKM ’17, ACM, pp. 5–5.
52. YE, H., SHAO, W., WANG, H., MA, J., WANG, L., ZHENG, Y., AND XUE, X. Face recognition via active annotation and learning. In Proceedings of the 2016 ACM on Multimedia Conference (New York, NY, USA, 2016), MM’16, ACM, pp. 1058–1062.
53. ZAHARIA, M., KONWINSKI, A., JOSEPH, A. D., KATZ, R., AND STOICA, I. Improving mapreduce performance in heterogeneous environments. In Proceedings of the 8th USENIX Conference on Operating Systems Design and Implementation (Berkeley, CA, USA, 2008), OSDI’08, USENIX Association, pp. 29–42.
54. ZAHARIA, M., XIN, R. S., WENDELL, P., DAS, T., ARMBRUST, M., DAVE, A., MENG, X., ROSEN, J., VENKATARAMAN, S., FRANKLIN, M. J., GHODSI, A., GONZALEZ, J., SHENKER, S., AND STOICA, I. Apache spark: A unified engine for big data processing. Communications of the ACM 59, 11 (Oct. 2016), 56–65.
55. ZHANG, X., AND MAHOOR, M. H. Task-dependent multi-task multiple kernel learning for facial action unit detection. Pattern Recogn. 51, C (Mar. 2016), 187–196.