Robustness analytics to data heterogeneity in edge computing

Computer Communications

Volumn 164, Issue , 2020, Pages 229-239

  Qian, Jia ^a   Hansen, Lars Kai ^a   Fafoutis, Xenofon ^a   Tiwari, Prayag ^b   Pandey, Hari Mohan ^c  

^a TECHNICAL UNIVERSITY OF DENMARK   (Denmark)

^b UNIVERSITY OF PADOVA   (Italy)

^c EDGE HILL UNIVERSITY   (United Kingdom)

Author keywords

Active learning; Distributed machine learning; Federated learning; Fog computing; Intelligent edge computing; User data privacy

Indexed keywords

EDGE COMPUTING; POPULATION STATISTICS;

ACTIVE SAMPLING; BIASED SAMPLING; CENTRALIZED SERVER; COMMUNICATION FREQUENCY; DATA HETEROGENEITY; LOCAL CLASSIFIER; LOCAL TRAINING;

CLASSIFICATION (OF INFORMATION);

EID: 85095711656     PISSN: 01403664     EISSN: 1873703X     Source Type: Journal    
DOI: 10.1016/j.comcom.2020.10.020     Document Type: Article

References (26)

1. Konečnỳ, J., McMahan, H., Yu, F.X., Richtárik, P., Suresh, A.T., Bacon, D., Federated learning: Strategies for improving communication efficiency. 2016 arXiv preprint arXiv:1610.05492.
2. M. Barzegaran, N. Desai, J. Qian, K. Tange, B. Zarrin, P. Pop, J. Kuusela, Fogification of electric drives: An industrial use case, in: The 25th International Conference on Emerging Technologies and Factory Automation ETFA2020, 08 Sep 2020, Vienna, Austria, 2020.
3. Qian, J., Tiwari, P., Gochhayat, S.P., Pandey, H.M., A noble double dictionary based ecg compression technique for ioth. IEEE Internet Things J., 2020.
4. He, C., Tan, C., Tang, H., Qiu, S., Liu, J., Central server free federated learning over single-sided trust social networks. 2019 arXiv preprint arXiv:1910.04956.
5. Zhao, Y., Yu, C., Zhao, P., Tang, H., Qiu, S., Liu, J., Decentralized online learning: Take benefits from others’ data without sharing your own to track global trend. 2019 arXiv preprint arXiv:1901.10593.
6. Diro, A.A., Chilamkurti, N., Distributed attack detection scheme using deep learning approach for Internet of Things. Future Gener. Comput. Syst. 82 (2018), 761–768.
7. Lakshminarayanan, B., Pritzel, A., Blundell, C., Simple and scalable predictive uncertainty estimation using deep ensembles. Advances in Neural Information Processing Systems, 2017, 6402–6413.
8. Zhu, H., Jin, Y., Multi-objective evolutionary federated learning. IEEE Trans. Neural Netw. Learn. Syst., 2019.
9. Zhao, Y., Li, M., Lai, L., Suda, N., Civin, D., Chandra, V., Federated learning with non-iid data. 2018 arXiv preprint arXiv:1806.00582.
10. Qian, J., Sengupta, S., Hansen, L.K., Active learning solution on distributed edge computing. 2019 arXiv preprint arXiv:1906.10718.
11. Qian, J., Gochhayat, S.P., Hansen, L.K., Distributed active learning strategies on edge computing. 2019 6th IEEE International Conference on Cyber Security and Cloud Computing (CSCloud)/2019 5th IEEE International Conference on Edge Computing and Scalable Cloud (EdgeCom), 2019, IEEE, 221–226.
12. Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R., Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15:1 (2014), 1929–1958.
13. Breiman, L., Bias, Variance, and Arcing Classifiers:, Tech. Rep., 1996, Tech. Rep. 460, Statistics Department, University of California, Berkeley ….
14. Zhou, Z.-H., Ensemble Methods: Foundations and Algorithms. 2012, CRC press.
15. Chen, T., He, T., Benesty, M., Khotilovich, V., Tang, Y., Xgboost: extreme gradient boosting. 2015, 1–4 R package version 0.4-2.
16. Z. Xu, G. Huang, K.Q. Weinberger, A.X. Zheng, Gradient boosted feature selection, in: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2014, pp. 522–531.
17. Klein, D.A., Cremers, A.B., Boosting scalable gradient features for adaptive real-time tracking. 2011 IEEE International Conference on Robotics and Automation, 2011, IEEE, 4411–4416.
18. J. Son, I. Jung, K. Park, B. Han, Tracking-by-segmentation with online gradient boosting decision tree, in: Proceedings of the IEEE International Conference on Computer Vision, 2015, pp. 3056–3064.
19. Nishio, T., Yonetani, R., Client selection for federated learning with heterogeneous resources in mobile edge. ICC 2019-2019 IEEE International Conference on Communications, ICC, 2019, IEEE, 1–7.
20. Kairouz, P., McMahan, H.B., Avent, B., Bellet, A., Bennis, M., Bhagoji, A.N., Bonawitz, K., Charles, Z., Cormode, G., Cummings, R., et al. Advances and open problems in federated learning. 2019 arXiv preprint arXiv:1912.04977.
21. Hashimoto, T.B., Srivastava, M., Namkoong, H., Liang, P., Fairness without demographics in repeated loss minimization. 2018 arXiv preprint arXiv:1806.08010.
22. Krogh, A., Hertz, J.A., A simple weight decay can improve generalization. Advances in Neural Information Processing Systems, 1992, 950–957.
23. Pinsler, R., Gordon, J., Nalisnick, E., Hernández-Lobato, J.M., Bayesian batch active learning as sparse subset approximation. Advances in Neural Information Processing Systems, 2019, 6356–6367.
24. Sarwar, S.S., Ankit, A., Roy, K., Incremental learning in deep convolutional neural networks using partial network sharing. IEEE Access, 2019.
25. Ioffe, S., Szegedy, C., Batch normalization: Accelerating deep network training by reducing internal covariate shift. 2015 arXiv preprint arXiv:1502.03167.
26. Verbeek, J.J., Vlassis, N., Kröse, B., Efficient greedy learning of Gaussian mixture models. Neural Comput. 15:2 (2003), 469–485.