Traffic and Computation Co-Offloading with Reinforcement Learning in Fog Computing for Industrial Applications

IEEE Transactions on Industrial Informatics

Volumn 15, Issue 2, 2019, Pages 976-986

  Wang, Yixuan ^a   Wang, Kun ^b   Huang, Huawei ^c   Miyazaki, Toshiaki ^d   Guo, Song ^b  

^a NANJING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

^b HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

^c KYOTO UNIVERSITY   (Japan)

^d UNIVERSITY OF AIZU   (Japan)

Author keywords

Computation offloading; fog computing; industrial application; reinforcement learning (RL); traffic offloading

Indexed keywords

AUTOMOBILE DRIVERS; EDGE COMPUTING; ENERGY UTILIZATION; FOG; GREEN COMPUTING; HETEROGENEOUS NETWORKS; INDUSTRIAL APPLICATIONS; JOB ANALYSIS; MOBILE TELECOMMUNICATION SYSTEMS; REINFORCEMENT LEARNING; SCHEDULING ALGORITHMS; SERVERS; TRAFFIC CONGESTION;

COMPUTATION OFFLOADING; DELAYS; DEVICE-TO-DEVICE COMMUNICATIONS; MOBILE HANDSETS; TASK ANALYSIS;

FOG COMPUTING;

EID: 85057892451     PISSN: 15513203     EISSN: None     Source Type: Journal    
DOI: 10.1109/TII.2018.2883991     Document Type: Article

References (29)

1. C. V. N. Index, "Global mobile data traffic forecast update, 2015-2020, " White Paper, CA, USA, 2016. [Online]. Available: http: //goo. gl/ylTuVx
2. Y. Cui et al., "Software defined cooperative offloading for mobile cloudlets, " IEEE/ACM Trans. Netw., vol. 25, no. 3, pp. 1746-1760, Jun. 2017.
3. K. Wang, Y. Wang, Y. Sun, S. Guo, and J. Wu, "Green industrial internet of things architecture: An energy-efficient perspective, " IEEE Commun. Mag., vol. 54, no. 12, pp. 48-54, Dec. 2016.
4. L. Vaquero and L. Rodero-Merino, "Finding your way in the fog: Towards a comprehensive definition of fog computing, " ACM SIGCOMM Comput. Commun. Rev., vol. 44, no. 5, pp. 27-32, 2014.
5. H. Huang and S. Guo, "Service provisioning update scheme formobile application users in a cloudlet network, " in Proc. IEEE Int. Conf. Commun., 2017, pp. 1-6.
6. C. Xu et al., "Making big data open in edges: A resource-efficient blockchain-based approach, " IEEE Trans. Parallel Distrib. Syst., vol. PP, no. 99, pp. 1-16, 2018.
7. X. Chen, J. Wu, Y. Cai, H. Zhang, and T. Chen, "Energy-efficiency oriented traffic offloading in wireless networks: A brief survey and a learning approach for heterogeneous cellular networks, " IEEE J. Sel. Areas Commun., vol. 33, no. 4, pp. 627-640, Apr. 2015.
8. E. Bastug, M. Bennis, and M. Debbah, "Living on the edge: The role of proactive caching in 5Gwireless networks, " IEEE Commun. Mag., vol. 52, no. 8, pp. 82-89, Aug. 2014.
9. J. Ho, J. Zhang, and M. Jo, "Selective offloading to WiFi devices for 5G mobile users, " in Proc. IEEE 13th Int. Wireless Commun. Mobile Comput. Conf., 2017, pp. 1047-1054.
10. Y. Lin, E. Chu, Y. Lai, and T. Huang, "Time-and-energy-aware computation offloading in handheld devices to coprocessors and clouds, " IEEE Syst. J., vol. 9, no. 2, pp. 393-405, Jun. 2015.
11. P. Mach and Z. Becvar, "Mobile edge computing: A survey on architecture and computation offloading, " IEEE Commun. Surv. Tut., vol. 19, no. 3, pp. 1628-1656, Jul.-Sep. 2017.
12. Y. Pan, C. Pan, H. Zhu, Q. Ahmed, M. Chen, and J. Wang, "On consideration of content preference and sharing willingness in D2D assisted offloading, " IEEE J. Sel. Areas Commun., vol. 35, no. 4, pp. 978-993, Apr. 2017.
13. M. Aazam, S. Zeadally, and K. Harras, "Deploying fog computing in industrial internet of things and industry 4. 0, " IEEE Trans. Ind. Inform., vol. 14, no. 19, pp. 4674-4682, Oct. 2018.
14. J. Fu, Y. Liu, H. Chao, B. Bhargava, and Z. Zhang, "Secure data storage and searching for industrial IoT by integrating fog computing and cloud computing, " IEEE Trans. Ind. Inform., vol. 14, no. 10, pp. 4519-4528, Oct. 2018.
15. S. Mishra, D. Putha, J. Rodrigues, B. Sahoo, and E. Dutkiewicz, "Sustainable service allocation using metaheuristic technique in fog server for industrial applications, " IEEE Trans. Ind. Inform., vol. 14, no. 10, pp. 4497-4506, Oct. 2018.
16. K. Kaur, S. Garg, G. Aujla, N. Kumar, J. Rodrigues, andM. Guizani, "Edge computing in the industrial internet of things environment: Softwaredefined-networks-based edge-cloud interplay, " IEEE Commun. Mag., vol. 56, no. 2, pp. 44-51, Feb. 2018.
17. S. Ha, S. Sen, C. Joe-Wong, Y. Im, andM. Chiang, "Tube: Time-dependent pricing for mobile data, "ACMSIGCOMMComput. Commun. Rev., vol. 42, no. 4, pp. 247-258, 2012.
18. X. Zhuo, W. Gao, G. Cao, and S. Hua, "An incentive framework for cellular traffic offloading, " IEEE Trans. Mobile Comput., vol. 13, no. 3, pp. 541-555, Mar. 2014.
19. K. Habak, M. Ammar, K. Harras, and E. Zegura, "Femto clouds: Leveraging mobile devices to provide cloud service at the edge, " in Proc. IEEE 8th Int. Conf. Cloud Comput., 2015, pp. 9-16.
20. K. Xie, J. Cao, X. Wang, and J. Wen, "Optimal resource allocation for reliable and energy efficient cooperative communications, " IEEE Trans. Wireless Commun., vol. 12, no. 10, pp. 4994-5007, Oct. 2013.
21. H. Mao, M. Alizadeh, I. Menache, and S. Kandula, "Resource management with deep reinforcement learning, " in Proc. 15th ACM Workshop Hot Topics Netw., 2016, pp. 50-56.
22. W. Zhang, Y. Wen, and D. Wu, "Energy-efficient scheduling policy for collaborative execution in mobile cloud computing, " in Proc. IEEE INFOCOM, 2013, pp. 190-194.
23. H. Deng and I. Hou, "Online scheduling for delayed mobile offloading, " in Proc. IEEE Conf. Comput. Commun., 2015, pp. 1867-1875.
24. B. Baron, P. Spathis, H. Rivano, M. Amorim, Y. Viniotis, and M. Ammar, "Centrally-controlled mass data offloading using vehicular traffic, " IEEE Trans. Netw. Serv. Manage., vol. 14, no. 2, pp. 401-415, Jun. 2017.
25. H. Wu and K. Wolter, "Stochastic analysis of delayed mobile offloading in heterogeneous networks, " IEEE Trans. Mobile Comput., vol. 17, no. 2, pp. 461-474, Feb. 2018.
26. X. He, K. Wang, H. Huang, T. Miyazaki, Y. Wang, and S. Guo, "Green resource allocation based on deep reinforcement learning in content-centric IoT, " IEEE Trans. Emerg. Topics Comput., vol. PP, no. 99, pp. 1-16, Feb. 2018.
27. N. Liu et al., "A hierarchical framework of cloud resource allocation and power management using deep reinforcement learning, " in Proc. IEEE 37th Int. Conf. Distrib. Comput. Syst., 2017, pp. 372-382.
28. Y. He, M. Chen, B. Ge, and M. Guizani, "On WiFi offloading in heterogeneous networks: Various incentives and trade-off strategies, " IEEE Commun. Surv. Tut., vol. 18, no. 4, pp. 2345-2385, Oct.-Dec. 2016.
29. M. Cheung and J. Huang, "Dawn: Delay-aware Wi-Fi offloading and network selection, " IEEE J. Sel. Areas Commun., vol. 33, no. 6, pp. 1214-1223, Jun. 2015.