A Survey of Deep Learning: Platforms, Applications and Emerging Research Trends

IEEE Access

Volumn 6, Issue , 2018, Pages 24411-24432

  Hatcher, William Grant ^a   Yu, Wei ^a  

^a TOWSON UNIVERSITY   (United States)

Author keywords

cyber physical systems; deep learning; emergent applications; Human centered smart systems; Internet of Things; networking; neural networks; platform; security; survey

Indexed keywords

CYBER PHYSICAL SYSTEM; EMBEDDED SYSTEMS; INTERNET OF THINGS; JOB ANALYSIS; LEARNING SYSTEMS; NEURAL NETWORKS; NEURONS; PERSONNEL TRAINING; SURVEYING; SURVEYS;

COMPUTATIONAL MODEL; NETWORKING AND SECURITY; PLATFORM; SMART SYSTEM; TASK ANALYSIS;

DEEP LEARNING;

EID: 85046378997     PISSN: None     EISSN: 21693536     Source Type: Journal    
DOI: 10.1109/ACCESS.2018.2830661     Document Type: Article

References (170)

1. (2017). Apache MXNet: A Flexible and Efficient Library for Deep Learn- ing. [Online]. Available: https://mxnet.apache.org/
2. (2017). Caffe. [Online]. Available: http://caffe.berkeleyvision.org/
3. (2017). Caffe2: A New Lightweight, Modular, and Scalable Deep Learning Framework. [Online]. Available: https://caffe2.ai/
4. (2017). Cloud TPU Alpha: Train and Run Machine Learning Models Faster Than Ever Before. [Online]. Available: https://cloud. google.com/tpu/
5. (2017). Deep Learning: For Data Scientists Who Need to Deliver. [Online]. Available: https://skymind.ai/
6. (2017). Deep Learning for Java: Open-Source, Distributed, Deep Learning Library for the JVM. [Online]. Available: https://deeplearning4j.org/
7. (2017). Keras: The Python Deep Learning Library. [Online]. Available: https://keras.io/
8. (2017). The Microsoft Cognitive Toolkit. [Online]. Available: https://docs.microsoft.com/en-us/cognitive-toolkit/
9. (2017). An Open-Source Software Library for Machine Intelligence. [Online]. Available: https://www.tensorflow.org/
10. (2017). Theano. [Online]. Available: http://deeplearning.net/software/ theano/
11. (2017). Torch: A Scientifc Computing Framework for LuaJIT. [Online]. Available: http://torch.ch/
12. A. Adler, D. Boublil, M. Elad, and M. Zibulevsky. (Jun. 2016). "A deep learning approach to block-based compressed sensing of images." [Online]. Available: https://arxiv.org/abs/1606.01519
13. M. Agiwal, A. Roy, and N. Saxena, "Next generation 5G wireless networks: A comprehensive survey," IEEE Commun. Surveys Tuts., vol. 18, no. 3, pp. 1617-1655, 3rd Quart., 2016.
14. M. E. Aminanto, R. Choi, H. C. Tanuwidjaja, P. D. Yoo, and K. Kim, "Deep abstraction and weighted feature selection forWi-Fi impersonation detection," IEEE Trans. Inf. Forensics Security, vol. 13, no. 3, pp. 621-636, Mar. 2018.
15. C. Angermueller, H. J. Lee,W. Reik, and O. Stegle, "DeepCpG: Accurate prediction of single-cell DNA methylation states using deep learning," Genome Biol., vol. 18, no. 1, p. 67, 2017.
16. C. Angermueller, T. Pärnamaa, L. Parts, and O. Stegle, "Deep learning for computational biology," Mole. Syst. Biol., vol. 12, no. 7, p. 878, 2016.
17. O. Araque, I. Corcuera-Platas, J. F. Sánchez-Rada, and C. A. Iglesias, "Enhancing deep learning sentiment analysis with ensemble techniques in social applications," Expert Syst. Appl., vol. 77, pp. 236-246, Jul. 2017.
18. D. M. S. Arsa, G. Jati, A. J. Mantau, and I. Wasito, "Dimensionality reduction using deep belief network in big data case study: Hyperspectral image classification," in Proc. Int.Workshop Big Data Inf. Secur. (IWBIS), Oct. 2016, pp. 71-76.
19. K. Arulkumaran, M. P. Deisenroth, M. Brundage, and A. A. Bharath, "Deep reinforcement learning: A brief survey," IEEE Signal Process. Mag., vol. 34, no. 6, pp. 26-38, Nov. 2017.
20. E. Barberio, B. Le, E. Richter-Was, Z. Was, D. Zanzi, and J. Zaremba, "Deep learning approach to the Higgs boson CP measurement in H → τ τ decay and associated systematics," Phys. Rev., vol. D96, no. 7, p. 073002, 2017.
21. A. Bonarini, A. Lazaric, F. Montrone, and M. Restelli, "Reinforcement distribution in fuzzy Q-learning," Fuzzy Sets Syst., vol. 160, no. 10, pp. 1420-1443, 2009.
22. J. Booz, J. McGiff, W. G. Hatcher, W. Yu, J. Nguyen, and C. Lu, "Tuning deep learning performance for Android malware detection," in Proc. 19th IEEE/ACIS Int. Conf. Softw. Eng., Artif. Intell., Netw. Parallel/Distrib. Comput. (SNPD), Jun. 2018.
23. T. S. Borkar and L. J. Karam, "DeepCorrect: Correcting DNN models against image distortions," CoRR, vol. abs/1705.02406, May 2017.
24. A. L. Buczak and E. Guven, "A survey of data mining and machine learning methods for cyber security intrusion detection," IEEE Commun. Surveys Tuts., vol. 18, no. 2, pp. 1153-1176, 2nd Quart., 2016.
25. X.W. Chen and X. Lin, "Big data deep learning: Challenges and perspectives," IEEE Access, vol. 2, pp. 514-525, 2014.
26. Z. Chen, H. Zhang, W. G. Hatcher, J. Nguyen, and W. Yu, "A streamingbased network monitoring and threat detection system," in Proc. IEEE 14th Int. Conf. Softw. Eng. Res., Manage. Appl. (SERA), Jun. 2016, pp. 31-37.
27. F. Chollet. (Oct. 2016). "Xception: Deep learning with depthwise separable convolutions." [Online]. Available: https://arxiv.org/abs/1610.02357
28. O. Cominetti, A. Matzavinos, S. Samarasinghe, D. Kulasiri, S. Liu, and P. K. Maini, "DifFUZZY: A fuzzy clustering algorithm for complex datasets," Int. J. Comput. Intell. Bioinformat., Syst. Biol., vol. 1, no. 4, pp. 402-417, 2010.
29. C. Cortes, X. Gonzalvo, V. Kuznetsov, M. Mohri, and S. Yang. (Jul. 2016). "AdaNet: Adaptive structural learning of artificial neural networks." [Online]. Available: https://arxiv.org/abs/1607.01097
30. A. Dairi, F. Harrou, M. Senouci, and Y. Sun, "Unsupervised obstacle detection in driving environments using deep-learning-based stereovision," Robot. Auto. Syst., vol. 10, pp. 287-301, Feb. 2018.
31. X. Ding, Y. Zhang, T. Liu, and J. Duan, "Deep learning for eventdriven stock prediction," in Proc. 24th Int. Conf. Artif. Intell., 2015, pp. 2327-2333.
32. Y. Ding, S. Chen, and J. Xu, "Application of deep belief networks for opcode based malware detection," in Proc. Int. Joint Conf. Neural Netw. (IJCNN), Jul. 2016, pp. 3901-3908.
33. S. Dodge and L. Karam, "Understanding how image quality affects deep neural networks," in Proc. 8th Int. Conf. Quality Multimedia Exper. (QoMEX), Jun. 2016, pp. 1-6.
34. L. Du et al., "A reconfigurable streaming deep convolutional neural network accelerator for Internet of Things," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 65, no. 1, pp. 198-208, Jan. 2018.
35. A. Ducournau and R. Fablet, "Deep learning for ocean remote sensing: An application of convolutional neural networks for super-resolution on satellite-derived sst data," in Proc. 9th IAPR Workshop Pattern Recognit. Remote Sens. (PRRS), Dec. 2016, pp. 1-6.
36. N. Ekedebe, C. Lu, and W. Yu, "Towards experimental evaluation of intelligent transportation system safety and traffic efficiency," in Proc. IEEE Int. Conf. Commun. (ICC), Jun. 2015, pp. 3757-3762.
37. P. Eulenberg et al., "Reconstructing cell cycle and disease progression using deep learning," Nature Commun., vol. 8, no. 1, p. 463, 2017.
38. Z. M. Fadlullah et al., "State-of-the-art deep learning: Evolving machine intelligence toward tomorrow's intelligent network traffic control systems," IEEE Commun. Surveys Tuts., vol. 19, no. 4, pp. 2432-2455, 4th Quart., 2017.
39. T. Fischer and C. Krauss, "Deep learning with long short-term memory networks for financial market predictions," Eur. J. Oper. Res., 2017.
40. H. Gabbard, M. Williams, F. Hayes, and C. Messenger. (Dec. 2017). "Matching matched filtering with deep networks in gravitational-wave astronomy." [Online]. Available: https://arxiv.org/abs/1712.06041
41. L. Ge, H. Zhang, G. Xu, W. Yu, C. Chen, and E. P. Blasch, "Towards mapreduce based machine learning techniques for processing massive network threat monitoring data," in Networking for Big Data, S.Yu, X. Lin, J. Misic, and X. Shen, Eds. Boca Raton, FL, USA: CRC Press, 2015.
42. L. L. Ge, Y. H.Wu, B. Hua, Z. M. Chen, and L. Chen, "Image registration based on SOFM neural network clustering," in Proc. 36th Chin. Control Conf. (CCC), Jul. 2017, pp. 6016-6020.
43. J. A. Gonzalez et al., "Direct speech reconstruction from articulatory sensor data by machine learning," IEEE/ACM Trans. Audio, Speech, Lan- guage Process., vol. 25, no. 12, pp. 2362-2374, Dec. 2017.
44. I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning. Cambridge, MA, USA: MIT Press, 2016. [Online]. Available: http://www.deeplearningbook.org
45. I. J. Goodfellow et al., "Generative adversarial networks," ArXiv e-prints, Jun. 2014. [Online]. Available: http://adsabs.harvard.edu/abs/ 2014arXiv1406.2661G
46. S. Gu, E. Holly, T. Lillicrap, and S. Levine, "Deep reinforcement learning for robotic manipulation with asynchronous off-policy updates," in Proc. IEEE Int. Conf. Robot. Autom. (ICRA), May 2017, pp. 3389-3396.
47. H. Guo, J.Wang, Y. Gao, J. Li, and H. Lu, "Multi-view 3D object retrieval with deep embedding network," IEEE Trans. Image Process., vol. 25, no. 12, pp. 5526-5537, Dec. 2016.
48. W. G. Hatcher, J. Booz, J. McGiff, C. Lu, and W. Yu, "Edge computing based machine learning mobile malware detection," in Proc. Nat. Cyber Summit, 2017.
49. W. G. Hatcher, D. Maloney, and W. Yu, "Machine learning-based mobile threat monitoring and detection," in Proc. IEEE 14th Int. Conf. Softw. Eng. Res., Manage. Appl. (SERA), Jun. 2016, pp. 67-73.
50. K. He, X. Zhang, S. Ren, and J. Sun. (Dec. 2015). "Deep residual learning for image recognition." [Online]. Available: https://arxiv.org/ abs/1512.03385
51. K. He, X. Zhang, S. Ren, and J. Sun, "Deep residual learning for image recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2016, pp. 770-778, doi: 10.1109/CVPR.2016.90.
52. S. Hickson, A. Angelova, I. Essa, and R. Sukthankar. (Jan. 2018). "Object category learning and retrieval with weak supervision." [Online]. Available: https://arxiv.org/abs/1801.08985
53. I. Higgins et al. (Jun. 2016). "Early visual concept learning with unsupervised deep learning." [Online]. Available: https://arxiv.org/abs/ 1606.05579
54. C. Hong, J.Yu, R. Xie, and D. Tao, "Weakly supervised hand pose recovery with domain adaptation by low-rank alignment," in Proc. IEEE 16th Int. Conf. Data Mining Workshops (ICDMW), Dec. 2016, pp. 446-453.
55. Z. Hu, W. Liu, J. Bian, X. Liu, and T.-Y. Liu. (Dec. 2017). "Listening to chaotic whispers:Adeep learning framework for news-oriented stock trend prediction." [Online]. Available: https://arxiv.org/abs/1712.02136
56. H. H. Huang and H. Liu, "Big data machine learning and graph analytics: Current state and future challenges," in Proc. IEEE Int. Conf. Big Data (Big Data), Oct. 2014, pp. 16-17.
57. L. Huang, A. D. Joseph, B. Nelson, B. I. Rubinstein, and J. D. Tygar, "Adversarial machine learning," in Proc. 4th ACM Workshop Secur. Artif. Intell. (AISec), New York, NY, USA, 2011, pp. 43-58.
58. Y. Huang, X. Ma, X. Fan, J. Liu, and W. Gong, "When deep learning meets edge computing," in Proc. IEEE 25th Int. Conf. Netw. Protocols (ICNP), Oct. 2017, pp. 1-2.
59. E. P. Ijjina and K. M. Chalavadi, "Human action recognition in RGB-D videos using motion sequence information and deep learning," Pattern Recognit., vol. 72, pp. 504-516, Dec. 2017.
60. M. Iliadis, L. Spinoulas, and A. K. Katsaggelos, "Deep fully-connected networks for video compressive sensing," Digit. Signal Process., vol. 72, pp. 9-18, Jan. 2018.
61. S. Jain and J. Dhar, "Image based search engine using deep learning," in Proc. 10th Int. Conf. Contemp. Comput. (IC3), Aug. 2017, pp. 1-7.
62. Y. Jia et al. (2014). "Caffe: Convolutional architecture for fast feature embedding." [Online]. Available: https://arxiv.org/abs/1408.5093
63. V. Jindal, "Integrating mobile and cloud for PPG signal selection to monitor heart rate during intensive physical exercise," in Proc. IEEE/ACM Int. Conf. Mobile Softw. Eng. Syst. (MOBILESoft), May 2016, pp. 36-37.
64. G. Kahn, A. Villaflor, B. Ding, P. Abbeel, and S. Levine. (Sep. 2017). "Self-supervised deep reinforcement learning with generalized computation graphs for robot navigation." [Online]. Available: https://arxiv.org/abs/1709.10489
65. J. Kim, J. Kim, B. Kim, M. Lee, and J. Lee, "Hardware design exploration of fully-connected deep neural network with binary parameters," in Proc. Int. SoC Design Conf. (ISOCC), Oct. 2016, pp. 305-306.
66. J. Kim, J. Kim, H. L. T. Thu, and H. Kim, "Long short term memory recurrent neural network classifier for intrusion detection," in Proc. Int. Conf. Platform Technol. Service (PlatCon), Feb. 2016, pp. 1-5.
67. S. C. Kim, "Device-free activity recognition using CSI big data analysis: A survey," in Proc. 9th Int. Conf. Ubiquitous Future Netw. (ICUFN), Jul. 2017, pp. 539-541.
68. P. V. Klaine, M. A. Imran, O. Onireti, and R. D. Souza, "A survey of machine learning techniques applied to self-organizing cellular networks," IEEE Commun. Surveys Tuts., vol. 19, no. 4, pp. 2392-2431, 4th Quart., 2017.
69. P. T. Komiske, E. M. Metodiev, and M. D. Schwartz, "Deep learning in color: Towards automated quark/gluon jet discrimination," J. High Energy Phys., vol. 2017, no. 1, p. 110, Jan. 2017. [Online]. Available: https://doi.org/10.1007/JHEP01(2017)110
70. J. Korczak and M. Hemes, "Deep learning for financial time series forecasting in A-Trader system," in Proc. Federated Conf. Comput. Sci. Inf. Syst. (FedCSIS), Sep. 2017, pp. 905-912.
71. K. Kowsari, D. E. Brown, M. Heidarysafa, K. J. Meimandi, M. S. Gerber, and L. E. Barnes. (Sep. 2017). "HDLTex: Hierarchical deep learning for text classification." [Online]. Available: https://arxiv.org/abs/1709.08267
72. O. Z. Kraus et al., "Automated analysis of high-content microscopy data with deep learning," Mole. Syst. Biol., vol. 13, no. 4, p. 924, 2017.
73. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks," in Proc. NIPS, vol. 1. 2012, pp. 1097-1105.
74. G. Lacey, G. W. Taylor, and S. Areibi. (Feb. 2016). "Deep learning on FPGAs: Past, present, and future." [Online]. Available: https://arxiv.org/abs/1602.04283
75. J. Li,W. Monroe, A. Ritter, M. Galley, J. Gao, and D. Jurafsky. (Jun. 2016). "Deep reinforcement learning for dialogue generation." [Online]. Available: https://arxiv.org/abs/1606.01541
76. P. Li, Z. Chen, L. T. Yang, Q. Zhang, and M. J. Deen, "Deep convolutional computation model for feature learning on big data in Internet of Things," IEEE Trans. Ind. Informat., vol. 14, no. 2, pp. 790-798, Feb. 2018.
77. P. Li et al., "Multi-key privacy-preserving deep learning in cloud computing," Future Generat. Comput. Syst., vol. 74, pp. 76-85, Sep. 2017.
78. Z. Li, A. Ren, J. Li, Q. Qiu, Y. Wang, and B. Yuan, "DSCNN: Hardwareoriented optimization for stochastic computing based deep convolutional neural networks," in Proc. IEEE 34th Int. Conf. Comput. Design (ICCD), Oct. 2016, pp. 678-681.
79. F. Liang, W. Yu, D. An, Q. Yang, X. Fu, and W. Zhao, "A survey on big data market: Pricing, trading and protection," IEEE Access, vol. 6, pp. 15132-15154, 2018.
80. J. Lin,W. Yu, X. Yang, Q. Yang, X. Fu, andW. Zhao, "A real-time en-route route guidance decision scheme for transportation-based cyberphysical systems," IEEE Trans. Veh. Technol., vol. 66, no. 3, pp. 2551-2566, Mar. 2017.
81. J. Lin, W. Yu, N. Zhang, X. Yang, and L. Ge, "On data integrity attacks against route guidance in transportation-based cyber-physical systems," in Proc. 14th IEEE Annu. Consum. Commun. Netw. Conf. (CCNC), Jan. 2017, pp. 313-318.
82. J. Lin, W. Yu, N. Zhang, X. Yang, H. Zhang, and W. Zhao, "A survey on Internet of things: Architecture, enabling technologies, security and privacy, and applications," IEEE Internet Things J., vol. 4, no. 5, pp. 1125-1142, Oct. 2017.
83. M. Lopez-Martin, B. Carro, A. Sanchez-Esguevillas, and J. Lloret, "Network traffic classifier with convolutional and recurrent neural networks for Internet of Things," IEEE Access, vol. 5, pp. 18042-18050, 2017.
84. D. Luo, H. Wu, and J. Huang, "Audio recapture detection using deep learning," in Proc. IEEE China Summit Int. Conf. Signal Inf. Process. (ChinaSIP), Jul. 2015, pp. 478-482.
85. X. Luo, Y. Lv, M. Zhou, W. Wang, and W. Zhao, "A laguerre neural network-based ADP learning scheme with its application to tracking control in the Internet of Things," Pers. Ubiquitous Comput., vol. 20, no. 3, pp. 361-372, 2016.
86. C. Ma et al. (May 2017). "DeepRT: Deep learning for peptide retention time prediction in proteomics." [Online]. Available: https://arxiv.org/abs/1705.05368
87. L. Ma, Z. Chen, L. Xu, and Y. Yan, "Multimodal deep learning for solar radio burst classification," Pattern Recognit., vol. 61, pp. 573-582, Jan. 2017.
88. J. Mahler et al., (Mar. 2017). "Dex-Net 2.0: Deep learning to plan robust grasps with synthetic point clouds and analytic grasp metrics." [Online]. Available: https://arxiv.org/abs/1703.09312
89. M. S. Mahmud, H.Wang, E. E. Alam, and H. Fang, "A real time and noncontact multiparameter wearable device for health monitoring," in Proc. IEEE Global Commun. Conf. (GLOBECOM), Dec. 2016, pp. 1-6.
90. N. Majumder et al., "Deep learning-based document modeling for personality detection from text," IEEE Intell. Syst., vol. 32, no. 2, pp. 74-79, Mar. 2017.
91. S. Mallapuram, N. Ngwum, F. Yuan, C. Lu, and W. Yu, "Smart city: The state of the art, datasets, and evaluation platforms," in Proc. IEEE/ACIS 16th Int. Conf. Comput. Inf. Sci. (ICIS), May 2017, pp. 447-452.
92. D. Marquardt and S. Doclo, "Noise power spectral density estimation for binaural noise reduction exploiting direction of arrival estimates," in Proc. IEEE Workshop Appl. Signal Process. Audio Acoust. (WASPAA), Oct. 2017, pp. 234-238.
93. V. Mnih et al., "Human-level control through deep reinforcement learning," Nature, vol. 518, pp. 529-533, Feb. 2015.
94. D. C. Mocanu, E. Mocanu, P. H. Nguyen, M. Gibescu, and A. Liotta, "Big IoT data mining for real-time energy disaggregation in buildings," in Proc. IEEE Int. Conf. Syst., Man, (SMC), Oct. 2016, pp. 003765-003769.
95. M. Mohammadi, A. Al-Fuqaha, M. Guizani, and J. S. Oh, "Semisupervised deep reinforcement learning in support of iot and smart city services," IEEE Internet Things J., vol. 5, no. 2, pp. 624-635, Apr. 2017.
96. R. Morcel et al., "Minimalist design for accelerating convolutional neural networks for low-end FPGA platforms," in Proc. IEEE 25th Annu. Int. Symp. Field-Programm. Custom Comput. Mach. (FCCM), Apr. 2017, p. 196.
97. T. Naseer and W. Burgard, "Deep regression for monocular camera-based 6-DoF global localization in outdoor environments," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), Sep. 2017, pp. 1525-1530.
98. N. D. Nguyen, T. Nguyen, and S. Nahavandi, "System design perspective for human-level agents using deep reinforcement learning: A survey," IEEE Access, vol. 5, pp. 27091-27102, 2017.
99. M. Nielsen. (2017). Neural Networks and Deep Learning. [Online]. Available: http://neuralnetworksanddeeplearning.com/
100. A. Niimi, "Deep learning for credit card data analysis," in Proc. World Congr. Internet Secur. (WorldCIS), Oct. 2015, pp. 73-77.
101. S. Park, M. Sohn, H. Jin, and H. Lee, "Situation reasoning framework for the internet of things environments using deep learning results," in Proc. IEEE Int. Conf. Knowl. Eng. Appl. (ICKEA), Sep. 2016, pp. 133-138.
102. A. B. Patel, M. T. Nguyen, and R. Baraniuk, "A probabilistic framework for deep learning," in Advances in Neural Information Processing Systems, D. D. Lee, M. Sugiyama, U. V. Luxburg, I. Guyon, and R. Garnett, Eds. Red Hook, NY, USA: Curran Associates, 2016, pp. 2558-2566.
103. M. Paul. (2017). Multiclass and Multi-Label Classification. [Online]. Available: http://cmci.colorado.edu/classes/INFO-4604/ files/slides-7-multi.pdf
104. K. Pei, Y. Cao, J. Yang, and S. Jana. (May 2017). "DeepXplore: Automated whitebox testing of deep learning systems." [Online]. Available: https://arxiv.org/abs/1705.06640
105. P. Poirson, P. Ammirato, C. Y. Fu, W. Liu, J. Kosecka, and A. C. Berg, "Fast single shot detection and pose estimation," in Proc. 4th Int. Conf. 3D Vis. (3DV), Oct. 2016, pp. 676-684.
106. A. S. Polydoros, L. Nalpantidis, and V. Krüger, "Real-time deep learning of robotic manipulator inverse dynamics," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), Sep. 2015, pp. 3442-3448.
107. Y.-H. Qu, H. Yu, X.-J. Gong, J.-H. Xu, and H.-S. Lee, "On the prediction of DNA-binding proteins only from primary sequences: A deep learning approach," PLoS ONE, vol. 12, no. 12, p. e0188129, 2017.
108. A. Rajesh and M. Mantur, "Eyeball gesture controlled automatic wheelchair using deep learning," in Proc. IEEE Region 10 Humanitarian Technol. Conf. (R10-HTC), Dec. 2017, pp. 387-391.
109. D. Ramachandram and G.W. Taylor, "Deep multimodal learning: A survey on recent advances and trends," IEEE Signal Process. Mag., vol. 34, no. 6, pp. 96-108, Nov. 2017.
110. D. Raví, C. Wong, B. Lo, and G.-Z. Yang, "A deep learning approach to on-node sensor data analytics for mobile or wearable devices," IEEE J. Biomed. Health Informat., vol. 21, no. 1, pp. 56-64, Jan. 2017.
111. Y. P. Raykov, A. Boukouvalas, F. Baig, and M. A. Little, "What to do when K-Means clustering fails: A simple yet principled alternative algorithm," PLoS ONE, vol. 11, no. 9, p. e0162259, 2016.
112. T. N. Sainath et al., "Multichannel signal processing with deep neural networks for automatic speech recognition," IEEE/ACM Trans. Audio, Speech, Language Process., vol. 25, no. 5, pp. 965-979, May 2017.
113. Y. Saito, S. Takamichi, and H. Saruwatari, "Statistical parametric speech synthesis incorporating generative adversarial networks," IEEE/ACM Trans. Audio, Speech, Language Process., vol. 26, no. 1, pp. 84-96, Jan. 2018.
114. K. T. Schütt, H. E. Sauceda, P.-J. Kindermans, A. Tkatchenko, and K.-R. Müller, "SchNet - A deep learning architecture for molecules and materials," J. Chem. Phys., vol. 148, no. 24, p. 241722, 2018.
115. E. Senft, P. Baxter, J. Kennedy, S. Lemaignan, and T. Belpaeme, "Supervised autonomy for online learning in human-robot interaction," Pattern Recognit. Lett., vol. 99, pp. 77-86, Nov. 2017.
116. A. Severyn and A. Moschitti, "Learning to rank short text pairs with convolutional deep neural networks," in Proc. 38th Int. ACM SIGIR Conf. Res. Develop. Inf. Retr. (SIGIR), New York, NY, USA, 2015, pp. 373-382.
117. Z. Shao, L. Zhang, and L. Wang, "Stacked sparse autoencoder modeling using the synergy of airborne LiDAR and satellite optical and sar data to map forest above-ground biomass," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 10, no. 12, pp. 5569-5582, Dec. 2017.
118. R. V. Sharan and T. J. Moir, "Robust acoustic event classification using deep neural networks," Inf. Sci., vol. 396, pp. 24-32, Aug. 2017.
119. S. Shi, Q. Wang, P. Xu, and X. Chu. (Aug. 2016). "Benchmarking state-of-the-art deep learning software tools." [Online]. Availble: https://arxiv.org/abs/1608.07249
120. W. Shi, J. Cao, Q. Zhang, Y. Li, and L. Xu, "Edge computing: Vision and challenges," IEEE Internet Things J., vol. 3, no. 5, pp. 637-646, Oct. 2016.
121. N. S. Keskar, D. Mudigere, J. Nocedal, M. Smelyanskiy, and P. T. P. Tang. (Sep. 2016). "On large-batch training for deep learning: Generalization gap and sharp minima." [Online]. Available: https://arxiv.org/abs/1609.04836
122. D. Silver et al., "Mastering the game of Go with deep neural networks and tree search," Nature, vol. 529, pp. 484-489, Jan. 2016.
123. D. Silver et al., "Mastering the game of go without human knowledge," Nature, vol. 550, pp. 354-359, Oct. 2017.
124. K. G. Srinivasa, S. Anupindi, R. Sharath, and S. K. Chaitanya, "Analysis of facial expressiveness captured in reaction to videos," in Proc. IEEE 7th Int. Adv. Comput. Conf. (IACC), Jan. 2017, pp. 664-670.
125. J. A. Stankovic, "Research directions for the Internet of Things," IEEE Internet Things J., vol. 1, no. 1, pp. 3-9, Feb. 2014.
126. B. Su, X. Ding, H. Wang, and Y. Wu, "Discriminative dimensionality reduction for multi-dimensional sequences," IEEE Trans. Pattern Anal. Mach. Intell., vol. 40, no. 1, pp. 77-91, Jan. 2018.
127. Y. Sun, H. Song, A. J. Jara, and R. Bie, "Internet of Things and big data analytics for smart and connected communities," IEEE Access, vol. 4, pp. 766-773, 2016.
128. J. Tang, D. Sun, S. Liu, and J. L. Gaudiot, "Enabling deep learning on iot devices," Computer, vol. 50, no. 10, pp. 92-96, 2017.
129. P. Thammasorn, L.Wootton, E. Ford, and M. Nyflot, "Deep convolutional triplet network for quantitative medical image analysis with comparative case study of gamma image classification," in Proc. IEEE Int. Conf. Bioinformat. Biomed. (BIBM), Nov. 2017, pp. 1119-1122.
130. R. T. Schirrmeister, L. Gemein, K. Eggensperger, F. Hutter, and T. Ball. (Aug. 2017). "Deep learning with convolutional neural networks for decoding and visualization of EEG pathology." [Online]. Available: https://arxiv.org/abs/1708.08012
131. ujjwalkarn. (2016). An Intuitive Explanation of Convolutional Neural Networks. [Online].Available: https://ujjwalkarn.me/2016/08/11/intuitiveexplanation- convnets/
132. S. O. Uwagbole, W. J. Buchanan, and L. Fan, "Numerical encoding to tame SQL injection attacks," in Proc. IEEE/IFIP Netw. Operat. Manage. Symp. (NOMS), Apr. 2016, pp. 1253-1256.
133. V. Gulshan et al., "Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs," J. Amer. Med. Assoc., vol. 316, no. 22, pp. 2402-2410, 2016.
134. S. Valipour, M. Siam, E. Stroulia, and M. Jagersand, "Parking-stall vacancy indicator system, based on deep convolutional neural networks," in Proc. IEEE 3rd World Forum Internet Things (WF-IoT), Dec. 2016, pp. 655-660.
135. B. Wang, P. Yin, A. L. Bertozzi, P. J. Brantingham, S. J. Osher, and J. Xin. (Nov. 2017). "Deep learning for real-time crime forecasting and its ternarization." [Online]. Available: https://arxiv.org/abs/1711.08833
136. D.Wang, A. Khosla, R. Gargeya, H. Irshad, and A. H. Beck. (Jun. 2016). "Deep learning for identifying metastatic breast cancer." [Online]. Available: https://arxiv.org/abs/1606.05718
137. J. Wang, Q. Gu, J. Wu, G. Liu, and Z. Xiong, "Traffic speed prediction and congestion source exploration: A deep learning method," in Proc. IEEE 16th Int. Conf. Data Mining (ICDM), Dec. 2016, pp. 499-508.
138. Q. Wang, Y. Zheng, G. Yang, W. Jin, X. Chen, and Y. Yin, "Multiscale rotation-invariant convolutional neural networks for lung texture classification," IEEE J. Biomed. Health Informat., vol. 22, no. 1, pp. 184-195, Jan. 2018.
139. S.Wang, Y. Shang, J.Wang, L. Mei, and C. Hu, "Deep features for person re-identification," in Proc. 11th Int. Conf. Semantics, Knowl. Grids (SKG), Aug. 2015, pp. 244-247.
140. Y. Wang, H. Li, and X. Li, "Re-architecting the on-chip memory subsystem of machine-learning accelerator for embedded devices," in Proc. 35th Int. Conf. Comput.-Aided Design (ICCAD), New York, NY, USA, 2016, pp. 13:1-13:6.
141. Y. Wang, B. Song, P. Zhang, N. Xin, and G. Cao, "A fast feature fusion algorithm in image classification for cyber physical systems," IEEE Access, vol. 5, pp. 9089-9098, 2017.
142. C. Wu, H. P. Cheng, S. Li, H. Li, and Y. Chen, "ApesNet: A pixel-wise efficient segmentation network for embedded devices," IET Cyber-Phys. Syst., Theory Appl., vol. 1, no. 1, pp. 78-85, 2016.
143. J. Wu and W. Zhao, "Design and realization of WInternet: From net of things to Internet of Things," ACM Trans. Cyber-Phys. Syst., vol. 1, no. 1, pp. 2:1-2:12, Nov. 2016.
144. H. Xu, J. Lin, and W. Yu, Smart Transportation Systems: Architec- ture, Enabling Technologies, and Open Issues. Singapore: Springer, 2017, pp. 23-49.
145. Y. Xu, X. Luo, W. Wang, and W. Zhao, "Efficient DV-HOP localization for wireless cyber-physical social sensing system: A correntropy-based neural network learning scheme," Sensors, vol. 17, no. 1, p. 135, 2017.
146. P. C. Yang, K. Sasaki, K. Suzuki, K. Kase, S. Sugano, and T. Ogata, "Repeatable folding task by humanoid robot worker using deep learning," IEEE Robot. Autom. Lett., vol. 2, no. 2, pp. 397-403, Apr. 2017.
147. Q. Yang, D. An, R. Min, W. Yu, X. Yang, and W. Zhao, "On optimal PMU placement-based defense against data integrity attacks in smart grid," IEEE Trans. Forensics Inf. Security, vol. 12, no. 7, pp. 1735-1750, Jul. 2017.
148. X. Yang, X. Ren, J. Lin, and W. Yu, "On binary decomposition based privacy-preserving aggregation schemes in real-time monitoring systems," IEEE Trans. Parallel Distrib. Syst., vol. 27, no. 10, pp. 2967-2983, Oct. 2016.
149. X. Yang, T.Wang, X. Ren, andW. Yu, "Survey on improving data utility in differentially private sequential data publishing," IEEE Trans. Big Data, to be published, doi: 10.1109/TBDATA.2017.2715334.
150. X. Yang, P. Zhao, X. Zhang, J. Lin, and W. Yu, "Toward a gaussianmixture model-based detection scheme against data integrity attacks in the smart grid," IEEE Internet Things J., vol. 4, no. 1, pp. 147-161, Feb. 2017.
151. Y. Yang, L. Wu, G. Yin, L. Li, and H. Zhao, "A survey on security and privacy issues in Internet-of-Things," IEEE Internet Things J., vol. 4, no. 5, pp. 1250-1258, Oct. 2017.
152. C. Yeshwanth, P. S. A. Sooraj, V. Sudhakaran, and V. Raveendran, "Estimation of intersection traffic density on decentralized architectures with deep networks," in Proc. Int. Smart Cities Conf. (ISC2), Sep. 2017, pp. 1-6.
153. W. Yu, D. An, D. Griffith, Q. Yang, and G. Xu, "Towards statistical modeling and machine learning based energy usage forecasting in smart grid," SIGAPP Appl. Comput. Rev., vol. 15, no. 1, pp. 6-16, Mar. 2015.
154. W. Yu, L. Ge, G. Xu, and X. Fu, "Towards neural network based malware detection on Android mobile devices," Cybersecurity Systems for Human Cognition Augmentation (Advances in Information Security), vol. 61, R. Pino, A. Kott, and M. Shevenell, Eds. Cham, Switzerland: Springer, 2014.
155. W. Yu et al., "A survey on the edge computing for the Internet of Things," IEEE Access, vol. 6, pp. 6900-6919, 2017.
156. W. Yu, G. Xu, Z. Chen, and P. Moulema, "A cloud computing based architecture for cyber security situation awareness," in Proc. IEEE Conf. Commun. Netw. Secur. (CNS), Oct. 2013, pp. 488-492.
157. W. Yu, H. Xu, H. Zhang, D. Griffith, and N. Golmie, "Ultra-dense networks: Survey of state of the art and future directions," in Proc. 25th Int. Conf. Comput. Commun. Netw. (ICCCN), Aug. 2016, pp. 1-10.
158. W. Yu, H. Zhang, L. Ge, and R. Hardy, "On behavior-based detection of malware on android platform," in Proc. IEEE Global Commun. Conf. (GLOBECOM), Dec. 2013, pp. 814-819.
159. X. Yuan, P. He, Q. Zhu, R. R. Bhat, and X. Li. (Dec. 2017). "Adversarial examples: Attacks and defenses for deep learning." [Online]. Available: https://arxiv.org/abs/1712.07107
160. Y. Yuan and K. Jia, "A distributed anomaly detection method of operation energy consumption using smart meter data," in Proc. Int. Conf. Intell. Inf. Hiding Multimedia Signal Process. (IIH-MSP), Sep. 2015, pp. 310-313.
161. A. Zanella, N. Bui, A. Castellani, L. Vangelista, and M. Zorzi, "Internet of Things for smart cities," IEEE Internet Things J., vol. 1, no. 1, pp. 22-32, Feb. 2014.
162. X. Zhang, X. Li, J. An, L. Gao, B. Hou, and C. Li, "Natural language description of remote sensing images based on deep learning," in Proc. IEEE Int. Geosci. Remote Sens. Symp. (IGARSS), Jul. 2017, pp. 4798-4801.
163. X. Zhang, X. Pan, and S.Wang, "Fuzzy DBN with rule-based knowledge representation and high interpretability," in Proc. 12th Int. Conf. Intell. Syst. Knowl. Eng. (ISKE), Nov. 2017, pp. 1-7.
164. X. L. Zhang, "Speech separation by cost-sensitive deep learning," in Proc. Asia-Pacific Signal Inf. Process. Assoc. Annu. Summit Conf. (APSIPA ASC), Dec. 2017, pp. 159-162.
165. P. Zhao, W. Yu, D. Quan, and X. Yang, "Deep learning-based detection scheme with raw ECG signal for wearable telehealth systems," Dept. Comput. Inf. Sci., Towson Univ., Towson, MD, USA, Tech. Rep. 2018-CS-021, Mar. 2018.
166. Y. Zhao, J. Li, and L. Yu, "A deep learning ensemble approach for crude oil price forecasting," Energy Econ., vol. 66, p. 9-16, Aug. 2017.
167. Z. Zhao, J. Guo, E. Ding, Z. Zhu, and D. Zhao, "Terminal replacement prediction based on deep belief networks," in Proc. Int. Conf. Netw. Inf. Syst. Comput., Jan. 2015, pp. 255-258.
168. D. Zhu, H. Jin, Y. Yang, D.Wu, andW. Chen, "DeepFlow: Deep learningbased malware detection by mining Android application for abnormal usage of sensitive data," in Proc. IEEE Symp. Comput. Commun. (ISCC), Jul. 2017, pp. 438-443.
169. J. Zhu, Y. Song, D. Jiang, and H. Song, "A new deep-Q-learning-based transmission scheduling mechanism for the cognitive Internet of Things," IEEE Internet Things J., to be published, doi: 10.1109/JIOT.2017.2759728.
170. M. Zolotukhin, T. Hämäläinen, T. Kokkonen, and J. Siltanen, "Increasing web service availability by detecting application-layer DDoS attacks in encrypted traffic," in Proc. 23rd Int. Conf. Telecommun. (ICT), May 2016, pp. 1-6.