Spark based distributed Deep Learning framework for Big Data applications

2016 International Conference on Information Science and Communications Technologies, ICISCT 2016

Volumn , Issue , 2016, Pages

  Khumoyun, Akhmedov ^a   Cui, Yun ^a   Hanku, Lee ^a  

^a Konkuk University   (South Korea)

Author keywords

Big Data; Deep Learning; Distributed Computing; HDFS; Spark

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPLEX NETWORKS; COMPUTER PROGRAMMING; DATA HANDLING; DISTRIBUTED COMPUTER SYSTEMS; ELECTRIC SPARKS; INFORMATION SCIENCE; SEMANTICS; STOCHASTIC MODELS; STOCHASTIC SYSTEMS;

BIG DATA APPLICATIONS; DATA CLASSIFICATION; DEEP LEARNING; DEEP NEURAL NETWORKS; HDFS; LARGE-SCALE DATA PROCESSING; SOFTWARE FRAMEWORKS; STOCHASTIC GRADIENT DESCENT;

BIG DATA;

EID: 85010521555     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICISCT.2016.7777390     Document Type: Conference Paper

References (12)

1. G. Dahl, D. Yu, L. Deng, and A. Acero. Context-dependent pre-trained deep neural networks for large vocabulary speech recognition. IEEE Transactions on Audio, Speech, and Language Processing, 2012.
2. D. C. Ciresan, U. Meier, L. M. Gambardella, and I. Schmidhuber. Deep big simple neural nets excel on handwritten digit recognition. CoRR, 2010.
3. A. Coates, H. Lee, and A. Y. Ng.: "An analysis of single-layer networks in unsupervised feature learning". AlSTATS 14,2011
4. Y. Bengio, R. Ducharme, P. Vincent, and C. Jauvin: "A neural probabilistic language model." Journal of Machine Learning Research, 3:1137-1155,2003.
5. Jeffrey Dean, Greg S. Corrado, Raj at Monga, Kai Chen, Matthieu Devin, Quoc V. Le, Mark Z. Mao, Marc'Aurelio Ranzato, Andrew Y. Ng: Large Scale Distributed Deep Networks. NIPS, 2012.
6. Philipp Moritz, Robert Nishihara, Ion Stoica, Michael I. Jordan.: "SparkkNet: Training Deep Networks in Spark", 2015.
7. D. Gillick, A. Faria, and I. DeNero: "Mapreduce: Distributed computing for machine learning," Berkley (December 18, 2006), 2006.
8. A. Ghoting, R. Krishnamurthy, E. Pednault, B. Reinwald, V. Sindhwani, S. Tatikonda, Y. Tian, and S. Vaithyanathan, "Systemml: Declarative machine learning on mapreduce," in Data Engineering (lCDE), 2011 IEEE 27th International Conference on. IEEE, 2011, pp. 231-242.
9. Apache Spark. Available: http://spark.apache.org/
10. National Research Council. Frontiers in Massive Data Analysis. The National Academies Press, Washington, DC; 2013.
11. W. Yang, J. Boyd-Graber, P. Resnik, "A Discriminative Topic Model using Document Network Structure", Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, pages 686-696, Berlin, Germany, August 7-12, 2016.
12. Vishal A. Kharde, S.S. Sonawane, "Sentiment Analysis of Twitter Data: A Survey of Techniques", International Journal of Computer Applications (0975 - 8887) Volume 139 -No.11, April 2016.