Very deep convolutional neural networks for LVCSR

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn 2015-January, Issue , 2015, Pages 3259-3263

  Bi, Mengxiao ^a   Qian, Yanmin ^a   Yu, Kai ^a  

^a SHANGHAI JIAO TONG UNIVERSITY   (China)

Author keywords

Acoustic model; CNNs; Neural networks; Speech recognition; Very deep convolutional networks

Indexed keywords

CONTINUOUS SPEECH RECOGNITION; CONVOLUTION; EMBEDDED SYSTEMS; IMAGE CLASSIFICATION; NEURAL NETWORKS; SPEECH; SPEECH COMMUNICATION;

ACOUSTIC MODEL; CNNS; CONVOLUTIONAL NETWORKS; CONVOLUTIONAL NEURAL NETWORK; LARGE VOCABULARY CONTINUOUS SPEECH RECOGNITION; LOCAL CORRELATIONS; STATE-OF-THE-ART PERFORMANCE; TEMPORAL DIMENSIONS;

SPEECH RECOGNITION;

EID: 84959133563     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. F. Seide, G. Li, and D. Yu, "Conversational speech transcription using context-dependent deep neural networks, " in Interspeech 2011. International Speech Communication Association, August 2011.
2. G. Hinton, L. Deng, D. Yu, G. Dahl, A. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. Sainath, and B. Kingsbury, "Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups, " Signal Processing Magazine, IEEE, vol. 29, no. 6, pp. 82-97, Nov 2012.
3. G. Dahl, D. Yu, L. Deng, and A. Acero, "Context-dependent pretrained deep neural networks for large vocabulary speech recognition, " IEEE Transactions on Audio, Speech, and Language Processing (receiving 2013 IEEE SPS Best Paper Award), vol. 20, no. 1, pp. 30-42, January 2012.
4. Y. LeCun and Y. Bengio, "Convolutional Networks for Images, Speech, and Time-Series, " 1995.
5. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition, " Proceedings of the IEEE, vol. 86, no. 11, pp. 2278-2324, 1998.
6. O. Abdel-Hamid, A. Mohamed, H. Jiang, and G. Penn, "Applying convolutional neural networks concepts to hybrid nn-hmm model for speech recognition, " in Acoustics, Speech and Signal Processing (ICASSP), 2012 IEEE International Conference on, March 2012, pp. 4277-4280.
7. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks, " in Advances in neural information processing systems, 2012, pp. 1097-1105.
8. O. Abdel-Hamid, A.-R. Mohamed, H. Jiang, L. Deng, G. Penn, and D. Yu, "Convolutional neural networks for speech recognition, " Audio, Speech, and Language Processing, IEEE/ACM Transactions on, vol. 22, no. 10, pp. 1533-1545, Oct 2014.
9. T. Sainath, A.-R. Mohamed, B. Kingsbury, and B. Ramabhadran, "Deep convolutional neural networks for lvcsr, " in Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on, May 2013, pp. 8614-8618.
10. T. N. Sainath, B. Kingsbury, G. Saon, H. Soltau, A. rahman Mohamed, G. Dahl, and B. Ramabhadran, "Deep convolutional neural networks for large-scale speech tasks, " Neural Networks, vol. 64, no. 0, pp. 39-48, 2015, special Issue on Deep Learning of Representations.
11. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, "Going deeper with convolutions, " CoRR, vol. Abs/1409. 4842, 2014.
12. K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition, " CoRR, vol. Abs/1409. 1556, 2014.
13. M. D. Zeiler and R. Fergus, "Stochastic pooling for regularization of deep convolutional neural networks, " CoRR, vol. Abs/1301. 3557, 2013.
14. D. Povey, A. Ghoshal, G. Boulianne, L. Burget, O. Glembek, N. Goel, M. Hannemann, P. Motlicek, Y. Qian, P. Schwarz, J. Silovsky, G. Stemmer, and K. Vesely, "The kaldi speech recognition toolkit, " in IEEE 2011 Workshop on Automatic Speech Recognition and Understanding. IEEE Signal Processing Society, dec 2011, iEEE Catalog No. : CFP11SRW-USB.
15. Y. Miao, "Kaldi+pdnn: Building dnn-based ASR systems with kaldi and PDNN, " CoRR, vol. Abs/1401. 6984, 2014.