An analysis of convolutional neural networks for speech recognition

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 2015-August, Issue , 2015, Pages 4989-4993

  Huang, Jui Ting ^a   Li, Jinyu ^a   Gong, Yifan ^a  

^a MICROSOFT   (United States)

Author keywords

Convolutional neural networks; DNN; low footprint models; maxout units

Indexed keywords

AUDIO SIGNAL PROCESSING; CONVOLUTION; DEEP NEURAL NETWORKS; NEURAL NETWORKS; SPEECH; SPEECH COMMUNICATION;

CONVOLUTIONAL NEURAL NETWORK; DISTANT SPEECH RECOGNITION; EDGE DETECTORS; MAXOUT UNITS; NOISE ROBUSTNESS; SMALL FOOTPRINTS; TEST CONDITION; WORD ERROR RATE REDUCTIONS;

SPEECH RECOGNITION;

EID: 84946086402     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2015.7178920     Document Type: Conference Paper

References (24)

1. D. Yu, L. Deng, and G. Dahl, "Roles of pretraining and fine-tuning in context-dependent DBN-HMMs for realworld speech recognition," in Proc. NIPS Workshop on Deep Learning and Unsupervised Feature Learning, 2010.
2. T. N. Sainath, B. Kingsbury, B. Ramabhadran, P. Fousek, P. Novak, and A. Mohamed, "Making deep belief networks effective for large vocabulary continuous speech recognition," in Proc. Workshop on Automatic Speech Recognition and Understanding, pp. 30-35, 2011.
3. G. E. Dahl, D. Yu, L. Deng, and A. Acero, "Contextdependent pre-trained deep neural networks for largevocabulary speech recognition," IEEE Trans. on Audio, Speech and Language Processing, vol. 20, no. 1, pp. 30-42, 2012.
4. G. Hinton, L. Deng, D. Yu, G. Dahl, A. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. Sainath, and B. Kingsbury, "Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups," IEEE Signal Processing Magazine, vol. 29, no. 6, pp. 82-97, 2012.
5. L. Deng, J. Li, J.-T. Huang et al. "Recent advances in deep learning for speech research at Microsoft," in Proc. ICASSP, 2013.
6. O. Abdel-Hamid, A. Mohamed, H. Jiang, L. Deng, G. Penn, D. Yu, "Convolutional neural networks for speech recognition," IEEE Transactions on Audio, Speech, and Language Processing, vol.22, no.1, pp.1533-1545, 2014.
7. T.N. Sainath, A. Mohamed, B. Kingsbury, and B. Ramabhadran, "Deep convolutional neural networks for LVCSR," in Proc IEEE ICASSP, 2013.
8. T.N. Sainath, B. Kingsbury, A. Mohamed, G.E. Dahl, G. Saon, H. Soltau, T. Beran, A.Y. Aravkin, and B. Ramabhadran, "Improvements to deep convolutional neural networks for LVCSR," in Proc IEEE ASRU, 2013.
9. Y. Miao and F. Metze, "Improving language-universal feature extraction with deep maxout and convolutional neural networks," in Proc. Interspeech, 2014.
10. P Swietojanski, A Ghoshal, and S Renals, "Convolutional neural networks for distant speech recognition," IEEE Signal Process. Letters, 2014
11. D. Yu, M. Seltzer, J. Li, J-T. Huang, F. Seide, "Feature learning in deep neural networks-studies on speech recognition tasks", ICLR 2013.
12. H. Soltau, H-K. Kuo, L. Mangu, G. Saon, T. Beran, "Neural network acoustic models for the DARPA RATS program," in Proc. Interspeech, 2013.
13. I. Goodfellow, H. Lee, Q. Le, A. Saxe, A. Ng, "Measuring invariances in deep networks," in Proc. NIPS, 2009.
14. X. Lei, A. Senior, A., A. Gruenstein, and J. Sorensen, "Accurate and compact large vocabulary speech recognition on mobile devices," in Proc. Interspeech, 2013.
15. I. J. Goodfellow, D. Warde-Farley, M. Mirza, A. Courville, and Y. Bengio, "Maxout networks," in Proc. ICML, 2013.
16. M.D. Zeiler, M. Ranzato, R. Monga, M. Mao, K. Yang, Q.V. Le, P. Nguyen, A. Senior, V. Vanhoucke, J. Dean, et al., "On rectified linear units for speech processing," in Proc. ICASSP, 2013.
17. P. Swietojanski, J. Li, and J.-T. Huang, "Investigation of maxout networks for speech recognition," in Proc. ICASSP, 2014
18. T. Ezzat, J. Bouvrie, and T. Poggio, "Spectro-temporal analysis of speech using 2-d Gabor filters," in Proc. Interspeech, 2007.
19. S.-Y. Chang and N. Morgan, "Robust CNN-based speech recognition with Gabor filter kernels," in Proc. Interspeech, 2014.
20. N. Parihar and J. Picone, "Aurora working group: DSR front end LVCSR evaluation AU/384/02," Tech. Rep., Institute for Signal and Information Processing, Mississippi State Univ., 2002.
21. K. Kumatani, T. Arakawa, K. Yamamoto, J. McDonough, B. Raj, R. Singh, and I. Tashev, "Microphone array processing for distant speech recognition: towards realworld deployment," APSIPA Annual Summit and Conference, 2012
22. J. Li, R. Zhao, J.-T. Huang, and Y. Gong, "Learning small-size DNN with output-distribution-based criteria," in Proc. Interspeech, 2014.
23. L. Toth, "Convolutional deep maxout networks for phone recognition," in Proc. Interspeech, 2014.
24. H. Sak, A. Senior, and F. Beaufays, "Long short-term memory recurrent neural network architectures for large scale acoustic modeling," in Interspeech, 2014, pp. 338-342.