Improvements to deep convolutional neural networks for LVCSR

2013 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2013 - Proceedings

Volumn , Issue , 2013, Pages 315-320

  Sainath, Tara N ^a   Kingsbury, Brian ^a   Mohamed, Abdel Rahman ^b   Dahl, George E ^b   Saon, George ^a   Soltau, Hagen ^a   Beran, Tomas ^a   Aravkin, Aleksandr Y ^a   Ramabhadran, Bhuvana ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

^b UNIVERSITY OF TORONTO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

BROADCAST NEWS; CONVOLUTIONAL NEURAL NETWORK; DEEP NEURAL NETWORKS; SPEAKER ADAPTATION; SPECTRAL VARIATION; WORD ERROR RATE;

NEURAL NETWORKS;

SPEECH RECOGNITION;

EID: 84893654379     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ASRU.2013.6707749     Document Type: Conference Paper

References (18)

1. G. Hinton, L. Deng, D. Yu, G. Dahl, A. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. N. Sainath, and B. Kingsbury, "Deep Neural Networks for Acoustic Modeling in Speech Recognition, " IEEE Signal Processing Magazine, vol. 29, no. 6, pp. 82-97, 2012.
2. Y. LeCun and Y. Bengio, "Convolutional Networks for Images, Speech, and Time-series, " in The Handbook of Brain Theory and Neural Networks. MIT Press, 1995.
3. O. Abdel-Hamid, A. Mohamed, H. Jiang, and G. Penn, "Applying Convolutional Neural Network Concepts to Hybrid NN-HMM Model for Speech Recognition, " in Proc. ICASSP, 2012.
4. T.N. Sainath, A. Mohamed, B. Kingsbury, and B. Ramabhadran, "Deep Convolutional Neural Networks for LVCSR, " in Proc. ICASSP, 2013.
5. L. Deng, O. Abdel-Hamid, and D. Yu, "A Deep Convolutional Neural Network using Heterogeneous Pooling for Trading Acoustic Invariance with Phonetic Confusion, " in Proc. ICASSP, 2013.
6. P. Sermanet, S. Chintala, and Y. LeCun, "Convolutional neural networks applied to house numbers digit classification, " in Pattern Recognition (ICPR), 2012 21st International Conference on, 2012.
7. M. Zeiler and R. Fergus, "Stochastic Pooling for Regularization of Deep Convolutional Neural Networks, " in Proc. of the International Conference on Representaiton Learning (ICLR), 2013.
8. A. Krizhevsky, I. Sutskever, and G. Hinton, "Imagenet Classification with Deep Convolutional Neural Networks, " in Advances in Neural Information Processing Systems, 2012.
9. Y. LeCun, F. Huang, and L. Bottou, "Learning Methods for Generic Object Recognition with Invariance to Pose and Lighting, " in Proc. CVPR, 2004.
10. M.J.F. Gales, "Maximum likelihood linear transformations for HMMbased Speech Recognition, " Computer Speech and Language, vol. 12, no. 2, pp. 75-98, 1998. (Pubitemid 128383747)
11. B. Kingsbury, T. N. Sainath, and H. Soltau, "Scalable Minimum Bayes Risk Training of Deep Neural Network Acoustic Models Using Distributed Hessian-free Optimization, " in Proc. Interspeech, 2012.
12. G.E. Dahl, T.N. Sainath, and G.E. Hinton, "Improving Deep Neural Networks for LVCSR Using Rectified Linear Units and Dropout, " in Proc. ICASSP, 2013.
13. A. Waibel, T. Hanazawa, G. Hinton, K. Shikano, and K.J Lang, "Phoneme Recognition using Time-delay Neural Networks, " IEEE Transactions on Acoustics, Speech and Signal Processing, vol. 37, no. 3, pp. 328-339, 1989. (Pubitemid 19065785)
14. M.J.F. Gales, "Semi-tied Covariance Matrices for Hidden Markov Models, " IEEE Transactions on Speech and Audio Processing, vol. 7, pp. 272-281, 1999.
15. B. Kingsbury, "Lattice-Based Optimization of Sequence Classification Criteria for Neural-Network Acoustic Modeling, " in Proc. ICASSP, 2009.
16. G.E. Hinton, N. Srivastava, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, "Improving Neural Networks by Preventing Co- Adaptation of Feature Detectors, " The Computing Research Repository (CoRR), vol. 1207.0580, 2012.
17. J. Martens, "Deep learning via Hessian-free optimization, " in Proc. Intl. Conf. on Machine Learning (ICML), 2010.
18. T. N. Sainath, B. Kingsbury, and B. Ramabhadran, "Auto-Encoder Bottleneck Features Using Deep Belief Networks, " in Proc. ICASSP, 2012.