Very deep multilingual convolutional neural networks for LVCSR

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 2016-May, Issue , 2016, Pages 4955-4959

  Sercu, Tom ^a,b   Puhrsch, Christian ^a   Kingsbury, Brian ^b   Lecun, Yann ^a  

^a NEW YORK UNIVERSITY   (United States)

^b IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Acoustic Modeling; Convolutional Networks; Multilingual; Neural Networks; Speech Recognition

Indexed keywords

EID: 84973324686     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2016.7472620     Document Type: Conference Paper

References (31)

1. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradientbased learning applied to document recognition, " Proc. of the IEEE, vol. 86, no. 11, pp. 2278-2324, 1998.
2. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks, " in Proc. NIPS, 2012, pp. 1097-1105.
3. K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition, " Proc. ICLR, 2015.
4. P. Sermanet, K. Kavukcuoglu, S. Chintala, and Y. LeCun, "Pedestrian detection with unsupervised multi-stage feature learning, " in Proc. CVPR, 2013, pp. 3626-3633.
5. R. Girshick, J. Donahue, T. Darrell, and J. Malik, "Rich feature hierarchies for accurate object detection and semantic segmentation, " in Proc. CVPR, 2014, pp. 580-587.
6. P. Sermanet, D. Eigen, X. Zhang, M. Mathieu, R. Fergus, and Y. LeCun, "Overfeat: Integrated recognition, localization and detection using convolutional networks, " Proc. ICLR, 2014.
7. C. Farabet, C. Couprie, L. Najman, and Y. LeCun, "Learning hierarchical features for scene labeling, " IEEE Trans. on Pattern Analysis and Machine Intelligence, 2013.
8. A. Waibel, T. Hanazawa, G. Hinton, K. Shikano, and K. J. Lang, "Phoneme recognition using time-delay neural networks, " IEEE Trans. on Acoustics, Speech and Signal Processing, vol. 37, no. 3, 1989.
9. L. Bottou, F. F. Soulié, P. Blanchet, and J. S. Liénard, "Experiments with time delay networks and dynamic time warping for speaker independent isolated digits recognition, " in Proc. Eurospeech, 1989.
10. L. Bottou, F. F. Soulié, P. Blanchet, and J. S. Liénard, "Speaker-independent isolated digit recognition: multilayer perceptrons vs. dynamic time warping, " Neural Networks, vol. 3, no. 4, pp. 453-465, 1990.
11. Y. Bengio, R. De Mori, G. Flammia, and R. Kompe, "Global optimization of a neural network-hidden Markov model hybrid, " IEEE Trans. on Neural Networks, vol. 3, no. 2, pp. 252-259, 1992.
12. F. Seide, G. Li, and D. Yu, "Conversational speech transcription using context-dependent deep neural networks., " in Proc. Interspeech, 2011, pp. 437-440.
13. A.-r. Mohamed, T. N Sainath, G. Dahl, B. Ramabhadran, G. E Hinton, and Michael A P., "Deep belief networks using discriminative features for phone recognition, " in Proc. ICASSP. IEEE, 2011, pp. 5060-5063.
14. Brian Kingsbury, "Lattice-based optimization of sequence classification criteria for neural-network acoustic modeling, " in Proc. ICASSP. IEEE, 2009, pp. 3761-3764.
15. O. Abdel-Hamid, A.-r. Mohamed, H. Jiang, and G. Penn, "Applying convolutional neural networks concepts to hybrid NNHMM model for speech recognition, " in Proc. ICASSP, 2012, pp. 4277-4280.
16. T. N. Sainath, A.-r. Mohamed, B. Kingsbury, and B. Ramabhadran, "Deep convolutional neural networks for lvcsr, " in Proc. ICASSP, 2013.
17. H. Soltau, G. Saon, and T. N. Sainath, "Joint training of convolutional and non-convolutional neural networks, " Proc. ICASSP, 2014.
18. G. Saon, H.-K. Kuo, S. Rennie, and M. Picheny, "The IBM 2015 english conversational telephone speech recognition system, " Proc. Interspeech, 2015.
19. M. Bi, Y. Qian, and K. Yu, "Very deep convolutional neural networks for LVCSR, " in Proc. Interspeech, 2015.
20. S. Scanzio, P. Laface, L. Fissore, R. Gemello, and F. Mana, "On the use of a multilingual neural network front-end, " in Proc. Interspeech, 2008.
21. S. Thomas, S. Ganapathy, and H. Hermansky, "Multilingual MLP features for low-resource LVCSR systems, " in Proc. ICASSP, 2012.
22. Z. Tüske, J. Pinto, D. Willett, and R. Schlüter, "Investigation on cross-and multilingual MLP features under matched and mismatched acoustical conditions, " in Proc. ICASSP, 2013.
23. K. M. Knill, M. J. F. Gales, S. P. Rath, P. C. Woodland, C. Zhang, and S.-X. Zhang, "Investigation of multilingual deep neural networks for spoken term detection, " in Proc. ASRU, 2013.
24. P. Sermanet and Y. LeCun, "Traffic sign recognition with multi-scale convolutional networks, " in Neural Networks (IJCNN), The 2011 International Joint Conference on. IEEE, 2011, pp. 2809-2813.
25. J. Long, E. Shelhamer, and T. Darrell, "Fully convolutional networks for semantic segmentation, " CVPR, 2015.
26. D. Eigen, C. Puhrsch, and R. Fergus, "Depth map prediction from a single image using a multi-scale deep network, " in Proc. NIPS, 2014, pp. 2366-2374.
27. F. Grezl, M. Karafiát, and L. Burget, "Investigation into bottleneck features for meeting speech recognition., " in Proc. Interspeech, 2009, pp. 2947-2950.
28. T. N Sainath, O. Vinyals, A. Senior, and H. Sak, "Convolutional, long short-term memory, fully connected deep neural networks, " Proc. ICASSP, 2015.
29. M. D. Zeiler, "ADADELTA: An adaptive learning rate method, " Technical Report, arXiv: 1212. 5701, 2012.
30. D. Kingma and J. Ba, "Adam: A method for stochastic optimization, " in Proc. International Conference on Learning Representations (ICLR), 2015.
31. X. Glorot and Y. Bengio, "Understanding the difficulty of training deep feedforward neural networks, " in Proc. AISTATS, 2010, pp. 249-256.