The IBM 2015 English conversational telephone speech recognition system

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn 2015-January, Issue , 2015, Pages 3141-3144

  Saon, George ^a   Kuo, Hong Kwang J ^a   Rennie, Steven ^a   Picheny, Michael ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Conversational speech recognition; Convolutional neural networks; Recurrent neural networks

Indexed keywords

CONVOLUTION; MODELING LANGUAGES; NEURAL NETWORKS; RECURRENT NEURAL NETWORKS; SPEECH; SPEECH COMMUNICATION; TELEPHONE SETS;

CONVERSATIONAL SPEECH RECOGNITION; CONVERSATIONAL TELEPHONE SPEECH RECOGNITION; CONVOLUTIONAL NEURAL NETWORK; EVALUATION TEST; JOINT MODELING; LANGUAGE MODEL; OUTPUT LAYER; WORD ERROR RATE;

SPEECH RECOGNITION;

EID: 84959129849     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. F. Seide, G. Li, X. Chien, and D. Yu, "Feature engineering in context-dependent deep neural networks for conversational speech transcription," in Proc. ASRU, 2011.
2. R. P. Lippmann, "Speech recognition by machines and humans," Speech communication, vol. 22, no. 1, pp. 1-15, 1997.
3. F. Liu, M. Monkowski, M. Novak, M. Padmanabhan, M. Picheny, and P. Rao, "Performance of the IBM LVCSR system on the Switchboard corpus," in Proceedings of Speech Research Symposium, 1995, p. 189.
4. T. Hain, P. Woodland, G. Evermann, and D. Povey, "The CU-HTK march 2000 HUB5E transcription system," in Proc. Speech Transcription Workshop, vol. 1. Baltimore, 2000.
5. H. Soltau, B. Kingsbury, L. Mangu, D. Povey, G. Saon, and G. Zweig, "The IBM 2004 conversational telephony system for rich transcription." in Acoustics, Speech and Signal Processing (ICASSP), 2005 IEEE International Conference on, 2005, pp. 205-208.
6. H. Soltau, G. Saon, and B. Kingsbury, "The IBM Attila speech recognition toolkit," in Proc. of IEEE Workshop on Spoken Language Technology (SLT), 2010, pp. 97-102.
7. D. Povey, B. Kingsbury, L. Mangu, G. Saon, H. Soltau, and G. Zweig, "fMPE: Discriminatively trained features for speech recognition," in Proc. of ICASSP, 2005, pp. 961-964.
8. K. Vesely, A. Ghoshal, L. Burget, and D. Povey, "Sequence-discriminative training of deep neural networks," in Proc. Interspeech, 2013.
9. F. Seide, H. Fu, J. Droppo, G. Li, and D. Yu, "1-bit stochastic gradient descent and its application to dataparallel distributed training of speech dnns," in Fifteenth Annual Conference of the International Speech Communication Association, 2014.
10. A. Hannun, C. Case, J. Casper, B. Catanzaro, G. Diamos, E. Elsen, R. Prenger, S. Satheesh, S. Sengupta, A. Coates et al., "Deepspeech: Scaling up end-to-end speech recognition," arXiv preprint arXiv:1412.5567, 2014.
11. P. Zhou, L. Dai, and H. Jiang, "Sequence training of multiple deep neural networks for better performance and faster training speed," in Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on. IEEE, 2014, pp. 5627-5631.
12. A. L. Maas, A. Y. Hannun, C. T. Lengerich, P. Qi, D. Jurafsky, and A. Y. Ng, "Increasing deep neural network acoustic model size for large vocabulary continuous speech recognition," arXiv preprint arXiv:1406.7806, 2014.
13. H. Soltau, G. Saon, and T. N. Sainath, "Joint training of convolutional and non-convolutional neural networks," to Proc. ICASSP, 2014.
14. G. Saon, H. Soltau, D. Nahamoo, and M. Picheny, "Speaker adaptation of neural network acoustic models using i-vectors," in Proc. ASRU, 2013.
15. B. Kingsbury, T. Sainath, and H. Soltau, "Scalable minimum Bayes risk training of deep neural network acoustic models using distributed Hessian-free optimization," in Proc. Interspeech, 2012.
16. I. J. Goodfellow, D. Warde-Farley, M. Mirza, A. Courville, and Y. Bengio, "Maxout networks," arXiv preprint arXiv:1302.4389, 2013.
17. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, "Dropout: A simple way to prevent neural networks from overfitting," The Journal of Machine Learning Research, vol. 15, no. 1, pp. 1929-1958, 2014.
18. X. Zhang, J. Trmal, D. Povey, and S. Khudanpur, "Improving deep neural network acoustic models using generalized maxout networks," in Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on. IEEE, 2014, pp. 215-219.
19. S. Rennie, V. Goel, and S. Thomas, "Annealed dropout training of deep networks," in Spoken Language Technology (SLT), IEEE Workshop on. IEEE, 2014.
20. T. Sainath, B. Kingsbury, V. Sindhwani, E. Arisoy, and B. Ramabhadran, "Low-rank matrix factorization for deep neural network training with high-dimensional output targets," in Proc. of ICASSP, 2013.
21. T. N. Sainath, A.-r. Mohamed, B. Kingsbury, and B. Ramabhadran, "Deep convolutional neural networks for LVCSR," in Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on. IEEE, 2013, pp. 8614-8618.
22. G. Saon, H. Soltau, A. Emami, and M. Picheny, "Unfolded recurrent neural networks for speech recognition," in Fifteenth Annual Conference of the International Speech Communication Association, 2014.
23. S. F. Chen and J. Goodman, "An empirical study of smoothing techniques for language modeling," Computer Speech & Language, vol. 13, no. 4, pp. 359-393, 1999.
24. A. Stolcke, "Entropy-based pruning of backoff language models," in Proc. DARPA Broadcast News Transcription and Understanding Workshop, 1998, pp. 270-274.
25. S. F. Chen, "Shrinking exponential language models," in Proc. NAACL-HLT, 2009, pp. 468-476.
26. Y. Bengio, R. Ducharme, P. Vincent, and C. Jauvin, "A neural probabilistic language model," Journal of Machine Learning Research, vol. 3, pp. 1137-1155, 2003.
27. A. Emami, "A neural syntactic language model," Ph.D. dissertation, Johns Hopkins University, Baltimore, MD, USA, 2006.
28. H. Schwenk, "Continuous space language models," Computer Speech & Language, vol. 21, no. 3, pp. 492-518, 2007.
29. A. Emami and L. Mangu, "Empirical study of neural network language models for Arabic speech recognition," in Proc. ASRU, 2007, pp. 147-152.
30. H.-K. J. Kuo, E. Arisoy, A. Emami, and P. Vozila, "Large scale hierarchical neural network language models," in Proc. Interspeech, 2012.