A time delay neural network architecture for efficient modeling of long temporal contexts

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn 2015-January, Issue , 2015, Pages 3214-3218

  Peddinti, Vijayaditya ^a   Povey, Daniel ^a   Khudanpur, Sanjeev ^a  

^a Johns Hopkins University   (United States)

Author keywords

Acoustic modeling; Recurrent neural networks; Time delay neural networks

Indexed keywords

FEEDFORWARD NEURAL NETWORKS; LEARNING ALGORITHMS; NEURAL NETWORKS; RECURRENT NEURAL NETWORKS; SPEECH COMMUNICATION; TIME DELAY;

ACOUSTIC EVENTS; ACOUSTIC MODEL; FEED-FORWARD NETWORK; RECURRENT NETWORKS; SUB-SAMPLING; TIME DELAY NEURAL NETWORKS; TRAINING DATA; TRAINING TIME;

NETWORK ARCHITECTURE;

EID: 84959115289     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (32)

1. H. Sak, A. Senior, and F. Beaufays, "Long Short-Term Memory Based Recurrent Neural Network Architectures for Large Vocabulary Speech Recognition, " Feb. 2014. [Online]. Available: http: //arxiv. org/abs/1402. 1128
2. A. Waibel, T. Hanazawa, G. Hinton, K. Shikano, and K. Lang, "Phoneme recognition using time-delay neural networks, " IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 37, no. 3, pp. 328-339, Mar. 1989.
3. A. Waibel, "Modular construction of time-delay neural networks for speech recognition, " Neural computation, vol. 1, no. 1, pp. 39-46, 1989.
4. D. Povey, D. Kanevsky, B. Kingsbury, B. Ramabhadran, G. Saon, and K. Visweswariah, "Boosted mmi for model and feature-space discriminative training, " in Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing. IEEE, 2008, pp. 4057-4060.
5. S. Xue, O. Abdel-Hamid, H. Jiang, L. Dai, and Q.-F. Liu, "Fast Adaptation of Deep Neural Network based on Discriminant Codes for Speech Recognition, " IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. PP, no. 99, pp. 1-1, 2014.
6. M. Karafiat, L. Burget, P. Matejka, O. Glembek, and J. Cernocky, "iVector-based discriminative adaptation for automatic speech recognition, " in 2011 IEEE Workshop on Automatic Speech Recognition & Understanding. IEEE, Dec. 2011, pp. 152-157.
7. J. Godfrey, E. Holliman, and J. McDaniel, "Switchboard: telephone speech corpus for research and development, " in Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP), vol. 1, Mar 1992, pp. 517-520 vol. 1.
8. H. Hermansky and S. Sharma, "Temporal patterns (traps) in asr of noisy speech, " in Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP), vol. 1, Mar 1999, pp. 289-292 vol. 1.
9. N. Mesgarani, S. Shamma, and M. Slaney, "Speech discrimination based on multiscale spectro-temporal modulations, " in Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP), vol. 1, May 2004, pp. I-601-4 vol. 1.
10. J. Andén and S. Mallat, "Deep scattering spectrum, " Signal Processing, IEEE Transactions on, vol. 62, no. 16, pp. 4114-4128, Aug 2014.
11. S. Thomas, S. Ganapathy, and H. Hermansky, "Phoneme recognition using spectral envelope and modulation frequency features, " in Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP), April 2009, pp. 4453-4456.
12. A. Graves, A.-R. Mohamed, and G. Hinton, "Speech recognition with deep recurrent neural networks, " in Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing. IEEE, 2013, pp. 6645-6649.
13. G. Saon, H. Soltau, A. Emami, and M. Picheny, "Unfolded recurrent neural networks for speech recognition, " in Proceedings of INTERSPEECH, 2014.
14. F. Grezl, M. Karafiat, and K. Vesely, "Adaptation of multilingual stacked bottle-neck neural network structure for new language, " in Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP), May 2014, pp. 7654-7658.
15. X. Zhang, J. Trmal, D. Povey, and S. Khudanpur, "Improving deep neural network acoustic models using generalized maxout networks, " in Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, May 2014, pp. 215-219.
16. S. B. Davis and P. Mermelstein, "Comparison of parametric representation for monosyllabic word recognition in continuously spoken sentences, " IEEE Transactions on Acoustics, Speech and Signal Processing, vol. 28, no. 4, pp. 357-366, 1980.
17. D. Povey, X. Zhang, and S. Khudanpur, "Parallel training of deep neural networks with natural gradient and parameter averaging, " CoRR, vol. abs/1410. 7455, 2014. [Online]. Available: http: //arxiv. org/abs/1410. 7455
18. N. Dehak, P. Kenny, R. Dehak, P. Dumouchel, and P. Ouellet, "Front-end factor analysis for speaker verification, " IEEE Transactions on Audio, Speech, and Language Processing, vol. 19, no. 4, pp. 788-798, May 2011.
19. M. Gibson, "Minimum bayes risk acoustic model estimation and adaptation, " Ph. D. dissertation, University of Sheffield, 2008.
20. K. Vesely, A. Ghoshal, L. Burget, and D. Povey, "Sequencediscriminative training of deep neural networks. " in Proceedings of INTERSPEECH, 2013, pp. 2345-2349.
21. V. Peddinti, G. Chen, D. Povey, and S. Khudanpur, "An i-vector based time delay neural network architecture for far field recognition, " in Proceedings of INTERSPEECH, 2015. [Online]. Available: http: //www. danielpovey. com/files/ 2015 interspeech aspire. pdf
22. V. Manohar, D. Povey, and S. Khudanpur, "Semi-supervised maximum mutual information training of deep neural network acoustic models, " in Proceedings of INTERSPEECH, 2015. [Online]. Available: http: //www. danielpovey. com/files/ 2015 interspeech entropy. pdf
23. T. Ko, V. Peddinti, D. Povey, and S. Khudanpur, "Audio augmentation for speech recognition, " in Proceedings of INTERSPEECH, 2015. [Online]. Available: http: //www. danielpovey. com/files/2015 interspeech augmentation. pdf
24. G. Chen, H. Xu, M. Wu, D. Povey, and S. Khudanpur, "Pronunciation and silence probability modeling for ASR, " in Proceedings of INTERSPEECH, 2015. [Online]. Available: http: //www. danielpovey. com/files/2015 interspeech silprob. pdf
25. H. Soltau, G. Saon, and T. Sainath, "Joint training of convolutional and non-convolutional neural networks, " in Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP), May 2014, pp. 5572-5576.
26. F. Seide, G. Li, X. Chen, and D. Yu, "Feature engineering in context-dependent deep neural networks for conversational speech transcription, " in Automatic Speech Recognition and Understanding (ASRU), 2011 IEEE Workshop on. IEEE, 2011, pp. 24-29.
27. D. Povey, A. Ghoshal, G. Boulianne, L. Burget, O. Glembek, N. Goel, M. Hannemann, P. Motlicek, Y. Qian, P. Schwarz, J. Silovsky, G. Stemmer, and K. Vesely, "The kaldi speech recognition toolkit, " in IEEE 2011 Workshop on Automatic Speech Recognition and Understanding. IEEE Signal Processing Society, 2011.
28. P. Price, W. Fisher, J. Bernstein, and D. Pallett, "The darpa 1000-word resource management database for continuous speech recognition, " in Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP), Apr 1988, pp. 651-654 vol. 1.
29. D. B. Paul and J. M. Baker, "The design for the wall street journalbased csr corpus, " in Proceedings of the workshop on Speech and Natural Language. Association for Computational Linguistics, 1992, pp. 357-362.
30. A. Rousseau, P. Deléglise, and Y. Estève, "Ted-lium: An automatic speech recognition dedicated corpus. " in LREC, 2012, pp. 125-129.
31. V. Panayotov, G. Chen, D. Povey, and S. Khudanpur, "Librispeech: An ASR corpus based on public domain audio books, " in Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2015.
32. C. Cieri, D. Miller, and K. Walker, "The fisher corpus: A resource for the next generations of speech-to-text. " in LREC, vol. 4, 2004, pp. 69-71.