Unfolded recurrent neural networks for speech recognition

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2014, Pages 343-347

  Saon, George ^a   Soltau, Hagen ^a   Emami, Ahmad ^a   Picheny, Michael ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Recurrent neural networks; Speech recognition

Indexed keywords

COMPLEX NETWORKS; MATRIX ALGEBRA; RECURRENT NEURAL NETWORKS; SPEECH COMMUNICATION;

DEEP NEURAL NETWORKS; DISCRIMINATIVE TRAINING; FEED-FORWARD NETWORK; HIERARCHICAL PROCESSING; MATRIX OPERATIONS; RECURRENT HIDDEN LAYERS; RECURRENT NEURAL NETWORK (RNNS); SPEAKER ADAPTATION;

SPEECH RECOGNITION;

EID: 84910072497     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. H. Soltau, H.-K. Kuo, L. Mangu, G. Saon, and T. Beran, "Neural network acoustic models for the darpa rats program, " in Proc. Interspeech, 2013.
2. A.Waibel, T. Hanazawa, G. Hinton, K. Shikano, and K. J. Lang, "Phoneme recognition using time-delay neural networks, " Acoustics, Speech and Signal Processing, IEEE Transactions on, vol. 37, no. 3, pp. 328-339, 1989.
3. Y. LeCun and Y. Bengio, "Convolutional networks for images, speech, and time series, " The handbook of brain theory and neural networks, vol. 3361, 1995.
4. T. Mikolov, M. Karafiát, L. Burget, J. Cernocky, and S. Khudanpur, "Recurrent neural network based language model." in INTERSPEECH, 2010, pp. 1045-1048.
5. A. J. Robinson, "An application of recurrent nets to phone probability estimation, " Neural Networks, IEEE Transactions on, vol. 5, no. 2, pp. 298-305, 1994.
6. P. J.Werbos, "Backpropagation through time: What it does and how to do it, " Proceedings of the IEEE, vol. 78, no. 10, pp. 1550-1560, 1990.
7. M. Schuster and K. K. Paliwal, "Bidirectional recurrent neural networks, " Signal Processing, IEEE Transactions on, vol. 45, no. 11, pp. 2673-2681, 1997.
8. O. Vinyals, S. V. Ravuri, and D. Povey, "Revisiting recurrent neural networks for robust asr, " in Acoustics, Speech and Signal Processing (ICASSP), 2012 IEEE International Conference on. IEEE, 2012, pp. 4085-4088.
9. A. Graves, A.-r. Mohamed, and G. Hinton, "Speech recognition with deep recurrent neural networks, " in Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on. IEEE, 2013, pp. 6645-6649.
10. A. Graves, N. Jaitly, and A.-r. Mohamed, "Hybrid speech recognition with deep bidirectional lstm, " in Automatic Speech Recognition and Understanding (ASRU), 2013 IEEE Workshop on. IEEE, 2013, pp. 273-278.
11. J. Schmidhuber, "Learning complex, extended sequences using the principle of history compression, " Neural Computation, vol. 4, no. 2, pp. 234-242, 1992.
12. H. Sak, A. Senior, and F. Beaufays, "Long short-term memory based recurrent neural network architectures for large vocabulary speech recognition, " arXiv preprint arXiv:1402.1128, 2014.
13. C. Weng, D. Yu, S. Watanabe, and B.-H. Juang, "Recurrent deep neural networks for robust speech recognition, " in Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on. IEEE, 2014.
14. R. Pascanu, C. Gulcehre, K. Cho, and Y. Bengio, "How to construct deep recurrent neural networks, " arXiv preprint arXiv:1312.6026, 2013.
15. F. Seide, G. Li, X. Chien, and D. Yu, "Feature engineering in context-dependent deep neural networks for conversational speech transcription, " in Proc. ASRU, 2011.
16. M. Hermans and B. Schrauwen, "Training and analysing deep recurrent neural networks, " in Advances in Neural Information Processing Systems, 2013, pp. 190-198.
17. G. Saon, H. Soltau, D. Nahamoo, and M. Picheny, "Speaker adaptation of neural network acoustic models using i-vectors, " in Proc. ASRU, 2013.
18. T. Sainath, B. Kingsbury, V. Sindhwani, E. Arisoy, and B. Ramabhadran, "Low-rank matrix factorization for deep neural network training with high-dimensional output targets, " in Proc. of ICASSP, 2013.
19. B. Kingsbury, T. Sainath, and H. Soltau, "Scalable minimum Bayes risk training of deep neural network acoustic models using distributed Hessian-free optimization, " in Proc. Interspeech, 2012.