Recognition of spontaneous conversational speech using long Short-Term Memory phoneme predictions

Proceedings of the 11th Annual Conference of the International Speech Communication Association, INTERSPEECH 2010

Volumn , Issue , 2010, Pages 1946-1949

  Wollmer, Martin ^a   Eyben, Florian ^a   Schuller, Björn ^a   Rigoll, Gerhard ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

Context modeling; Large vocabulary continuous speech recognition; Long Short Term Memory; Recurrent neural networks

Indexed keywords

BRAIN; CONTINUOUS SPEECH RECOGNITION; FORECASTING; NETWORK ARCHITECTURE; RECURRENT NEURAL NETWORKS; SPEECH; SPEECH COMMUNICATION; VOCABULARY CONTROL;

CO-ARTICULATION; CONTEXT MODELING; CONVERSATIONAL SPEECH; LARGE CORPORA; LARGE VOCABULARY CONTINUOUS SPEECH RECOGNITION; PREDICTION ERROR RATES; WORD ACCURACIES; WORD RECOGNITION; CONTEXT MODELS; HUMAN SPEECH; MEMORY MODELING; MEMORY NETWORK; SYSTEM USE; TIME-PERIODS; TRIPHONES;

LONG SHORT-TERM MEMORY;

EID: 79959821052     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. V. Valtchev, J. J. Odell, P. C. Woodland, and S. J. Young, "MMIE training of large vocabulary recognition systems," Speech Communication, vol. 22, no. 4, pp. 303-314, 1997. (Pubitemid 127433601)
2. B. Pellom and K. Hacioglu, "Recent improvements in the CU SONIC ASR system for noisy speech: the spine task," in Proc. of ICASSP, Hong Kong, 2003.
3. B. Schuller, F. Eyben, and G. Rigoll, "Static and dynamic modelling for the recognition of non-verbal vocalisations in conversational speech," in Proc. of PIT, Kloster Irsee, Germany, 2008, pp. 99-110.
4. B. Mesot and D. Barber, "Switching linear dynamic systems for noise robust speech recognition," IEEE Transactions on Audio, Speech, and Language Processing, vol. 15, no. 6, pp. 1850-1858, 2007.
5. M. Wöllmer, F. Eyben, B. Schuller, Y. Sun, T. Moosmayr, and N. Nguyen-Thien, "Robust in-car spelling recognition - a tandem BLSTM-HMM approach," in Proc. of Interspeech, Brighton, UK, 2009.
6. B. Schuller, M. Wöllmer, T. Moosmayr, and G. Rigoll, "Recognition of noisy speech: A comparative survey of robust model architecture and feature enhancement," Journal on Audio, Speech, and Music Processing, 2009, iD 942617.
7. H. Hermansky, D. P. W. Ellis, and S. Sharma, "Tandem con-nectionist feature extraction for conventional HMM systems," in Proc. of ICASSP, vol. 3, Istanbul, Turkey, 2000, pp. 1635-1638.
8. H. Ketabdar and H. Bourlard, "Enhanced phone posteriors for improving speech recognition systems," in IDIAP-RR, no. 39, 2008.
9. D. P. W. Ellis, R. Singh, and S. Sivadas, "Tandem acoustic modeling in large-vocabulary recognition," in Proc. of ICASSP, Salt Lake City, UT, USA, 2001, pp. 517-520. (Pubitemid 32839300)
10. S. Hochreiter, Y. Bengio, P. Frasconi, and J. Schmidhuber, "Gradient flow in recurrent nets: the difficulty of learning long-term dependencies," in A Field Guide to Dynamical Recurrent Neural Networks, S. C. Kremer and J. F. Kolen, Eds. IEEE Press, 2001.
11. H. Hermansky and P. Fousek, "Multi-resolution RASTA filtering for TANDEM-based ASR," in Proc. of European Conf. on Speech Communication and Technology, Lisbon, Portugal, 2008, pp. 361-364. (Pubitemid 43908074)
12. A. M. Schaefer, S. Udluft, and H. G. Zimmermann, "Learning long-term dependencies with recurrent neural networks," Neuro-computing, vol. 71, no. 13-15, pp. 2481-2488, 2008.
13. H. Jaeger, "The echo state approach to analyzing and training recurrent neural networks," Bremen: German National Research Center for Information Technology, Tech. Rep., 2001.
14. S. Hochreiter and J. Schmidhuber, "Long short-term memory," Neural Computation, vol. 9, no. 8, pp. 1735-1780, 1997. (Pubitemid 127462305)
15. A. Graves and J. Schmidhuber, "Framewise phoneme classification with bidirectional LSTM and other neural network architectures," Neural Networks, vol. 18, no. 5-6, pp. 602-610, 2005. (Pubitemid 43186580)
16. A. Graves, S. Fernandez, and J. Schmidhuber, "Bidirectional LSTM networks for improved phoneme classification and recognition," in Proc. of ICANN, Warsaw, Poland, 2005, pp. 602-610. (Pubitemid 43186580)
17. M. Wöllmer, F. Eyben, J. Keshet, A. Graves, B. Schuller, and G. Rigoll, "Robust discriminative keyword spotting for emotionally colored spontaneous speech using bidirectional LSTM networks," in Proc. of ICASSP, Taipei, Taiwan, 2009.
18. M. Wöllmer, F. Eyben, A. Graves, B. Schuller, and G. Rigoll, "A Tandem BLSTM-DBN architecture for keyword spotting with enhanced context modeling," in Proc. of NOLISP 2009, Vic, Spain, 2009.
19. S. Fernandez, A. Graves, and J. Schmidhuber, "An application of recurrent neural networks to discriminative keyword spotting," in Proc. of ICANN, Porto, Portugal, 2007, pp. 220-229.
20. M. Woellmer, F. Eyben, A. Graves, B. Schuller, and G. Rigoll, "Bidirectional LSTM networks for context-sensitive keyword detection in a cognitive virtual agent framework," Cognitive Computation, Special Issue on Non-Linear and Non-Conventional Speech Processing, 2010.
21. A. Stupakov, E. Hanusa, J. Bilmes, and D. Fox, "COSINE - a corpus of multi-party conversational speech in noisy environments," in Proc. of ICASSP, Taipei, Taiwan, 2009.
22. M. Schuster and K. K. Paliwal, "Bidirectional recurrent neural networks," IEEE Transactions on Signal Processing, vol. 45, pp. 2673-2681, November 1997. (Pubitemid 127766336)
23. M. Wöllmer, B. Schuller, F. Eyben, and G. Rigoll, "Combining long short-term memory and dynamic bayesian networks for incremental emotion-sensitive artificial listening," IEEE Journal of Selected Topics in Signal Processing, Special Issue on Speech Processing for Natural Interaction with Intelligent Environments, 2010.