Acoustic modeling with deep neural networks using raw time signal for LVCSR

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2014, Pages 890-894

  Tüske, Zoltán ^a   Golik, Pavel ^a   Schlüter, Ralf ^a   Ney, Hermann ^a,b  

^a RWTH AACHEN UNIVERSITY   (Germany)

^b UFR 919 Laboratoire d'Informatique Pour la Mécanique et les Sciences de l'Ingénieur   (France)

Author keywords

Acoustic modeling; Neural networks; Raw signal

Indexed keywords

EXTRACTION; FEATURE EXTRACTION; FILTER BANKS; NEURAL NETWORKS; SIGNAL PROCESSING; SPEECH COMMUNICATION; TIME DOMAIN ANALYSIS;

ACOUSTIC MODEL; AUTOMATIC SPEECH RECOGNITION; DEEP NEURAL NETWORKS; MAGNITUDE SPECTRUM; MULTI-RESOLUTIONAL ANALYSIS; RAW SIGNALS; RECOGNITION ACCURACY; SIGMOID ACTIVATION FUNCTION;

SPEECH RECOGNITION;

EID: 84910065702     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. F. Seide, G. Li, X. Chen, and D. Yu, "Feature engineering in context-dependent deep neural networks for conversational speech transcription, " in Proc. IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), Hawaii, USA, Dec. 2011, pp. 24-29.
2. D. Yu, M. L. Seltzer, J. Li, J.-T. Huang, and F. Seide, "Feature learning in deep neural networks - A study on speech recognition tasks, " in International Conference on Learning Representations, Scottsdale, AZ, USA, May 2013.
3. H. A. Bourlard and N. Morgan, Connectionist speech recognition: A hybrid approach. Norwell, MA, USA: Kluwer Academic Publishers, 1993.
4. G. Cybenko, "Approximation by superpositions of a sigmoidal function, " Mathematics of Control, Signals and Systems, vol. 2, no. 4, pp. 303-314, 1989.
5. K. Hornik, M. B. Stinchcombe, and H. White, "Multilayer feedforward networks are universal approximators, " Neural Networks, vol. 2, no. 5, pp. 359-366, Jul. 1989.
6. T. N. Sainath, B. Kingsbury, A.-r. Mohamed, and B. Ramabhadran, "Learning filter banks within a deep neural network framework, " in Proc. IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), Olomouc, Czech Republic, Dec. 2013, pp. 297-302.
7. S. Wiesler, A. Richard, R. Schlüter, and H. Ney, "Meannormalized stochastic gradient for large-scale deep learning, " in Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing, Florence, Italy, May 2014, pp. 180-184.
8. C. Plahl, R. Schlüter, and H. Ney, "Improved acoustic feature combination for LVCSR by neural networks, " in Proc. Interspeech, Florence, Italy, Aug. 2011, pp. 1237-1240.
9. D. Palaz, R. Collobert, and M. Magimai.-Doss, "Estimating phoneme class conditional probabilities from raw speech signal using convolutional neural networks, " in Proc. Interspeech, Lyon, France, Aug. 2013, pp. 1766-1770.
10. O. Abdel-Hamid, A. Mohamed, H. Jiang, and G. Penn, "Applying convolutional neural networks concepts to hybrid NN-HMM model for speech recognition, " in Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing, Kyoto, Japan, Mar. 2012, pp. 4277-4280.
11. A. B. Poritz, "Linear predictive hidden Markov models and the speech signal, " in Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing, vol. 7, Paris, France, May 1982, pp. 1291- 1294.
12. Y. Ephraim and W. J. J. Roberts, "Revisiting autoregressive hidden Markov modeling of speech signals, " IEEE Signal Processing Letters, vol. 12, no. 2, pp. 166-169, Feb. 2005.
13. J. Yousafzai, Z. Cvetkovíc, and P. Sollich, "Subband acoustic waveform front-end for robust speech recognition using support vector machines, " in Proc. Interspeech, Brighton, UK, Sep. 2009, pp. 2679-2682.
14. S. B. Davis and P. Mermelstein, "Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences, " IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 28, no. 4, pp. 357-366, Aug. 1980.
15. R. Schlüter, I. Bezrukov, H. Wagner, and H. Ney, "Gammatone features and feature combination for large vocabulary speech recognition, " in Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing, Honolulu, Hawaii, USA, Apr. 2007, pp. 649- 652.
16. H. Hermansky, "Perceptual linear predictive (PLP) analysis of speech, " Journal of the Acoustical Society of America, vol. 87, no. 4, pp. 1738-1752, 1990.
17. Quaero Programme. http://www.quaero.org.
18. D. Rybach, S. Hahn, P. Lehnen, D. Nolden, M. Sundermeyer, Z. Tüske, S. Wiesler, R. Schlüter, and H. Ney, "RASR - The RWTH Aachen university open source speech recognition toolkit, " in Proc. IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), Hawaii, USA, Dec. 2011.
19. V. Nair and G. E. Hinton, "Rectified linear units improve restricted Boltzmann machines, " in Proc. of the 27th Int. Conf. on Machine Learning, Haifa, Israel, Jun. 2010, pp. 807-814.
20. B. R. Glasberg and B. C. J. Moore, "Derivation of auditory filter shapes from notched-noise data, " Hearing Research, vol. 47, no. 1-2, pp. 103-138, Aug. 1990.