Convolutional neural networks for acoustic modeling of raw time signal in LVCSR

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn 2015-January, Issue , 2015, Pages 26-30

  Golik, Pavel ^a   Tüske, Zoltán ^a   Schlüter, Ralf ^a   Ney, Hermann ^a,b  

^a RWTH AACHEN UNIVERSITY   (Germany)

^b Laboratoire Interdisciplinaire des Sciences du Numérique   (France)

Author keywords

Acoustic modeling; Convolutional neural networks; Raw time signal

Indexed keywords

CONVOLUTION; EXTRACTION; FEATURE EXTRACTION; FILTER BANKS; NEURAL NETWORKS; SPEECH COMMUNICATION;

ACOUSTIC MODEL; ANALYSIS WINDOWS; AUTOMATIC SPEECH RECOGNITION; CONVOLUTIONAL NEURAL NETWORK; DEEP NEURAL NETWORKS; PERFORMANCE GAPS; TIME SIGNALS; TIME-FREQUENCY DECOMPOSITION;

SPEECH RECOGNITION;

EID: 84959110637     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Z. Tüske, P. Golik, R. Schlüter, and H. Ney, "Acoustic modeling with deep neural networks using raw time signal for LVCSR, " in Proc. Interspeech, Singapore, Sep. 2014, pp. 890-894.
2. S. B. Davis and P. Mermelstein, "Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences, " IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 28, no. 4, pp. 357-366, Aug. 1980.
3. H. Hermansky, "Perceptual linear predictive (PLP) analysis of speech, " Journal of the Acoustical Society of America, vol. 87, no. 4, pp. 1738-1752, 1990.
4. R. Schlüter, I. Bezrukov, H. Wagner, and H. Ney, "Gammatone features and feature combination for large vocabulary speech recognition, " in Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing, Honolulu, HI, USA, Apr. 2007, pp. 649-652.
5. A. Biem and S. Katagiri, "Filter bank design based on discriminative feature extraction, " in Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing, Adelaide, Australia, Apr. 1994, pp. 485-488.
6. T. N. Sainath, B. Kingsbury, A.-r. Mohamed, and B. Ramabhadran, "Learning filter banks within a deep neural network framework, " in Proc. IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), Olomouc, Czech Republic, Dec. 2013, pp. 297-302.
7. D. Palaz, R. Collobert, and M. Magimai.-Doss, "Estimating phoneme class conditional probabilities from raw speech signal using convolutional neural networks, " in Proc. Interspeech, Lyon, France, Aug. 2013, pp. 1766-1770.
8. D. Palaz, M. Magimai.-Doss, and R. Collobert, "Convolutional neural networks-based continuous speech recognition using raw speech signal, " in Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing, Brisbane, Australia, Apr. 2015, accepted for publication.
9. A. Waibel, T. Hanazawa, G. Hinton, K. Shikano, and K. Lang, "Phoneme recognition using time-delay neural networks, " Acoustics, Speech and Signal Processing, IEEE Transactions on, vol. 37, no. 3, pp. 328-339, Mar. 1989.
10. Y. LeCun, B. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard, and L. D. Jackel, "Handwritten digit recognition with a back-propagation network, " in Advances in Neural Information Processing Systems 2, D. Touretzky, Ed., vol. 2. Denver, CO: Morgan Kaufman, 1990.
11. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks, " in Advances in Neural Information Processing Systems 25, F. Pereira, C. Burges, L. Bottou, and K. Weinberger, Eds. Curran Associates, Inc., 2012, pp. 1097-1105.
12. O. Abdel-Hamid, A. Mohamed, H. Jiang, and G. Penn, "Applying convolutional neural networks concepts to hybrid NN-HMM model for speech recognition, " in Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing, Kyoto, Japan, Mar. 2012, pp. 4277-4280.
13. H. Soltau, H. Kuo, L. Mangu, G. Saon, and T. Beran, "Neural network acoustic models for the DARPA RATS program, " in Proc. Interspeech, Lyon, France, Aug. 2013, pp. 3092-3096.
14. T. N. Sainath, B. Kingsbury, A. Mohamed, G. E. Dahl, G. Saon, H. Soltau, T. Beran, A. Y. Aravkin, and B. Ramabhadran, "Improvements to deep convolutional neural networks for LVCSR, " in Proc. IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), Olomouc, Czech Republic, Dec. 2013, pp. 315-320.
15. V. Nair and G. E. Hinton, "Rectified linear units improve restricted Boltzmann machines, " in Proc. of the 27th Int. Conf. on Machine Learning, Haifa, Israel, Jun. 2010, pp. 807-814.
16. (2013) Quaero Programme. Accessed: 2015-03-27. [Online]. Available: http: //www. quaero. org
17. F. Seide, G. Li, X. Chen, and D. Yu, "Feature engineering in context-dependent deep neural networks for conversational speech transcription, " in Proc. IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), Honolulu, HI, USA, Dec. 2011, pp. 24-29.
18. D. Rybach, S. Hahn, P. Lehnen, D. Nolden, M. Sundermeyer, Z. Tüske, S. Wiesler, R. Schlüter, and H. Ney, "RASR-the RWTH Aachen University open source speech recognition toolkit, " in Proc. IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), Honolulu, HI, USA, Dec. 2011.
19. S. Wiesler, A. Richard, P. Golik, R. Schlüter, and H. Ney, "RASR/NN: The RWTH neural network toolkit for speech recognition, " in IEEE International Conference on Acoustics, Speech, and Signal Processing, Florence, Italy, May 2014, pp. 3313-3317.
20. H. Hermansky and P. Fousek, "Multi-resolution RASTA filtering for TANDEM-based ASR, " in Proc. Interspeech, Lisbon, Portugal, Sep. 2005, pp. 361-364.
21. S. Chang and N. Morgan, "Robust CNN-based speech recognition with Gabor filter kernels, " in Proc. Interspeech, Singapore, Sep. 2014, pp. 905-909.