Analysis of CNN-based speech recognition system using raw speech as input

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn 2015-January, Issue , 2015, Pages 11-15

  Palaz, Dimitri ^a,b   Magimai Doss, Mathew ^a   Collobert, Ronan ^a,c  

^a IDIAP RESEARCH INSTITUTE   (Switzerland)

^b EPFL   (Switzerland)

^c FACEBOOK AI RESEARCH   (United States)

Author keywords

Automatic speech recognition; Convolutional neural networks; Raw signal; Robust speech recognition

Indexed keywords

CONVOLUTION; FEATURE EXTRACTION; NEURAL NETWORKS; SPEECH; SPEECH COMMUNICATION; TELEPHONE SETS;

AUTOMATIC SPEECH RECOGNITION; AUTOMATIC SPEECH RECOGNITION SYSTEM; CLASSIFIER TRAINING; CONVOLUTIONAL NEURAL NETWORK; RAW SIGNALS; ROBUST SPEECH RECOGNITION; SPECTRAL ENVELOPES; SPEECH RECOGNITION SYSTEMS;

SPEECH RECOGNITION;

EID: 84955059475     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (27)

1. H. Bourlard and N. Morgan, Connectionist speech recognition: A hybrid approach. Springer, 1994, vol. 247.
2. G. E. Hinton, S. Osindero, and Y. W. Teh, "A fast learning algorithm for deep belief nets, " Neural computation, vol. 18, no. 7, pp. 1527-1554, 2006.
3. G. Hinton, L. Deng, D. Yu, G. E. Dahl, A. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, and T. N. Sainath, "Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups, " Signal Processing Magazine, IEEE, vol. 29, no. 6, p. 8297, 2012.
4. F. Seide, G. Li, and D. Yu, "Conversational speech transcription using context-dependent deep neural networks, " in Proc. of Interspeech, 2011, pp. 437-440.
5. G. E. Dahl, D. Yu, L. Deng, and A. Acero, "Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition, " IEEE Transactions on Audio, Speech, and Language Processing, vol. 20, no. 1, p. 3042, 2012.
6. A. Mohamed, G. Dahl, and G. Hinton, "Acoustic modeling using deep belief networks, " IEEE Transactions on Audio, Speech, and Language Processing, vol. 20, no. 1, pp. 14-22, jan. 2012.
7. H. Lee, P. Pham, Y. Largman, and A. Y. Ng, "Unsupervised feature learning for audio classification using convolutional deep belief networks, " in Advances in Neural Information Processing Systems 22, 2009, pp. 1096-1104.
8. O. Abdel-Hamid, A. Mohamed, H. Jiang, and G. Penn, "Applying convolutional neural networks concepts to hybrid NN-HMM model for speech recognition, " in Proc. of ICASSP, 2012, pp. 4277-4280.
9. T. N. Sainath, A. Mohamed, B. Kingsbury, and B. Ramabhadran, "Deep convolutional neural networks for lvcsr, " in Proc. of ICASSP, 2013, pp. 8614-8618.
10. P. Swietojanski, A. Ghoshal, and S. Renals, "Convolutional neural networks for distant speech recognition, " Signal Processing Letters, IEEE, vol. 21, no. 9, pp. 1120-1124, September 2014.
11. E. Bocchieri and D. Dimitriadis, "Investigating deep neural network based transforms of robust audio features for lvcsr, " in Proc. of ICASSP, 2013, pp. 6709-6713.
12. N. Jaitly and G. Hinton, "Learning a better representation of speech soundwaves using restricted boltzmann machines, " in Proc. of ICASSP, 2011, pp. 5884-5887.
13. T. Sainath, B. Kingsbury, A.-R. Mohamed, and B. Ramabhadran, "Learning filter banks within a deep neural network framework, " in Proc. of ASRU, Dec. 2013, pp. 297-302.
14. Z. Tüske, P. Golik, R. Schlüter, and H. Ney, "Acoustic modeling with deep neural networks using raw time signal for lvcsr, " in Proc. of Interspeech, Singapore, Sep. 2014, pp. 890-894.
15. D. Palaz, R. Collobert, and M. Magimai.-Doss, "End-to-end Phoneme Sequence Recognition using Convolutional Neural Networks, " ArXiv e-prints, Dec. 2013.
16. D. Palaz, R. Collobert, and M. Magimai.-Doss, "Estimating phoneme class conditional probabilities from raw speech signal using convolutional neural networks, " in Proc. of Interspeech, 2013.
17. D. Palaz, M. Magimai.-Doss, and R. Collobert, "Convolutional neural networks-based continuous speech recognition using raw speech signal, " in Proc. of ICASSP, April 2015.
18. Y. LeCun, "Generalization and network design strategies, " in Connectionism in Perspective, R. Pfeifer, Z. Schreter, F. Fogelman, and L. Steels, Eds. Zurich, Switzerland: Elsevier, 1989.
19. J. Bridle, "Probabilistic interpretation of feedforward classification network outputs, with relationships to statistical pattern recognition, " in Neuro-computing: Algorithms, Architectures and Applications, 1990, pp. 227-236.
20. L. Bottou, "Stochastic gradient learning in neural networks, " in Proceedings of Neuro-Nmes 91. Nimes, France: EC2, 1991.
21. K. F. Lee and H. W. Hon, "Speaker-independent phone recognition using hidden markov models, " IEEE Transactions on Acoustics, Speech and Signal Processing, vol. 37, no. 11, pp. 1641-1648, 1989.
22. A. Varga and H. J. Steeneken, "Assessment for automatic speech recognition: Ii. noisex-92: A database and an experiment to study the effect of additive noise on speech recognition systems, " Speech communication, vol. 12, no. 3, pp. 247-251, 1993.
23. H.-G. Hirsch, "Fant-filtering and noise adding tool, " 2005.
24. H.-G. Hirsch and D. Pearce, "The Aurora experimental framework for the performance evaluation of speech recognition systems under noisy conditions, " in ASR2000-Automatic Speech Recognition: Challenges for the new Millenium ISCA Tutorial and Research Workshop (ITRW), 2000.
25. S. Young, G. Evermann, D. Kershaw, G. Moore, J. Odell, D. Ollason, V. Valtchev, and P. Woodland, "The htk book, " Cambridge University Engineering Department, vol. 3, 2002.
26. R. Collobert, K. Kavukcuoglu, and C. Farabet, "Torch7: A matlab-like environment for machine learning, " in BigLearn, NIPS Workshop, 2011.
27. H.-G. Hirsch and D. Pearce, "Applying the advanced ETSI frontend to the aurora-2 task, " Tech. Rep., 2006, version 1. 1.