Acoustic modelling from the signal domain using CNNs

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn 08-12-September-2016, Issue , 2016, Pages 3434-3438

  Ghahremani, Pegah ^a   Manohar, Vimal ^a   Povey, Daniel ^a,b   Khudanpur, Sanjeev ^a,b  

^a Johns Hopkins University   (United States)

^b JOHNS HOPKINS UNIVERSITY   (United States)

Author keywords

Network In Network nonlinearity; Raw waveform; Statistic extraction layer

Indexed keywords

SPEECH COMMUNICATION; SPEECH PROCESSING; SPEECH RECOGNITION;

ACOUSTIC MODELLING; ADAPTATION METHODS; FEATURE EXTRACTOR; IN NETWORKS; INTERMEDIATE LAYERS; OBJECTIVE FUNCTIONS; SPEECH RECOGNITION SYSTEMS; WAVE FORMS;

NETWORK ARCHITECTURE;

EID: 84994235770     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: 10.21437/Interspeech.2016-1495     Document Type: Conference Paper

References (25)

1. P. Mermelstein, "Distance measures for speech recognition, psychological and instrumental, " Pattern recognition and artificial intelligence, vol. 116, pp. 374-388, 1976.
2. H. Hermansky, "Perceptual linear predictive (PLP) analysis of speech, " Journal of the Acoustical Society of America, vol. 87, pp. 1738-1752, 1990.
3. T. N. Sainath, B. Kingsbury, A.-R. Mohamed, and B. Ramabhadran, "Learning filter banks within a deep neural network framework, " in Automatic Speech Recognition and Understanding (ASRU), 2013 IEEE Workshop on. IEEE, 2013, pp. 297-302.
4. Z. Tüske, P. Golik, R. Schlüter, and H. Ney, "Acoustic modeling with deep neural networks using raw time signal for LVCSR, " in Proc. Interspeech, 2014.
5. Y. Hoshen, R. J.Weiss, and K.W.Wilson, "Speech acoustic modeling from raw multichannel waveforms, " in Acoustics, Speech and Signal Processing (ICASSP), 2015 IEEE International Conference on. IEEE, 2015, pp. 4624-4628.
6. D. Palaz, R. Collobert et al., "Analysis of CNN-based Speech Recognition System using Raw Speech as Input, " in Proceedings of Interspeech, no. EPFL-CONF-210029, 2015.
7. T. N. Sainath, R. J. Weiss, A. Senior, K. W. Wilson, and O. Vinyals, "Learning the speech front-end with raw waveform cldnns, " in Proc. Interspeech, 2015.
8. A. Waibel, T. Hanazawa, G. Hinton, K. Shikano, and K. J. Lang, "Phoneme recognition using time-delay neural networks, " IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 37, no. 3, pp. 328-339, Mar 1989.
9. D. Povey, V. Peddinti, D. Galvez, P. Ghahrmani, V. Manohar, X. Na, Y. Wang, and S. Khudanpur, "Purely sequencetrained neural networks for ASR based on lattice-free MMI, " in Submitted to Interspeech, 2016. [Online]. Available: http://www.danielpovey.com/files/2016 interspeech mmi.pdf
10. J. J. Godfrey et al., "Switchboard: Telephone speech corpus for research and development, " in ICASSP, 1992.
11. D. Palaz, R. Collobert, and M. M. Doss, "Estimating phoneme class conditional probabilities from raw speech signal using convolutional neural networks, " arXiv preprint arXiv:1304.1018, 2013.
12. M. Bhargava and R. Rose, "Architectures for deep neural network based acoustic models defined over windowed speech waveforms, " in Sixteenth Annual Conference of the International Speech Communication Association, 2015.
13. M. Lin, Q. Chen, and S. Yan, "Network in network, " arXiv preprint arXiv:1312.4400, 2013.
14. M. J. F. Gales and P. C. Woodland, "Mean and Variance Adaptation Within the MLLR Framework, " Computer Speech and Language, vol. 10, pp. 249-264, 1996.
15. N. Dehak, P. Kenny, R. Dehak, P. Dumouchel, and P. Ouellet, "Front-end factor analysis for speaker verification, " Audio, Speech, and Language Processing, IEEE Transactions on, vol. 19, no. 4, pp. 788-798, 2011.
16. G. Saon, H. Soltau, D. Nahamoo, and M. Picheny, "Speaker adaptation of neural network acoustic models using i-vectors." in ASRU, 2013, pp. 55-59.
17. V. Peddinti, G. Chen, V. Manohar, T. Ko, D. Povey, and S. Khudanpur, "JHU ASpIRE system: Robust LVCSR with TDNNs, ivector Adaptation, and RNN-LMs, " in ASRU, 2015.
18. S. Garimella, A. Mandal, N. Strom, B. Hoffmeister, S. Matsoukas, and S. H. K. Parthasarathi, "Robust i-vector based adaptation of DNN acoustic model for speech recognition, " In Proceedings of Interspeech, 2015.
19. T. Ko, V. Peddinti, D. Povey, and S. Khudanpur, "Audio augmentation for speech recognition, " in Proceedings of INTERSPEECH, 2015.
20. J. Andén and S. Mallat, "Deep scattering spectrum, " Signal Processing, IEEE Transactions on, vol. 62, no. 16, pp. 4114-4128, 2014.
21. X. Zhang, J. Trmal, D. Povey, and S. Khudanpur, "Improving Deep Neural Network Acoustic Models using Generalized Maxout Networks, " in Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on, May 2014, pp. 215-219.
22. P. Golik, Z. Tüske, R. Schlüter, and H. Ney, "Convolutional Neural Networks for Acoustic Modeling of Raw Time Signal in LVCSR, " in Sixteenth Annual Conference of the International Speech Communication Association, 2015.
23. V. Peddinti, D. Povey, and S. Khudanpur, "A time delay neural network architecture for efficient modeling of long temporal contexts, " in Proceedings of INTERSPEECH, 2015.
24. D. B. Paul and J. M. Baker, "The design for the Wall Street Journal-based CSR corpus, " in Proceedings of the workshop on Speech and Natural Language. Association for Computational Linguistics, 1992, pp. 357-362.
25. D. Povey, A. Ghoshal et al., "The Kaldi Speech Recognition Toolkit, " in Proc. ASRU, 2011.