Combining time- and frequency-domain convolution in convolutional neural network-based phone recognition

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2014, Pages 190-194

  Toth, Laszlo ^a  

^a UNIVERSITY OF SZEGED   (Hungary)

Author keywords

convolutional neural network; Deep neural network; rectified linear unit; speech recognition; TIMIT

Indexed keywords

CONVOLUTION; IMAGE RECOGNITION; NETWORK ARCHITECTURE; NEURAL NETWORKS; SPEECH RECOGNITION;

CONVOLUTIONAL NEURAL NETWORK; DEEP NEURAL NETWORKS; FULLY CONNECTED NETWORKS; LINEAR UNITS; SPECTRAL REPRESENTATIONS; TIME AND FREQUENCIES; TIME-DOMAIN CONVOLUTION; TIMIT;

SIGNAL PROCESSING;

EID: 84905252069     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2014.6853584     Document Type: Conference Paper

References (21)

1. Y. Lecun and Y. Bengio, "Convolutional networks for images, speech and time series," in The Handbook of Brain Theory and Neural Networks, Michael A. Arbib, Ed. 1995, pp. 255-258, MIT Press.
2. O. Abdel-Hamid, A. Mohamed, H. Jiang, and G. Penn, "Applying convolutional neural network concepts to hybrid NN-HMM model for speech recognition," in Proc. ICASSP, 2012, pp. 4277-4280.
3. T. N. Sainath, A. Mohamed, B. Kingsbury, and B. Ramabhadran, "Deep convolutional neural networks for LVCSR," in Proc. ICASSP, 2013, pp. 8614-8618.
4. Waibel, A. and Hanazawa, T. and Hinton, G. and Shikano, K and Lang, K. J., "Phoneme recognition using time-delay neural networks," IEEE Trans. ASSP, vol. 37, no. 3, pp. 328-339, 1989.
5. O. Abdel-Hamid, L. Deng, and D. Yu, "Exploring convolutional neural network structures and optimization techniques for speech recognition," in Proc. Interspeech, 2013, pp. 3366-3370.
6. T. N. Sainath, B. Kingsbury, A. Mohamed, and B. Ramabhadran, "Improvements to deep convolutional neural networks for LVCSR," in Proc. ASRU. 2013, accepted, in print.
7. K. Veselý, M. Karafíat, and F. Grézl, "Convolutive bottleneck network features for LVCSR," in Proc. ASRU, 2011, pp. 42-47.
8. L. Tóth, "Phone recognition with deep sparse rectifier neural networks," in Proc. ICASSP, 2013, pp. 6985-6989.
9. G. E. Dahl, T. N. Sainath, and G. E. Hinton, "Improving deep neural networks for LVCSR using rectified linear units and dropout," in Proc. ICASSP, 2013, pp. 8609-8613.
10. M. D. Zeiler, M. Ranzato, R. Monga, M. Mao, K. Yang, Q. V. Le, P. Nguyen, A. Senior, V. Vanhoucke, J. Dean, and G. E. Hinton, "On rectified linear units for speech processing," in Proc. ICASSP, 2013, pp. 3517-3521.
11. A. L. Maas, A. Y. Hannun, and A. Y. Ng, "Rectifier nonlinearities improve neural network acoustic models," in Proc. ICML, 2013.
12. L. Tóth, "Convolutional deep rectifier neural nets for phone recognition," in Proc. Interspeech, 2013, pp. 1722-1726.
13. H. Ketabdar and H. Bourlard, "Enhanced phone posteriors for improving speech recognition systems," IEEE Trans. ASLP, vol. 18, no. 6, pp. 1094-1106, 2010.
14. J. Pinto et al., "Analysis of MLP based hierarchical phoneme posterior probability estimator," IEEE Trans. ASLP, vol. 19, no. 2, pp. 225-241, 2010.
15. A. Mohamed, G. E. Dahl, and G. Hinton, "Acoustic modeling using deep belief networks," IEEE Trans. ASLP, vol. 20, no. 1, pp. 14-22, 2012.
16. L. Deng, O. Abdel-Hamid, and D. Yu, "A deep convolutional neural network using heterogeneous pooling for trading acoustic invariance with phonetic confusion," in Proc. ICASSP, 2013, pp. 6669-6673.
17. A. Graves, A. Mohamed, and G. E. Hinton, "Speech recognition with deep recurrent neural networks," in Proc. ICASSP, 2013, pp. 6645-6649.
18. G.E. Hinton, N. Srivastava, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, "Improving neural networks by preventing co-adaptation of feature detectors," CoRR, vol. abs/1207.0580, 2012.
19. B. Kingsbury, "Lattice-based optimization of sequence classification criteria for neural-network acoustic modeling," in Proc. ICASSP, 2009, pp. 3761-3764.
20. A. Mohamed, D. Yu, and L. Deng, "Investigation of fullsequence training of deep belief networks for speech recognition," in Proc. Interspeech, 2010, pp. 2846-2849.
21. K. Veselý, A. Ghoshal, L. Burget, and D. Povey, "Sequence-discriminative training of deep neural networks," in Proc. Interspeech, 2013, pp. 2345-2349.