Phone recognition with deep sparse rectifier neural networks

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2013, Pages 6985-6989

  Toth, Laszlo ^a  

^a UNIVERSITY OF SZEGED   (Hungary)

Author keywords

Deep neural networks; phone recognition; sparse rectifier neural networks

Indexed keywords

DEEP ARCHITECTURES; DEEP NEURAL NETWORKS; HIDDEN LAYERS; PHONE ERROR RATE; PHONE RECOGNITION; PRE-TRAINING; RECOGNITION ACCURACY; SIGMOID ACTIVATION FUNCTION;

NEURONS; SIGNAL PROCESSING;

NEURAL NETWORKS;

EID: 84890451371     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2013.6639016     Document Type: Conference Paper

References (16)

1. H. Bourlard and N. Morgan, Connectionist Speech Recognition-A Hybrid Approach, Kluwer, 1994
2. X. Glorot and Y. Bengio, "Understanding the difficulty of training deep feedforward neural networks," in Proc. AISTATS, 2010, pp. 249-256
3. G. Hinton, S. Osindero, and Y. Teh, "A fast learning algorithm for deep belief nets," Neural Computation, vol. 18, pp. 1527-1554, 2006
4. A. Mohamed, G. E. Dahl, and G. Hinton, "Acoustic modeling using deep belief networks," IEEE Trans. ASLP, vol. 20, no. 1, pp. 14-22, 2012
5. G. E. Dahl, D. Yu, L. Deng, and A. Acero, "Contextdependent pre-trained deep neural networks for large vocabulary speech recognition," IEEE Trans. ASLP, vol. 20, no. 1, pp. 30-42, 2012
6. D. Yu, L. Deng, and G. E. Dahl, "Roles of pre-training and fine-tuning in context-dependent DBN-HMMs for real-world speech recognition," in NIPS 2010 Workshop on Deep Learning and Unsupervised Feature Learning, 2010
7. F. Seide, G. Li, L. Chen, and D. Yu, "Feature engineering in context-dependent deep neural networks for conversational speech transcription," in Proc. ASRU, 2011, pp. 24-29
8. X. Glorot, A. Bordes, and Y. Bengio, "Deep sparse rectifier neural networks," in Proc. AISTATS, 2011
9. V. Nair and G. E. Hinton, "Rectified linear units improve restricted Boltzmann machines," in Proc. ICML, 2010, pp. 807-814
10. O. Vinyals and L. Deng, "Are sparse representations rich enough for acoustic modeling?," in Proc. INTERSPEECH, 2012
11. D.L. Ly, V. Paprotski, and D. Yen, "Neural networks on GPUs: Restricted Boltzmann Machines," Technical Report, Dept. of Electrical and Comp. Eng., University of Toronto, 2009
12. C.M. Bishop, Neural Networks for Pattern Recognition, Clarendon Press, 1995
13. C. Plahl, T. N. Sainath, B. Ramabhadran, and D. Nahamoo, "Improved pre-training of deep belief networks using sparse encoding symmetric machines," in Proc. ICASSP, 2012, pp. 4165-4168
14. G.S.V.S. Sivaram and H. Hermansky, "Sparse multilayer perceptron for phoneme recognition," IEEE Trans. ASLP, vol. 20, no. 1, pp. 23-29, 2012
15. A. Mohamed, G. E. Hinton, and G. Penn, "Understanding how Deep Belief Networks perform acoustic modelling," in Proc. ICASSP, 2012, pp. 4273-4276
16. G. E. Dahl, M. Ranzato, A. Mohamed, and G. Hinton, "Phone recognition with themean-covariance Restricted Boltzmann Machine," in NIPS, 2010, pp. 469-477.