Understanding how deep belief networks perform acoustic modelling

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2012, Pages 4273-4276

  Mohamed, Abdel Rahman ^a   Hinton, Geoffrey ^a   Penn, Gerald ^a  

^a UNIVERSITY OF TORONTO   (Canada)

Author keywords

acoustic modeling; Deep belief networks; neural networks

Indexed keywords

ACOUSTIC MODELING; ACOUSTIC MODELLING; DEEP BELIEF NETWORKS; FEATURE VECTORS; GAUSSIAN MIXTURE MODEL; HIDDEN LAYERS; MULTIPLE SCALE; PHONE RECOGNITION; RECOGNITION PERFORMANCE;

HIDDEN MARKOV MODELS; NEURAL NETWORKS; SIGNAL PROCESSING;

SPEECH RECOGNITION;

EID: 84867585919     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2012.6288863     Document Type: Conference Paper

References (9)

1. H. Bourlard and N.Morgan, Connectionist Speech Recognition: A Hybrid Approach, Kluwer Academic Publishers, 1993.
2. H. Hermansky, D. Ellis, and S. Sharma, "Tandem connectionist feature extraction for conventional HMM systems," in ICASSP, 2000, pp. 1635-1638.
3. G. E. Hinton, S. Osindero, and Y.W. Teh, "A fast learning algorithm for deep belief nets," Neural Computation, vol. 18, no. 7, pp. 1527-1554, 2006.
4. A. Mohamed, G. Dahl, and G. Hinton, "Acoustic modeling using deep belief networks," IEEE Transactions on Audio, Speech, and Language Processing, 2011.
5. G. Dahl, D. Yu, L. Deng, and A. Acero, "Context-dependent pre-trained deep neural networks for large vocabulary speech recognition," IEEE Transactions on Audio, Speech, and Language Processing, 2011.
6. T. N. Sainath, B. Kingsbury, B. Ramabhadran, P. Fousek, P. Novak, and A. Mohamed, "Making deep belief networks effective for large vocabulary continuous speech recognition," in ASRU, 2011.
7. J.B. Allen, "How do humans process and recognize speech?," IEEE Trans. Speech Audio Processing, vol. 2, no. 4, pp. 567-577, 1994.
8. G. E. Hinton, "Training products of experts by minimizing contrastive divergence," Neural Computation, vol. 14, no. 8, pp. 1711-1800, 2002.
9. L.J.P. van der Maaten and G.E. Hinton, "Visualizing high-dimensional data using t-sne," Journal of Machine Learning Research, vol. 9, pp. 2579-2605, 2008.