Deep belief networks using discriminative features for phone recognition

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2011, Pages 5060-5063

  Mohamed, Abdel Rahman ^a   Sainath, Tara N ^b   Dahl, George ^a   Ramabhadran, Bhuvana ^b   Hinton, Geoffrey E ^a   Picheny, Michael A ^b  

^a UNIVERSITY OF TORONTO   (Canada)

^b IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Deep belief networks; Discriminative feature transformation; Phone recognition

Indexed keywords

BIGRAM LANGUAGE MODELS; DEEP BELIEF NETWORKS; DISCRIMINATIVE FEATURES; GENERATIVE MODEL; HIDDEN UNITS; HIGHER ORDER; LANGUAGE MODEL; MULTIPLE LAYERS; PHONE ERROR RATE; PHONE RECOGNITION; RANDOM WEIGHT; STATISTICAL STRUCTURES;

COMPUTATIONAL LINGUISTICS; METADATA; NEURAL NETWORKS; SIGNAL PROCESSING; SPEECH COMMUNICATION; TELEPHONE SETS;

FEATURE EXTRACTION;

EID: 80051654263     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2011.5947494     Document Type: Conference Paper

References (16)

1. A. Mohamed, G. Dahl, and G. Hinton, "Acoustic Modeling using Deep Belief Networks," IEEE Trans. on Audio, Speech and Language Processing., 2011.
2. G.E. Dahl, M. Ranzato, A. Mohamed, and G.E. Hinton., "Phone Recognition with the Mean-Covariance Restricted Boltzmann Machine.," in NIPS, 2010.
3. B.H. Juang, W. Hou, and C.H. Lee, "Minimum classification error rate methods for speech recognition," IEEE Trans. on Speech and Audio Processing, vol. 5, no. 3, pp. 257-265, 1997.
4. D. Povey, D. Kanevsky, B. Kingsbury, B. Ramabhadran, G. Saon, and K. Visweswariah, "Boosted MMI for model and feature-space discriminative training," 2008, pp. 4057-4060.
5. M.J.F. Gales, "Maximum Likelihood Linear Transformations for HMM-Based Speech Recognition," Computer Speech and Language, vol. 12, pp. 75-98, 1998.
6. T. N. Sainath, B. Ramabhadran, and M. Picheny, "An Explortation of Large Vocabulary Tools for Small Vocabulary Phonetic Recognition," in Proc. ASRU, 2009.
7. H. Bourlard and N. Morgan, Connectionist Speech Recognition: A Hybrid Approach, Kluwer Academic Publishers, 1993.
8. H. Larochelle, D. Erhan, A. Courville, J. Bergstra, and Y. Bengio, "An empirical evaluation of deep architectures on problems with many factors of variation," in ICML, 2007, pp. 473-480.
9. G. E. Hinton, S. Osindero, and Y. Teh, "A fast learning algorithm for deep belief nets," Neural Computation, vol. 18, pp. 1527-1554, 2006.
10. D. Erhan, Y. Bengio, A. Courville, P. Manzagol, and P. Vincent, "Why does unsupervised pre-training help deep learning?," Journal of Machine Learning Research, vol. 11, pp. 625-660, 2010.
11. G. E. Hinton, "Training products of experts by minimizing contrastive divergence," Neural Computation, vol. 14, pp. 1771-1800, 2002.
12. G. E. Hinton, "A Practical Guide to Training Restricted Boltzmann Machines," in Technical report 2010-003, Machine Learning Group, University of Toronto, 2010.
13. K. F. Lee and H. W. Hon, "Speaker-independent phone recognition using hidden Markov models," IEEE Transactions on Audio, Speech & Language Processing, vol. 37, no. 11, pp. 16411648, 1989.
14. S. Young et. al., The HTK Book, Cambridge University, 2002.
15. H. Soltau, G. Saon, and B. Kingsbury, "The IBM Attila speech recognition toolkit," in Proc. IEEEWorkshop on Spoken Language Technology, 2010, to appear.
16. T. N. Sainath, B. Ramabhadran, M. Picheny, D. Nahamoo, and D. Kanevsky, "Exemplar-Based Sparse Representation Features: From TIMIT to LVCSR," Submitted to TSAP, 2010.