Improving wideband speech recognition using mixed-bandwidth training data in CD-DNN-HMM

2012 IEEE Workshop on Spoken Language Technology, SLT 2012 - Proceedings

Volumn , Issue , 2012, Pages 131-136

  Li, Jinyu ^a   Yu, Dong ^a   Huang, Jui Ting ^a   Gong, Yifan ^a  

^a MICROSOFT   (United States)

Author keywords

CD DNN HMM; deep neural network; log filter bank; mixed bandwidth; narrowband; wideband

Indexed keywords

CD-DNN-HMM; DEEP NEURAL NETWORKS; MIXED-BANDWIDTH; NARROW BANDS; WIDE-BAND;

FILTER BANKS; HIDDEN MARKOV MODELS; NEURAL NETWORKS; SPEECH RECOGNITION;

BANDWIDTH;

EID: 84874282188     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SLT.2012.6424210     Document Type: Conference Paper

References (22)

1. D. Yu, L. Deng, and G. Dahl, "Roles of pretraining and finetuning in context-dependent DNN-HMMs for real-world speech recognition," in Proc. NIPS Workshop on Deep Learning and Unsupervised Feature Learning, Dec. 2010.
2. G. Dahl, D. Yu, L. Deng, and A. Acero, "Context-dependent pre-trained deep neural networks for large vocabulary speech recognition," IEEE Trans. Speech and Audio Proc., vol. 20, no. 1, pp. 30-42, 2012.
3. F. Seide, G. Li, and D. Yu, "Conversational speech transcription using context-dependent deep neural networks," in Proc. Interspeech, 2011.
4. D. Yu, F. Seide, G. Li, J. Li, and M. Seltzer, "Why deep neural networks are promising for large vocabulary speech recognition," submitted to IEEE Trans. on Audio, Speech, and Language Processing, 2012.
5. N. Jaitly, P. Nguyen, A. Senior, and V. Vanhoucke, "An application of pretrained deep neural networks to large vocabulary conversational speech recognition," Tech. Rep. 001, Department of Computer Science, University of Toronto, 2012.
6. T. N. Sainath, B. Kingsbury, and B. Ramabhadran, "Improvements in using deep belief networks for large vocabulary continuous speech recognition," Tech. Rep. UTML TR 2010-003, Speech and Language Algorithm Group, IBM, February 2011
7. T. N. Sainath, B. Kingsbury, B. Ramabhadran, P. Fousek, P. Novak, A.-r. Mohamed, "Making deep belief networks effective for large vocabulary continuous speech recognition", in Proc. ASRU 2011, pp. 30-35.
8. D. Yu, Y. C. Ju, Y. Y. Wang, G. Zweig, and A. Acero, "Automated directory assistance system-from theory to practice," in Proc. Interspeech, 2007, pp. 2709-2711.
9. P. Moreno and R. M. Stern, "Sources of degradation of speech recognition in the telephone network," in Proc. ICASSP, Adelaide, Australia, vol. I, pp.109-112, Apr. 1994.
10. X. Huang, A. Acero, and H.-W. Hon, Spoken Language Processing, Prentice-Hall, May 2001.
11. M. L. Seltzer and A. Acero, "Training wideband acoustic models using mixed-bandwidth training data for speech recognition", IEEE Transactions on Audio, Speech, and Language Processing, vol. 15, no. 1, pp. 235-245, 2007.
12. M. L. Seltzer, A. Acero, and J. Droppo, "Robust bandwidth extension of noise-corrupted narrowband speech," in Proc. Interspeech, pp. 1509-1512, 2005.
13. Y. M. Cheng, D. O'Shaughnessy, and P. Mermelstein, "Statistical recovery of wideband speech from narrowband speech," IEEE Trans. Speech Audio Process., vol. 2, no. 4, pp. 544-548, Oct. 1994.
14. K.-Y. Park and H. S. Kim, "Narrowband to wideband conversion of speech using GMM based transformation," in Proc. ICASSP, Istanbul, Turkey, Jun. 2000, vol. 3, pp. 1843-1846.
15. P. Jax and P. Vary, "Wideband extension of telephone speech using a hidden Markov model," in IEEE Workshop on Speech Coding, Delavan, WI, Sep. 2000, pp. 133-135.
16. A. Senior V. Vanhoucke and M. Z. Mao (2011), "Improving the speed of neural networks on CPUs," in Proc. Deep Learning and Unsupervised Feature Learning Workshop, NIPS, 2011.
17. A. Mohamed, G. Hinton, and G. Penn, "Understanding how deep belief networks perform acoustic modelling", in Proc. ICASSP, pp. 4273-4276, 2012.
18. D. Povey, B. Kingsbury, L. Mangu, G. Saon, H. Soltau and G. Zweig, "fMPE: discriminatively trained features for speech recognition," in Pro. ICASSP, 2005.
19. D. Povey, D. Kanevsky, B. Kingsbury, B. Ramabhadran, G. Saon and K. Visweswariah, "Boosted MMI for model and feature space discriminative training", in Proc. ICASSP, 2008
20. A. Mohamed, D. Yu, and L. Deng, "Investigation of fullsequence training of deep belief networks for speech recognition", in Proc. Interspeech 2010, pp. 1692-1695.
21. B. Kingsbury, "Lattice-based optimization of sequence classification criteria for neural-network acoustic modeling," in Proc. ICASSP 2009, pp. 3761-3764.
22. X. Fan, M. Seltzer, J. Droppo, H. Malvar, and A. Acero, "Joint encoding of the waveform and speech recognition features using a transform codec," in Proc. ICASSP, pp.5148-5151, May 2011.