Deep segmental neural networks for speech recognition

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2013, Pages 1849-1853

  Abdel Hamid, Ossama ^a   Deng, Li ^b   Yu, Dong ^b   Jiang, Hui ^a  

^a YORK UNIVERSITY   (Canada)

^b MICROSOFT RESEARCH   (United States)

Author keywords

Deep segmental neural network; Segmental conditional random field; Segmental model

Indexed keywords

HIDDEN MARKOV MODELS; HYBRID SYSTEMS; RANDOM PROCESSES;

DECODING ALGORITHM; DEEP NEURAL NETWORKS; EVALUATION EXPERIMENTS; LARGE VOCABULARY SPEECH RECOGNITION; SEGMENTAL CONDITIONAL RANDOM FIELDS; VARIABLE LENGTH;

SPEECH RECOGNITION;

EID: 84906282118     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. G. Dahl, D. Yu, L. Deng, and A. Acero, "Contextdependent pre-trained deep neural networks for largevocabulary speech recognition, " Audio, Speech, and Language Processing, IEEE Transactions on, vol. 20, no. 1, pp. 30 -42, jan. 2012.
2. F. Seide, G. Li, and D. Yu, "Conversational speech transcription using context-dependent deep neural networks, " in Interspeech 2011, 2011.
3. T. N. Sainath, B. Kingsbury, B. Ramabhadran, P. Fousek, P. Novak, and A. Mohamed, "Making deep belief networks effective for large vocabulary continuous speech recognition, " in ASRU, 2011.
4. G. Hinton, L. Deng, D. Yu, G. Dahl, A. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. Sainath, and B. Kingsbury, "Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups, " Signal Processing Magazine, IEEE, vol. 29, no. 6, pp. 82 -97, nov. 2012.
5. D. Yu, L. Deng, and F. Seide, "The deep tensor neural network with applications to large vocabulary speech recognition, " IEEE Trans. Audio, Speech, and Language Proc., vol. 21, no. 2, pp. 388-396, 2013.
6. L. Deng, O. Abdel-Hamid, and D. Yu, "A deep convolutional neural network using heterogeneous pooling for trading acoustic invariance with phonetic confusion, " in Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on, May 2013.
7. L. Deng, J. Li, J.-T. Huang, K. Yao, D. Yu, F. Seide, M. Seltzer, G. Zweig, X. He, J. Williams, Y. Gong, and A. Acero, "Recent advances in deep learning for speech research at Microsoft, " in Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on, May 2013.
8. S. M. Siniscalchi, D. Yu, L. Deng, and C. hui Lee, "Speech recognition using long-span temporal patterns in a deep network model, " IEEE Signal Processing Letters, March 2013.
9. M. Ostendorf, V. Digalakis, and O. Kimball, "From HMM's to segment models: A unified view of stochastic modeling for speech recognition, " Speech and Audio Processing, IEEE Transactions on, vol. 4, no. 5, pp. 360-378, 1996.
10. L. Deng, "A generalized hidden markov model with stateconditioned trend functions of time for the speech signal, " Signal Processing, vol. 27, no. 1, pp. 65 - 78, 1992.
11. L. Deng, M. Aksmanovic, X. Sun, and C. Wu, "Speech recognition using hidden markov models with polynomial regression functions as nonstationary states, " Speech and Audio Processing, IEEE Transactions on, vol. 2, no. 4, pp. 507 -520, oct 1994.
12. G. Zweig and P. Nguyen, "A segmental CRF approach to large vocabulary continuous speech recognition, " in Automatic Speech Recognition Understanding, 2009. ASRU 2009. IEEE Workshop on, 13 2009-dec. 17 2009, pp. 152 -157.
13. G. Zweig, P. Nguyen, D. Van-Compernolle, K. Demuynck, L. Atlas, P. Clark, G. Sell, M. Wang, F. Sha, H. Hermansky, D. Karakos, A. Jansen, S. Thomas, G. Sivaram, S. Bowman, and J. Kao, "Speech recognition with segmental conditional random fields: A summary of the JHU CLSP 2010 summer workshop, " in Acoustics, Speech and Signal Processing (ICASSP), 2011 IEEE International Conference on, may 2011, pp. 5044 -5047.
14. A. Mohamed, G. Dahl, and G. Hinton, "Acoustic modeling using deep belief networks, " Audio, Speech, and Language Processing, IEEE Transactions on, vol. 20, no. 1, pp. 14 -22, jan. 2012.
15. O. Abdel-Hamid, A. Mohamed, H. Jiang, and G. Penn, "Applying convolutional neural networks concepts to hybrid NN-HMM model for speech recognition, " in Acoustics, Speech and Signal Processing (ICASSP), 2012 IEEE International Conference on, march 2012, pp. 4277 - 4280.
16. G. Zweig, "Classification and recognition with direct segment models, " in Acoustics, Speech and Signal Processing (ICASSP), 2012 IEEE International Conference on, march 2012, pp. 4161 -4164.
17. S. Austin, G. Zavaliagkos, J. Makhoul, and R. Schwartz, "Continuous speech recognition using segmental neural nets, " in Neural Networks, 1992. IJCNN., International Joint Conference on, vol. 2, jun 1992, pp. 314 -319 vol.2.
18. Y. He and E. Fosler-Lussier, "Efficient segmental conditional random fields for one-pass phone recognition, " in Interspeech 2012, 2012.
19. R. Prabhavalkar and E. Fosler-Lussier, "Backpropagation training for multilayer conditional random field based phone recognition, " in Acoustics Speech and Signal Processing (ICASSP), 2010 IEEE International Conference on, march 2010, pp. 5534 -5537.
20. A.-R. Mohamed, D. Yu, and L. Deng, "Investigation of full-sequence training of deep belief networks for speech recognition, " in Interspeech, 2010, pp. 2846-2849.
21. D. Yu and L. Deng, "Deep-structured hidden conditional random fields for phonetic recognition, " in Interspeech, 2010.
22. T.-M.-T. Do and T. Artieres, "Neural conditional random fields, " in Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, vol. 9, 5 2010.