Segmental conditional random fields with deep neural networks as acoustic models for first-password recognition

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn 2015-January, Issue , 2015, Pages 2640-2644

  He, Yanzhang ^a   Fosler Lussier, Eric ^a  

^a The Ohio State University   (United States)

Author keywords

First pass decoder; Segmental conditional random fields; Word recognition

Indexed keywords

ACOUSTIC FIELDS; DECODING; RANDOM PROCESSES; SPEECH COMMUNICATION; TELEPHONE SETS; VOCABULARY CONTROL;

DEEP NEURAL NETWORKS; FIRST-PASS DECODER; LATTICE GENERATIONS; LATTICE RESCORING; PASSWORD RECOGNITION; SEGMENTAL CONDITIONAL RANDOM FIELDS; UNIFIED FRAMEWORK; WORD RECOGNITION;

SPEECH RECOGNITION;

EID: 84959175560     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. M. Ostendorf, V. V. Digalakis, and O. A. Kimball, "From hmm's to segment models: A unified view of stochastic modeling for speech recognition, " Speech and Audio Processing, IEEE Transactions on, vol. 4, no. 5, pp. 360-378, 1996.
2. J. R. Glass, "A probabilistic framework for segment-based speech recognition, " Computer Speech & Language, vol. 17, no. 2, pp. 137-152, 2003.
3. L. Deng, DYNAMIC SPEECH MODELS-Theory, Algorithm, and Application. Morgan & Claypool, December 2006.
4. M. DeWachter, M. Matton, K. Demuynck, P. Wambacq, R. Cools, and D. Van Compernolle, "Template-based continuous speech recognition, " Audio, Speech, and Language Processing, IEEE Transactions on, vol. 15, no. 4, pp. 1377-1390, 2007.
5. M. Layton and M. Gales, "Augmented statistical models for speech recognition, " in Acoustics, Speech and Signal Processing, 2006. ICASSP 2006 Proceedings. 2006 IEEE International Conference on, vol. 1. IEEE, 2006, pp. I-I.
6. G. Zweig and P. Nguyen, "A segmental CRF approach to large vocabulary continuous speech recognition, " in Proceedings of the IEEE Workshop on Automatic Speech Recognition Understanding (ASRU'09), Merano, Italy, Dec. 2009, pp. 152-157.
7. S. Zhang, A. Ragni, and M. Gales, "Structured log linear models for noise robust speech recognition, " Signal Processing Letters, IEEE, vol. 17, no. 11, pp. 945-948, 2010.
8. G. Zweig, P. Nguyen, D. Van Compernolle, K. Demuynck, L. Atlas, P. Clark, G. Sell, M. Wang, F. Sha, H. Hermansky, D. Karakos, A. Jansen, S. Thomas, G. S. V. S. Sivaram, S. Bowman, and J. Kao, "Speech recognition with segmental conditional random fields: A summary of the JHU CLSP 2010 summer workshop, " in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'11), Prague, Czech Republic, May 2011, pp. 5044-5047.
9. G. Zweig, "Classification and recognition with direct segment models, " in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'12), Kyoto, Japan, Mar. 2012, pp. 4161-4164.
10. Y. He and E. Fosler-Lussier, "Efficient segmental conditional random fields for phone recognition, " in Proceedings of the Annual Conference of the International Speech Communication Association (Interspeech'12), Portland, OR, USA, Sep. 2012.
11. O. Abdel-Hamid, L. Deng, D. Yu, and H. Jiang, "Deep segmental neural networks for speech recognition, " in INTERSPEECH, 2013.
12. G. Hinton, L. Deng, D. Yu, G. E. Dahl, A.-r. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. N. Sainath et al., "Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups, " Signal Processing Magazine, IEEE, vol. 29, no. 6, pp. 82-97, 2012.
13. L. Deng, J. Li, J.-T. Huang, K. Yao, D. Yu, F. Seide, M. Seltzer, G. Zweig, X. He, J. Williams et al., "Recent advances in deep learning for speech research at microsoft, " ICASSP 2013, 2013.
14. J. Lafferty, A. McCallum, and F. Pereira, "Conditional random fields: Probabilistic models for segmenting and labeling sequence data, " 2001.
15. E. Fosler-Lussier, Y. He, P. Jyothi, and R. Prabhavalkar, "Conditional random fields in speech, audio, and language processing, " Proceedings of the IEEE, vol. 101, no. 5, pp. 1054-1075, 2013.
16. S. Sarawagi andW. W. Cohen, "Semi-Markov conditional random fields for information extraction, " in Advances in Neural Information Processing Systems (NIPS'04), Vancouver, British Columbia, Canada, Dec. 2004, pp. 1185-1192.
17. H. Bourlard and N. Morgan, Connectionist Speech Recognition: A Hybrid Approach. Kluwer Academic Publishers, 1993.
18. M. Mohri, F. Pereira, and M. Riley, "Speech recognition with weighted finite-state transducers, " in Springer Handbook of Speech Processing. Springer, 2008, pp. 559-584.
19. J. J. Morris, "A study on the use of conditional random fields for automatic speech recognition, " Ph. D. dissertation, The Ohio State University, 2010.
20. D. Povey, A. Ghoshal, G. Boulianne, L. Burget, O. Glembek, N. Goel, M. Hannemann, P. Motlicek, Y. Qian, P. Schwarz et al., "The Kaldi speech recognition toolkit, " in Proc. of ASRU, 2011, pp. 1-4.
21. B. Kingsbury, "Lattice-based optimization of sequence classification criteria for neural-network acoustic modeling, " in Proc. of ICASSP, 2009, pp. 3761-3764.
22. K. Vesely, A. Ghoshal, L. Burget, and D. Povey, "Sequencediscriminative training of deep neural networks, " in INTERSPEECH, 2013.
23. J. Duchi, E. Hazan, and Y. Singer, "Adaptive subgradient methods for online learning and stochastic optimization, " J. Mach. Learn. Res., vol. 12, pp. 2121-2159, 2011.
24. X. He, L. Deng, and W. Chou, "Discriminative learning in sequential pattern recognition, " IEEE Signal Processing Magazine, vol. 25, no. 5, pp. 14-36, Sep. 2008.
25. D. Povey, "Discriminative training for large vocabulary speech recognition, " Ph. D. dissertation, University of Cambridge, 2004.
26. R. Prabhavalkar and E. Fosler-Lussier, "Backpropagation training for multilayer conditional random field based phone recognition, " in Acoustics Speech and Signal Processing (ICASSP), 2010 IEEE International Conference on. IEEE, 2010, pp. 5534-5537.
27. S.-X. Zhang and M. J. Gales, "Structured svms for automatic speech recognition, " Audio, Speech, and Language Processing, IEEE Transactions on, vol. 21, no. 3, pp. 544-555, 2013.
28. H. Tang, K. Gimpel, and K. Livescu, "A comparison of training approaches for discriminative segmental models, " in Proc. Annual Conference of International Speech Communication Association (INTERSPEECH), 2014.
29. A. J. Robinson, "An application of recurrent nets to phone probability estimation, " Neural Networks, IEEE Transactions on, vol. 5, no. 2, pp. 298-305, 1994.
30. A. Graves, A.-r. Mohamed, and G. Hinton, "Speech recognition with deep recurrent neural networks, " in Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on. IEEE, 2013, pp. 6645-6649.
31. H. Sak, A. Senior, and F. Beaufays, "Long short-term memory recurrent neural network architectures for large scale acoustic modeling, " in Proceedings of the Annual Conference of International Speech Communication Association (INTERSPEECH), 2014.