Efficient one-pass decoding with NNLM for speech recognition

IEEE Signal Processing Letters

Volumn 21, Issue 4, 2014, Pages 377-381

  Shi, Yongzhe ^a   Zhang, Wei Qiang ^a   Cai, Meng ^a   Liu, Jia ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

Neural network language model; one pass decoding; speech recognition

Indexed keywords

EID: 84894523837     PISSN: 10709908     EISSN: None     Source Type: Journal    
DOI: 10.1109/LSP.2014.2303136     Document Type: Article

References (11)

1. Y. Bengio, R. Ducharme, P. Vincent, and C. Jauvin, "A neural probabilistic language model, " J. Mach. Learn. Res. (JMLR), pp. 1137-1155, 2003.
2. H. Schwenk and J.-L. Gauvain, "Connectionist language modeling for large vocabulary continuous speech recognition, " in Proc. ICASSP, 2002, pp. 765-768.
3. H. Schwenk, "Continuous space language models, " Comput., Speech Lang., vol. 21, no. 3, pp. 492-518, 2007. (Pubitemid 46367510)
4. A. Deoras, T. Mikolov, S. Kombrink, and K. Church, "Approximate inference: A sampling based modeling technique to capture complex dependencies in a language model, " Speech Commun., vol. 55, pp. 162-177, 2012.
5. E. Arisoy, S. F. Chen, B. Ramabhadran, and A. Sethy, "Converting neural network language models into back-off language models for efficient decoding in automatic speech recognition, " in Proc. ICASSP, 2013, pp. 8242-8246.
6. G. Lecorve and P. Motlicek, "Conversion of recurrent neural network language models to weighted finite state trans-ducers for automatic speech recognition, " in Proc. InterSpeech, 2012.
7. A. Mnih and G. Hinton, "A scalable hierarchical distributed language model, " Adv. Neural Inf. Process. Syst., vol. 21, 2008.
8. F. Zamora-Martlnez, M. J. Castro-Bleda, and S. Espana-Boquera, "Fast evaluation of connectionist language models, " in Proc. IWANN '09, 2009, pp. 33-40.
9. T. Mikolov, S. Kombrink, L. Burget, J. H. Cernocky, and S. Khu-danpur, "Extensions of recurrent neural network language model, " in Proc. ICASSP, 2011, pp. 5528-5531.
10. H.-S. Le, I. Oparin, A. Allauzen, J.-L. Gauvain, and F. Yvon, "Structured output layer neural network language models for speech recognition, " IEEE Trans. Audio, Speech, Lang. Process., vol. 21, no. 1, pp. 197-206, Jan. 2013.
11. Y. Shan, X. Chen, Y. Shi, and J. Liu, "Fast language model look-ahead algorithm using extended n-gram model, " Acta Autom. Sinica, vol. 38, pp. 1618-1626, 2012.