Paraphrastic recurrent neural network language models

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 2015-August, Issue , 2015, Pages 5406-5410

  Liu, X ^a   Chen, X ^a   Gales, M J F ^a   Woodland, P C ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

language model; paraphrase; recurrent neural network; speech recognition

Indexed keywords

AUDIO SIGNAL PROCESSING; COMPUTATIONAL LINGUISTICS; RECURRENT NEURAL NETWORKS; SPEECH; SPEECH COMMUNICATION;

AUTOMATICALLY GENERATED; CONVERSATIONAL TELEPHONE SPEECH RECOGNITION; ERROR RATE REDUCTION; LANGUAGE MODEL; LARGE VOCABULARY; PARAPHRASE; SPEECH RECOGNITION SYSTEMS; STATE OF THE ART;

SPEECH RECOGNITION;

EID: 84946066405     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2015.7179004     Document Type: Conference Paper

References (30)

1. I. Androutsopoulos and P. Malakasiotis (2010). "A survey of paraphrasing and textual entailment methods", Journal of Artificial Intelligence Research, 38:135-187, 2010.
2. Y. Bengio and R. Ducharme (2003), "A neural probabilistic language model," Journal of Machine Learning Research, vol. 3, pp. 1137-1155, 2003.
3. I. Bulyko, M. Ostendorf, and A. Stolcke (2003), "Getting more mileage from web text sources for conversational speech language modeling using class-dependent mixtures," in Proc. HLT, Edmonton, Canada, 2003.
4. X. Chen, Y. Wang, X. Liu, M. J. F. Gales and P. C. Woodland (2014). "Efficient GPU-based training of recurrent neural network language models using spliced sentence bunch", in Proc. ISCA Interspeech2014, Singapore, pp. 641-645.
5. A. Deoras, T. Mikolov, S. Kombrink and K. Church (2013), "Approximate inference: A sampling based modeling technique to capture complex dependencies in a language model," Speech Communication, vol. 55, no. 1, pp. 162-177, January 2013.
6. A. Emami and L. Mangu (2007), "Empirical study of neural network language models for Arabic speech recognition," in Proc. ASRU, Kyoto, Japan, 2007, pp. 147-152.
7. G. Evermann, H. Y. Chan, M. J. F. Gales, B. Jia, D. Mrva, P. C.Woodland, and K. Yu (2005), "Training LVCSR systems on thousands of hours of data," in Proc. ICASSP, Philadelphia, PA, 2005, vol. 1, pp. 209-212.
8. Z. Harris (1954). "Distributional structure", Word, 10(2):3 pp.146-162.
9. T. Hori, Y. Kubo, and A. Nakamura (2014). "Real-time onepass decoding with recurrent neural network language model for speech recognition", in Proc. IEEE ICASSP2014, Florence, Italy.
10. Z. Huang, G. Zweig, and B. Dumoulin (2014). " Cache based recurrent neural network language model inference for first pass speech recognition", in Proc. IEEE ICASSP2014, Florence, Italy, pp. 6404-6408.
11. H.-S. Le, I. Oparin, A. Allauzen, J. Gauvain, and F. Yvon (2013), "Structured output layer neural network language models for speech recognition," IEEE Transactions on Audio, Speech and Language Processing, vol. 21, no. 1, pp. 197-206, 2013.
12. X. Liu, M. J. F. Gales, and P. C. Woodland (2013), "Use of contexts in language model interpolation and adaptation," Computer Speech &Language, vol. 27, no. 1, pp. 301-321, January 2013.
13. X. Liu, J. L. Hieronymus, M. J. F. Gales and P. C. Woodland (2013). "Syllable language models for Mandarin speech recognition: exploiting character sequence models", Journal of the Acoustical Society of America, Volume 133, Issue 1, pp. 519-528, January 2013.
14. X. Liu, M. J. F. Gales and P. C. Woodland (2012). "Paraphrastic language models", in Proc. ISCA Interspeech2012, Portland, Oregon.
15. X. Liu, M. J. F. Gales and P. C. Woodland (2014). "Paraphrastic neural network language models", in Proc. IEEE ICASSP2014, Florence, Italy.
16. X. Liu, Y. Wang, X. Chen, M. J. F. Gales and P. C. Woodland (2014). "Efficient lattice rescoring using recurrent neural network language models", in Proc. IEEE ICASSP2014, Florence, Italy.
17. X. Liu, M. J. F. Gales, and P. C. Woodland (2014). "Paraphrastic language models", Computer Speech and Language, Volume 28, Issue 6, pp. 1298-1316., November 2014.
18. N. Madnani and B. Dorr (2010). "Generating phrasal and sentential paraphrases: a survey of data-driven methods", Computational Linguistics, Vol. 36, No. 3, 2010.
19. T. Mikolov, M. Karafiat, L. Burget, J. Cernocky, and S. Khudanpur (2010), "Recurrent neural network based language model," in Proc. ISCA Interspeech, Makuhari, Japan, 2010, pp. 1045-1048.
20. T. Mikolov, S. Kombrink, L. Burget, J. H. Cernocky, and S. Khudanpur (2011), "Extensions of recurrent neural network language model," in Proc. ICASSP, Prague, Czech Republic, 2011, pp. 5528-5531.
21. T. Mikolov, S. Kombrink, L. Burget, J. H. Cernocky and S. Khudanpur (2011), "RNNLM-Recurrent neural network language modeling toolkit", in demo session of IEEE ASRU2011, Hawaii.
22. T. Mikolov, W. Yih, and G. Zweig (2013). "Linguistic regularities in continuous space word representations", in Proc. NAACL-HLT-2013, Association for Computational Linguistics, 27 May, 2013.
23. F. Morin and Y. Bengio (2005), "Hierarchical probabilistic neural network language model," in Proc. International workshop on artificial intelligence and statistics, Barbados, 2005, pp. 246-252.
24. M. Mohri (1997), "Finite-state transducers in language and speech processing," Computational linguistics, vol. 23, no. 2, pp. 269-311, 1997.
25. J. Park, X. Liu, M. J. F. Gales, and P. C. Woodland (2010), "Improved neural network based language modelling and adaptation," in Proc. ISCA Interspeech, Makuhari, Japan, 2010, pp. 1041-1044.
26. D. E. Rumelhart, G. E. Hintont, and R. J. Williams (1986), "Learning representations by back-propagating errors," Nature, vol. 323, no. 6088, pp. 533-536, 1986.
27. H. Schwenk (2007), "Continuous space language models," Computer Speech &Language, vol. 21, no. 3, pp. 492-518, 2007.
28. Y. Si, Q. Zhang, T. Li, J. Pan, and Y. Yan (2013), "Prefix tree based n-best list re-scoring for recurrent neural network language model used in speech recognition system," in Proc. ISCA Interspeech, Lyon, France, 2013, pp. 3419-3423.
29. M. Sundermeyer, R. Schlüter, and H. Ney (2012), "LSTM neural networks for language modeling," in Proc. ISCA Interspeech, Portland, OR, 2012.
30. M. Sundermeyer, I. Oparin, J. L. Gauvain, B. Freiberg, R. Schluter, and H. Ney (2013), "Comparison of feedforward and recurrent neural network language models," in Proc. ICASSP, Vancouver, Canada, 2013, pp. 8430-8434.