Paraphrastic neural network language models

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2014, Pages 4903-4907

  Liu, X ^a   Gales, M J F ^a   Woodland, P C ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

neural network language model; paraphrase; speech recognition

Indexed keywords

AUDIO SYSTEMS; NATURAL LANGUAGE PROCESSING SYSTEMS; SIGNAL PROCESSING; SPEECH RECOGNITION;

CONVERSATIONAL TELEPHONE SPEECH RECOGNITION; ERROR RATE REDUCTION; FEED-FORWARD; NATURAL LANGUAGES; NETWORK LANGUAGE; PARAPHRASE; STATISTICAL LANGUAGE MODELS;

COMPUTATIONAL LINGUISTICS;

EID: 84905239312     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2014.6854534     Document Type: Conference Paper

References (28)

1. I. Androutsopoulos and P. Malakasiotis (2010). "A survey of paraphrasing and textual entailment methods", Journal of Artificial Intelligence Research, 38:135-187, 2010.
2. Y. Bengio and R. Ducharme (2003). "A neural probabilistic language model, " Journal of Machine Learning Research, vol. 3, pp. 1137-1155, 2003.
3. P. F. Brown et al. (1992). "Class-based n-gram models of natural language". Computational Linguistics 18(4) pp.467-470.
4. I. Bulyko, M. Ostendorf and A. Stolcke (2003). "Getting more mileage from web text sources for conversational speech language modeling using class-dependent mixtures", in Proc. HLT2003, Edmonton, Canada.
5. G. Cao, J-Y Nie and J. Bai (2005). "Integrating word relationships into language models", in Proc. ACM SIGIR2005, pp. 298-305, Salvador, Brazil.
6. G. Evermann, H. Y. Chan, M. J. F. Gales, B. Jia, D. Mrva, P. C. Woodland and K. Yu (2005). "Training LVCSR systems on thousands of hours of data, " in Proc. ICASSP2005, Philadelphia, PA, vol. 1, pp. 209-212.
7. C. Fellbaum (1998) WordNet: An electronic lexical database, MIT Press. Cambridge, MA.
8. Z. Harris (1954). "Distributional structure", Word, 10(2):3 pp.146-162.
9. R. Hoberman and R. Rosenfeld (2002). "Using WordNet to supplement corpus statistics" (Online Document). Available: http://www.cs.cmu.edu/~roseh/Papers/wordnet.pdf, 2002.
10. F. Jelinek, R. Mercer and S. Roukos (1990). "Classifying words for improved statistical language models", in Proc. IEEE ICASSP1990, Vol. 1, pp. 621-624, Albuquerque, New Mexico.
11. R. Kneser and H. Ney (1993), "Improved clustering techniques for class based statistical language modeling, " in Proc. EuroSpeech93', Berlin, Germany.
12. R. Kneser and J. Peters (1997). "Semantic clustering for adaptive language modeling", in Proc. ICASSP1997, Vol. 2, pp. 779-782, Munich, Germany.
13. H.-S. Le, I. Oparin, A. Allauzen, J.-L. Gauvain and F. Yvon (2013). "Structured output layer neural network language models for speech recognition", IEEE Transactions on Audio, Speech and Language Processing, 21(1), 2013, pp. 197-206.
14. D. Lin and P. Pantel (2001). "DIRT-discovery of inference rules from text", in Proc. ACM SIGKDD2001, pp.323-328, San Francisco, CA.
15. X. Liu, M. J. F. Gales, J. L. Hieronymus and P. C. Woodland (2010), "Language model combination and adaptation using weighted finite state transducers, " in Proc. ICASSP2010, Dallas, TX, 2010, pp. 5390-5393.
16. X. Liu, M. J. F. Gales and P. C. Woodland (2013). "Use of contexts in language model interpolation and adaptation, " Computer Speech and Language, vol. 27, no. 1, pp. 301-321, January 2013.
17. X. Liu, J. L. Hieronymus, M. J. F. Gales and P. C. Woodland (2013). "Syllable language models for Mandarin speech recognition: exploiting character sequence models", Journal of the Acoustical Society of America, Volume 133, Issue 1, pp. 519-528, January 2013.
18. X. Liu, M. J. F. Gales and P. C. Woodland (2012). "Paraphrastic language models", in Proc. ISCA Interspeech2012, Portland, Oregon.
19. X. Liu, M. J. F. Gales and P. C.Woodland (2013). "Paraphrastic language models and combination with neural network language models", in Proc. IEEE ICASSP2013, Vancouver, Canada.
20. X. Liu, M. J. F. Gales and P. C. Woodland (2013). "Crossdomain paraphrasing for improving language modelling using out-of-domain data", in Proc. ISCA Interspeech2013, Lyon, France.
21. N. Madnani and B. Dorr (2010). "Generating phrasal and sentential paraphrases: A survey of data-driven methods", Computational Linguistics, Vol. 36, No. 3, 2010.
22. T. Mikolov, M. Karafiat, L. Burget, J. Cernocky and S. Khudanpur (2010). "Recurrent neural network based language model", in Proc. ISCA Interspeech2010, pp. 1045-1048, Makuhari, Japan.
23. F. Morin and Y. Bengio (2005). "Hierarchical probabilistic neural network language model", in Proc. 10th International Workshop on Artificial Intelligence and Statistics, Barbados, 2005, pp.246-252.
24. M. Mohri (1997). "Finite-state transducers in language and speech processing", Computational Linguistics, 23:2, 1997.
25. J. Park, X. Liu, M. J. F. Gales and P. C. Woodland (2010), "Improved neural network based language modelling and adaptation, " in Proc. ISCA Interspeech, Makuhari, Japan, 2010, pp. 1041-1044.
26. M. Pasca and P. Dienes (2005). "Aligning needles in a haystack: Paraphrase acquisition across the Web", In Proc. IJCNLP2005, Jeju Island, pp. 119-130.
27. H. Schwenk (2007), "Continuous space language models", Computer Speech and Language, Vol. 21, 2007, pp. 492-518.
28. M. Sundermeyer, R. Schlueter and H. Ney (2012). "LSTM neural networks for language modeling", in Proc. ISCA Interspeech2012, Portland, Oregon