Paraphrastic language models

Computer Speech and Language

Volumn 28, Issue 6, 2014, Pages 1298-1316

  Liu, X ^a   Gales, M J F ^a   Woodland, P C ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

Language modelling; Paraphrase; Speech recognition

Indexed keywords

SEMANTICS; SPEECH RECOGNITION;

CONVERSATIONAL TELEPHONE SPEECH; ERROR RATE REDUCTION; LANGUAGE MODELLING; MULTI-LEVEL LANGUAGES; N-GRAM LANGUAGE MODELS; PARAPHRASE; SEMANTIC ANNOTATIONS; WEIGHTED FINITE-STATE TRANSDUCERS;

COMPUTATIONAL LINGUISTICS;

EID: 84903160476     PISSN: 08852308     EISSN: 10958363     Source Type: Journal    
DOI: 10.1016/j.csl.2014.04.004     Document Type: Article

References (47)

1. I. Androutsopoulos, and P. Malakasiotis A survey of paraphrasing and textual entailment methods J. Artif. Intell. Res. 38 2010 135 187
2. R. Barzilay, and L. Lee Learning to paraphrase: an unsupervised approach using multiple-sequence alignment Proc. of HLT-NAACL 2003 Edmonton 2003 16 23
3. Y. Bengio, R. Ducharme, P. Vincent, and C. Jauvin A neural probabilistic language model J. Mach. Learn. Res. 3 2 2003 1137 1155
4. P.F. Brown et al. A statistical approach to machine translation Comput. Linguist. 16 2 1990 79 85
5. P.F. Brown et al. Class-based n-gram models of natural language Comput. Linguist. 18 4 1992 467 470
6. I. Bulyko, M. Ostendorf, and A. Stolcke Getting more mileage from web text sources for conversational speech language modeling using class-dependent mixtures Proc. HLT Edmonton, Canada 2003
7. G. Cao, J.-Y. Nie, and J. Bai Integrating word relationships into language models Proc. ACM SIGIR2005 Salvador, Brazil 2005 298 305
8. S.F. Chen, and J.T. Goodman An empirical study of smoothing techniques for language modeling Comput. Speech Lang. 13 4 1999 359 394 (Pubitemid 30518216)
9. C. Cieri, D. Miller, and K. Walker The Fisher corpus: a resource for the next generations of speech-to-text Proc. LREC 2004 69 71
10. N. Chomsky Topics in the Theory of Generative Grammar, vol. 56 1966 Walter de Gruyter The Hague, The Neatherlands
11. Z. Dong, and Q. Dong HowNet and the Computation of Meaning 2006 World Scientific Charlottesville, Virginia 1 316 ISBN: 978-981-256-491-7
12. G. Evermann, H.Y. Chan, M.J.F. Gales, B. Jia, D. Mrva, P.C. Woodland, and K. Yu Training LVCSR systems on thousands of hours of data Proc. ICASSP2005, vol. 1 Philadelphia, PA 2005 209 212
13. C. Fellbaum WordNet: An Electronic Lexical Database 1998 MIT Press Cambridge, MA
14. Z. Harris Distributional structure Word 10 23 1954 146 162
15. Hoberman, R., Rosenfeld, R., (2002). Using WordNet to supplement corpus statistics (online document). Available from: http://www.cs.cmu.edu/∼roseh/ Papers/wordnet.pdf, 2002.
16. R. Jackendoff Semantic Interpretation in Generative Grammar 1974 MIT Press Cambridge, MA ISBN: 0262100134
17. F. Jelinek, R. Mercer, and S. Roukos Classifying words for improved statistical language models Proc. IEEE ICASSP1990. vol. 1 Albuquerque, New Mexico 1990 621 624
18. S.M. Katz Estimation of probabilities from sparse data for the language model component of a speech recognizer IEEE Trans Acoust. Speech Signal Process. 35 1987 400 401
19. R. Kneser, and H. Ney Improved clustering techniques for class based statistical language modeling Proc. EuroSpeech93' Berlin 1993
20. R. Kneser, and J. Peters Semantic clustering for adaptive language modeling Proc. ICASSP1997. vol. 2 Munich 1997 779 782
21. N. Kumar Investigation of Silicon-Auditory Models and Generalization of Linear Discriminant Analysis for Improved Speech Recognition 1997 John Hopkins University Baltimore (Ph.D. thesis)
22. H.-K. Kuo, E. Arisoy, A. Emami, and P. Vozila Large scale hierarchical neural network language models Proc. ISCA Interspeech2012 Portland, Oregon 2012
23. C.J. Leggetter, and P.C. Woodland Maximum likelihood linear regression for speaker adaptation of continuous density HMMs Comput. Speech Lang. 9 1995 171 186
24. H.-S. Le, I. Oparin, A. Allauzen, J.-L. Gauvain, and F. Yvon Structured output layer neural network language models for speech recognition IEEE Trans. Audio Speech Lang. Process. 21 1 2013 197 206
25. D. Lin, and P. Pantel DIRT - discovery of inference rules from text Proc. ACM SIGKDD2001 San Francisco, CA 2001 323 328
26. X. Liu, M.J.F. Gales, and P.C. Woodland Automatic complexity control for HLDA systems Proc. IEEE ICASSP2003. vol. 1 Hong Kong, China 2003 132 135
27. X. Liu, M.J.F. Gales, J.L. Hieronymus, and P.C. Woodland Language model combination and adaptation using weighted finite state transducers Proc. ICASSP, Dallas, TX 2010 5390 5393
28. X. Liu, M.J.F. Gales, and P.C. Woodland Use of contexts in language model interpolation and adaptation Comput. Speech Lang. 27 1 2013 301 321
29. X. Liu, J.L. Hieronymus, M.J.F. Gales, and P.C. Woodland Syllable language models for Mandarin speech recognition: exploiting character sequence models J. Acoust. Soc. Am. 133 1 2013 519 528
30. X. Liu, M.J.F. Gales, and P.C. Woodland Language model cross adaptation for LVCSR system combination Comput. Speech Lang. 27 4 2012 928 942 June 2013
31. X. Liu, M.J.F. Gales, and P.C. Woodland Paraphrastic language models Proc. ISCA Interspeech2012 Portland, Oregon 2012
32. X. Liu, M.J.F. Gales, and P.C. Woodland Paraphrastic language models and combination with neural network language models Proc. IEEE ICASSP2013 Vancouver, Canada 2013
33. N. Madnani, and B. Dorr Generating phrasal and sentential paraphrases: a survey of data-driven methods Comput. Linguist. 36 3 2010 2010
34. T. Mikolov, M. Karafiat, L. Burget, J. Cernocky, and S. Khudanpur Recurrent neural network based language model Proc. ISCA Interspeech Makuhari, Japan 2010 1045 1048
35. M. Mohri Finite-state transducers in language and speech processing Comput. Linguist. 23 2 1997 269 311
36. T.R. Niesler, and P.C. Woodland Combination of word-based and category-based language models Proc. ICSLP96' Philadelphia 1996 220 223
37. T.R. Niesler, E.W.D. Whittaker, and P.C. Woodland Comparison of part-of-speech and automatically derived category-based language models for speech recognition Proc. IEEE ICASSP1998. vol. 1 Seattle, WA 1998 177 180
38. J. Olive, C. Caitlin, and J. McCary Handbook of Natural Language Processing and Machine Translation: DARPA Global Autonomous Language Exploitation 2011 Springer
39. M. Padmanabhan et al. Speech recognition performance on a voicemail transcription task Proc. IEEE ICASSP1998 Seattle, WA 2 1998 913 916
40. J. Park, X. Liu, M.J.F. Gales, and P.C. Woodland Improved neural network based language modelling and adaptation Proc. ISCA Interspeech2010 Makuhari 2010
41. M. Pasca, and P. Dienes Aligning needles in a haystack: paraphrase acquisition across the web Proc. IJCNLP2005 Jeju Island 2005 119 130
42. D. Povey, and P.C. Woodland Minimum phone error and I-smoothing for improved discriminative training Proc. IEEE ICASSP2002 Orlando 2002
43. H. Schwenk Continuous space language models Comput. Speech Lang. 21 2007 492 518 (Pubitemid 46367510)
44. A. Stolcke SRILM - An Extensible Language Modeling Toolkit Proc. Proc. ICSLP'02 Denver 2002
45. M. Sundermeyer, R. Schlueter, and H. Ney LSTM neural networks for language modeling Proc. ISCA Interspeech2012 Portland, Oregon 2012
46. Y. Tam, and T. Schultz Correlated bi-gram LSA for unsupervised language model adaptation Proc. NIPS2008 Vancouver 2008 2008
47. P.C. Woodland, M.J.F. Gales, D. Pye, and S.J. Young The development of the 1996 HTK broadcast news transcription system Proc. DARPA Speech Recognition Workshop NY, US 1996 Arden House 73 78