Semantic spaces for improving language modeling

Computer Speech and Language

Volumn 28, Issue 1, 2014, Pages 192-209

  Brychcín, Tomáš ^a   Konopík, Miloslav ^a  

^a UNIVERSITY OF WEST BOHEMIA   (Czech Republic)

Author keywords

BEAGLE; Class based language models; Clustering Inflectional languages; COALS; HAL; Machine translation; Purandare and Pedersen; Random Indexing; Semantic spaces

Indexed keywords

BEAGLE; CLASS-BASED LANGUAGE MODEL; HAL; MACHINE TRANSLATIONS; PURANDARE AND PEDERSEN; RANDOM INDEXING; SEMANTIC SPACE;

COAL; COMPUTATIONAL LINGUISTICS; COMPUTER AIDED LANGUAGE TRANSLATION; SEMANTICS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84885425676     PISSN: 08852308     EISSN: 10958363     Source Type: Journal    
DOI: 10.1016/j.csl.2013.05.001     Document Type: Article

References (45)

1. L.R. Bahl, F. Jelinek, and R.L. Mercer A maximum likelihood approach to continuous speech recognition IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-5 2 1983 179 190 (Pubitemid 13555897)
2. S. Bai, H. Li, Z. Lin, and B. Yuan Building class-based language models with contextual statistics Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing 1998 173 176
3. J.R. Bellegarda Exploiting latent semantic information in statistical language modeling Proceedings of the IEEE 88 August (8) 2000 1279 1296
4. J.R. Bellegarda, J.W. Butzberger, Y.L. Chow, N.B. Coccaro, and D. Naik A novel word clustering algorithm based on latent semantic analysis Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing 1996 172 175
5. D.M. Blei, A.Y. Ng, M.I. Jordan, and J. Lafferty Latent dirichlet allocation Journal of Machine Learning Research 3 2003 2003
6. P.F. Brown, P.V. deSouza, R.L. Mercer, V.J.D. Pietra, and J.C. Lai Class-based n-gram models of natural language Computational Linguistics 18 1992 467 479
7. T. Brychcín, and M. Konopík Morphological based language models for inflectional languages Proceedings of IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems 2011
8. C. Burgess, and K. Lund Modelling parsing constraints with high-dimensional context space Language and Cognitive Processes 12 1997 177 210
9. W.G. Charles Contextual correlates of meaning Applied Psycholinguistics 21 04 2000 505 524 (Pubitemid 33243104)
10. S.F. Chen, and J.T. Goodman An empirical study of smoothing techniques for language modeling. Tech. rep. 1998 Computer Science Group, Harvard University
11. S. Deerwester, S.T. Dumais, G.W. Furnas, T.K. Landauer, and R. Harshman Indexing by latent semantic analysis Journal of the American Society for Information Science 41 1990 391 407
12. A.P. Dempster, N.M. Laird, and D.B. Rubin Maximum likelihood from incomplete data via the EM algorithm Journal of the Royal Statistical Society. Series B 39 1 1977 1 38
13. J. Gao, J.T. Goodman, and J. Miao The use of clustering techniques for language modeling application to Asian languages Computational Linguistics 2002
14. D. Gildea, and T. Hofmann Topic-based language models using EM Proceedings of Eurospeech 1999 2167 2170
15. S. Hahn, A. Sethy, H.J. Kuo, and B. Ramabhadran A study of unsupervised clustering techniques for language modeling Proceedings of Interspeech 2008 1598 1601
16. T. Hofmann Probabilistic latent semantic analysis Proceedings of 15th Conference on Uncertainty in Artificial Intelligence 1999 289 296
17. M.N. Jones, and D.J.K. Mewhort Representing word meaning and order information in a composite holographic lexicon Psychological Review 114 2007 1 37
18. D. Jurgens, and K. Stevens The s-space package: an open source package for word space models System Papers of the Association of Computational Linguistics 2010
19. G. Karypis Cluto - A Clustering Toolkit 2003 www.cs.umn.edu/ karypis/cluto
20. K. Kirchhoff, D. Vergyri, J. Bilmes, K. Duh, and A. Stolcke Morphology-based language modeling for conversational Arabic speech recognition Computer Speech and Language 20 October (4) 2006 589 608 (Pubitemid 44142007)
21. P. Koehn Europarl: a parallel corpus for statistical machine translation Machine Translation Summit X. Phuket, Thailand 2005 79 86
22. P. Koehn, H. Hoang, A. Birch, C. Callison-Burch, M. Federico, N. Bertoldi, B. Cowan, W. Shen, C. Moran, R. Zens, C. Dyer, O. Bojar, A. Constantin, and E. Herbst Moses: open source toolkit for statistical machine translation Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions. ACL'07 2007 Association for Computational Linguistics 177 180
23. T.K. Landauer, and S.T. Dumais Solution to Plato's problem: the latent semantic analysis theory of acquisition, induction and representation of knowledge Psychological Review 104 104 1997 211 240
24. T.K. Landauer, P. Foltz, and D. Laham An introduction to latent semantic analysis Discourse Processes 25 1998 259 284
25. F. Liu, and Y. Liu Unsupervised language model adaptation incorporating named entity information Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics 2007 Association for Computational Linguistics 672 679
26. Y. Liu, and F. Liu Unsupervised language model adaptation via topic modeling based on named entity hypotheses Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing 2008 4921 4924
27. K. Lund, and C. Burgess Producing high-dimensional semantic spaces from lexical co-occurrence Behavior Research Methods Instruments and Computers 28 2 1996 203 208 (Pubitemid 126454814)
28. G. Maltese, P. Bravetti, H. Crepy, B.J. Grainger, M. Herzog, and F. Palou Combining word and class-based language models: a comparative study in several languages using automatic and manual wordclustering techniques Proceedings of 7th European Conference on Speech Communication and Technology. Eurospeech 2001 21 24
29. I. Oparin Language models for automatic speech recognition of inflectional languages 2008 University of West Bohemia Pilsen (Ph.D. thesis)
30. K. Papineni, S. Roukos, T. Ward, and W.-J. Zhu Bleu: a method for automatic evaluation of machine translation Proceedings of the 40th Annual Meeting on Association for Computational Linguistics. ACL'02 2002 Association for Computational Linguistics 311 318
31. A. Purandare, and T. Pedersen Word sense discrimination by clustering contexts in vector and similarity spaces Proceedings of 8th Conference on Computational Natural Language Learning 2004 41 48
32. D.L.T. Rohde, L.M. Gonnerman, and D.C. Plaut An improved method for deriving word meaning from lexical co-occurrence Cognitive Psychology 7 2004 573 605
33. H. Rubenstein, and J.B. Goodenough Contextual correlates of synonymy Communications of the ACM 8 October (10) 1965 627 633
34. M. Sahlgren An introduction to random indexing Methods and Applications of Semantic Indexing Workshop at the 7th International Conference on Terminology and Knowledge Engineering, TKE 2005
35. M. Sahlgren, A. Holst, and P. Kanerva Permutations as a means to encode order in word space Proceedings of the 30th Annual Conference of the Cognitive Science Society 2008 1300 1305
36. Y. Tam, and T. Schultz Dynamic language model adaptation using variational Bayes inference Proceedings of Interspeech 2005 5 8 (Pubitemid 43907987)
37. Y. Tam, and T. Schultz Unsupervised language model adaptation using latent semantic marginals Proceedings of Interspeech 2006
38. A. Vaiciunas, V. Kaminskas, and G. Raškinis Statistical language models of Lithuanian based on word clustering and morphological decomposition Informatica 15 4 2004 565 580 (Pubitemid 40664989)
39. S. Wang, D. Schuurmans, F. Peng, and Y. Zhao Semantic n-gram language modeling with the latent maximum entropy principle Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP03) 2003
40. S. Watanabe, T. Iwata, T. Hori, A. Sako, and Y. Ariki Topic tracking language model for speech recognition Computer Speech and Language April (25) 2011 440 461
41. E.W.D. Whittaker Statistical language modelling for automatic speech recognition of Russian and English 2000 Cambridge University Cambridge, MA, USA (Ph.D. thesis)
42. E.W.D. Whittaker, and P.C. Woodland Language modelling for Russian and English using words and classes Computer Speech and Language 17 2003 87 104
43. H. Yamamoto, and Y. Sagisaka Multi-class composite n-gram based on connection direction Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing 1999
44. T. Yokoyama, T. Shinozaki, K. Iwano, and S. Furui Unsupervised language model adaptation using word classes for spontaneous speech recognition Proceedings of IEEE-ISCA Workshop on Spontaneous Speech Processing and Recognition 2003 71 74
45. Y. Zhao, and G. Karypis Criterion Functions for Document Clustering: Experiments and Analysis. Tech. Rep. 2002 Department of Computer Science, University of Minnesota Minneapolis