Enhancing language models in statistical machine translation with backward n-grams and mutual information triggers

ACL-HLT 2011 - Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies

Volumn 1, Issue , 2011, Pages 1288-1297

  Xiong, Deyi ^a   Zhang, Min ^a   Li, Haizhou ^a  

^a INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

Author keywords

[No Author keywords available]

Indexed keywords

LANGUAGE MODEL; LONG-DISTANCE DEPENDENCIES; MUTUAL INFORMATIONS; N-GRAM LANGUAGE MODELS; N-GRAMS; PHRASE-BASED STATISTICAL MACHINE TRANSLATION; STATISTICAL MACHINE TRANSLATION; TRAINING DATA; TRANSLATION QUALITY;

INFORMATION THEORY;

COMPUTATIONAL LINGUISTICS;

EID: 84859097531     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (25)

1. Thorsten Brants, Ashok C. Popat, Peng Xu, Franz J. Och, and Jeffrey Dean. 2007. Large language models in machine translation. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), pages 858-867, Prague, Czech Republic, June. Association for Computational Linguistics.
2. P. F. Brown, S. A. Della Pietra, V. J. Della Pietra, and R. L. Mercer. 1993. The mathematics of statistical machine translation: Parameter estimation. Computational Linguistics, 19(2):263-311.
3. Eugene Charniak, Kevin Knight, and Kenji Yamada. 2003. Syntax-based language models for statistical machine translation. In Proceedings of MT Summit IX. Intl. Assoc. for Machine Translation.
4. David Chiang. 2007. Hierarchical phrase-based translation. Computational Linguistics, 33(2):201-228.
5. Kenneth Ward Church and Patrick Hanks. 1990. Word association norms, mutual information, and lexicography. Computational Linguistics, 16(1):22-29.
6. Jacques Duchateau, Kris Demuynck, and Patrick Wambacq. 2002. Confidence scoring based on backward language models. In Proceedings of ICASSP, pages 221-224, Orlando, FL, April.
7. Ahmad Emami, Kishore Papineni, and Jeffrey Sorensen. 2007. Large-scale distributed language modeling. In Proceedings of ICASSP, pages 37-40, Honolulu, HI, April.
8. Andrew Finch and Eiichiro Sumita. 2009. Bidirectional phrase-based statistical machine translation. In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, pages 1124-1132, Singapore, August. Association for Computational Linguistics.
9. Joshua T. Goodman. 2001. A bit of progress in language modeling extended version. Technical report, Microsoft Research.
10. Philipp Koehn, Franz Joseph Och, and Daniel Marcu. 2003. Statistical phrase-based translation. In Proceedings of the 2003 Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics, pages 58-54, Edmonton, Canada, May-June.
11. Philipp Koehn. 2004. Statistical significance tests for machine translation evaluation. In Proceedings of EMNLP 2004, pages 388-395, Barcelona, Spain, July.
12. Arne Mauser, Saša Hasan, and Hermann Ney. 2009. Extending statistical machine translation with discriminative and trigger-based lexicon models. In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, pages 210-218, Singapore, August. Association for Computational Linguistics.
13. Franz Josef Och. 2003. Minimum error rate training in statistical machine translation. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics, pages 160-167, Sapporo, Japan, July.
14. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. Bleu: a method for automatic evaluation of machine translation. In Proceedings of 40th Annual Meeting of the Association for Computational Linguistics, pages 311-318, Philadelphia, Pennsylvania, USA, July.
15. Matt Post and Daniel Gildea. 2008. Parsers as language models for statistical machine translation. In Proceedings of AMTA.
16. Sylvain Raybaud, Caroline Lavecchia, David Langlois, and Kamel Smaïli. 2009. New confidence measures for statistical machine translation. In Proceedings of the International Conference on Agents and Artificial Intelligence, pages 61-68, Porto, Portugal, January.
17. Roni Rosenfeld, Jaime Carbonell, and Alexander Rudnicky. 1994. Adaptive statistical language modeling: A maximum entropy approach. Technical report, Carnegie Mellon University.
18. Libin Shen, Jinxi Xu, and Ralph Weischedel. 2008. A new string-to-dependency machine translation algorithm with a target dependency language model. In Proceedings of ACL-08: HLT, pages 577-585, Columbus, Ohio, June. Association for Computational Linguistics.
19. Andreas Stolcke. 2002. Srilm-an extensible language modeling toolkit. In Proceedings of the 7th International Conference on Spoken Language Processing, pages 901-904, Denver, Colorado, USA, September.
20. David Talbot and Miles Osborne. 2007. Randomised language modelling for statistical machine translation. In Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, pages 512-519, Prague, Czech Republic, June. Association for Computational Linguistics.
21. Dekai Wu. 1996. A polynomial-time algorithm for statistical machine translation. In Proceedings of the 34th Annual Meeting of the Association for Computational Linguistics, pages 152-158, Santa Cruz, California, USA, June.
22. Dekai Wu. 1997. Stochastic inversion transduction grammars and bilingual parsing of parallel corpora. Computational Linguistics, 23(3):377-403. (Pubitemid 127461226)
23. Deyi Xiong, Qun Liu, and Shouxun Lin. 2006. Maximum entropy based phrase reordering model for statistical machine translation. In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, pages 521-528, Sydney, Australia, July. Association for Computational Linguistics.
24. Ying Zhang, Almut Silja Hildebrand, and Stephan Vogel. 2006. Distributed language modeling for n-best list re-ranking. In Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, pages 216-223, Sydney, Australia, July. Association for Computational Linguistics.
25. GuoDong Zhou. 2004. Modeling of long distance context dependency. In Proceedings of Coling, pages 92- 98, Geneva, Switzerland, Aug 23-Aug 27. COLING.