Language modelweight adaptation based on cross-entropy for statistical machine translation

PACLIC 25 - Proceedings of the 25th Pacific Asia Conference on Language, Information and Computation

Volumn , Issue , 2011, Pages 20-30

  Zhao, Yinggong ^a   Ji, Yangsheng ^a   Xi, Ning ^a   Huang, Shujian ^a   Chen, Jiajun ^a  

^a NANJING UNIVERSITY   (China)

Author keywords

Crossentropy; Language model; Statistical machine translation; Weight adaptation

Indexed keywords

ADAPTATION STRATEGIES; CROSS ENTROPY; DATA SETS; LANGUAGE MODEL; STATISTICAL MACHINE TRANSLATION; WEIGHT ADAPTATION;

COMPUTATIONAL LINGUISTICS; ENTROPY; STATISTICAL TESTS;

TRANSLATION (LANGUAGES);

EID: 84863858754     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Article

References (17)

1. Amittai Axelrod, Xiaodong He and Jianfeng Gao. 2011. Domain Adaptation via Pseudo In- Domain Data Selection. In Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, 355-362, Edinburgh, July, 2011.
2. David Chiang. 2005. A Hierarchical Phrase-based Model for Statistical Machine Translation. In Proceedings of the 43rd Annual Meeting of the ACL, 263-270.
3. Almut Hildebrand, Matthias Eck, Stephan Vogel, and Alex Waibel. 2005. Adaptation of the Translation Model for Statistical Machine translation based on Information Retrieval. In Proceedings of EAMT, Budapest, Hungary.
4. George Foster and Roland Kuhn. 2007. Mixture-Model Adaptation for SMT. In Proceedings of the Second ACL Workshop on Statistical Machine Translation, Prague, Czech Republic.
5. George Foster, Cyril Goutte and Roland Kuhn. 2010. Discriminative Instance Weighting for Domain Adaptation in Statistical Machine Translation. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, 451-459, MIT, Massachusetts, USA, October 2010.
6. Philipp Koehn and Josh Schroeder. 2007. Experiments in Domain Adaptation for Statistical Machine Translation. In Proceedings of the Second Workshop on Statistical Machine Translation, 224-227, Prague, June 2007.
7. Mu Li, Yinggong Zhao, Dongdong Zhang and Ming Zhou. 2010. Adaptive Development Data Selection for Log-linear Model in Statistical Machine Translation. In Proceedings of the 23rd International Conference on Computational Linguistics (Coling 2010), 662-670.
8. Yajuan Lü, Jin Huang and Qun Liu. 2007. Improving Statistical Machine Translation Performance by Training Data Selection and Optimization. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, 343-350.
9. Spyros Matsoukas, Antti-Veikko Rosti and Bing Zhang. 2009. Discriminative Corpus Weight Estimation for Machine Translation. In Proc. of the Conference on Empirical Methods in Natural Language Processing, 160-167
10. Behrang Mohit, Frank Liberato and Rebecca Hwa. 2009. Language Model Adaptation for Difficult To Translate Phrases. In Proceedings of the 13th Annual Conference of the EAMT, 160-167.
11. Behrang Mohit, Rebecca Hwa and Alon Lavie. 2010. Using Variable Decoding Weight for Language Model in Statistical Machine Translation In The Proceedings of the 9th Conference of the Association for Machine Translation in the Americas, Colorado
12. Robert C. Moore and William Lewis. 2010. Intelligent Selection of Language Model Training Data. In Proceedings of the ACL 2010 Conference Short Papers, 220-224, Uppsala, Sweden.
13. Franz Och. 2003. Minimum Error Rate Training in Statistical Machine Translation. In Proceedings of the 41th Annual Meeting of the Association for Computational Linguistic (ACL), Sapporo, Japan.
14. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. Bleu: a Method for Automatic Evaluation of Machine Translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistic (ACL), 311-318.
15. Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla and John Makhoul. 2006. A Study of Translation Edit Rate with Targeted Human Annotation. In Proceedings of Association for Machine Translation in the Americas
16. Yuta Tsuboi, Hisashi Kashima, Shohei Hido, Steffen Bickel and Masashi Sugiyama. 2008. Direct Density Ratio Estimation for Large-scale Covariate Shift Adaptation. In Proceedings of the Eighth SIAM International Conference on Data Mining, pp. 443-454, 2008.
17. Bing Zhao, Matthias Eck and Stephan Vogel. 2004. Language Model Adaptation for Statistical Machine Translation with Structured Query Models. In Proceedings of International Conference on Computational Linguistics(COLING), Geneva, August.