Topic models + word alignment = A flexible framework for extracting bilingual dictionary from comparable corpus

CoNLL 2013 - 17th Conference on Computational Natural Language Learning, Proceedings

Volumn , Issue , 2013, Pages 212-221

  Liu, Xiaodong ^a   Duh, Kevin ^a   Matsumoto, Yuji ^a  

^a NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ALIGNMENT; COMPUTER AIDED LANGUAGE TRANSLATION;

BILINGUAL DICTIONARY; CO-OCCURRENCE STATISTICS; COMPARABLE CORPORA; FLEXIBLE FRAMEWORK; PROBABILITY MODELS; SPECIFIC KNOWLEDGE; STATISTICAL MACHINE TRANSLATION; TRANSLATION PAIR;

DATA MINING;

EID: 84899973165     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. Timothy Baldwin. 2011. Mwes and topic modelling: enhancing machine learning with linguistics. In Proceedings of the Workshop on Multiword Expressions: from Parsing and Generation to the Real World, MWE’11, pages 1–1, Stroudsburg, PA, USA. Association for Computational Linguistics.
2. D. Blei, A. Ng, and M. Jordan. 2003. Latent dirichlet allocation. Journal of Machine Learning Research.
3. Jordan Boyd-Graber and David M. Blei. 2009. Multilingual topic models for unaligned text. In UAI.
4. P. Brown, S. Della Pietra, V. Della Pietra, and R. Mercer. 1993. The mathematics of statistical machine translation: Parameter estimation. Computational Linguistics, 19(2).
5. Hal Daume III and Jagadeesh Jagarlamudi. 2011. Domain adaptation for machine translation by mining unseen words. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, pages 407–412, Portland, Oregon, USA, June. Association for Computational Linguistics.
6. Jesse Davis and Mark Goadrich. 2006. The relationship between precision-recall and ROC curves. In ICML.
7. Hervé Déjean, Éric Gaussier, and Fatia Sadat. 2002. An approach based on multilingual thesauri and model combination for bilingual lexicon extraction. In Proceedings of the 19th international conference on Computational linguistics - Volume 1, COLING ’02, pages 1–7.
8. John DeNero and Klaus Macherey. 2011. Model-based aligner combination using dual decomposition. In Proceedings of the Association for Computational Linguistics (ACL).
9. Pascale Fung and Percy Cheung. 2004. Mining verynon-parallel corpora: Parallel sentence and lexicon extraction via bootstrapping and em. In Proceedings of the Conference on Empirical Methods in Natural Language Processing.
10. Pascale Fung and Yuen Yee Lo. 1998. Translating unknown words using nonparallel, comparable texts. In COLING-ACL.
11. Eric Gaussier, J.M. Renders, I. Matveeva, C. Goutte, and H. Dejean. 2004. A geometric view on bilingual lexicon extraction from comparable corpora. In Proceedings of the 42nd Meeting of the Association for Computational Linguistics (ACL’04), Main Volume, pages 526–533, Barcelona, Spain, July.
12. Ghloamreza Haffari and Yee Whye Teh. 2009. Hierarchical dirichlet trees for information retrieval. In NAACL.
13. Aria Haghighi, Percy Liang, Taylor Berg-Kirkpatrick, and Dan Klein. 2008. Learning bilingual lexicons from monolingual corpora. In Proceedings of ACL-08: HLT, pages 771–779, Columbus, Ohio, June. Association for Computational Linguistics.
14. Jagadeesh Jagarlamudi and Hal Daume. 2010. Extracting multilingual topics from unaligned comparable corpora. In ECIR.
15. Philipp Koehn and Kevin Knight. 2002. Learning a translation lexicon from monolingual corpora. In Proceedings of ACL Workshop on Unsupervised Lexical Acquisition.
16. Philipp Koehn. 2010. Statistical Machine Translation. Cambridge University Press, New York, NY, USA, 1st edition.
17. Audrey Laroche and Philippe Langlais. 2010. Revisiting context-based projection methods for term-translation spotting in comparable corpora. In Proceedings of the 23rd International Conference on Computational Linguistics (Coling 2010), pages 617–625, Beijing, China, August. Coling 2010 Organizing Committee.
18. Mausam, Stephen Soderland, Oren Etzioni, Daniel S. Weld, Michael Skinner, and Jeff Bilmes. 2009. Compiling a massive, multilingual dictionary via probabilistic inference. In ACL.
19. Coskun Mermer and Murat Saraclar. 2011. Bayesian word alignment for statistical machine translation. In ACL.
20. David Mimno, Hanna Wallach, Jason Naradowsky, David A. Smith, and Andrew McCallum. 2009. Polylingual topic models. In EMNLP.
21. Robert Moore. 2004. Improving IBM word alignment model 1. In ACL.
22. Graham Neubig, Yosuke Nakata, and Shinsuke Mori. 2011. Pointwise prediction for robust, adaptable japanese morphological analysis. In The 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies (ACL-HLT) Short Paper Track, pages 529–533, Portland, Oregon, USA, 6.
23. Xiaochuan Ni, Jian-Tao Sun, Jian Hu, and Zheng Chen. 2009. Mining multilingual topics from wikipedia. In WWW.
24. Franz Josef Och and Hermann Ney. 2003. A systematic comparison of various statistical alignment models. Comput. Linguist., 29(1):19–51, March.
25. Reinhard Rapp. 1995. Identifying word translations in non-parallel texts. In Proceedings of the 33rd Annual Meeting of the Association for Computational Linguistics.
26. Philip Resnik, Douglas Oard, and Gina Levow. 2011. Improved cross-language retrieval using backoff translation. In Proceedings of the First International Conference on Human Language Technology.
27. Daphna Shezaf and Ari Rappoport. 2010. Bilingual lexicon generation using non-aligned signatures. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, ACL’10, pages 98–107. Association for Computational Linguistics.
28. Akihiro Tamura, Taro Watanabe, and Eiichiro Sumita. 2012. Bilingual lexicon extraction from comparable corpora using label propagation. In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pages 24–36, Jeju Island, Korea, July. Association for Computational Linguistics.
29. Ivan Vulić, Wim De Smet, and Marie-Francine Moens. 2011. Identifying word translations from comparable corpora using latent topic models. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, pages 479–484, Portland, Oregon, USA, June. Association for Computational Linguistics.
30. Bing Zhao and Eric P. Xing. 2007. HM-BiTAM: Bilingual Topic Exploration, Word Alignment, and Translation. In NIPS.