Extracting parallel sentences from comparable corpora using document level alignment

NAACL HLT 2010 - Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Proceedings of the Main Conference

Volumn , Issue , 2010, Pages 403-411

  Smith, Jason R ^a   Quirk, Chris ^b   Toutanova, Kristina ^b  

^a JOHNS HOPKINS UNIVERSITY   (United States)

^b MICROSOFT RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLOSE PROXIMITY; COMPARABLE CORPORA; NEWS ARTICLES; ONLINE ENCYCLOPEDIA; SENTENCE EXTRACTION; SMT SYSTEMS; STATE OF THE ART; STATISTICAL MACHINE TRANSLATION; TIME-PERIODS; WIKIPEDIA;

ALIGNMENT; COMPUTATIONAL LINGUISTICS; SPEECH TRANSMISSION; WEBSITES;

CONTEXT FREE GRAMMARS;

EID: 84863338397     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. S. F Adafre and M. de Rijke. 2006. Finding similar sentences across multiple languages in wikipedia. In Proceedings of EACL, pages 62-69.
2. Phil Blunsom and Trevor Cohn. 2006. Discriminative word alignment with conditional random fields. In Proceedings of ACL.
3. P. F Brown, V. J Della Pietra, S. A Della Pietra, and R. L Mercer. 1993. The mathematics of statistical machine translation: Parameter estimation. Computational linguistics, 19(2):263-311.
4. P. Fung and P. Cheung. 2004. Multi-level bootstrapping for extracting parallel sentences from a quasi-comparable corpus. In Proceedings of the 20th international conference on Computational Linguistics, page 1051.
5. W. A Gale and K. W Church. 1991. Identifying word correspondences in parallel texts. In Proceedings of the workshop on Speech and Natural Language, pages 152-157.
6. Aria Haghighi, Percy Liang, Taylor Berg-Kirkpatrick, and Dan Klein. 2008. Learning bilingual lexicons from monolingual corpora. In Proceedings of ACL, pages 771-779.
7. Roy Bar-Haim Ido, Ido Dagan, Bill Dolan, Lisa Ferro, Danilo Giampiccolo, Bernardo Magnini, and Idan Szpektor. 2006. The second pascal recognising textual entailment challenge.
8. P. Koehn and K. Knight. 2002. Learning a translation lexicon from monolingual corpora. In Proceedings of the ACL Workshop on Unsupervised Lexical Acquisition.
9. Philipp Koehn, Franz Josef Och, and Daniel Marcu. 2003. Statistical phrase-based translation. In Proceedings of HLT/NAACL, pages 127-133, Edmonton, Canada, May.
10. P. Koehn. 2005. Europarl: A parallel corpus for statistical machine translation. In MT summit, volume 5.
11. J. Lafferty, A. McCallum, and F. Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the 18th International Conference on Machine Learning, pages 282-289.
12. R. C Moore. 2002. Fast and accurate sentence alignment of bilingual corpora. Lecture Notes in Computer Science, 2499:135-144.
13. D. S Munteanu and D. Marcu. 2005. Improving machine translation performance by exploiting non-parallel corpora. Computational Linguistics, 31(4):477-504. (Pubitemid 43677932)
14. Franz Josef Och. 2003. Minimum error rate training in statistical machine translation. In Proceedings of the Annual Meeting of the Association for Computational Linguistics, pages 160-167, Sapporo, Japan.
15. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: a method for automatic evaluation of machine translation. In Proceedings of the Annual Meeting of the Association for Computational Linguistics, pages 311-318, Philadelpha, Pennsylvania, USA.
16. R. Rapp. 1999. Automatic identification of word translations from unrelated English and German corpora. In Proceedings of ACL.
17. P. Resnik and N. A Smith. 2003. The web as a parallel corpus. Computational Linguistics, 29(3):349-380. (Pubitemid 37449712)
18. C. Tillmann and J. Xu. 2009. A simple sentence-level extraction algorithm for comparable data. In Proceedings of HLT/NAACL, pages 93-96.
19. C. Tillmann. 2009. A Beam-Search extraction algorithm for comparable data. In Proceedings of ACL, pages 225-228.
20. S. Vogel, H. Ney, and C. Tillmann. 1996. HMM-based word alignment in statistical translation. In Proceedings of the 16th conference on Computational linguistics-Volume 2, pages 836-841.
21. Wikipedia. 2004. Wikipedia, the free encyclopedia. [Online; accessed 20-November-2009].
22. B. Zhao and S. Vogel. 2002. Adaptive parallel sentences mining from web bilingual news collection. In Proceedings of the 2002 IEEE International Conference on Data Mining, page 745. IEEE Computer Society.