Segmentation and alignment of parallel text for statistical machine translation

Natural Language Engineering

Volumn 13, Issue 3, 2007, Pages 235-260

  Deng, Yonggang ^a   Kumar, Shankar ^b   Byrne, William ^c  

^a Johns Hopkins University   (United States)

^b GOOGLE INC   (United States)

^c UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; DYNAMIC PROGRAMMING; IMAGE SEGMENTATION; TEXT PROCESSING;

CHUNK ALIGNMENT; DIVISIVE CLUSTERING PARALLEL TEXT; STATISTICAL MACHINE TRANSLATION;

COMPUTER AIDED LANGUAGE TRANSLATION;

EID: 37549037494     PISSN: 13513249     EISSN: 14698110     Source Type: Journal    
DOI: 10.1017/S1351324906004293     Document Type: Article

References (33)

1. Breiman, L., Friedman, J. H., Olshen, R. A. and Stone, C. J. (1984) Classification and regression trees. Wadsworth International Group.
2. Brown, P. F., Lai, J. C. and Mercer, R. L. (1991) Aligning Sentences in Parallel Corpora. Pages 169-176 of: Meeting of the Association for Computational Linguistics.
3. Brown, P. F., Pietra, S. A. D., Pietra, V. D. J. and Mercer, R. L. (1993) The mathematics of machine translation: Parameter estimation. Computational Linguistics, 19: 263-312.
4. Chen, S. F. (1993) Aligning Sentences in Bilingual Corpora using Lexical Information. Pages 9-16 of: Meeting of the Association for Computational Linguistics..
5. Gale, W. A. and Church, K. W. (1991) A Program for Aligning Sentences in Bilingual Corpora. Pages 177-184 of: Meeting of the Association for Computational Linguistics.
6. Haruno, M. and Yamazaki, T. (1996) High-performance bilingual text alignment using statistical and dictionary information. Pages 131-138 of: Proceedings of the Association for Computational Linguistics '96.
7. Kim, W. and Khudanpur, S. (2003) Cross-Lingual Lexical Triggers in Statistical Language Modeling. Pages 17-24 of: Proc. of EMNLP.
8. Kumar, S., Deng, Y. and Byrne, W. (2005) A Weighted Finite State Transducer Translation Template Model for Statistical Machine Translation. Journal of Natural Language Engineering, 11 (3).
9. Linde, Y., Buzo, A. and Gray, R. (1980) An Algorithm for Vector Quantizer Design. IEEE Transaction on Communications, 28(1 , 84-94.
10. Linguistic Data Consortium. (2002) LDC Chinese Segmenter. http://www.ldc.upenn.edu/Projects/Chinese.
11. Ma, X., et al. (2003) Rosetta: A sentence aligner for imperfect world. Machine Translation Evaluation Workshop. NIST, Gaithersburg, MD.
12. Ma, X., Cieri, C. and Miller, D. (2004) Corpora & Tools for Machine Translation. Machine Translation Evaluation Workshop. NIST, Alexandria, VA.
13. Mann, G. and Yarowsky, D. (2001) Multipath Translation Lexicon Induction via Bridge Languages. Proceedings of the Second Conference of the North American Association for Computational Linguistics.
14. Marcu, D. and Wong, W. (2002) A phrase-based, joint probability model for statistical machine translation. Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP-2002).
15. Melamed, I. D. (1997) A Portable Algorithm for Mapping Bitext Correspondence. Pages 305-312 of: Proceedings of the 35th Annual Conference of the Association for Computational Linguistics.
16. Melamed, I. D. (2000) Models of translational equivalence among words. Computational Linguistics 26(2): 221-249.
17. Moore, R. C. (2002) Fast and Accurate Sentence Alignment of Bilingual Corpora. Pages 135-244 of: Proceeding of 5th Conference of the Association for Machine Translation in the Americas.
18. NIST. (2003) The NIST Machine Translation Evaluations. http:// www.nist.gov/speech/tests/mt/.
19. NIST. (2004) The NIST Machine Translation Evaluations Workshop. Gaithersburg, MD. http://www.nist.gov/speech/tests/mt/.
20. NIST. (2005) The NIST Machine Translation Evaluations Workshop. North Bethesda, MD. http://www.nist.gov/speech/tests/summaries/2005/ mt05.htm.
21. Oard, D. (1996) A survey of Multilingual Text Retrieval. Tech. rept. UMIACS-TR-96-19 CS-TR-3615, University of Maryland, College Park.
22. Och, F. (2002) Statistical Machine Translation: From Single Word Models to Alignment Templates. PhD thesis, RWTH Aachen, Germany.
23. Och, F. J. and Ney, H. (2003) A Systematic Comparison of Various Statistical Alignment Models. Computational Linguistics 29 1): 19-51.
24. Och, F. J. and Ney, H. (2004) The alignment template approach to statistical machine translation. Computational Linguistics 30 4): 417-449.
25. Papineni, K., Roukos, S., Ward, T. and Zhu, W. (2002) Bleu: A Method for Automatic Evaluation of Machine Translation. Pages 311-318 of: Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL).
26. Simard, M. and Plamondon, P. (1998) Bilingual Sentence Alignment: Balancing Robustness and Accuracy. Pages 59-80 of: Machine Translation, vol. 13.
27. TC-STAR. (2005) TC-STAR Speech-to-Speech Translation Evaluation Meeting. Trento, Italy. http://www.tc-star.org/.
28. Vogel, S., Ney, H. and Tillmann, C. (1996) HMM Based Word Alignment in Statistical Translation. Pages 836-841 of: Proc. of the COLING.
29. Wu, D. (1994) Aligning a Parallel English-Chinese Corpus Statistically with Lexical Criteria. Pages 80-87 of: Meeting of the Association for Computational Linguistics.
30. Wu, D. (1995) An Algorithm for Simultaneously Bracketing Parallel Texts by Aligning Words. Pages 244-251 of: Meeting of the Association for Computational Linguistics.
31. Wu, D. (1997) Stochastic inversion transduction grammar and bilingual parsing of parallel corpora. Computational Linguistics 23 3): 377-482.
32. Xu, J., Zens, R. and Ney, H. (2005) Sentence Segmentation Using IBM Word Alignment Model 1. Proceedings of the European Association for Machine Translation (EAMT 2005).
33. Yarowsky, D. (1995) Unsupervised Word Sense Disambiguation Rivaling Supervised Methods. Pages 189-196 of: Meeting of the Association for Computational Linguistics.