Exploiting morphology and local word reordering in English-to-Turkish Phrase-based statistical machine translation

IEEE Transactions on Audio, Speech and Language Processing

Volumn 18, Issue 6, 2010, Pages 1313-1322

  El Kahlout, I̊lknur Durgar ^a   Oflazer, Kemal ^b  

^a SABANCI UNIVERSITY   (Turkey)

^b CARNEGIE MELLON UNIVERSITY   (Qatar)

Author keywords

Complex morphology; English; statistical machine translation (SMT); Turkish; word reordering

Indexed keywords

ALIGNMENT; COMPUTATIONAL LINGUISTICS; COMPUTER AIDED LANGUAGE TRANSLATION; DECODING; LINGUISTICS; MORPHOLOGY;

COMPLEX MORPHOLOGY; ENGLISH; STATISTICAL MACHINE TRANSLATION; TURKISHS; WORD REORDERING;

TRANSLATION (LANGUAGES);

EID: 84988221520     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2009.2033321     Document Type: Article

References (43)

1. J. Hutchins, "Machine translation: A brief history," in Concise History of the Language Sciences: From the Sumerians to the Cognitivists, E. Koerner and R. E. Asher, Eds. Oxford, U.K.: Pergamon, 1995, pp. 431-445.
2. P. F. Brown, S. A. D. Pietra, V. J. D. Pietra, J. D. Lafferty, and R. L. Mercer, "Analysis, statistical transfer, and synthesis in machine translation," in Proc. TMI: 4th Int. Conf. Theoretical and Methodological Issues in MT, 1992, pp. 83-100.
3. P. F. Brown, S. A. D. Pietra, V. J. D. Pietra, and R. L. Mercer, "The mathematics of statistical machine translation: Parameter estimation," Comput. Linguist., vol.19, no.2, pp. 263-311.
4. R. Zens, F. J. Och, and H. Ney, M. Jarke, J. Koehler, and G. Lake-meyer, Eds., "Phrase-based statistical machine translation," in Proc. 25th German Conf. Artif. Intell. (KI2002), Vol.2479 of Lecture Notes in Artif. Intell. (LNAI), Aachen, Germany, 2002, pp. 18-22.
5. D. Marcu and W. Wong, "A phrase-based, joint probability model for statistical machine translation," in Proc. Conf. Empirical Methods in Natural Lang. Process. (EMNLP-02), Philadelphia, PA, 2002.
6. P. Koehn, F. J. Och, and D. Marcu, "Statistical phrase-based translation," Proc. HLT/NAACL, 2003.
7. F. J. Och and H. Ney, "The alignment template approach to statistical machine translation," Comput. Linguist., vol.30, no.4, pp. 417-449, 2004. (Pubitemid 41399543)
8. D. Chiang, "A hierarchical phrase-based model for statistical machine translation," in Proc. 43rd Annu. Meeting Assoc. Comput. Linguist. (ACL'05), Ann Arbor, MI, Jun. 2005, pp. 263-270 [Online]. Available: http://www.aclweb.org/anthology/P/P05/P05-1033
9. P. Koehn and H. Hoang, "Factored translation models," in Proc. EMNLP, 2007.
10. K. Yamada and K. Knight, "A syntax-based statistical translation model," in Proc. ACL, 2001, pp. 523-530.
11. M. Hopkins and J. Kuhn, "Machine translation as tree labeling," in Proc. SSST, NAACL-HLT 2007/AMTA Workshop Syntax and Structure in Statist. Transl., Rochester, NY, Apr. 2007, pp. 41-48 [Online]. Available: http://www.aclweb.org/anthology/W/W07/W07-0406
12. C. Cherry and D. Lin, "Inversion transduction grammar for joint phrasal translation modeling," in Proc. SSST, NAACL-HLT 2007/AMTA Workshop on Syntax and Structure in Statistical Transl., Rochester, NY, Apr. 2007, pp. 17-24 [Online]. Available: http://www.aclweb.org/an-thology/W/W07/W07-0403
13. D. Wu, "Stochastic inversion transduction grammars and bilingual parsing of parallel corpora," Comput. Linguist., vol.23, no.3, pp. 377-403, 1997.
14. I. D. El-Kahlout and K. Oflazer, "Initial explorations in English to Turkish statistical machine translation," in Proc. Workshop on Statist. Mach. Translation, New York, Jun. 2006, pp. 7-14.
15. J. Hankamer, "Morphological parsing and the lexicon," in Lexical Representation and Process, W. Marslen-Wilson, Ed. Cambridge, MA: MIT Press, 1989.
16. P. Koehn, "Europarl: A parallel corpus for statistical machine translation," in Proc. MT Summit X, Phuket, Thailand, 2005.
17. K. Papineni, S. Roukos, T. Ward, and W.-J. Zhu, "BLEU: A method for automatic evaluation of machine translation," in Proc. 40th Annu. Meeting Assoc. Comput. Linguist., 2002, pp. 311-318 [Online]. Available: http://www.aclweb.org/anthology/P02-1040.pdf
18. S. Niessen and H. Ney, "Statistical machine translation with scarce resources using morpho-syntatic information," Comput. Linguist., vol.30, no.2, pp. 181-204, 2004.
19. M. Yang and K. Kirchhoff, "Phrase-based backoff models for machine translation of highly inflected languages," Proc. EACL, pp. 41-48, 2006.
20. S. Corston-Oliver and M. Gamon, "Normalizing German and English inflectional morphology to improve statistical word alignment," Proc. AMTA, pp. 48-57, 2004.
21. Y.-S. Lee, "Morphological analysis for statistical machine translation," Proc. HLT-NAACL 2004\Companion Vol., pp. 57-60, 2004.
22. A. Zollmann, A. Venugopal, and S. Vogel, "Bridging the inflection morphology gap for Arabic statistical machine translation," in Proc. Human Lang. Technol. Conf. NAACL, Companion Vol.: Short Papers, New York, Jun. 2006, pp. 201-204 [Online]. Available: http://www. aclweb.org/anthology/N/N06/N06-2051
23. M. Popovic and H. Ney, "Towards the use of word stems and suffixes for statistical machine translation," in Proc. 4th Int. Conf. Lang. Resources Eval. (LREC), May 2004, pp. 1585-1588.
24. S. Goldwater and D. McClosky, "Improving statistical MT through morphological analysis," in Proc. Human Lang. Technol. Conf. and Conf. Empirical Methods in Natural Lang. Process., Vancouver, BC, Canada, Oct. 2005, pp. 676-683 [Online]. Available: http://www.aclweb.org/anthology/H/H05/H05-1085
25. E. Minkov, K. Toutanova, and H. Suzuki, "Generating complex morphology for machine translation," in Proc. 45th Annu. Meeting Assoc. Comput. Linguist., Prague, Czech Republic, Jun. 2007, pp. 128-135 [Online]. Available: http://www.aclweb.org/an-thology/P/P07/P07-1017
26. D. Talbot and M. Osborne, "Modelling lexical redundancy for machine translation," in Proc. 21st Int. Conf. Comput. Linguist. and 44th Annu. Meeting Assoc. Comput. Linguist., Sydney, Australia, Jul. 2006, pp. 969-976 [Online]. Available: http://www.aclweb.org/anthology/P/P06/P06-1122
27. K. Oflazer and I. D. El-Kahlout, "Exploring different representational units in English-to-Turkish statistical machine translation," in Proc. 2nd Workshop Statist. Mach. Transl., Prague, Czech Republic, Jun. 2007, pp. 25-32 [Online]. Available: http://www.aclweb.org/an- thology/W/W07/W07-0704
28. K. Oflazer, "Two-level description of Turkish morphology," Literary Linguist. Comput., vol.9, no.2, pp. 137-148, 1994.
29. D. Yuret and F. Türe, "Learning morphological disambiguation rules for Turkish," in Proc. Human Lang. Technol. Conf. NAACL, Main Conf., New York, Jun. 2006, pp. 328-334 [Online]. Available: http://www.aclweb.org/ anthology/N/N06/N06-1042
30. H. Schmid, "Probabilistic part-of-speech tagging using decision trees," in Proc. Int. Conf. New Methods in Lang. Process., 1994.
31. F. J. Och and H. Ney, "A systematic comparison of various statistical alignment models," Comput. Linguist., vol.29, no.1, pp. 19-51, 2003.
32. P. Koehn, H. Hoang, A. Birch, C. Callison-Burch, M. Federico, N. Bertoldi, B. Cowan, W. Shen, C. Moran, R. Zens, C. Dyer, O. Bojar, A. Constantin, and E. Herbst, "Moses: Open source toolkit for statistical machine translation," in Proc. 45th Annu. Meeting Assoc. Comput. Linguist. (ACL'07)\Companion Vol., Jun. 2007.
33. A. Stolcke, "SRILM\An extensible language modeling toolkit," in Proc. Int. Conf. Spoken Lang. Process., 2002 [Online]. Available: cite-seer.ist.psu.edu/stolcke02srilm.html
34. F. J. Och, E. Hinrichs and D. Roth, Eds., "Minimum error rate training in statistical machine translation," in Proc. 41st Annu. Meeting Assoc. Comput. Linguist., Sapporo, Japan, 2003, pp. 160-167 [Online]. Available: http://www.aclweb.org/anthology/P03-1021
35. F. Xia and M. McCord, "Improving a statistical MT system with automatically learned rewrite patterns," in Proc. 20th Int. Conf. Comput. Linguist. (COLING), Geneva, Switzerland, Aug. 2004, pp. 508-514.
36. M. Collins, P. Koehn, and I. Kucerova, "Clause restructuring for statistical machine translation," in Proc. 43rd Annu. Meeting Assoc. Comput. Linguist. (ACL'05)., Ann Arbor, MI, Jun. 2005, pp. 531-540.
37. M. Popovic and H. Ney, "POS-based word reorderings for statistical machine translation," in 5th Int. Conf. Lang. Res. Eval. LREC, Genoa, Italy, May 2006, pp. 1278-1283.
38. C. Wang, M. Collins, and P. Koehn, "Chinese syntactic reordering for statistical machine translation," in Proc. EMNLP, Prague, Czech Republic, Jun. 2007, pp. 737-745.
39. S. Zwarts and M. Dras, "Syntax-based word reordering in phase-based statistical machine translation: Why does it work?," in Proc. MT SUMMIT XI, Copenhagen, Denmark, Sep. 2007, pp. 559-566.
40. K. Oflazer, "Error-tolerant finite-state recognition with applications to morphological analysis and spelling correction," Comput. Linguist., vol.22, no.1, pp. 73-90, Mar. 1996.
41. R. Zens and H. Ney, "N-gram posterior probabilities for statistical machine translation," in Proc. Workshop Statist. Mach. Transl., New York, Jun. 2006, pp. 72-77 [Online]. Available: http://www.aclweb.org/an-thology/W/ W06/W06-3110
42. R. Yeniterzi, "Syntax-to-morphology alignment and constituent reordering in factored phrase-based statistical machine translation from English to Turkish," M.S. thesis, Sabanc? Univ., Istanbul, Turkey, 2009.
43. M. Marcus, B. Santorini, and M. A. Marcinkiewitz, "Building a large annotated corpus of English: The Penn Treebank," Comput. Linguist., 1993.