Improved Arabic-to-English statistical machine translation by reordering post-verbal subjects for word alignment

Machine Translation

Volumn 26, Issue 1-2, 2012, Pages 105-120

  Carpuat, Marine ^a   Marton, Yuval ^b   Habash, Nizar ^c  

^a NATIONAL RESEARCH COUNCIL CANADA   (Canada)

^b IBM T J WATSON RESEARCH CENTER   (United States)

^c MC 7717 ^*  (United States)

Author keywords

Dependency parsing; Matrix subject; Post verbal subjects; Reordering; Statistical machine translation; Subject detection; VS; Word alignment

Indexed keywords

DEPENDENCY PARSING; MATRIX; POST-VERBAL SUBJECTS; REORDERING; STATISTICAL MACHINE TRANSLATION; WORD ALIGNMENT;

ALIGNMENT; INFORMATION THEORY; LINGUISTICS; VIRTUAL STORAGE;

SPEECH TRANSMISSION;

EID: 84857781886     PISSN: 09226567     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10590-011-9112-y     Document Type: Article

References (42)

1. Andreas J, Habash N, Rambow O (2011) Fuzzy syntactic reordering for phrase-based statistical machine translation. In: Proceedings of the workshop on statistical machine translation at the conference on empirical methods for natural language processing (EMNLP), Edinburgh, Scotland, UK
2. Bach N, Vogel S, Cherry C (2009) Cohesive constraints in a beam search phrase-based decoder. In: Proceedings of the 10th meeting of the North American chapter of the Association for Computational Linguistics, Companion volume: Short papers, Boulder, Colorado, pp 1-4
3. DM Bikel 2004 Intricacies of Collins' parsing model Comput Linguist 30 4 479 511 10.1162/0891201042544929 (Pubitemid 41399545)
4. Bisazza A, Federico M (2010) Chunk-based verb reordering in VSO sentences for Arabic-English statistical machine translation. In: Proceedings of the joint fifth workshop on statistical machine translation and MetricsMATR, Uppsala, Sweden, pp 235-243
5. PE Brown VJD Pietra SAD Pietra RL Mercer 1993 The mathematics of statistical machine translation: parameter estimation Comput Linguist 19 2 263 312
6. Carpuat M, Marton Y, Habash N (2010a) Explorations in subject-verb reordering for Arabic-English statistical machine translation. In: Proceedings of the 48th annual meeting of the Association for Computational Linguistics (ACL 2010), short papers, Los Angeles, CA, pp 178-183
7. Carpuat M, Marton Y, Habash N (2010b) Reordering matrix post-verbal subjects for Arabic-to-English SMT. In: Proceedings of the 17th conference sur le Traitement des Langues Naturelles (TALN), Montreal, Canada
8. Cherry C (2008) Cohesive phrase-based decoding for statistical machine translation. In: Proceedings of ACL'08, Columbus, Ohio, pp 72-80
9. Collins M, Koehn P, Kucerova I (2005) Clause restructuring for statistical machine translation. In: Proceedings of ACL 2005 (meeting of the Association for Computational Linguistics), Ann Arbor, Michigan pp 531-540
10. Crego JM, Habash N (2008) Using shallow syntax information to improve word alignment and reordering for SMT. In: Proceedings of the third workshop on statistical machine translation, Columbus, Ohio, pp 53-61
11. Fossum V, Knight K, Abney S (2008) Using syntax to improve word alignment precision for syntax-based machine translation. In: StatMT '08: proceedings of the third workshop on statistical machine translation, Waikiki, Hawai'i, pp 44-52
12. Green S, Manning CD (2010) Better Arabic parsing: baselines, evaluations, and analysis. In: Proceedings of the 23rd international conference on computational linguistics (Coling 2010), Coling 2010 Organizing Committee, Beijing, China, pp 394-402
13. Green S, Sathi C, Manning CD (2009) NP subject detection in verb-initial Arabic clauses. In: Proceedings of the third workshop on computational approaches to Arabic script-based languages (CAASL3), Ottawa, Ontario
14. Habash N (2007a) Arabic morphological representations for machine translation. In: van den Bosch A, Soudi A (eds) Arabic computational morphology: knowledge-based and empirical methods. Springer, Dordrecht
15. Habash N (2007b) Syntactic preprocessing for statistical machine translation. In: Proceedings of the 11th machine translation summit (MT-Summit), Copenhagen, Denmark
16. Habash N (2010) Introduction to Arabic natural language processing. Morgan and Claypool Publishers, San Rafael
17. Habash N, Rambow O (2005) Arabic tokenization, part-of-speech tagging and morphological disambiguation in one fell swoop. In: Proceedings of the 43rd annual meeting of the Association for Computational Linguistics (ACL'05), Ann Arbor, Michigan, pp 573-580
18. Habash N, Roth R (2009) CATiB: The Columbia Arabic treebank. In: Proceedings of the ACL-IJCNLP 2009 conference short papers, Suntec, Singapore, pp 221-224
19. Habash N, Sadat F (2006) Arabic preprocessing schemes for statistical machine translation. In: Proceedings of the 7th meeting of the North American chapter of the Association for Computational Linguistics, Companion volume: short papers, New York City, USA, pp 49-52
20. Habash N, Soudi A, Buckwalter T (2007) On Arabic transliteration. In: van den Bosch A, Soudi A (eds). Arabic computational morphology: knowledge-based and empirical methods. Springer, Berlin
21. Hermjakob U (2009) Improved word alignment with statistics and linguistic heuristics. In: Proceedings of the conference on empirical methods in natural language processing, Singapore, pp 229-237
22. Howlett S, Dras M (2011) Clause restructuring for SMT not absolutely helpful. In: Proceedings of the 49th annual meeting of the Association for Computational Linguistics, Portland, Oregon
23. Johnson H, Martin J, Foster G, Kuhn R (2007) Improving translation quality by discarding most of the phrasetable. In: Proceedings of the 2007 joint conference on empirical methods in natural language processing and computational natural language learning (EMNLP-CoNLL), Prague, Czech Republic, pp 967-975
24. Koehn P (2004) Statistical significance tests for machine translation evaluation. In: Proceedings of the 2004 conference on empirical methods in natural language processing (EMNLP-2004), Barcelona, Spain, pp 388-395
25. Koehn P, Hoang H, Birch A, Callison-Burch C, Federico M, Bertoldi N, Cowan B, Shen W, Moran C, Zens R, Dyer C, Bojar O, Constantin A, Herbst E (2007) Moses: open source toolkit for statistical machine translation. In: Annual meeting of the Association for Computational Linguistics (ACL), demonstration session, Prague, Czech Republic, pp 177-180
26. Lopez A, Resnik P (2006) Word-based alignment, phrase-based translation: What's the link? In: Proceedings of the 7th conference of the Association for Machine Translation in the Americas, Cambridge, Massachusets pp 90-99
27. Maamouri M, Bies A, Buckwalter T, Mekki W (2004) The Penn Arabic treebank: building a large-scale annotated Arabic corpus. In: NEMLAR conference on Arabic language resources and tools, Cairo, Egypt, pp 102-109
28. Manning CD, Schuetze H (1999) Foundations of statistical natural language processing. MIT Press, Cambridge, MA
29. Marton Y, Resnik P (2008) Soft syntactic constraints for hierarchical phrased-based translation. In: Proceedings of the 44th annual meeting of the Association for Computational Linguistics, Columbus, Ohio, USA, pp 1003-1011
30. Marton Y, Habash N, Rambow O (2010) Improving Arabic dependency parsing with lexical and inflectional morphological features. In: Proceedings of the 11th Meeting of the North American Chapter of the Association for Computational Linguistics (NAACL) Workshop on statistical parsing of morphologically rich languages (SPMRL), Los Angeles, California
31. Nivre J (2003) An efficient algorithm for projective dependency parsing. In: Proceedings of the 8th international conference on parsing technologies (IWPT), Nancy, France, pp 149-160
32. J Nivre 2008 Algorithms for deterministic incremental dependency parsing Comput Linguist 34 4 513 553 2468644 10.1162/coli.07-056-R1-07-027
33. Nivre J, Hall J, Nilsson J (2006) MaltParser: a data-driven parser-generator for dependency parsing. In: Proceedings of the fifth international conference on language resources and evaluation (LREC2006), Genoa, Italy, pp 2216-2219
34. FJ Och H Ney 2003 A systematic comparison of various statistical alignment models Comput Linguist 29 1 19 52 10.1162/089120103321337421 (Pubitemid 37049767)
35. Papineni K, Roukos S, Ward T, Zhu WJ (2002) BLEU: a method for automatic evaluation of machine translation. In: Proceedings of the 40th annual meeting of the Association for Computational Linguistics, Philadelphia, Pennsylvania pp 311-318
36. Roth R, Rambow O, Habash N, Diab M, Rudin C (2008) Arabic morphological tagging, diacritization, and lemmatization using lexeme models and feature ranking. In: Proceedings of ACL-08: HLT, short papers, Columbus, Ohio, pp 117-120.
37. Snover M, Dorr B, Schwartz R, Micciulla L, Makhoul J (2006) A study of translation edit rate with targeted human annotation. In: Proceedings of the conference of the Association for Machine Translation in the Americas, Association for Machine Translation in the Americas, Boston, MA, pp 223-231
38. Vogel S, Ney H, Tillman C (1996) HMM-based word alignment in statistical machine translation. In: Proceedings of the 16th international conference on computational linguistics, Copenhagen, Denmark, pp 836-841
39. Wang C, Collins M, Koehn P (2007) Chinese syntactic reordering for statistical machine translation. In: Proceedings of the 2007 joint conference on empirical methods in natural language processing and computational natural language learning (EMNLP-CoNLL), Prague, Czech Republic, pp 737-745
40. Xia F, McCord M (2004) Improving a statistical mt system with automatically learned rewrite patterns. In: Proceedings of the 20th international conference on computational linguistics, Geneva, Switzerland, pp 508-514
41. Zhang Y, Zens R, Ney H (2007) Chunk-level reordering of source language sentences with automatically learned rules for statistical machine translation. In: Proceedings of the workshop on syntax and structure in statistical translation, Association for Computational Linguistics, Rochester, New York, pp 1-8
42. Zitouni I, Sorensen JS, Sarikaya R (2006) Maximum entropy based restoration of Arabic diacritics. In: Proceedings of the 21st international conference on computational linguistics and 44th annual meeting of the Association for Computational Linguistics, Sydney, Australia, pp 577-584