Hierarchical phrase-based translation with weighted finite-state transducers and shallow-n grammars

Computational Linguistics

Volumn 36, Issue 3, 2010, Pages 505-533

  de Gispert, Adrià ^a   Iglesias, Gonzalo ^b   Blackwood, Graeme ^a   Banga, Eduardo R ^b   Byrne, William ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b UNIVERSITY OF VIGO   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; DECODING; TRANSDUCERS;

DIRECT GENERATION; HIERARCHICAL PHRASE; MINIMUM BAYES RISK; PARAMETER OPTIMIZATION; PRUNING PROCEDURES; SPECIFIC LANGUAGES; TRANSLATION SYSTEMS; WEIGHTED FINITE-STATE TRANSDUCERS;

TRANSLATION (LANGUAGES);

EID: 77958066904     PISSN: 08912017     EISSN: 15309312     Source Type: Journal    
DOI: 10.1162/coli_a_00006     Document Type: Article

References (34)

1. Allauzen, Cyril, Mehryar Mohri, and Brian Roark. 2003. Generalized algorithms for constructing statistical language models. In Proceedings of ACL, pages 557-564, Sapporo.
2. Allauzen, Cyril, Michael Riley, Johan Schalkwyk, Wojciech Skut, and Mehryar Mohri. 2007. OpenFst: A general and efficient weighted finite-state transducer library. In Proceedings of CIAA, pages 11-23, Prague.
3. Bender, Oliver, Evgeny Matusov, Stefan Hahn, Sasa Hasan, Shahram Khadivi, and Hermann Ney. 2007. The RWTH Arabic-to-English spoken language translation system. In Proceedings of ASRU, pages 396-401, Kyoto.
4. Blunsom, Phil, Trevor Cohn, and Miles Osborne. 2008. A discriminative latent variable model for statistical machine translation. In Proceedings of ACL-HLT, pages 200-208, Columbus, OH.
5. Brants, Thorsten, Ashok C. Popat, Peng Xu, Franz J. Och, and Jeffrey Dean. 2007. Large language models in machine translation. In Proceedings of EMNLP-ACL, pages 858-867, Prague.
6. Callison-Burch, Chris, Cameron Fordyce, Philipp Koehn, Christof Monz, and Josh Schroeder. 2008. Further meta-evaluation of machine translation. In Proceedings of the ACL Workshop on Statistical Machine Translation, pages 70-106, Columbus, OH.
7. Chappelier, Jean-Ćedric and Martin Rajman. 1998. A generalized CYK algorithm for parsing stochastic CFG. In Proceedings of TAPD, pages 133-137, Paris.
8. Chiang, David. 2005. A hierarchical phrase-based model for statistical machine translation. In Proceedings of ACL, pages 263-270, Ann Arbor, MI.
9. Chiang, David. 2007. Hierarchical phrase-based translation. Computational Linguistics, 33(2):201-228.
10. de Gispert, Adriá, Sami Virpioja, Mikko Kurimo, and William Byrne. 2009. Minimum Bayes-Risk combination of translation hypotheses from alternative morphological decompositions. In Proceedings of HLT/NAACL, Companion Volume: Short Papers, pages 73-76, Boulder, CO.
11. Deng, Yonggang and William Byrne. 2008. HMM word and phrase alignment for statistical machine translation. IEEE Transactions on Audio, Speech, and Language Processing, 16(3):494-507.
12. Graehl, Jonathan, Kevin Knight, and Jonathan May. 2008. Training tree transducers. Computational Linguistics, 34(3):391-427.
13. Habash, Nizar and Owen Rambow. 2005. Arabic tokenization, part-of-speech tagging and morphological disambiguation in one fell swoop. In Proceedings of the ACL, pages 573-580, Ann Arbor, MI.
14. Iglesias, Gonzalo, Adria de Gispert, Eduardo R. Banga, and William Byrne. 2009a. Rule filtering by pattern forefficient hierarchical translation. In Proceedings of the EACL, pages 380-388, Athens.
15. Iglesias, Gonzalo, Adria de Gispert, Eduardo R. Banga, and William Byrne. 2009b. Hierarchical phrase-based translation with weighted finite state transducers. In Proceedings of HLT/NAACL, pages 433-441, Boulder, CO.
16. Iglesias, Gonzalo, Adria de Gispert, Eduardo R. Banga, and William Byrne. 2009c. The HiFST system for the Europarl Spanish-to-English task. In Proceedings of SEPLN, pages 207-214, Donosti.
17. Knight, Kevin and Yaser Al-Onaizan. 1998. Translation with finite-state devices. In Proceedings of the Third Conference of the AMTA on Machine Translation and the Information Soup, pages 421-437, Langhorne, PA.
18. Koehn, Philipp, Franz Josef Och, and Daniel Marcu. 2003. Statistical phrase-based translation. In Proceedings of HLT-NAACL, pages 127-133, Edmonton.
19. Kumar, Shankar and William Byrne. 2004. Minimum Bayes-risk decoding for statistical machine translation. In Proceedings of HLT-NAACL, pages 169-176, Boston, MA.
20. Kumar, Shankar, Yonggang Deng, and William Byrne. 2006. A weighted finite state transducer translation template model for statistical machine translation. Natural Language Engineering, 12(1):35-75.
21. Lewis, P. M., II, and R. E. Stearns. 1968. Syntax-directed transduction. Journal of the ACM, 15(3):465-488.
22. Mohri, Mehryar. 1997. Finite-state transducers in language and speech processing. Computational Linguistics, 23:269-311.
23. Mohri, Mehryar, Fernando Pereira, and Michael Riley. 2000. The design principles of a weighted finite-state transducer library. Theoretical Computer Science, 231:17-32.
24. Mohri, Mehryar, Fernando Pereira, and Michael Riley. 2002.Weighted finite-state transducers in speech recognition. Computer Speech and Language, 16:69-88.
25. Och, Franz J. 2003. Minimum error rate training in statistical machine translation. In Proceedings of ACL, pages 160-167, Sapporo.
26. Och, Franz Josef and Hermann Ney. 2002. Discriminative training and maximum entropy models for statistical machine translation. In Proceedings of the ACL, pages 295-302, Philadelphia, PA.
27. Papineni, Kishore, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2001. BLEU: A method for automatic evaluation of machine translation. In Proceedings of ACL, pages 311-318, Toulouse.
28. Rosti, Antti-Veikko, Necip Fazil Ayan, Bing Xiang, Spyros Matsoukas, Richard Schwartz, and Bonnie Dorr. 2007. Combining outputs from multiple machine translation systems. In Proceedings of HLT-NAACL, pages 228-235, Rochester, NY.
29. Setiawan, Hendra, Min Yen Kan, Haizhou Li, and Philip Resnik. 2009. Topological ordering of function words in hierarchical phrase-based translation. In Proceedings of the ACL-IJCNLP, pages 324-332, Singapore.
30. Sim, Khe Chai, William Byrne, Mark Gales, Hichem Sahbi, and Phil Woodland. 2007. Consensus network decoding for statistical machine translation system combination. In Proceedings of ICASSP, pages 105-108, Honolulu, HI.
31. Tromble, Roy, Shankar Kumar, Franz J. Och, and Wolfgang Macherey. 2008. Lattice Minimum Bayes-Risk decoding for statistical machine translation. In Proceedings of EMNLP, pages 620-629, Honolulu, HI.
32. Varile, Giovanni B. and Peter Lau. 1988. Eurotra practical experience with a multilingual machine translation system under development. In Proceedings of the Second Conference on Applied Natural Language Processing, pages 160-167, Austin, TX.
33. Woods, W. A. 1970. Transition network grammars for natural language analysis. Communications of the ACM, 13(10):591-606.
34. Wu, Dekai. 1997. Stochastic inversion transduction grammars and bilingual parsing of parallel corpora. Computational Linguistics, 23(3):377-403.