Syntactically lexicalized phrase-based SMT

IEEE Transactions on Audio, Speech and Language Processing

Volumn 16, Issue 7, 2008, Pages 1260-1273

  Hassan, Hany ^a   Sima'an, Khalil ^b   Way, Andy ^a  

^a DUBLIN CITY UNIVERSITY   (Ireland)

^b UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Combinatory categorical grammar (ccg); Lexical syntax; Lexicalized tree adjoining grammar (ltag); Statistical machine translation (smt); Syntax based machine translation

Indexed keywords

COMBINATORY CATEGORICAL GRAMMAR (CCG); LEXICAL SYNTAX; LEXICALIZED TREE ADJOINING GRAMMAR (LTAG); STATISTICAL MACHINE TRANSLATION (SMT); SYNTAX-BASED MACHINE TRANSLATION;

COMPUTATIONAL LINGUISTICS; COMPUTER AIDED LANGUAGE TRANSLATION; CONTEXT SENSITIVE GRAMMARS; INFORMATION THEORY; SPEECH TRANSMISSION; SURFACE MOUNT TECHNOLOGY; SYNTACTICS;

TRANSLATION (LANGUAGES);

EID: 70350451547     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2008.925870     Document Type: Article

References (52)

1. H. Alshawi, S. Bangalore, and S. Douglas, "Learning dependency translation models as collections of finite state head transducers, " Comput. Linguist., vol. 26, no. 1, pp. 45-60, 2000.
2. S. Bangalore, A. Emami, and P. Haffner, "Factoring global inference by enriching local representations, " AT&T Labs-Research, Tech. Rep., 2005.
3. S. Bangalore and A. Joshi, "Supertagging: An approach to almost parsing, " Comput. Linguist., vol. 25, no. 2, pp. 237-265, 1999.
4. A. Birch, M. Osborne, and P.Koehn, "CCG supertags in factored statistical machine translation, " in Proc. 2nd Workshop Statist Mach. Translation, ACL-07, Prague, Czech Republic, 2007, pp. 9-16.
5. R. Bod, R. Scha, and K. Sima'an, Eds., Data-Oriented Parsing. Stanford, CA: CSLI Publications, 2003.
6. P. Brown, J. Cocke, S. Della Pietra, F. Jelinek, V. Della Pietra, J. Lafferty, R. Mercer, and P. Roossin, "A statistical approach to machine translation, " Comput. Linguist., vol. 16, no. 2, pp. 79-85, 1990.
7. M. Carpuat and D. Wu, "Improving statistical machine translation using word sense disambiguation, " in Proc. Joint Conf. Empirical Methods in Natural Lang. Process. Comput. Natural Lang. Learn. (EMNLP-CoNLL 2007), Prague, Czech Republic, 2007, pp. 61-72.
8. J. Chandioux, "MÉTÉO: un système opérationel pour la traduction automatique des bulletins météorologiques destinés au grand public, " META, vol. 21, pp. 127-133, 1976.
9. J. Chen, S. Bangalore, and K. Vijay-Shanker, "Automated extraction of tree-adjoining grammars from treebanks, " Natural Lang. Eng., vol. 12, no. 3, pp. 251-299, 2006.
10. D. Chiang, "A hierarchical phrase-based model for statistical machine translation, " in Proc. 43rd Annu. Meeting Assoc. Comput. Linguist., Ann Arbor, MI, 2005, pp. 263-270.
11. S. Clark and J. Curran, "The importance of supertagging for wide-coverage ccg parsing, " in Proc. 20th Int. Conf. Comput. Linguist. (COLING'04), Geneva, Switzerland, 2004, pp. 282-288.
12. T. Cohn and M. Lapata, "Machine translation by triangulation: Making effective use of multi-parallel corpora, " in Proc. 45th Annu. Meeting Assoc. Comput. Linguist., Prague, Czech Republic, 2007, pp. 728-735.
13. M. Galley, J. Graehl, K. Knight, D. Marcu, S. DeNeefe, W.Wang, and I. Thayer, "Scalable inference and training of context-rich syntactic models, " in Proc. 21st Int. Conf. Comput. Linguist. 44th Annu. Meeting Assoc. Comput. Linguist., Sydney, Australia, 2006, pp. 961-968.
14. J. Goodman, "Abit of progress in language modeling, " Comput. Speech Lang., vol. 15, no. 1, pp. 403-434, 2001.
15. D. Groves, M. Hearne, and A. Way, "Robust sub-sentential alignment of phrase-structure trees, " in Proc. 20th Int. Conf. Comput. Linguist. (COLING'04), Geneva, Switzerland, 2004, pp. 1072-1078.
16. H. Hassan, M. Hearne, A. Way, and K. Sima'an, "Syntactic phrasebased statistical machine translation, " in Proc. IEEE 2006 Workshop Spoken Lang. Translation, Palm Beach, Aruba, 2006, pp. 238-241.
17. H. Hassan, Y. Ma, and A. Way, "MaTrEx: The DCU machine translation system for IWSLT 2007, " in Proc. Int. Workshop Spoken Lang. Translation, Trento, Italy, 2007, pp. 69-75.
18. H. Hassan, K. Sima'an, and A. Way, "Integrating supertags into phrase-based statistical machine translation, " in Proc. 45th Annu. Meeting Assoc. Comput. Linguist. (ACL-07), Prague, Czech Republic, 2007, pp. 288-295.
19. M. Hearne and A. Way, "Disambiguation strategies for data-oriented translation, " in Proc. 11th Annu. Conf. Eur. Assoc. Mach. Translation, Oslo, Norway, 2006, pp. 59-68.
20. J. Hockenmaier, "Data and models for statistical parsing with combinatory categorial grammar, " Ph.D. dissertation, Univ. of Edinburgh, U.K., 2003.
21. A. Joshi and Y. Schabes, M. Nivat and A. Podelski, Eds., "Tree adjoining grammars and lexicalized grammars, " in Tree Automata and Languages. Amsterdam, The Netherlands: North-Holland, 1992, pp. 409-431.
22. R. Kneser and H. Ney, "Improved backing-off for M-gram language modeling, " in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP'95), Detroit, MI, 1995, pp. 181-184.
23. P. Koehn, "Noun phrase translation, " Ph.D. dissertation, Univ. of Southern California, Los Angeles, CA, 2003.
24. P. Koehn, "Statistical significance tests for machine translation evaluation, " in Proc. 2004 Conf. Empirical Methods in Natural Lang. Process. (EMNLP 04), Edmonton, AB, Canada, 2004, pp. 388-395.
25. P. Koehn, R. Frederking and K. Taylor, Eds., "Pharaoh: A beam search decoder for phrase-based statistical machine translation models, " in Proc. Mach. Translation: From Real Users to Res.; 6th Conf. Assoc. Mach. Translation in the Americas, AMTA 2004, 2004, pp. 115-124, LNAI 3265, Berlin/Heidelberg, Germany: Springer Verlag.
26. P. Koehn, "Europarl: A parallel corpus for statistical machine translation, " in MT Summit X: 10th Mach. Translation Summit, Phuket, Thailand, 2005, pp. 79-86.
27. P. Koehn, H. Hoang, A. Birch, C. Callison-Burch, M. Federico, N. Bertoldi, B. Cowen, W. Shen, C. Moran, R. Zens, C. Dyer, O. Bojar, A. Constantin, and E. Herbst, "Moses: Open source toolkit for statistical machine translation, " in Proc. ACL Demo and Poster Session, Prague, Czech Republic, 2007, pp. 177-180.
28. P. Koehn, F. Och, and D. Marcu, "Statistical phrase-based translation, " in Proc. Joint Human Lang. Technol. Conf. Annu. Meeting North Amer. Chap. Assoc. Comput. Linguist. (HLT-NAACL), Edmonton, AB, Canada, 2003, pp. 127-133.
29. J. Kupiec, "Robust part-of-speech tagging using a hidden markov model, " Comput. Speech Lang., vol. 6, pp. 225-242, 1992.
30. D. Marcu, W. Wang, A. Echihabi, and K. Knight, "SPMT: Statistical machine translation with syntactified target language phrases, " in Proc. 2006 Conf. Empirical Methods Natural Lang. Process. (EMNLP 2006), Sydney, Australia, 2006, pp. 44-52.
31. R. Nesson, S. Shieber, and A. Rush, "Induction of probabilistic synchronous tree-insertion grammars for machine translation, " in Proc. 10th Conf. Theoretical and Methodological Issues Mach. Translation (TMI-04), Baltimore, MD, 2004, pp. 128-137.
32. F. Och, "Minimum error rate training in statistical machine translation, " in Proc. 41st Annu. Meeting Assoc. Comput. Linguist. (ACL'03), Sapporo, Japan, 2003, pp. 160-167.
33. F. Och, D. Gildea, S. Khudanpur, A. Sarkar, K. Yamada, A. Fraser, S. Kumar, L. Shen, D. Smith, K. Eng, V. Jain, Z. Jin, and D. Radev, "A smorgasbord of features for statistical machine translation, " in Proc. Joint Human Lang. Technol. Conf. Annu. Meeting North Amer. Chap. Assoc. Comput. Linguist. (HLT-NAACL), Boston, MA, 2004, pp. 161-168.
34. F. Och and H. Ney, "Discriminative training and maximum entropy models for statistical machine translation, " in Proc. 40th Annu. Meeting Assoc. Comput. Linguist., Philadelphia, PA, 2002, pp. 295-302.
35. F. Och and H. Ney, "A systematic comparison of various statistical alignment models, " Comput. Linguist., vol. 29, pp. 19-51, 2003.
36. F. Och, C. Tillmann, and H. Ney, "Improved alignment models for statistical machine translation, " in Proc. Joint SIGDAT Conf. Empirical Methods Natural Lang. Process. and Very Large Corpora, College Park, MD, 1999, pp. 20-28.
37. K. Owczarzak, D. Groves, J. van Genabith, and A. Way, "Contextual bitext-derived paraphrases in automatic MT evaluation, " in Proc. HLTNAACL 2006 Workshop Statist Mach. Translation, New York, 2006, pp. 86-93.
38. K. Papineni, S. Roukos, T. Ward, and W.-J. Zhu, "BLEU: A method for automatic evaluation of machine translation, " in Proc. 40th Annu. Meeting Assoc. Comput. Linguist. (ACL-02), Philadelphia, PA, 2002, pp. 311-318.
39. A. Patry, F. Gotti, and P. Langlais, "MOOD: A modular object-oriented decoder for statistical machine translation, " in Proc. 5th Int. Conf. Lang. Resources Eval. (LREC 2006), Genoa, Italy, 2006, pp. 709-714.
40. C. Quirk, A. Menezes, and C. Cherry, "Dependency treelet translation: syntactically informed phrasalSMT, " in Proc. 43rd Annu. Meeting Assoc. Comput. Linguist., Ann Arbor, MI, 2005, pp. 271-279.
41. L. Rabiner, A. Waibel and F.-K. Lee, Eds., "A tutorial on hidden markov models and selected applications in speech recognition, " in Readings in Speech Recognition, San Mateo, CA, 1990, pp. 267-296, Morgan Kaufmann.
42. M. Steedman, The Syntactic Process. Cambridge, MA: MIT Press, 2000.
43. A. Stolcke, "SRILM - An extensible language modeling toolkit, " in Proc. 7th Int. Conf. Spoken Lang. Process., Denver, CO, 2002, pp. 901-904.
44. N. Stroppa, A. van den Bosch, and A. Way, "Exploiting source similarity for smt using context-informed features, " in Proc. 11th Int. Conf. Theoretical and Methodological Issues Mach. Translation (TMI 2007), Skövde, Sweden, 2007, pp. 231-240.
45. C. Tillmann and H. Ney, "Word re-ordering and dp-based search in statistical machine translation, " in Proc. 18th Int. Conf. Comput. Linguist. (COLING'00), Saarbrücken, Germany, 2000, pp. 850-856.
46. C. Tillmann and F. Xia, "A phrase-based unigram model for statistical machine translation, " in Proc. Joint Human Lang. Technol. Conf. Annu. Meeting North Amer. Chap. Assoc. Comput. Linguist. (HLT-NAACL), Edmonton, AB, Canada, 2003, pp. 106-108.
47. K. Toutanova, P. Markova, and C. Manning, "The leaf projection path view of parse trees: Exploring string kernels for HPSG parse selection, " in Proc. 2004 Conf. Empirical Methods Natural Lang. Process. (EMNLP 2004), Barcelona, Spain, 2004, pp. 166-173.
48. D. Wu, "Stochastic inversion transduction grammars and bilingual parsing of parallel corpora, " Comput. Linguist., vol. 23, no. 3, pp. 377-403, 1997.
49. K. Yamada and K. Knight, "A syntax-based statistical translation model, " in Proc. 39th Annu. Meeting Assoc. Comput. Linguist. and 10th Meeting Eur. Chap., Toulouse, France, 2001, pp. 523-530.
50. K. Yamamoto and Y. Matsumoto, "Extracting translation knowledge from parallel corpora, " in Recent Advances in Example-Based Machine Translation, M. Carl and A. Way, Eds. Dordrecht, The Netherlands: Kluwer, 2003, pp. 365-395.
51. R. Zens, F. Och, and H. Ney, M. Jarke, J. Koehler, and G. Lakemeyer, Eds., "Phrase-based statistical machine translation, " in 25th German Conf. Artif. Intell. (KI-2002), Aachen, Germany, 2002, vol. 2479, pp. 18-32, of Lecture Notes in Artificial Intelligence (LNAI).
52. A. Zollmann and K. Sima'an, "A consistent and efficient estimator for data-oriented parsing, " J. Automata, Lang. Combinatorics (JALC), vol. 10, no. 2, 3, pp. 367-388, 2005.