A weighted finite state transducer translation template model for statistical machine translation

Natural Language Engineering

Volumn 12, Issue 1, 2006, Pages 35-75

  Kumar, Shankar ^a   Deng, Yonggang ^a   Byrne, William ^a  

^a Johns Hopkins University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ERROR ANALYSIS; FINITE AUTOMATA; STATISTICAL METHODS; WORD PROCESSING;

FINITE STATE TRANSDUCER TRANSLATION TEMPLATE MODEL; STATISTICAL MACHINE TRANSLATION; WORD-TO-WORD TRANSLATION MODELS;

COMPUTER AIDED LANGUAGE TRANSLATION;

EID: 33744923157     PISSN: 13513249     EISSN: 14698110     Source Type: Journal    
DOI: 10.1017/S1351324905003815     Document Type: Article

References (37)

1. Allauzen, C., Mohri, M. and Roark, B. (2003) Generalized algorithms for constructing statistical language models. Proceedings 41st Annual Meeting of the Association of Computational Linguistics, pp. 40-47. Sapporo, Japan.
2. Bangalore, S. and Riccardi, G. (2001) A finite-state approach to machine translation. Proceedings 2nd meeting of the North American Chapter of the Association for Computational Linguistics. Pittsburgh, PA.
3. Brown, P. F., Cocke, J., Della Pietra, S. A., Della Pietra, V. J., Jelinek, F., Lafferty, J. D., Mercer, R. L. and Roossin, P. S. (1990) A statistical approach to machine translation. Computational Linguistics 16(2): 79-85.
4. Brown, P. F., Della Pietra, S. A., Della Pietra, V. J. and Mercer, R. L. (1993) The mathematics of statistical machine translation: Parameter estimation. Computational Linguistics 19(2): 263-311.
5. Byrne, W., Khudanpur, S., Kim, W, Kumar, S., Pecina, P., Virga, P., Xu, P. and Yarowsky, D. (2003) The Johns Hopkins University 2003 Chinese-English Machine Translation System. Proceedings of MT Summit IX, pp. 447-450. New Orleans, LA.
6. Deng, Y. and Byrne, W. (2004) Bitext Chunk Alignment for Statistical Machine Translation. Research Note, Center for Language and Speech Processing, Johns Hopkins University.
7. Doddington, G. (2002) Automatic evaluation of machine translation quality using N-gram co-occurrence statistics. Proceedings of the Conference on Human Language Technology, pp. 138-145, San Diego, CA.
8. Germann, U., Jahr, M., Knight, K., Marcu, D. and Yamada, K. (2001) Fast decoding and optimal decoding for machine translation. Proceedings of the 39th Annual Meeting of the Association for Computational Linguistics, pp. 228-235. Toulouse, France.
9. Canadian Parliament (2003) Canadian Hansards. http://www.parl.gc.ca/.
10. Knight, K. and Al-Onaizan, Y. (1998) Translation with finite-state devices, Proceedings of the AMTA Conference, pp. 421-437. Langhorne, PA.
11. Koehn, P., Och, F. and Marcu, D. (2003) Statistical phrase-based translation. Proceedings of the Conference on Human Language Technology, pp. 127-133. Edmonton, Canada.
12. Kumar, S. and Byrne, W. (2002) Minimum Bayes-risk alignment of bilingual texts. Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp. 140-147. Philadelphia, PA.
13. Kumar, S. and Byrne, W. (2003) A weighted finite state transducer implementation of the alignment template model for statistical machine translation. Proceedings of the Conference on Human Language Technology, pp. 142-149. Edmonton, Canada.
14. Kumar, S. and Byrne, W. (2004) A weighted finite state transducer translation template model for statistical machine translation. Research Note No. 48, Center for Language and Speech Processing, Johns Hopkins University.
15. Kumar, S. and Byrne, W. (2004) Minimum Bayes-risk decoding for statistical machine translation Proceedings of the Conference on Human Language Technology, pp. 169-176. Boston, MA.
16. LDC (2002), Chinese Segmenter. http://www.ldc.upenn.edu/Projects/Chinese.
17. Marcu, D. and Germann, U. (2002) The ISI ReWrite Decoder Release 0.7.0b. http://www.isi.edu/licensed-sw/rewrite-decoder/.
18. Marcu, D. and Wong, W. (2002) A phrase-based, joint probability model for statistical machine translation. Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp. 133-139. Philadelphia, PA.
19. Mohri, M., Pereira, F. and M. Riley (1997), ATT General-purpose finite-state machine software tools. http://www.research.att.com/sw/ tools/fsm/
20. NIST (2004) The NIST Machine Translation Evaluations. http://www.nist. gov/speech/tests/mt/.
21. Och, F. (2002) Statistical Machine Translation: From Single Word Models to Alignment Templates. PhD Thesis, RWTH Aachen, Germany.
22. Och, F. and Ney, H. (2000) Improved statistical alignment models. Proceedings of the 38th Annual Meeting of the Association for Computational Linguistics pp. 440-447. Hong Kong, China.
23. Och, F., Tillmann, C. and Ney, H. (1999) Improved alignment models for statistical machine translation. Proceedings of the Joint Conference of Empirical Methods in Natural Language Processing and Very Large Corpora, pp. 20-28. College Park, MD.
24. Och, F., Ueffing, N. and Ney, H. (2001) An efficient A* search algorithm for statistical machine translation. Proceedings of the 39th Annual Meeting of the Association for Computational Linguistics, pp. 55-62. Toulouse, France.
25. Papineni, K., Roukos, S., Ward, T. and Zhu, W (2001) Bleu: A Method for Automatic Evaluation of Machine Translation. Technical Report RC22176 (W0109-022), IBM Research Division.
26. The People's Daily (2002). http://www.english.people.com.cn.
27. Schafer, C. and Yarowsky, D. (2003) Statistical machine translation using coercive two-level syntactic transduction. Proceedings of the Conference on Empirical Methods in Natural Language Processing, Sapporo, Japan.
28. Stolcke, A (1998) Entropy-based pruning of backoff language models. Proceedings of the DARPA Broadcast News Transcription and Understanding Workshop, pp. 270-274, Lansdowne, VA.
29. Stolcke, A. (2002) SRILM - An Extensible Language Modeling Toolkit. http://www.speech.sri.com/projects/srilm/. Proceedings of the International Conference on Spoken Language Processing, pp. 901-904. Denver, CO.
30. Tillmann, C. and Ney, H. (2003) Word reordering and a dynamic programming beam search algorithm for statistical machine translation. Computational Linguistics 29(1): 97-133.
31. Tillmann, C. (2003) A projection extension algorithm for statistical machine translation. Proceedings of the Conference on Empirical Methods in Natural Language Processing, Sapporo, Japan.
32. Ueffing, N., Och, F. and Ney, H. (2002) Generation of word graphs in statistical machine translation. Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp. 156-163. Philadelphia, PA.
33. Vogel, S., Ney, H. and Tillmann, C. (1996) HMM based word alignment in statistical translation. Proceedings of the 16th International Conference on Computational Linguistics pp. 836-841. Copenhagen, Denmark.
34. Wang, Y. and Waibel, A. (1997) Decoding algorithm in statistical machine translation. Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics, pp. 366-372. Madrid, Spain.
35. JHU (2003), Syntax for Statistical Machine Translation, Final Report, JHU Summer Workshop. http://www.clsp.jhu.edu/ws2003/groups/translate/.
36. Zens, R. and Ney, H. (2004) Improvements in phrase-based statistical machine translation. Proceedings of the Conference on Human Language Technology, pp. 257-264. Boston, MA.
37. Zhang, Y. Vogel, S. and Waibel A. (2003), Integrated phrase segmentation and alignment model for statistical machine translation. Proceedings of the Conference on Natural Language Processing and Knowledge Engineering. Beijing, China.