Bilingually motivated word segmentation for statistical machine translation

ACM Transactions on Asian Language Information Processing

Volumn 8, Issue 2, 2009, Pages

  Ma, Yanjun ^a   Way, Andy ^a  

^a DUBLIN CITY UNIVERSITY   (Ireland)

Author keywords

Alignment; Bilingually motivated; Phrase based statistical machine translation; Word segmentation

Indexed keywords

BILINGUALLY MOTIVATED; CHINESE WORD SEGMENTATION; CONSISTENT STATE; DIFFERENT DOMAINS; PHRASE-BASED STATISTICAL MACHINE TRANSLATION; PREDICTIVE POWER; SMT SYSTEMS; STATISTICAL MACHINE TRANSLATION; TARGET LANGUAGE; TRAINING DATA; TRANSLATION MODELS; TWO DOMAINS; WORD SEGMENTATION;

ALIGNMENT; COMPUTER AIDED LANGUAGE TRANSLATION; INFORMATION THEORY; LEAD ALLOYS; LINGUISTICS; QUERY LANGUAGES; TRANSLATION (LANGUAGES);

SPEECH TRANSMISSION;

EID: 67650327608     PISSN: 15300226     EISSN: 15583430     Source Type: Journal    
DOI: 10.1145/1526252.1526255     Document Type: Article

References (37)

1. BANERJEE, S. AND LAVIE, A. 2005. METEOR: An automatic metric for MT evaluation with improved correlation with human judgments. In Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and/or Summarization (ACL'05). 65-72.
2. BIRCH, A., CALLISON-BURCH, C., AND OSBORNE, M. 2006. Constraining the phrase-based, joint probability statistical translation model. In Proceedings of the 7th Biennial Conference of the Association for Machine Translation in the Americas (AMTA'06). 10-18.
3. BROWN, P. F., PIETRA, S. A. D., PIETRA, V. J. D., AND MERCER, R. L. 1993. The mathematics of statistical machine translation: Parameter estimation. Comput. Linguist. 19, 2, 263-311.
4. CHANG, P.-C., GALLEY, M., AND MANNING, C. D. 2008. Optimizing Chinese word segmentation for machine translation performance. In Proceedings of the 3rd Workshop on Statistical Machine Translation (SMT'08). 224-232.
5. DENG, Y. AND BYRNE, W. 2005. HMM word and phrase alignment for statistical machine translation. In Proceedings of the Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing (HLT-EMNLP'05). 169-176.
6. DENG, Y. AND BYRNE, W. 2006. MTTK: An alignment toolkit for statistical machine translation. In Proceedings of the Human Language Technology Conference/ North American Chapter of the Association for Computational Linguistics (HLT-NAACL'06). 265-268.
7. DODDINGTON, G. 2002. Automatic evaluation of machine translation quality using n-gram cooccurrence statistics. In Proceedings of the 2nd International Conference on Human Language Technology (HLT'02). 138-145.
8. DYER, C., MURESAN, S., AND RESNIK, P. 2008. Generalizing word lattice translation. In Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies (ACL-HLT'08). 1012-1020.
9. FRASER, A. AND MARCU, D. 2007. Getting the structure right for word alignment: LEAF. In Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL'07). 51-60.
10. KNESER, R. AND NEY, H. 1995. Improved backing-off for m-gram language modeling. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'95). 181-184.
11. KOEHN, P. 2005. Europarl: A parallel corpus for statistical machine translation. In Proceedings of the Machine Translation Summit X (MT'05). 79-86.
12. KOEHN, P., HOANG, H., BIRCH, A., CALLISON-BURCH, C., FEDERICO, M., BERTOLDI, N., COWAN, B., SHEN, W., MORAN, C., ZENS, R., DYER, C., BOJAR, O., CONSTANTIN, A., AND HERBST, E. 2007. Moses: Open source toolkit for statistical machine translation. In Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics Companion Volume Proceedings of the Demo and Poster Sessions (ACL'07). 177-180.
13. KOEHN, P., OCH, F., AND MARCU, D. 2003. Statistical phrase-based translation. In Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing (HLT-EMNLP'03). 48-54.
14. MA, Y., OZDOWSKA, S., SUN, Y., AND WAY, A. 2008. Improving word alignment using syntactic dependencies. In Proceedings of the HLT 2nd Workshop on Syntax and Structure in Statistical Translation (SSST-2'08). 69-77.
15. MA, Y., STROPPA, N., AND WAY, A. 2007. Bootstrapping word alignment via word packing. In Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics (ACL'07). 304-311.
16. MACHEREY, W., OCH, F., THAYER, I., AND USZKOREIT, J. 2008. Lattice-based minimum error rate training for statistical machine translation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP'08). 725-734.
17. MARCU, D. AND WONG, W. 2002. A phrase-based, joint probability model for statistical machine translation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP'02). 133-139.
18. MELAMED, I. D. 1997. Automatic discovery of noncompositional compounds in parallel data. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP'97). 97-108.
19. MELAMED, I. D. 2000. Models of translational equivalence among words. Comput. Linguist. 26, 2, 221-249.
20. NOREEN, E. W. 1989. Computer-Intensive Methods for Testing Hypotheses: An Introduction. Wiley-Interscience, New York.
21. OCH, F. 2003. Minimum error rate training in statistical machine translation. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics (ACL'03). 160-167.
22. OCH, F. AND NEY, H. 2003. A systematic comparison of various statistical alignment models. Comput. Linguist. 29, 1, 19-51.
23. PAPINENI, K., ROUKOS, S., WARD, T., AND ZHU, W.-J. 2002. BLEU: a method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL'02). 311-318.
24. PAUL, M. 2006. Overview of the IWSLT 2006 Evaluation Campaign. In Proceedings of the International Workshop on Spoken Language Translation (IWSLT'06). 1-15.
25. SMADJA, F., MCKEOWN, K. R., AND HATZIVASSILOGLOU, V. 1996. Translating collocations for bilingual lexicons: A statistical approach. Comput. Linguist. 22, 1, 1-38.
26. SPROAT, R. W., SHIH, C., GALE, W., AND CHANG, N. 1996. A stochastic finite-state word-segmentation algorithm for Chinese. Comput. Linguist. 22, 3, 377-404.
27. STOLCKE, A. 2002. SRILM-An extensible language modeling toolkit. In Proceedings of the International Conference on Spoken Language Processing (ISWLT'02). 901-904.
28. TAKEZAWA, T., SUMITA, E., SUGAYA, F., YAMAMOTO, H., AND YAMAMOTO, S. 2002. Toward a broad-coverage bilingual corpus for speech translation of travel conversations in the real world. In Proceedings of 3rd International Conference on Language Resources and Evaluation (LREC'02). 147-152.
29. TIEDEMANN, J. 2003. Combining clues for word alignment. In Proceedings of the 10th Conference of European Chapter of the Association for Computational Linguistics (EACL'03). 339-346.
30. TSENG, H., CHANG, P., ANDREW, G., JURAFSKY, D., AND MANNING, C. 2005. A conditional random field word segmenter for sighan bakeoff 2005. In Proceedings of the 4th SIGHAN Workshop on Chinese Language Processing (SIGHAN'05). 168-171.
31. VOGEL, S., NEY, H., AND TILLMANN, C. 1996. HMM-based word alignment in statistical translation. In Proceedings of the 16th International Conference on Computational Linguistics (COLING'96). 836-841.
32. WU, D. 1997. Stochastic inversion transduction grammars and bilingual parsing of parallel corpora. Comput. Linguist. 23, 3, 377-403.
33. XU, J., GAO, J., TOUTANOVA, K., AND NEY, H. 2008. Bayesian semi-supervised chinese word segmentation for statistical machine translation. In Proceedings of the 22nd International Conference on Computational Linguistics (COLING'08). 1017-1024.
34. XU, J., MATUSOV, E., ZENS, R., AND NEY, H. 2005. Integrated Chinese word segmentation in statistical machine translation. In Proceedings of the International Workshop on Spoken Language Translation (IWSLT'05). 141-147.
35. XU, J., ZENS, R., AND NEY, H. 2004. Do we need Chinese word segmentation for statistical machine translation? In Proceedings of the ACL Workshop on Chinese Language Processing (SIGHAN'04). 122-128.
36. ZHANG, H., YU, H., XIONG, D., AND LIU, Q. 2003. HHMM-based Chinese lexical analyzer ICTCLAS. In Proceedings of 2nd ACL Workshop on Chinese Language Processing (SIGHAN'03). 184-187.
37. ZHANG, R., YASUDA, K., AND SUMITA, E. 2008. Improved statistical machine translation by multiple Chinese word segmentation. In Proceedings of the 3rd Workshop on Statistical Machine Translation (SMT'08). 216-223.