Integration of Multiple Bilingually-Learned Segmentation Schemes into Statistical Machine Translation

Proceedings of the Annual Meeting of the Association for Computational Linguistics

Volumn , Issue , 2010, Pages 400-408

  Paul, Michael ^a   Finch, Andrew ^a   Sumita, Eiichiro ^a  

^a NATIONAL INSTITUTE OF INFORMATION AND COMMUNICATIONS TECHNOLOGY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; COMPUTER AIDED LANGUAGE TRANSLATION; IMAGE SEGMENTATION; MACHINE TRANSLATION; NATURAL LANGUAGE PROCESSING SYSTEMS; SPEECH TRANSMISSION;

LANGUAGE PAIRS; MACHINE TRANSLATION MODELS; MULTIPLE SEGMENTATION; SEGMENTATION ALGORITHMS; SEGMENTATION SCHEME; SOURCE LANGUAGE; STATISTICAL MACHINE TRANSLATION; STATISTICAL MACHINE TRANSLATION SYSTEM; TRANSLATION QUALITY; WORD SEGMENTATION;

ITERATIVE METHODS;

EID: 85122525139     PISSN: 0736587X     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (25)

1. Adam Berger, Stephen Della Pietra, and Vincent Della Pietra. 1996. A maximum entropy approach to NLP. Computational Linguistics, 22(1):39–71.
2. John Blatz, Erin Fitzgerald, George Foster, Simona Gandrabur, Cyril Goutte, Alex Kulesza, Alberto Sanchis, and Nicola Ueffing. 2003. Confidence estimation for statistical machine translation. In Final Report of the JHU Summer Workshop.
3. Michael Brent. 1999. An efficient, probabilistically sound algorithm for segmentation and word discovery. Machine Learning, 34:71–105.
4. Chris Callison-Burch, Cameron Fordyce, Philipp Koehn, Christof Monz, and Jan Schroeder. 2007. (Meta-) Evaluation of Machine Translation. In Proceedings of the 2nd Workshop on SMT, pages 136–158, Prague, Czech Republic.
5. Pi-Chuan Chang, Michel Galley, and Christopher Manning. 2008. Optimizing Chinese Word Segmentation for Machine Translation Performance. In Proc. of the 3rd Workshop on SMT, pages 224–232, Columbus, USA.
6. Kwok-Shing Cheng, Gilbert Young, and Kam-Fai Wong. 1999. A study on word-based and integratbit Chinese text compression algorithms. American Society of Information Science, 50(3):218–228.
7. Tagyoung Chung and Daniel Gildea. 2009. Unsupervised Tokenization for Machine Translation. In Proc. of the EMNLP, pages 718–726, Singapore.
8. Adrian de Gispert, Sami Virpioja, Mikko Kurimo, and William Byrne. 2009. Minimum Bayes Risk Combination of Translation Hypotheses from Alternative Morphological Decompositions. In Proc. of HLT, Companion Volume, pages 73–76, Boulder, USA.
9. Christopher Dyer, Smaranda Muresan, and Philip Resnik. 2008. Generalizing Word Lattice Translation. In Proc. of ACL, pages 1012–1020, Columbus, USA.
10. Christopher Dyer. 2009. Using a maximum entropy model to build segmentation lattices for MT. In Proc. of HLT, pages 406–414, Boulder, USA.
11. Sharon Goldwater, Thomas Griffith, and Mark Johnson. 2006. Contextual Dependencies in Unsupervised Word Segmentation. In Proc. of the ACL, pages 673–680, Sydney, Australia.
12. Geninchiro Kikui and Hirofumi Yamamoto. 2002. Finding Translation Pairs from English-Japanese Untokenized Aligned Corpora. In Proc. of the Workshop on Speech-to-Speech Translation, pages 23–30, Philadephia, USA.
13. Geninchiro Kikui, Seiichi Yamamoto, Toshiyuki Takezawa, and Eiichiro Sumita. 2006. Comparative study on corpora for speech translation. IEEE Transactions on Audio, Speech and Language, 14(5):1674–1682.
14. Alon Lavie and Abhaya Agarwal. 2007. METEOR: An automatic metric for MT evaluation with high levels of correlation with human judgments. In Proc. of the 2nd Workshop on SMT, pages 228–231, Prague, Czech Republic.
15. Yanjun Ma and Andy Way. 2009. Bilingually Motivated Domain-Adapted Word Segmentation for Statistical Machine Translation. In Proc. of the 12th EACL, pages 549–557, Athens, Greece.
16. Preslav Nakov, Chang Liu, Wei Lu, and Hwee Tou Ng. 2009. The NUS SMT System for IWSLT 2009. In Proc. of IWSLT, pages 91–98, Tokyo, Japan.
17. Franz J. Och and Hermann Ney. 2003. A Systematic Comparison of Statistical Alignment Models. Computational Linguistics, 29(1):19–51.
18. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: a Method for Automatic Evaluation of Machine Translation. In Proc. of the 40th ACL, pages 311–318, Philadelphia, USA.
19. Stephen Della Pietra, Vincent Della Pietra, and John Lafferty. 1997. Inducing Features of Random Fields. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(4):380–393.
20. Adwait Ratnaparkhi. 1996. A Maximum Entropy Model for Part-Of-Speech Tagging. In Proc. of the EMNLP, pages 133–142, Pennsylvania, USA.
21. Andreas Stolcke. 2002. SRILM an extensible language modeling toolkit. In Proc. of ICSLP, pages 901–904, Denver, USA.
22. Anand Venkataraman. 2001. A statistical model for word discovery in transcribed speech. Computational Linguistics, 27(3):351–372.
23. Jia Xu, Jianfeng Gao, Kristina Toutanova, and Hermann Ney. 2008. Bayesian Semi-Supervised Chinese Word Segmentation for SMT. In Proc. of the COLING, pages 1017–1024, Manchester, UK.
24. Ying Zhang, Stephan Vogel, and Alex Waibel. 2004. Interpreting Bleu/NIST Scores: How Much Improvement do We Need to Have a Better System? In Proc. of the LREC, pages 2051–2054, Lisbon, Portugal.
25. Ruiqiang Zhang, Keiji Yasuda, and Eiichiro Sumita. 2008. Improved Statistical Machine Translation by Multiple Chinese Word Segmentation. In Proc. of the 3rd Workshop on SMT, pages 216–223, Columbus, USA.