Unsupervised tokenization for machine translation

EMNLP 2009 - Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: A Meeting of SIGDAT, a Special Interest Group of ACL, Held in Conjunction with ACL-IJCNLP 2009

Volumn , Issue , 2009, Pages 718-726

  Chung, Tagyoung ^a   Gildea, Daniel ^a  

^a University of Rochester   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS;

MACHINE TRANSLATIONS; PARALLEL CORPORA; RULE BASED; STATISTICAL MACHINE TRANSLATION; TOKENIZATION; TOKENIZING; UNSUPERVISED METHOD; WRITING SYSTEMS;

COMPUTER AIDED LANGUAGE TRANSLATION;

EID: 80053397836     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/1699571.1699606     Document Type: Conference Paper

References (19)

1. Matthew J. Beal. 2003. Variational Algorithms for Approximate Bayesian Inference. Ph.D. thesis, University College London.
2. Peter F. Brown, Stephen A. Della Pietra, Vincent J. Della Pietra, and Robert L. Mercer. 1993. The mathematics of statistical machine translation: Parameter estimation. Computational Linguistics, 19(2):263-311.
3. Pi-Chuan Chang,Michel Galley, and ChristopherManning. 2008. Optimizing Chinese word segmentation for machine translation performance. In Proceedings of the Third Workshop on Statistical Machine Translation, pages 224-232.
4. Carl deMarcken. 1996. Linguistic structure as composition and perturbation. In Meeting of the Association for Computational Linguistics, pages 335-341. Morgan Kaufmann Publishers.
5. John Goldsmith. 2001. Unsupervised learning of the morphology of a natural language. Computational Linguistics, 27(2):153-198.
6. Sharon Goldwater, Thomas L. Griffiths, and Mark Johnson. 2006. Contextual dependencies in unsupervised word segmentation. In Proceedings of the International Conference on Computational Linguistics/ Association for Computational Linguistics (COLING/ACL-06), pages 673-680.
7. Mark Johnson. 2007. Why doesn't EM find good HMM POS-taggers? In 2007 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 296-305, Prague, Czech Republic, June. Association for Computational Linguistics.
8. Genichiro Kikui and Hirofumi Yamamoto. 2002. Finding translation pairs from english-japanese untokenized aligned corpora. In Proceedings of the 40th Annual Conference of the Association for Computational Linguistics (ACL-02) workshop on Speech-to-speech translation: algorithms and systems, pages 23-30. Association for Computational Linguistics.
9. Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondrej Bojar, Alexandra Constantin, and Evan Herbst. 2007. Moses: Open source toolkit for statistical machine translation. In Proceedings of the 45th Annual Conference of the Association for Computational Linguistics (ACL-07), Demonstration Session, pages 177-180.
10. I. Dan Melamed. 1999. Bitext maps and alignment via pattern recognition. Computational Linguistics, 25:107-130.
11. Robert C. Moore. 2002. Fast and accurate sentence alignment of bilingual corpora. In AMTA '02: Proceedings of the 5th Conference of the Association for Machine Translation in the Americas on Machine Translation: From Research to Real Users, pages 135-144, London, UK. Springer-Verlag.
12. Franz Josef Och and Hermann Ney. 2003. A systematic comparison of various statistical alignment models. Computational Linguistics, 29(1):19-51.
13. Franz Josef Och. 2003. Minimum error rate training for statistical machine translation. In Proceedings of the 41th Annual Conference of the Association for Computational Linguistics (ACL-03).
14. Kishore Papineni, Salim Roukos, ToddWard, and Wei-Jing Zhu. 2002. BLEU: A method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Conference of the Association for Computational Linguistics (ACL-02).
15. Fei Xia, Martha Palmer, Nianwen Xue, Mary Ellen Okurowski, John Kovarik, Shizhe Huang, Tony Kroch, and Mitch Marcus. 2000. Developing Guidelines and Ensuring Consistency for Chinese Text Annotation. In Proc. of the 2nd International Conference on Language Resources and Evaluation (LREC-2000), Athens, Greece.
16. Jia Xu, Jianfeng Gao, Kristina Toutanova, and Hermann Ney. 2008. Bayesian semi-supervised chinese word segmentation for statistical machine translation. In Proceedings of the 22nd International Conference on Computational Linguistics (Coling 2008), pages 1017-1024, Manchester, UK, August. Coling 2008 Organizing Committee.
17. Nianwen Xue. 2003. Chinese word segmentation as character tagging. In International Journal of Computational Linguistics and Chinese Language Processing, volume 8, pages 29-48.
18. Hao Zhang, Chris Quirk, Robert C. Moore, and Daniel Gildea. 2008a. Bayesian learning of noncompositional phrases with synchronous parsing. In Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics (ACL-08), pages 97-105, Columbus, Ohio.
19. Ruiqiang Zhang, Keiji Yasuda, and Eiichiro Sumita. 2008b. Improved statistical machine translation by multiple Chinese word segmentation. In Proceedings of the Third Workshop on Statistical Machine Translation, pages 216-223.