Do we need Chinese word segmentation for statistical machine translation?

Proceedings of the 3rd SIGHAN Workshop on Chinese Language Processing, SIGHAN@ACL 2004 - Held in cooperation with ACL 2004

Volumn , Issue , 2004, Pages 122-128

  Xu, Jia ^a   Zens, Richard ^a   Ney, Hermann ^a  

^a RWTH AACHEN UNIVERSITY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS;

CHINESE CHARACTERS; CHINESE TEXT; CHINESE WORD SEGMENTATION; MINIMISATION; STATISTICAL MACHINE TRANSLATION; TEXT WORDS; TRANSLATION QUALITY; TRANSLATION SYSTEMS; WHITE SPACE; WORD SEGMENTATION;

COMPUTER AIDED LANGUAGE TRANSLATION;

EID: 38149009876     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. P. F. Brown, J. Cocke, S. A. Della Pietra, V. J. Della Pietra, F. Jelinek, J. D. Lafferty, R. L. Mercer, and P. S. Roossin. 1990. A statistical approach to machine translation. Computational Linguistics, 16(2):79–85, June.
2. P. F. Brown, S. A. Della Pietra, V. J. Della Pietra, and R. L. Mercer. 1993. The mathematics of statistical machine translation: Parameter estimation. Computational Linguistics, 19(2):263–311, June.
3. LDC. 2003a. LDC Chinese resources home page. http://www.ldc.upenn.edu/Projects/Chinese/LDC ch.htm.
4. LDC. 2003b. LDC resources home page. http://www.ldc.upenn.edu/Pro jects/TIDES/ mt2004cn.htm.
5. NIST. 2003. Machine translation home page. http://www.nist.gov/speech/tests/mt/ index.htm.
6. F. J. Och and H. Ney. 2002. Discriminative training and maximum entropy models for statistical machine translation. In Proc. of the 40th Annual Meeting of the Association for Computational Linguistics (ACL), pages 295–302, Philadelphia, PA, July.
7. F. J. Och and H. Ney. 2003. A systematic comparison of various statistical alignment models. Computational Linguistics, 29(1):19–51, March.
8. F. J. Och, C. Tillmann, and H. Ney. 1999. Improved alignment models for statistical machine translation. In Proc. of the Joint SIG-DAT Conf. on Empirical Methods in Natural Language Processing and Very Large Corpora, pages 20–28, University of Maryland, College Park, MD, June.
9. D. D. Palmer. 1997. A trainable rule-based algorithm for word segmentation. In Proc. of the 35th Annual Meeting of ACL and 8th Conference of the European Chapter of ACL, pages 321–328, Madrid, Spain, August.
10. K. A. Papineni, S. Roukos, T. Ward, and W. J. Zhu. 2001. Bleu: a method for automatic evaluation of machine translation. Technical Report RC22176 (W0109-022), IBM Research Division, Thomas J. Watson Research Center, September.
11. R. W. Sproat and C. Shih. 1990. A statistical method for finding word boundaries in Chinese text. Computer Processing of Chinese and Oriental Languages, 4:336–351.
12. M. Sun, D. Shen, and B. K. Tsou. 1998. Chinese word segmentation without using lexicon and hand-crafted training data. In Proc. of the 36th Annual Meeting of ACL and 17th Int. Conf. on Computational Linguistics (COLING-ACL 98), pages 1265–1271, Montreal, Quebec, Canada, August.
13. S. Vogel, H. Ney, and C. Tillmann. 1996. HMM-based word alignment in statistical translation. In COLING’96: The 16th Int. Conf. on Computational Linguistics, pages 836–841, Copenhagen, Denmark, August.