Chinese word segmentation and statistical machine translation

ACM Transactions on Speech and Language Processing

Volumn 5, Issue 2, 2008, Pages

  Zhang, Ruiqiang ^a,b   Yasuda, Keiji ^a   Sumita, Eiichiro ^a  

^a NATIONAL INSTITUTE OF INFORMATION AND COMMUNICATIONS TECHNOLOGY   (Japan)

^b ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

Author keywords

Chinese word segmentation; Linear integration; Statistical machine translation; Translation model

Indexed keywords

COMPUTER AIDED LANGUAGE TRANSLATION; COMPUTER NETWORKS; ERRORS; INFORMATION THEORY; INTERPOLATION; LINGUISTICS; MATHEMATICAL MODELS; NUMERICAL ANALYSIS; PHOTOACOUSTIC EFFECT; SPECIFICATIONS; STATISTICAL METHODS; STATISTICS; SUPPORT VECTOR MACHINES; SURFACE MOUNT TECHNOLOGY; TRANSLATION (LANGUAGES);

BEIJING; CHINESE WORD SEGMENTATION (CWS); CITY UNIVERSITY; EXPERIMENTAL RESULTS; F SCORE; HONG KONG; MICROSOFT RESEARCH (CO); STATISTICAL MACHINE TRANSLATION (SMT); TRAINING DATA; TRANSLATION MODELS;

SPEECH TRANSMISSION;

EID: 44849108434     PISSN: 15504875     EISSN: 15504883     Source Type: Journal    
DOI: 10.1145/1363108.1363109     Document Type: Article

References (23)

1. EMERSON, T. 2005. The second international chinese word segmentation bakeoff. In Proceedings of the 4th SIGHAN Workshop on Chinese Language Processing. Jeju, Korea.
2. FOSTER, G.AND KUHN, R. 2007. Mixture-model adaptation for SMT. InProceedings of the 2nd Workshop on Statistical Machine Translation. Prague, Czech Republic, Association for Computational Linguistics, 128-135.
3. FRASER, A. AND MARCU, D. 2007. Measuring word alignment quality for statistical machine translation. Comput. Linguist. (Squibs with Discussion). 33, 3, 293-303.
4. GAO, J., WU, A., LI, M., HUANG, C.-N., LI, H., XIA, X., AND QIN, H. 2004. Adaptive chinese word segmentation. In Proceedings of the Association for Computational Linguistics (ACL'04). Barcelona, Spain. 462-469.
5. GOLDWATER, S. AND MCCLOSKY, D. 2005. Improving statistical MT through morphological analysis. In Proceedings of the HLT/EMNLP. Vancouver, British Columbia, Canada. 676-683.
6. KOEHN, P., AXELROD, A., MAYNE , A. B., CHRIS CALLISON-BURCH, M. O., TALBOT, D., AND WHITE, M. 2005. Edinburgh system description for the 2005 nist mt evaluation. In Proceedings of Machine Translation Evaluation Workshop.
7. KOEHN, P., OCH, F. J., AND MARCU, D. 2003. Statistical phrase-based translation. In Proceedings of the HLT-NAACL. 127-133.
8. KUDO, T. AND MATSUMOTO, Y. 2001. Chunking with support vector machine. In Proceedings of the NAACL. 192-199.
9. LAFFERTY, J., MCCALLUM, A., AND PEREIRA, F. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the ICML. 591-598.
10. LEE, Y.-S. 2004. Morphological analysis for statistical machine translation. In Proceedings of the HLT-NAACL. Boston, MA., 57-60.
11. OCH, F. J. 2003. Minimum error rate training in statistical machine translation. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics (ACL). 160-167.
12. OCH, F. J. AND NEY, H. 2003. A systematic comparison of various statistical alignment models. Computat. Linguist. 29, 1, 19-51.
13. PAPINENI, K., ROUKOS, S., WARD, T., AND ZHU, W. 2002. BLEU: A method for automatic evaluation of machine translation. In Proceedings of the 40th Meeting of the Association for Computational Linguistics (ACL). Philadelphia, PA. 311-318.
14. PAUL, M. 2006. Overview of the IWSLT 2006 Evaluation Campaign. In Proceedings of the IWSLT. Kyoto, Japan. 1-15.
15. PENG, F. AND MCCALLUM, A. 2004. Chinese segmentation and new word detection using conditional random fields. In Proceedings of Coling. Geneva, Switzerland. 562-568.
16. SADAT, F. AND HABASH, N. 2006. Combination of arabic preprocessing schemes for statistical machine translation. In Proceedings of the COLING/ACL. Sydney, Australia. 1-8.
17. TSENG, H., CHANG, P., ANDREW, G., JURAFSKY, D., AND MANNING, C. 2005. A conditional random field word segmenter for Sighan bakeoff 2005. In Proceedings of the 4th SIGHAN Workshop on Chinese Language Processing. Jeju, Korea.
18. UEFFING, N. AND NEY, H. 2003. Using pos information for statistical machine translation into morphologically rich languages. In Proceedings of the European Chapter of the Association for Computational Linguistics (EACL). 347-354.
19. XUE, N. AND SHEN, L. 2003. Chinese word segmentation as LMR tagging. In Proceedings of the 2nd SIGHAN Workshop on Chinese Language Processing.
20. ZHANG, H., YU, H., XIONG, D., AND LIU, Q. 2003. HHMM-based Chinese lexical analyzer ICTCLAS. In Proceedings of the 2nd SIGHAN Workshop on Chinese Language Processing. 184-187.
21. ZHANG, R., KIKUI, G., AND SUMITA, E. 2006. Subword-based tagging by conditional random fields for chinese word segmentation. In Proceedings of the HLT-NAACL (Companion Volume: Short Papers). New York City, NY. 193-196.
22. ZHANG, R. AND SUMITA, E. 2008. Chinese unknown word translation by subword re-segmentation. In Proceedings of the 3rd International Joint Conference on Natural Language Processing (IJCNLP). Hyderabad, India, 252-232.
23. ZHANG, Y., VOGEL, S., AND WAIBEL, A. 2004. Interpreting BLEU/NIST scores: How much improvement do we need to have a better system? In Proceedings of the International Conference on Language Resources and Evaluation (LREC).