A maximum-entropy segmentation model for statistical machine translation

IEEE Transactions on Audio, Speech and Language Processing

Volumn 19, Issue 8, 2011, Pages 2494-2505

  Xiong, Deyi ^a   Zhang, Min ^a   Li, Haizhou ^a  

^a INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

Author keywords

Bracketing transduction grammar (BTG) based phrasal machine translation; hierarchical segmentation; maximum entropy; phrasal segmentation; statistical machine translation (SMT)

Indexed keywords

BROADCAST NEWS; HIERARCHICAL SEGMENTATION; MACHINE TRANSLATIONS; MAXIMUM ENTROPY; STATISTICAL MACHINE TRANSLATION; TRAINING DATA; TRANSLATION QUALITY;

ENTROPY; INFORMATION THEORY; LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS; STATISTICS;

SPEECH TRANSMISSION;

EID: 80053214216     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2011.2144971     Document Type: Article

References (24)

1. D. Chiang, "Hierarchical phrase-based translation," Comput. Linguist., vol. 33, no. 2, pp. 201-228, 2007.
2. B. Roark and K. Hollingshead, "Classifying chart cells for quadratic complexity context-free inference," in Proc. 22nd Int. Conf. Comput. Linguist. (Coling 2008), Manchester, U.K., Aug. 2008, pp. 745-752 [Online]. Available: http://www.aclweb.org/anthology/C08-1094
3. D. Xiong, M. Zhang, and H. Li, "Learning translation boundaries for phrase-based decoding," in Human Lang. Technol.: Proc. 2010 Annu. Conf. North Ameri. Chap. Assoc. Comput. Linguist., Los Angeles, CA, Jun. 2010, pp. 136-144 [Online]. Available: http://www.aclweb.org/ anthology/N10-1016
4. P. Koehn, F. J. Och, and D. Marcu, "Statistical phrase-based translation," in Proc. Human Lang. Technol. Conf. North Ameri. Chap. Assoc. Comput. Linguist., Edmonton, AB, Canada, May-Jun. 2003, pp. 54-58.
5. D. Chiang, "A hierarchical phrase-based model for statistical machine translation," in Proc. 43rd Annu. Meeting Assoc. for Comput. Linguist., Ann Arbor, MI, Jun. 2005, pp. 263-270.
6. G. Blackwood, A. de Gispert, and W. Byrne, "Phrasal segmentation models for statistical machine translation," in Proc. Coling 2008: Companion volume: Posters,Manchester, U.K., Aug. 2008, pp. 19-22 [Online]. Available: http://www.aclweb.org/anthology/C08-2005
7. Y. Marton and P. Resnik, "Soft syntactic constraints for hierarchical phrased-based translation," in Proc. ACL-08: HLT, Columbus, OH, Jun. 2008, pp. 1003-1011 [Online]. Available: http://www.aclweb.org/ anthology/P/P08/P08-1114
8. C. Cherry, "Cohesive phrase-based decoding for statistical machine translation," in Proc. ACL-08: HLT, Columbus, OH, Jun. 2008, pp. 72-80 [Online]. Available: http://www.aclweb.org/anthology/ P/P08/P08-1009
9. D. Xiong, M. Zhang, A. Aw, and H. Li, "A syntax-driven bracketing model for phrase-based translation," in Proc. Joint Conf. 47th Annu. Meeting ACL and 4th Int. Joint Conf. Natural Lang. Process. AFNLP, Suntec, Singapore, Aug. 2009, pp. 315-323 [Online]. Available: http:// www.aclweb.org/anthology/P/P09/P09-1036
10. H. Fox, "Phrasal cohesion and statistical machine translation," in Proc. 2002 Conf. Empirical Methods Natural Lang. Process., Jul. 2002, pp. 304-3111 [Online]. Available: http://www.aclweb.org/anthology/ W02-1039
11. A. L. Berger, S. A. D. Pietra, and V. J. D. Pietra, "A maximum entropy approach to natural language processing," Comput. Linguist., vol. 22, no. 1, pp. 39-71, 1996.
12. P. F. Brown, S. A. D. Pietra, V. J. D. Pietra, R. L. Mercer, and S. Mohanty, "Dividing and conquering long sentences in a translation system," in Proc. Workshop Speech and Natural Lang., Human Lang. Technol., 1992.
13. Z. He, Y. Meng, and H. Yu, "Learning phrase boundaries for hierarchical phrase-based translation," in Proc. Coling 2010: Posters, Beijing, China, Aug. 2010, pp. 383-390 [Online]. Available: http://www. aclweb.org/anthology/C10-2044
14. F. J. Och, "Minimum error rate training in statistical machine translation," in Proc. 41st Annu. Meeting Assoc. Comput. Linguist., Sapporo, Japan, Jul. 2003, pp. 160-167 [Online]. Available: http://www.aclweb. org/anthology/P03-1021
15. F. J. Och and H. Ney, "Discriminative training and maximum entropy models for statistical machine translation," in Proc. 40th Annu. Meeting Assoc. Comput. Linguist., Philadelphia, PA, Jul. 2002, pp. 295-302 [Online]. Available: http://www.aclweb.org/anthology/P02-1038
16. H. Zhang, D. Gildea, and D. Chiang, "Extracting synchronous grammar rules from word-level alignments in linear time," in Proc. 22nd Int. Conf. Comput. Linguist. (Coling 2008), Manchester, U.K., Aug. 2008, pp. 1081-1088 [Online]. Available: http://www.aclweb.org/anthology/ C08-1136
17. D. Wu, "Stochastic inversion transduction grammars and bilingual parsing of parallel corpora," Comput. Linguist., vol. 23, no. 3, pp. 377-403, 1997. (Pubitemid 127461226)
18. D. Xiong, Q. Liu, and S. Lin, "Maximum entropy based phrase reordering model for statistical machine translation," in Proc. 21st Int. Conf. Comput. Linguist. 44th Annu. Meeting Assoc. Comput. Linguist., Sydney, Australia, Jul. 2006, pp. 521-528 [Online]. Available: http:// www.aclweb.org/anthology/P06-1066
19. F. J. Och and H. Ney, "Improved statistical alignment models," in Proc. 38th Ann. Meeting Assoc. Comput. Linguist., Hong Kong, China, Oct. 2000, pp. 440-447.
20. P. Koehn, A. Axelrod, A. B. Mayne, C. Callison-Burch, M. Osborne, and D. Talbot, "Edinburgh system description for the 2005 iwslt speech translation evaluation," in Proc. Int. Workshop Spoken Lang. Translation 2005, Pittsburgh, PA, Oct. 2005.
21. A. Stolcke, "Srilm-an extensible language modeling toolkit," in Proc. 7th Int. Conf. Spoken Lang. Process. (ICSLP 2002), Denver, CO, Sep. 2002, pp. 901-904. [22] D. Xiong, Q. Liu, and S. Lin, "Parsing the penn chinese treebank with semantic knowledge," in Proc. The 2nd Int. Joint Conf. Natural Lang. Process. (IJCNLP-05), Jeju Island, Korea, Oct. 2005, pp. 70-81.
22. K. Papineni, S. Roukos, and T. W.-J. Zhu, "Bleu: A method for automatic evaluation of machine translation," in Proc. 40th Annu. Meeting Assoc. Comput. Linguist., Philadelphia, PA, Jul. 2002, pp. 311-318 [Online]. Available: http://www.aclweb.org/anthology/P02-1040
23. P. Koehn, "Statistical significance tests for machine translation evaluation," in Proc. EMNLP 2004, Barcelona, Spain, Jul. 2004, pp. 388-395.
24. K. Yamada and K. Knight, "A syntax-based statistical translation model," in Proc. 39th Annu. Meeting Assoc. Comput. Linguist., Toulouse, France, Jul. 2001, pp. 523-530 [Online]. Available:http://www.aclweb.org/ anthology/P01-1067