Reranking machine translation hypotheses with structured and web-based language models

2007 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2007, Proceedings

Volumn , Issue , 2007, Pages 159-164

  Wang, Wen ^a   Stolcke, Andreas ^a   Zheng, Jing ^a  

^a SRI INTERNATIONAL   (United States)

Author keywords

N best reranking; Smoothing; Statistical machine translation; Structured language model; Web based language modeling

Indexed keywords

COMPUTATIONAL LINGUISTICS; COMPUTER AIDED LANGUAGE TRANSLATION; COMPUTER NETWORKS; FORMAL LANGUAGES; INFORMATION THEORY; LINGUISTICS; MICROFLUIDICS; NATURAL LANGUAGE PROCESSING SYSTEMS; RHENIUM; SPEECH; SPEECH ANALYSIS; SPEECH TRANSMISSION; SYNTACTICS; TRANSLATION (LANGUAGES);

APPLIED (CO); AUTOMATIC SPEECH RECOGNITION (ASR); COMPUTATIONALLY EFFICIENT; DEPENDENCY CONSTRAINTS; DEPENDENCY GRAMMARS; LANGUAGE MODELING (LM); LANGUAGE MODELLING; LANGUAGE MODELS (LM); LEXICAL FEATURES; MACHINE TRANSLATION (MT); N-BEST RE-SCORING; N-GRAMS; RE-RANKING; STATISTICAL MACHINE TRANSLATION SYSTEMS; STRUCTURED LANGUAGE; SYNTACTIC FEATURES; WEB DOCUMENTS;

SPEECH RECOGNITION;

EID: 44849096872     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. F. Och and H. Ney, "Discriminative training and maximum entropy models for statistical machine translation", in Proceedings of the Annual Meeting of the Association for Computational Linguistics, pp. 295-302. Association for Computational Linguistics, 2002.
2. F. Och, D. Gildea, S. Khudanpur, A. Sarkar, K. Yamada, A. Fraser, S. Kumar, L. Shen, D. Smith, K. Eng, V. Jain, Z. Jin, and D. Radev, "A smorgasbord of features for statistical machine translation", in Proceedings of HLT-NAACL, pp. 161-168, 2004.
3. S. Hasan, O. Bender, and H. Ney, "Reranking translation hypotheses using structural properties", in Proceedings of EACL, 2006.
4. Y. Zhang, A. S. Hildebrand, and S. Vogel, "Distributed language modeling for nbest list re-ranking", in Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, pp. 216-223, Sydney, Australia, July 2006. Association for Computational Linguistics.
5. T. Brants, A. C. Popat, P. Xu, F. Och, and J. Dean, "Large language models in machine translation", in Proceedings of Conference of Empirical Methods in Natural Language Processing, pp. 858-867, 2007.
6. S. F. Chen and J. T. Goodman, "An empirical study of smoothing techniques for language modeling", Technical report, Harvard University, Computer Science Group, 1998.
7. D. Chiang, "A hierarchical phrase-based model for statistical machine translation", in Proceedings of the Annual Meeting of the Association for Computational Linguistics, pp. 263-270. Association for Computational Linguistics, 2005.
8. P. Koehn, F. Och, and D. Marcu, "Statistical phrase-based translation", in Proceedings of HLT-NAACL, pp. 127-133, 2003.
9. D. Marcu, W. Wang, A. Echihabi, and K. Knight, "SPMT: Statistical machine translation with syntactified target language phrases", in Proceedings of Conference of Empirical Methods in Natural Language Processing, pp. 44-52, 2006.
10. C. Chelba and F. Jelinek, "Exploiting syntactic structure for language modeling", in Proc. COLING-ACL, vol. 1, pp. 225-231, Montreal, 1998.
11. B. Roark, "Probabilistic top-down parsing and language modeling", Computational Linguistics, vol. 27, pp. 249-276, 2001.
12. W. Wang and M. Harper, 'The SuperARV language model:Investigating the effectiveness of tightly integrating multiple knowledge sources", in Proceedings of Conference of Empirical Methods in Natural Language Processing, 2002.
13. B. Srinivas, Complexity of lexical descriptions and its relevance to partial parsing, PhD thesis, University of Pennsylvania, 1997.
14. W. Wang, Statistical Parsing and Language Modeling Based On Constraint Dependency Grammar, PhD thesis, Purdue University, 2003.
15. M. J. Collins, "A new statistical parser based on bigram lexical dependencies", in Proceedings of the 34th Annual Meeting of the Association for Computational Linguistics, pp. 184-191, 1996.
16. W. Wang and M. Harper, "Language modeling using a statistical dependency grammar parser", in Proceedings of the IEEE Automatic Speech Recognition and Understanding Workshop, pp. 519-524, 2003.
17. P. Xu, C. Chelba, and F Jelinek, "A study on richer syntactic dependencies for structured language modeling", in In Proceedings of ACL 2002, 2002.
18. A. Stoicke, "SRILM - an extensible language modeling toolkit", in J. H. L. Hansen and B. Pellom, editors, Proc. ICSLP, vol. 2, pp. 901-904, Denver, Sep. 2002.