Large-scale discriminative n-gram language models for statistical machine translation

AMTA 2008 - 8th Conference of the Association for Machine Translation in the Americas

Volumn , Issue , 2008, Pages

  Li, Zhifei ^a   Khudanpur, Sanjeev ^a  

^a Johns Hopkins University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATIC SPEECH RECOGNITION; BENCHMARK TESTS; DATA SELECTION; LANGUAGE MODEL; LANGUAGE MODELING; MACHINE TRANSLATION SYSTEMS; N-GRAM LANGUAGE MODELS; STATISTICAL MACHINE TRANSLATION; SYSTEMATIC EXPERIMENT; TRAINING DATA;

BENCHMARKING; COMPUTATIONAL LINGUISTICS; DATA REDUCTION; EXPERIMENTS; NATURAL LANGUAGE PROCESSING SYSTEMS; SPEECH RECOGNITION;

INFORMATION THEORY;

EID: 84863251018     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (35)

1. Lalit R. Bahl, Peter F. Brown, Peter V. de Souza, and Robert L. Mercer. 1989. A tree-based statistical language model for natural language speech recognition. IEEE Trans Acoustics, Speech, and Signal Processing, 37(7):1001-1008.
2. Yoshua Bengio, Rejean Ducharme, and Pascal Vincent. 2001. A neural probabilistic language model. In Advances in Neural Information Processing Systems (NIPS).
3. Phil Blunsom, Trevor Cohn and Miles Osborne. 2008. A Discriminative Latent Variable Model for Statistical Machine Translation. In Proceedings of ACL 2008.
4. Peter F. Brown, Stephen A. Della Pietra, Vincent J. Della Pietra, and R. L. Mercer. 1993. The mathematics of statistical machine translation: Parameter estimation. Computational Linguistics, 19(2):263-311.
5. Marine Carpuat and Dekai Wu. 2007. Improving statistical machine translation using word sense disambiguation. In Proceedings of EMNLP 2007.
6. Yee Seng Chan, Hwee Tou Ng, and David Chiang. 2007 Word sense disambiguation improves statistical machine translation. In Proceedings of EMNLP 2007.
7. Pi-Chuan Chang and Kristina Toutanova. 2007. A Discriminative Syntactic Word Order Model for Machine Translation. In Proceedings of ACL 2007.
8. Ciprian Chelba and Frederick Jelinek. 2000. Structured language modeling. Computer Speech and Language, 14(4):283-332.
9. Stanley F. Chen and Joshua Goodman. 1998. An empirical study of smoothing techniques for language modeling. Technical Report TR-10-98, Harvard University Center for Research in Computing Technology.
10. Zheng Chen, Kai-Fu Lee, and Ming-jing Li. 2000. Discriminative training on language model. In Proceedings of International Conference on Spoken Language Processing(ICSLP) 2000.
11. David Chiang. 2005. A hierarchical phrase-based model for statistical machine translation. In Proceedings of ACL 2005.
12. David Chiang. 2007. Hierarchical phrase-based translation. Computational Linguistics, 33(2):201-228.
13. Michael Collins. 2002. Discriminative training methods for hidden markov models: Theory and experiments with perceptron algorithms. In Proceedings of EMNLP 2002.
14. Michel Galley, Jonathan Graehl, Kevin Knight, Daniel Marcu, Steve DeNeefe, Wei Wang, and Ignacio Thayer. 2006. Scalable inference and training of context-rich syntactic translation models. In Proceedings of COLING/ACL 2006.
15. Sanjeev Khudanpur and Jun Wu. 2000. Maximum Entropy Techniques for Exploiting Syntactic, Semantic and Collocational Dependencies in Language Modeling. Computer Speech and Language, 14(4):355-372.
16. Philipp Koehn, Franz Josef Och, and Daniel Marcu. 2003. Statistical phrase-based translation. In Proceedings of NAACL 2003.
17. Hong-Kwang Jeff Kuo, Eric Fosler-Lussier, Hui Jiang, and Chin-Hui Lee. 2002. Discriminative training of language models for speech recognition. In Proceedings of ICASSP 2002.
18. Zhifei Li and Sanjeev Khudanpur. 2008. A Scalable Decoder for Parsing-based Machine Translation with Equivalent Language Model State Maintenance. In Proceedings SSST, ACL 2008 Workshop on Syntax and Structure in Statistical Translation.
19. Percy Liang, Alexandre Bouchard-Cote, Dan Klein, and Ben Taskar. 2006. An end-to-end discriminative approach to machine translation. In Proceedings of COLING/ ACL 2006.
20. Adam Lopez. 2007. Hierarchical Phrase-Based Translation with Suffix Arrays. In Proceedings of EMNLPCoNLL 2007.
21. Franz Josef Och. 2003. Minimum error rate training in statistical machine translation. In Proceedings of ACL 2003.
22. Franz Josef Och and Hermann Ney. 2000. Improved statistical alignment models. In Proceedings of ACL 2000.
23. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: a method for automatic evaluation of machine translation. In Proceedings of ACL 2002.
24. Brian Roark, Murat Saraclar, and Michael Collins. 2007. Discriminative n-gram language modeling. Computer Speech and Language, 21(2):373-392. (Pubitemid 44709838)
25. Roni Rosenfeld. 1996. A Maximum Entropy Approach to Adaptive Statistical Language Modeling. Computer Speech and Language, 10(3):187-228.
26. Libin Shen, Anoop Sarkar and Franz Josef Och. 2004. Discriminative Reranking for Machine Translation. In Proceedings of HLT/NAACL 2004.
27. David A. Smith and Jason Eisner. 2006. Minimum risk annealing for training log-linear models. In Proceedings of ACL 2006.
28. Andreas Stolcke. 2002. SRILM - an extensible language modeling toolkit. In Proceedings of the International Conference on Spoken Language Processing, volume 2, pages 901-904.
29. Andreas Stolcke and Mitch Weintraub. 1998. Discriminitive language modeling. In Proceedings of the 9th Hub-5 Conversational Speech Recognition Workshop.
30. Charles Sutton, Michael Sindelar, and Andrew McCallum. 2006. Reducing Weight Undertraining in Structured Discriminative Learning. In Proceedings of HLTNAACL 2006.
31. Christoph Tillmann and Tong Zhang. 2006. A discriminative global training algorithm for statistical MT. In Proceedings of COLING/ACL 2006.
32. Taro Watanabe, Jun Suzuki, Hajime Tsukada, and Hideki Isozaki. 2007. Online Large-Margin Training for Statistical Machine Translation. In Proceedings of EMNLP-CoNLL 2007.
33. Peng Xu and Frederick Jelinek. 2004. Random Forests in Language Modeling. In Proceedings of EMNLP 2004.
34. Richard Zens and Hermann Ney. 2006. Discriminative reordering models for statistical machine translation. In Proceedings of WSMT 2006.
35. Richard Zens, Sasa Hasan, and Hermann Ney. 2007. A Systematic Comparison of Training Criteria for Statistical Machine Translation. In Proceedings of EMNLPCoNLL 2007.