Distributed word clustering for large scale class-based language modeling in machine translation

ACL-08: HLT - 46th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference

Volumn , Issue , 2008, Pages 755-762

  Uszkoreit, Jakob ^a   Brants, Thorsten ^a  

^a GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLASS-BASED; CLASS-BASED LANGUAGE MODEL; CLASS-BASED LANGUAGES; CLUSTERINGS; DATA SPARSITY; HIGHER ORDER; LARGE VOCABULARY; LOGLINEAR MODEL; MACHINE TRANSLATIONS; N-GRAM MODELS; STATISTICAL LANGUAGE MODELING; STATISTICAL MACHINE TRANSLATION SYSTEM; TRAINING CORPUS; TRANSLATION QUALITY; WORD CLASSIFICATION; WORD CLUSTERING;

CLUSTERING ALGORITHMS; COMPUTER AIDED LANGUAGE TRANSLATION; EQUIVALENCE CLASSES; REGRESSION ANALYSIS;

COMPUTATIONAL LINGUISTICS;

EID: 70349439960     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. Thorsten Brants, Ashok C. Popat, Peng Xu, Franz J. Och, and Jeffrey Dean. 2007. Large language models in machine translation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing and on Computational Natural Language Learning (EMNLP-CoNLL), pages 858-867, Prague, Czech Republic.
2. Peter F. Brown, Vincent J. Della Pietra, Peter V. de Souza, Jennifer C. Lai, and Robert L. Mercer. 1990. Class-based n-gram models of natural language. Computational Linguistics, 18(4):467-479.
3. Jeffrey Dean and Sanjay Ghemawat. 2004. MapReduce: Simplified data processing on large clusters. In Proceedings of the Sixth Symposium on Operating System Design and Implementation (OSDI-04), San Francisco, CA, USA.
4. Ahmad Emami and Frederick Jelinek. 2005. Random clusterings for language modeling. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Philadelphia, PA, USA.
5. Joshua Goodman and Jianfeng Gao. 2000. Language model size reduction by pruning and clustering. In Proceedings of the IEEE International Conference on Spoken Language Processing (ICSLP), Beijing, China.
6. Joshua Goodman. 2000. A bit of progress in language modeling. Technical report, Microsoft Research.
7. Reinherd Kneser and Hermann Ney. 1993. Improved clustering techniques for class-based statistical language modelling. In Proceedings of the 3rd European Conference on Speech Communication and Technology, pages 973-976, Berlin, Germany.
8. Philipp Koehn. 2004. Statistical significance tests for machine translation evaluation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), Barcelona, Spain.
9. Sven Martin, Jörg Liermann, and Hermann Ney. 1998. Algorithms for bigram and trigram word clustering. Speech Communication, 24:19-37.
10. Eric W. Noreen. 1989. Computer-Intensive Methods for Testing Hypotheses. John Wiley & Sons, New York.
11. Franz Josef Och and Hermann Ney. 2002. Discriminative training and maximum entropy models for statistical machine translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL), pages 295-302, Philadelphia, PA, USA.
12. Franz Josef Och. 2003. Minimum error rate training for statistical machine translation. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics (ACL), pages 160-167, Sapporo, Japan.
13. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: a method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL), pages 311-318, Philadelphia, PA, USA.
14. Martin Raab. 2006. Language model techniques in machine translation. Master's thesis, Universiẗat Karlsruhe/Carnegie Mellon University.
15. E. W. D. Whittaker and P. C. Woodland. 2001. Efficient class-based language modelling for very large vocabularies. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 545-548, Salt Lake City, UT, USA.