Semi-supervised learning for neural machine translation

54th Annual Meeting of the Association for Computational Linguistics, ACL 2016 - Long Papers

Volumn 4, Issue , 2016, Pages 1965-1974

  Cheng, Yong ^a   Xu, Wei ^a   He, Zhongjun ^b   He, Wei ^b   Wu, Hua ^b   Sun, Maosong ^a   Liu, Yang ^a  

^a TSINGHUA UNIVERSITY   (China)

^b BAIDU INC   (China)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; COMPUTER AIDED LANGUAGE TRANSLATION; LEARNING ALGORITHMS; SUPERVISED LEARNING;

LOW RESOURCE LANGUAGES; MACHINE TRANSLATIONS; PARALLEL CORPORA; SEMI- SUPERVISED LEARNING; SEMI-SUPERVISED; SOURCE LANGUAGE; STATE OF THE ART; TRANSLATION MODELS;

MACHINE LEARNING;

EID: 85011958920     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.18653/v1/p16-1185     Document Type: Conference Paper

References (27)

1. Waleed Ammar, Chris Dyer, and Noah Smith. 2014. Conditional random field autoencoders for unsupervised structred prediction. In Proceedings of NIPS 2014.
2. Dzmitry Bahdanau, KyungHyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. In Proceedings of ICLR.
3. Nicola Bertoldi and Marcello Federico. 2009. Domain adaptation for statistical machine translation. In Proceedings of WMT.
4. Peter F. Brown, Stephen A. Delia Pietra, Vincent J. Delia Pietra, and Robert L. Mercer. 1993. The mathematics of statistical machine translation: Parameter estimation. Computational Linguisitics.
5. David Chiang. 2005. A hierarchical phrase-based model for statistical machine translation. In Proceedings of ACL.
6. Kyunhyun Cho, Bart van Merriënboer, Dzmitry Bahdanau, and Yoshua Bengio. 2014. On the properties of neural machine translation: Encoder-decoder approaches. In Proceedings of SSST-8.
7. Andrew M. Dai and Quoc V. Le. 2015. Semi-supervised sequence learning. In Proceedings of NIPS.
8. Qing Dou, Ashish Vaswani, and Kevin Knight. 2014. Beyond parallel data: Joint word alignment and decipherment improves machine translation. In Proceedings of EMNLP.
9. Caglar Gulccehre, Orhan Firat, Kelvin Xu, Kyunghyun Cho, Loïc Barrault, Huei-Chi Lin, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2015. On using monolingual corpora in neural machine translation. arXiv: 1503.03535 [cs.CL].
10. Sepp Hochreiter and Jürgen Schmidhuber. 1993. The mathematics of statistical machine translation: Parameter estimation. Computational Linguisitics.
11. Sebastien Jean, Kyunghyun Cho, Roland Memisevic, and Yoshua Bengio. 2015. On using very large target vocabulary for neural machine translation. In Proceedings of ACL.
12. Nal Kalchbrenner and Phil Blunsom. 2013. Recurrent continuous translation models. In Proceedings of EMNLP.
13. Diederik P Kingma, Shakir Mohamed, Danilo Jimenez Rezende, and Max Welling. 2014. Semi-supervised learning with deep generative models. In Advances in Neural Information Processing Systems.
14. Alexandre Klementiev, Ann Irvine, Chris Callison-Burch, and David Yarowsky. 2012. Toward statistical machine translation without paralel corpora. In Proceedings of EACL.
15. Philipp Koehn, Franz J. Och, and Daniel Marcu. 2003. Statistical phrase-based translation. In Proceedings of NAACL.
16. Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondrej Bojar, Alexandra Constantin, and Evan Herbst. 2007. Moses: Open source toolkit for statistical machine translation. In Proceedings of ACL (demo session).
17. Minh-Thang Luong, Ilya Sutskever, Quoc V. Le, Oriol Vinyals, and Wojciech Zaremba. 2015. Addressing the rare word problem in neural machine translation. In Proceedings of ACL.
18. Franz Och. 2003. Minimum error rate training in statistical machine translation. In Proceedings of ACL.
19. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. Bleu: a methof for automatic evaluation of machine translation. In Proceedings of ACL.
20. Sujith Ravi and Kevin Knight. 2011. Deciphering foreign language. In Proceedings of ACL.
21. Rico Sennrich, Barry Haddow, and Alexandra Birch. 2015. Improving nerual machine translation models with monolingual data. arXiv: 1511.06709 [cs.CL].
22. Richard Socher, Jeffrey Pennington, Eric Huang, Andrew Ng, and Christopher Manning. 2011. Semi-supervised recursive autoencoders for predicting sentiment distributions. In Proceedings of EMNLP.
23. Andreas Stolcke. 2002. Srilm - am extensible language modeling toolkit. In Proceedings of ICSLP.
24. Ilya Sutskever, Oriol Vinyals, and Quoc V. Le. 2014. Sequence to sequence learning with neural networks. In Proceedings of NIPS.
25. Nicola Ueffing, Gholamreza Haffari, and Anoop Sarkar. 2007. Trasductive learning for statistical machine translation. In Proceedings of ACL.
26. Pascal Vincent, Hugo Larochelle, Isabelle Lajoie, Yoshua Bengio, and Pierre-Autoine Manzagol. 2010. Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. Journal of Machine Learning Research.
27. Jiajun Zhang and Chengqing Zong. 2013. Learning a phrase-based translation model from monolingual data with application to domain adaptation. In Proceedings of ACL.