Unsupervised machine translation using monolingual corpora only

6th International Conference on Learning Representations, ICLR 2018 - Conference Track Proceedings

Volumn , Issue , 2018, Pages

  Lample, Guillaume ^a,b   Conneau, Alexis ^a   Denoyer, Ludovic ^b   Ranzato, Marc'Aurelio ^a  

^a FACEBOOK AI RESEARCH   (United States)

^b SORBONNE UNIVERSITÉ   (France)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; COMPUTER AIDED LANGUAGE TRANSLATION;

FEATURE SPACE; LABELED DATA; LANGUAGE PAIRS; LOW RESOURCE LANGUAGES; MACHINE TRANSLATIONS; PARALLEL CORPORA; PARALLEL DATA; TRAINING TIME;

DEEP LEARNING;

EID: 85083950395     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (41)

1. D. Bahdanau, K. Cho, and Y. Bengio. Neural machine translation by jointly learning to align and translate. In ICLR, 2015.
2. Piotr Bojanowski, Edouard Grave, Armand Joulin, and Tomas Mikolov. Enriching word vectors with subword information. Transactions_of_the_Association_for_Computational_Linguistics, 5: 135–146, 2017.
3. Y. Chen, Y. Liu, Y. Cheng, and V.O.K. Li. A teacher-student framework for zero-resource neural machine translation. In ACL, 2017.
4. Y. Cheng, W. Xu, Z. He, W. He, H. Wu, M. Sun, and Y. Liu. Semi-supervised learning for neural machine translation. arXiv:1606.04596, 2016.
5. A. Conneau, G. Lample, M. Ranzato, L. Denoyer, and H. Jégou. Word translation without parallel data. arXiv:1710.04087, 2017.
6. D.L. Donoho. Compressed sensing. IEEE_Transactions_on_Information_Theory, 2006.
7. Desmond Elliott, Stella Frank, Khalil Sima’an, and Lucia Specia. Multi30k: Multilingual english-german image descriptions. arXiv_preprint_arXiv:1605.00459, 2016.
8. O. Firat, B. Sankaran, Y. Al-Onaizan, F.T.Y. Vural, and K. Cho. Zero-resource translation with multi-lingual neural machine translation, 2016.
9. Y. Ganin, E. Ustinova, H. Ajakan, P. Germain, H. Larochelle, F. Laviolette, M. Marchand, and V. Lempitsky. Domain-adversarial training of neural networks. JMLR, 2016.
10. Ian Goodfellow. Nips 2016 tutorial: Generative adversarial networks. arXiv_preprint arXiv:1701.00160, 2016.
11. Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. Generative adversarial nets. In Advances_in_neural information_processing_systems, pp. 2672–2680, 2014.
12. Caglar Gulcehre, Orhan Firat, Kelvin Xu, Kyunghyun Cho, Loic Barrault, Huei-Chi Lin, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. On using monolingual corpora in neural machine translation. arXiv_preprint_arXiv:1503.03535, 2015.
13. Di He, Yingce Xia, Tao Qin, Liwei Wang, Nenghai Yu, Tieyan Liu, and Wei-Ying Ma. Dual learning for machine translation. In Advances_in_Neural_Information_Processing_Systems, pp. 820–828, 2016.
14. Felix Hill, Kyunghyun Cho, and Anna Korhonen. Learning distributed representations of sentences from unlabelled data. arXiv_preprint_arXiv:1602.03483, 2016.
15. Zhiting Hu, Zichao Yang, Xiaodan Liang, Ruslan Salakhutdinov, and Eric P Xing. Controllable text generation. arXiv_preprint_arXiv:1703.00955, 2017.
16. A. Irvine. Combining bilingual and comparable corpora for low resource machine translation. 2013.
17. A. Irvine and C. Callison-Burch. End-to-end statistical machine translation with zero or small parallel texts. Natural_Language_Engineering, 1(1), 2015.
18. M. Johnson, M. Schuster, Q.V. Le, M. Krikun, Y. Wu, Z. Chen, N. Thorat, F. Vigas, M. Wattenberg, G. Corrado, M. Hughes, and J. Dean. Googles multilingual neural machine translation system: Enabling zero-shot translation, 2016.
19. Diederik Kingma and Jimmy Ba. Adam: A method for stochastic optimization. arXiv_preprint arXiv:1412.6980, 2014.
20. Diederik P Kingma and Max Welling. Auto-encoding variational bayes. arXiv_preprint arXiv:1312.6114, 2013.
21. Alex M Lamb, Anirudh Goyal ALIAS PARTH GOYAL, Ying Zhang, Saizheng Zhang, Aaron C Courville, and Yoshua Bengio. Professor forcing: A new algorithm for training recurrent networks. In Advances_In_Neural_Information_Processing_Systems, pp. 4601–4609, 2016.
22. Guillaume Lample, Neil Zeghidour, Nicolas Usunier, Antoine Bordes, Ludovic DENOYER, et al. Fader networks: Manipulating images by sliding attributes. In Advances_in_Neural_Information Processing_Systems, pp. 5963–5972, 2017.
23. J. Lee, K. Cho, J. Weston, and D. Kiela. Emergent translation in multi-agent communication. arXiv:1710.06922, 2017.
24. Ming-Yu Liu and Oncel Tuzel. Coupled generative adversarial networks. In Advances_in_neural information_processing_systems, pp. 469–477, 2016.
25. Ming-Yu Liu, Thomas Breuel, and Jan Kautz. Unsupervised image-to-image translation networks. arXiv_preprint_arXiv:1703.00848, 2017.
26. D.S. Munteanu, A. Fraser, and D. Marcu. Improved machine translation performance via parallel sentence extraction from comparable corpora. In ACL, 2004.
27. H. Nakayama and N. Nishida. Zero-resource machine translation by multimodal encoder-decoder network with multimedia pivot. arXiv:1611.04503, 2017.
28. K. Papineni, S. Roukos, T. Ward, and W.J. Zhu. Bleu: a method for automatic evaluation of machine translation. In Annual_Meeting_on_Association_for_Computational_Linguistics, 2002.
29. N. Pourdamghani and K. Knight. Deciphering related languages. In EMNLP, 2017.
30. S. Ravi and K. Knight. Deciphering foreign language. In ACL, 2011.
31. Rico Sennrich, Barry Haddow, and Alexandra Birch. Improving neural machine translation models with monolingual data. arXiv_preprint_arXiv:1511.06709, 2015a.
32. Rico Sennrich, Barry Haddow, and Alexandra Birch. Neural machine translation of rare words with subword units. arXiv_preprint_arXiv:1508.07909, 2015b.
33. Tianxiao Shen, Tao Lei, Regina Barzilay, and Tommi Jaakkola. Style transfer from non-parallel text by cross-alignment. arXiv_preprint_arXiv:1705.09655, 2017.
34. Ilya Sutskever, Oriol Vinyals, and Quoc V Le. Sequence to sequence learning with neural networks. In Advances_in_neural_information_processing_systems, pp. 3104–3112, 2014.
35. Yaniv Taigman, Adam Polyak, and Lior Wolf. Unsupervised cross-domain image generation. arXiv preprint_arXiv:1611.02200, 2016.
36. T. Tieleman and G. Hinton. Lecture 6.5—RmsProp: Divide the gradient by a running average of its recent magnitude. COURSERA: Neural Networks for Machine Learning, 2012.
37. Pascal Vincent, Hugo Larochelle, Yoshua Bengio, and Pierre-Antoine Manzagol. Extracting and composing robust features with denoising autoencoders. In Proceedings_of_the_25th_international conference_on_Machine_learning, pp. 1096–1103. ACM, 2008.
38. Yonghui Wu, Mike Schuster, Zhifeng Chen, Quoc V Le, Mohammad Norouzi, Wolfgang Macherey, Maxim Krikun, Yuan Cao, Qin Gao, Klaus Macherey, et al. Google’s neural machine translation system: Bridging the gap between human and machine translation. arXiv_preprint arXiv:1609.08144, 2016.
39. Qizhe Xie, Zihang Dai, Yulun Du, Eduard Hovy, and Graham Neubig. Controllable invariance through adversarial feature learning. arXiv_preprint_arXiv:1705.11122, 2017.
40. H. Zheng, Y. Cheng, and Y. Liu. Maximum expected likelihood estimation for zero-resource neural machine translation. In IJCAI, 2017.
41. Jun-Yan Zhu, Taesung Park, Phillip Isola, and Alexei A Efros. Unpaired image-to-image translation using cycle-consistent adversarial networks. arXiv_preprint_arXiv:1703.10593, 2017.