Transfer learning for low-resource neural machine translation

EMNLP 2016 - Conference on Empirical Methods in Natural Language Processing, Proceedings

Volumn , Issue , 2016, Pages 1568-1575

  Zoph, Barret ^a   Yuret, Deniz ^b   May, Jonathan ^c   Knight, Kevin ^c  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b KOÇ UNIVERSITY   (Turkey)

^c UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; COMPUTER AIDED LANGUAGE TRANSLATION; NATURAL LANGUAGE PROCESSING SYSTEMS;

CHILD MODELS; ENCODER-DECODER; LANGUAGE PAIRS; LOW RESOURCE LANGUAGES; MACHINE TRANSLATIONS; STATE OF THE ART; TRANSFER LEARNING; TRANSFER LEARNING METHODS;

LEARNING SYSTEMS;

EID: 85072838695     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.18653/v1/d16-1163     Document Type: Conference Paper

References (27)

1. D. Bahdanau, K. Cho, and Y. Bengio. 2014. Neural machine translation by jointly learning to align and translate. In Proc. ICLR.
2. P. Baltescu and P. Blunsom. 2015. Pragmatic neural language modelling in machine translation. In Proc. HLT-NAACL.
3. Y. Bengio. 2012. Deep learning of representations for unsupervised and transfer learning. JMLR, 27.
4. O. Bojar, R. Chatterjee, C. Federmann, B. Haddow, M. Huck, C. Hokamp, P. Koehn, V. Logacheva, C. Monz, M. Negri, M. Post, C. Scarton, L. Specia, and M. Turchi. 2015. Findings of the 2015 workshop on statistical machine translation. In Proc. WMT.
5. M. A. Castaño and F. Casacuberta. 1997. A connectionist approach to machine translation. In Proc. Eurospeech.
6. D. Chiang, K. Knight, and W. Wang. 2009. 11,001 new features for statistical machine translation. In Proc. HLT-NAACL.
7. D. C. Ciresan, U. Meier, and J. Schmidhuber. 2012. Transfer learning for Latin and Chinese characters with deep neural networks. In Proc. IJCNN.
8. D. Dong, H. Wu, W. He, D. Yu, and H. Wang. 2015. Multi-task learning for multiple language translation. In Proc. ACL-IJCNLP.
9. O. Firat, K. Cho, and Y. Bengio. 2016. Multi-way, multilingual neural machine translation with a shared attention mechanism. In Proc. NAACL-HLT.
10. M. Galley, M. Hopkins, K. Knight, and D. Marcu. 2004. What's in a translation rule? In Proc. HLT-NAACL.
11. M. Galley, J. Graehl, K. Knight, D. Marcu, S. DeNeefe, W. Wang, and I. Thayer. 2006. Scalable inference and training of context-rich syntactic translation models. In Proc. ACL-COLING.
12. F. A. Gers, J. Schmidhuber, and F. Cummins. 2000. Learning to forget: Continual prediction with LSTM. Neural computation, 12(10).
13. S. Hochreiter and J. Schmidhuber. 1997. Long short-term memory. Neural Computation, 9(8).
14. R. Józefowicz, W. Zaremba, and I. Sutskever. 2015. An empirical exploration of recurrent network architectures. In Proc. ICML.
15. P. Liang, B. Taskar, and D. Klein. 2006. Alignment by agreement. In Proc. HLT-NAACL.
16. M. Luong, H. Pham, and C. Manning. 2015a. Effective approaches to attention-based neural machine translation. In Proc. EMNLP.
17. T. Luong, I. Sutskever, Q. Le, O. Vinyals, and W. Zaremba. 2015b. Addressing the rare word problem in neural machine translation. In Proc. ACL.
18. A. Mnih and Y. W. Teh. 2012. A fast and simple algorithm for training neural probabilistic language models. In Proc. ICML.
19. R. Neco and M. Forcada. 1997. Asynchronous translations with recurrent neural nets. In Proc. International Conference on Neural Networks.
20. S. J. Pan and Q. Yang. 2010. A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 22(10).
21. I. Sutskever, O. Vinyals, and Q. V. Le. 2014. Sequence to sequence learning with neural networks. In Proc. NIPS.
22. L. Torrey and J. Shavlik. 2009. Transfer learning. In E. Soria, J. Martin, R. Magdalena, M. Martinez, and A. Serrano, editors, Handbook of Research on Machine Learning Applications and Trends: Algorithms, Methods, and Techniques. IGI Global.
23. A. Vaswani, Y. Zhao, V. Fossum, and D. Chiang. 2013. Decoding with large-scale neural language models improves translation. In Proc. EMNLP.
24. D. Wang and T. Fang Zheng. 2015. Transfer learning for speech and language processing. CoRR, abs/1511.06066.
25. P. J. Werbos. 1990. Backpropagation through time: what it does and how to do it. Proc. IEEE, 78(10).
26. W. Williams, N. Prasad, D. Mrva, T. Ash, and T. Robinson. 2015. Scaling recurrent neural network language models. In Proc. ICASSP.
27. W. Zaremba, I. Sutskever, and O. Vinyals. 2014. Recurrent neural network regularization. CoRR, abs/1409.2329.