Deep neural language models for machine translation

CoNLL 2015 - 19th Conference on Computational Natural Language Learning, Proceedings

Volumn , Issue , 2015, Pages 305-309

  Luong, Minh Thang ^a   Kayser, Michael ^a   Manning, Christopher D ^a  

^a Stanford University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; COMPUTER AIDED LANGUAGE TRANSLATION; DEEP NEURAL NETWORKS; NATURAL LANGUAGE PROCESSING SYSTEMS;

HIDDEN LAYERS; LANGUAGE MODEL; MACHINE TRANSLATIONS; N-BEST LIST; RE-RANKING; TARGET CONTEXT; TRANSLATION QUALITY; WEB FORUMS;

MULTILAYER NEURAL NETWORKS;

EID: 85034835301     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.18653/v1/k15-1031     Document Type: Conference Paper

References (26)

1. Ebru Arsoy, Tara N. Sainath, Brian Kingsbury, and Bhuvana Ramabhadran. 2012. Deep neural network language models. In NAACL WLM Workshop.
2. D. Bahdanau, K. Cho, and Y. Bengio. 2015. Neural machine translation by jointly learning to align and translate. In ICLR.
3. Y. Bengio, R. Ducharme, P. Vincent, and C. Janvin. 2003. A neural probabilistic language model. JMLR, 3:1137–1155.
4. Yoshua Bengio. 2009. Learning deep architectures for ai. Foundations and Trends in Machine Learning, 2(1):1–127, January.
5. D. Cer, M. Galley, D. Jurafsky, and C. D. Manning. 2010. Phrasal: A statistical machine translation toolkit for exploring new model features. In ACL, Demonstration Session.
6. J. Devlin, R. Zbib, Z. Huang, T. Lamar, R. Schwartz, and J. Makhoul. 2014. Fast and robust neural network joint models for statistical machine translation. In ACL.
7. S. Green, D. Cer, and C. D. Manning. 2014. An empirical comparison of features and tuning for phrase-based machine translation. In WMT.
8. Michael Gutmann and Aapo Hyvärinen. 2012. Noise-contrastive estimation of unnormalized statistical models, with applications to natural image statistics. JMLR, 13:307–361.
9. G. Hinton, L. Deng, D. Yu, G. Dahl, A. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. Sainath, and B. Kingsbury. 2012. Deep neural networks for acoustic modeling in speech recognition. IEEE Signal Processing Magazine.
10. Sébastien Jean, Kyunghyun Cho, Roland Memisevic, and Yoshua Bengio. 2015. On using very large target vocabulary for neural machine translation. In ACL.
11. N. Kalchbrenner and P. Blunsom. 2013. Recurrent continuous translation models. In EMNLP.
12. A. Krizhevsky, I. Sutskever, and G. E. Hinton. 2012. ImageNet classification with deep convolutional neural networks. In NIPS.
13. M.-T. Luong, I. Sutskever, Q. V. Le, O. Vinyals, and W. Zaremba. 2015. Addressing the rare word problem in neural machine translation. In ACL.
14. Tomas Mikolov, Martin Karafiát, Lukas Burget, Jan Cernocký, and Sanjeev Khudanpur. 2010. Recurrent neural network based language model. In Inter-speech.
15. Tomas Mikolov, Stefan Kombrink, Lukas Burget, Jan Cernocký, and Sanjeev Khudanpur. 2011. Extensions of recurrent neural network language model. In ICASSP.
16. Andriy Mnih and Geoffrey Hinton. 2007. Three new graphical models for statistical language modelling. In ICML.
17. Andriy Mnih and Geoffrey Hinton. 2009. A scalable hierarchical distributed language model. In NIPS.
18. Andriy Mnih and Yee Whye Teh. 2012. A fast and simple algorithm for training neural probabilistic language models. In ICML.
19. Frederic Morin. 2005. Hierarchical probabilistic neural network language model. In AISTATS.
20. Vinod Nair and Geoffrey E. Hinton. 2010. Rectified linear units improve restricted boltzmann machines. In ICML.
21. Stefan Riezler and T. John Maxwell. 2005. On some pitfalls in automatic evaluation and significance testing for MT. In ACL Workshop, Intrinsic/Extrinsic Evaluation Measures for MT and Summarization.
22. H. Schwenk, A. Rousseau, and M. Attik. 2012. Large, pruned or continuous space language models on a gpu for statistical machine translation. In NAACL WLM workshop.
23. H. Schwenk. 2010. Continuous space language models for statistical machine translation. The Prague Bulletin of Mathematical Linguistics, (93):137–146.
24. Le Hai Son, Alexandre Allauzen, and François Yvon. 2012. Continuous space translation models with neural networks. In NAACL-HLT.
25. I. Sutskever, O. Vinyals, and Q. V. Le. 2014. Sequence to sequence learning with neural networks. In NIPS.
26. Ashish Vaswani, Yinggong Zhao, Victoria Fossum, and David Chiang. 2013. Decoding with large-scale neural language models improves translation. In EMNLP.