Variable-length word encodings for neural translation models

Conference Proceedings - EMNLP 2015: Conference on Empirical Methods in Natural Language Processing

Volumn , Issue , 2015, Pages 2088-2093

  Chitnis, Rohan ^a   De Nero, John ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ENCODING (SYMBOLS); NATURAL LANGUAGE PROCESSING SYSTEMS; SIGNAL ENCODING; VOCABULARY CONTROL;

LARGE VOCABULARY; LEARNING PROCEDURES; MACHINE TRANSLATIONS; NEW PARAMETERS; TRAINING TIME; TRANSLATION MODELS; VARIABLE LENGTH; VARIABLE-LENGTH ENCODING;

TRANSLATION (LANGUAGES);

EID: 84959863369     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.18653/v1/d15-1249     Document Type: Conference Paper

References (16)

1. Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. CoRR, abs/1409.0473.
2. Kyunghyun Cho, Bart van Merrienboer, Caglar Gülçehre, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. CoRR, abs/1406.1078.
3. Ronan Collobert and Jason Weston. 2008. A unified architecture for natural language processing: Deep neural networks with multitask learning. In Proceedings of the International Conference on Machine Learning.
4. Eric H. Huang, Richard Socher, Christopher D. Manning, and Andrew Y. Ng. 2012. Improving word representations via global context and multiple word prototypes. In Proceedings of the Association for Computational Linguistics.
5. David A. Huffman. 1952. A method for the construction of minimum-redundancy codes. Proceedings of the IRE.
6. Sebastien Jean, Kyunghyun Cho, Roland Memisevic, and Yoshua Bengio. 2014. On using very large target vocabulary for neural machine translation. CoRR, abs/1412.2007.
7. Nal Kalchbrenner and Phil Blunsom. 2013. Recurrent continuous translation models.
8. Thang Luong, Ilya Sutskever, Quoc V. Le, Oriol Vinyals, and Wojciech Zaremba. 2014. Addressing the rare word problem in neural machine translation. CoRR, abs/1410.8206.
9. Tomas Mikolov, Anoop Deoras, Daniel Povey, Lukas Burget, and Jan Cernocky. 2011a. Strategies for training large scale neural network language models. In Proceedings of ASRU.
10. Tomas Mikolov, S. Kombrink, L. Burget, J. H. Cernocky, and Sanjeev Khudanpur. 2011b. Extensions of recurrent neural network language model. In Acoustics, Speech and Signal Processing.
11. Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. CoRR, abs/1301.3781.
12. Andriy Mnih and Geoffrey E. Hinton. 2009. A scalable hierarchical distributed language model. In Advances in Neural Information Processing Systems.
13. Andriy Mnih and Koray Kavukcuoglu. 2013. Learning word embeddings efficiently with noise-contrastive estimation. In Advances in Neural Information Processing Systems.
14. Frederic Morin and Yoshua Bengio. 2005. Hierarchical probabilistic neural network language model. In AI Stats.
15. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. Bleu: A method for automatic evaluation of machine translation. In Proceedings of the Association/or Computational Linguistics.
16. Ilya Sutskever, Oriol Vinyals, and Quoc V. Le. 2014. Sequence to sequence learning with neural networks. CoRR, abs/1409.3215.