The neural noisy channel

5th International Conference on Learning Representations, ICLR 2017 - Conference Track Proceedings

Volumn , Issue , 2017, Pages

  Yu, Lei ^a   Blunsom, Phil ^a,b   Dyer, Chris ^b   Grefenstette, Edward ^b   Kociský, Tomáš ^a,b  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b DEEPMIND   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

DECODING; RECURRENT NEURAL NETWORKS;

CHANNEL MODEL; COMPONENT MODEL; EFFECTIVE BEAMS; LATENT VARIABLE; MACHINE TRANSLATIONS; NOISY CHANNEL MODELS; OUTPUT DISTRIBUTION; TRAINING SAMPLE;

CHANNEL CODING;

EID: 85088231409     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (39)

1. Tamer Alkhouli, Gabriel Bretschner, Jan-Thorsten Peter, Mohammed Hethnawi, Andreas Guta, and Hermann Ney. Alignment-based neural machine translation. In Proc. Machine Translation, 2016.
2. Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. Neural machine translation by jointly learning to align and translate. In Proc. ICLR, 2015.
3. Eric Brill and Robert C. Moore. An improved error model for noisy channel spelling correction. In Proc. ACL, 2000.
4. Peter F. Brown, Stephen A. Della Pietra, Vincent J. Della Pietra, and Robert. L. Mercer. The mathematics of statistical machine translation: Parameter estimation. Computational Linguistics, 19: 263-311, 1993.
5. Yong Cheng, Wei Xu, Zhongjun He, Wei He, Hua Wu, Maosong Sun, and Yang Liu. Semi-supervised learning for neural machine translation. In Proc. ACL, 2016.
6. Sumit Chopra, Michael Auli, and Alexander M. Rush. Abstractive sentence summarization with attentive recurrent neural networks. In Proc. NAACL, 2016.
7. Greg Durrett and John DeNero. Supervised learning of complete morphological paradigms. In HLT-NAACL, 2013.
8. Abdessamad Echihabi and Daniel Marcu. A noisy-channel approach to question answering. In Proc. ACL, 2003.
9. Jeffrey L. Elman. Finding structure in time. Cognitive science, 14(2):179-211, 1990.
10. Manaal Faruqui, Yulia Tsvetkov, Graham Neubig, and Chris Dyer. Morphological inflection generation using character sequence to sequence learning. In Proc. HLT-NAACL, 2016.
11. David Graff, Junbo Kong, Ke Chen, and Kazuaki Maeda. English gigaword. Linguistic Data Consortium, Philadelphia, 2003.
12. Alex Graves. Sequence transduction with recurrent neural networks. arXiv preprint arXiv:1211.3711, 2012.
13. Alex Graves, Santiago Fernández, Faustino Gomez, and Jürgen Schmidhuber. Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks. In ICML, 2006.
14. Alvin Grissom II, Jordan Boyd-Graber, He He, John Morgan, and Hal Daumé III. Don't until the final verb wait: Reinforcement learning for simultaneous machine translation. In Empirical Methods in Natural Language Processing, 2014.
15. Jiatao Gu, Graham Neubig, Kyunghyun Cho, and Victor O.K. Li. Learning to translate in real-time with neural machine translation. CoRR, abs/1610.00388, 2016.
16. Çaglar Gülçehre, Orhan Firat, Kelvin Xu, Kyunghyun Cho, Loïc Barrault, Huei-Chi Lin, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. On using monolingual corpora in neural machine translation. CoRR, abs/1503.03535, 2015.
17. Çaglar Gülçehre, Sungjin Ahn, Ramesh Nallapati, Bowen Zhou, and Yoshua Bengio. Pointing the unknown words. CoRR, abs/1603.08148, 2016.
18. Sepp Hochreiter and Jürgen Schmidhuber. Long short-term memory. Neural computation, 9(8): 1735-1780, 1997.
19. Kyuyeon Hwang and Wonyong Sung. Character-level incremental speech recognition with recurrent neural networks. In Proc. ICASSP, 2016.
20. Navdeep Jaitly, David Sussillo, Quoc V Le, Oriol Vinyals, Ilya Sutskever, and Samy Bengio. A neural transducer. Proc. NIPS, 2016.
21. Frederick Jelinek. Statistical Methods for Speech Recognition. MIT, 1998.
22. Nal Kalchbrenner and Phil Blunsom. Recurrent continuous translation models. In Proc. EMNLP, 2013.
23. Diederik P. Kingma and Jimmy Ba. Adam: A method for stochastic optimization. In Proc. ICIR, 2015.
24. Dan Klein and Christopher D. Manning. Conditional structure versus conditional estimation in nlp models. In Proc. EMNLP, 2001.
25. Lingpeng Kong, Chris Dyer, and Noah A Smith. Segmental recurrent neural networks. Proc. ICLR, 2016.
26. Lemao Liu, Masao Utiyama, Andrew Finch, and Eiichiro Sumita. Agreement on target-bidirectional neural machine translation. In Proc. NAACL, 2016.
27. Yishu Miao and Phil Blunsom. Language as a latent variable: Discrete generative models for sentence compression. In Proc. EMNLP, 2016.
28. Courtney Napoles, Matthew Gormley, and Benjamin Van Durme. Annotated gigaword. In Proceedings of the Joint Workshop on Automatic Knowledge Base Construction and Web-scale Knowledge Extraction, 2012.
29. Garrett Nicolai, Colin Cherry, and Grzegorz Kondrak. Inflection generation as discriminative string transduction. In Proc. HLT-NAACL, 2015.
30. Alexander M. Rush, Sumit Chopra, and Jason Weston. A neural attention model for abstractive sentence summarization. In Proc. EMNLP, 2015.
31. Baskaran Sankaran, Ajeet Grewal, and Anoop Sarkar. Incremental decoding for phrase-based statistical machine translation. In Proc. WMT, 2010.
32. Rico Sennrich, Barry Haddow, and Alexandra Birch. Improving neural machine translation models with monolingual data. In Proc. ACL, 2016.
33. Claude Shannon. A mathematical theory of communication. Bell System Technical Journal, 27(3): 379-423, 1948.
34. Khalil Sima'an. Computational complexity of probabilistic disambiguation by means of tree-grammars. In Proc. COLING, 1996.
35. Ilya Sutskever, Oriol Vinyals, and Quoc V. Le. Sequence to sequence learning with neural networks. In Proc. NIPS, 2014.
36. Christoph Tillmann, Stephan Vogel, Hermann Ney, and Alex Zubiaga. A DP-based search using monotone alignments in statistical translation. In Proc. EACL, 1997.
37. Zhaopeng Tu, Yang Liu, Lifeng Shang, Xiaohua Liu, and Hang Li. Neural machine translation with reconstruction. CoRR, abs/1611.01874, 2016.
38. Oriol Vinyals, Meire Fortunato, and Navdeep Jaitly. Pointer networks. In Proc. NIPS, 2015.
39. Lei Yu, Jan Buys, and Phil Blunsom. Online segment to segment neural transduction. In Proc. EMNLP, 2016.