Agreement on target-bidirectional LSTMs for sequence-to-sequence learning

30th AAAI Conference on Artificial Intelligence, AAAI 2016

Volumn , Issue , 2016, Pages 2630-2637

  Liu, Lemao ^a   Finch, Andrew ^a   Utiyama, Masao ^a   Sumita, Eiichiro ^a  

^a NATIONAL INSTITUTE OF INFORMATION AND COMMUNICATIONS TECHNOLOGY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE;

EFFECTIVE APPROACHES; GRAPHEME TO PHONEMES; LEARNING TASKS; LONG SEQUENCES; LONG SHORT TERM MEMORY; MACHINE TRANSLITERATION; SEQUENCE LEARNING; STATE-OF-THE-ART SYSTEM;

RECURRENT NEURAL NETWORKS;

EID: 85007170410     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (36)

1. Bahdanau, D.; Cho, K.; and Bengio, Y. 2015. Neural machine translation by jointly learning to align and translate. In Proceedings of ICLR.
2. Bergstra, J.; Breuleux, O.; Bastien, F.; Lamblin, P.; Pascanu, R.; Desjardins, G.; Turian, J.; Warde-Farley, D.; and Bengio, Y. 2010. Theano: A CPU and GPU math expression compiler. In Proceedings of SciPy.
3. Bisani, M., and Ney, H. 2008. Joint-sequence models for grapheme-to-phoneme conversion. Speech Commun.
4. Collins, M., and Roark, B. 2004. Incremental parsing with the perceptron algorithm. In Proceedings of ACL.
5. Devlin, J.; Zbib, R.; Huang, Z.; Lamar, T.; Schwartz, R.; and Makhoul, J. 2014. Fast and robust neural network joint models for statistical machine translation. In Proceedings of ACL.
6. Dyer, C.; Ballesteros, M.; Ling, W.; Matthews, A.; and Smith, N. A. 2015. Transition-based dependency parsing with stack long short-term memory. In Proceedings of ACLIJCNLP.
7. Finch, A. M., and Sumita, E. 2008. Phrase-based machine transliteration. In Proceedings of IJCNLP.
8. Finch, A., and Sumita, E. 2009. Bidirectional phrase-based statistical machine translation. In Proceedings of EMNLP.
9. Graves, A., and Schmidhuber, J. 2008. Offline handwriting recognition with multidimensional recurrent neural networks. In Proceedings of NIPS.
10. Graves, A. 2013. Generating sequences with recurrent neural networks. CoRR.
11. Hochreiter, S., and Schmidhuber, J. 1997. Long short-term memory. Neural Comput. 9.
12. Huang, L.; Fayong, S.; and Guo, Y. 2012. Structured perceptron with inexact search. In Proceedings of NAACL.
13. Jean, S.; Cho, K.; Memisevic, R.; and Bengio, Y. 2015. On using very large target vocabulary for neural machine translation. In Proceedings of ACL-IJCNLP.
14. Jiampojamarn, S.; Cherry, C.; and Kondrak, G. 2008. Joint processing and discriminative training for letter-to-phoneme conversion. In Proceedings of ACL-HLT.
15. Kaindl, H., and Kainz, G. 1997. Bidirectional heuristic search reconsidered. Journal of Artificial Intelligence Research 7.
16. Koehn, P.; Hoang, H.; Birch, A.; Callison-Burch, C.; Federico, M.; Bertoldi, N.; Cowan, B.; Shen, W.; Moran, C.; Zens, R.; Dyer, C.; Bojar, O.; Constantin, A.; and Herbst, E. 2007. Moses: open source toolkit for statistical machine translation. In Proceedings of ACL: Demonstrations.
17. Kubo, K.; Sakti, S.; Neubig, G.; Toda, T.; and Nakamura, S. 2014. Structured soft margin confidence weighted learning for grapheme-to-phoneme conversion. In Proceedings of InterSpeech.
18. Liang, P.; Bouchard-Côté, A.; Klein, D.; and Taskar, B. 2006. An end-to-end discriminative approach to machine translation. In Proceedings of COLING-ACL.
19. Liu, L., and Huang, L. 2014. Search-aware tuning for machine translation. In Proceedings of EMNLP.
20. Luong, T.; Sutskever, I.; Le, Q.; Vinyals, O.; and Zaremba, W. 2015. Addressing the rare word problem in neural machine translation. In Proceedings of ACL-IJCNLP.
21. Meng, F.; Lu, Z.; Tu, Z.; Li, H.; and Liu, Q. 2015. Neural transformation machine: A new architecture for sequenceto- sequence learning. CoRR.
22. Mikolov, T.; Karafíat, M.; Burget, L.; Cernocký, J.; and Khudanpur, S. 2010. Recurrent neural network based language model. In Proceedings of INTERSPEECH.
23. Novak, J. R.; Minematsu, N.; and Hirose, K. 2012. WFSTbased grapheme-to-phoneme conversion: Open source tools for alignment, model-building and decoding. In Proceedings of ACL Workshop on FSMNLP.
24. Rao, K.; Peng, F.; Sak, H.; and Beaufays, F. 2015. Graphemeto-phoneme conversion using long short-term memory recurrent neural networks. In ICASSP.
25. Rumelhart, D. E.; Hinton, G. E.; and Williams, R. J. 1986. Parallel distributed processing. chapter Learning Internal Representations by Error Propagation.
26. Sundermeyer, M.; Alkhouli, T.; Wuebker, J.; and Ney, H. 2014. Translation modeling with bidirectional recurrent neural networks. In Proceedings of EMNLP.
27. Sutskever, I.; Vinyals, O.; and Le, Q. V. V. 2014. Sequence to sequence learning with neural networks. In NIPS.
28. Tai, K. S.; Socher, R.; and Manning, C. D. 2015. Improved semantic representations from tree-structured long shortterm memory networks. In Proceedings of ACL-IJCNLP.
29. Tamura, A.; Watanabe, T.; and Sumita, E. 2014. Recurrent neural networks for word alignment model. In Proceedings of ACL.
30. Watanabe, T., and Sumita, E. 2002. Bidirectional decoding for statistical machine translation. In Proceeding of COLING.
31. Watanabe, T., and Sumita, E. 2015. Transition-based neural constituent parsing. In Proceedings of ACL-IJCNLP.
32. Wu, K.; Allauzen, C.; Hall, K. B.; Riley, M.; and Roark, B. 2014. Encoding linear models as weighted finite-state transducers. In INTERSPEECH.
33. Yao, K., and Zweig, G. 2015. Sequence-to-sequence neural net models for grapheme-to-phoneme conversion. CoRR.
34. Zeiler, M. D. 2012. ADADELTA: An adaptive learning rate method. CoRR.
35. Zhang, M.; Li, H.; Liu, M.; and Kumaran, A. 2012. Whitepaper of news 2012 shared task on machine transliteration. In Proceedings of NEWS Workshop.
36. Zhang, H.; Toutanova, K.; Quirk, C.; and Gao, J. 2013. Beyond left-to-right: Multiple decomposition structures for smt. In HLT-NAACL.