Morphological inflection generation using character sequence to sequence learning

2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2016 - Proceedings of the Conference

Volumn , Issue , 2016, Pages 634-643

  Faruqui, Manaal ^a   Tsvetkov, Yulia ^a   Neubig, Graham ^b   Dyer, Chris ^a  

^a Carnegie Mellon University ^*  (United States)

^b NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ENCODER-DECODER; LANGUAGE INDEPENDENTS; SEMI-SUPERVISED; SEQUENCE LEARNING; STATE OF THE ART;

COMPUTATIONAL LINGUISTICS;

EID: 84994149005     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.18653/v1/n16-1077     Document Type: Conference Paper

References (53)

1. Malin Ahlberg, Markus Forsberg, and Mans Hulden. 2014. Semi-supervised learning of morphological paradigms and lexicons. In Proc. of EACL.
2. Malin Ahlberg, Markus Forsberg, and Mans Hulden. 2015. Paradigm classification in supervised learning of morphology. Proc. of NAACL.
3. Harald R. Baayen, Richard Piepenbrock, and Leon Gulikers. 1995. The CELEX Lexical Database. Release 2 (CD-ROM). LDC, University of Pennsylvania.
4. Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. In Proc. of ICLR.
5. Miguel Ballesteros, Chris Dyer, and Noah A. Smith. 2015. Improved transition-based parsing by modeling characters instead of words with lstms. In Proc. of EMNLP.
6. Timothy C Bell, John G Cleary, and Ian H Witten. 1990. Text compression. Prentice-Hall, Inc.
7. Lasse Bergroth, Harri Hakonen, and Timo Raita. 2000. A survey of longest common subsequence algorithms. In Proc. of SPIRE.
8. Victor Chahuneau, Eva Schlinger, Noah A. Smith, and Chris Dyer. 2013a. Translating into morphologically rich languages with synthetic phrases. In Proc. of EMNLP.
9. Victor Chahuneau, Noah A Smith, and Chris Dyer. 2013b. Knowledge-rich morphological priors for bayesian language models. In Proc. of NAACL.
10. Kyunghyun Cho, Bart van Merrienboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using rnn encoder-decoder for statistical machine translation. In Proc. of EMNLP.
11. N. Chomsky and M. Halle. 1968. The Sound Pattern of English. Harper & Row, New York, NY.
12. Alexander Clark. 2003. Combining distributional and morphological information for part of speech induction. In Proc. of EACL.
13. Ann Clifton and Anoop Sarkar. 2011. Combining morpheme-based machine translation with post-processing morpheme prediction. In Proc. of ACL.
14. Ronan Collobert, Jason Weston, Léon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural language processing (almost) from scratch. The Journal of Machine Learning Research, 12:2493-2537.
15. Ryan Cotterell and Hinrich Schütze. 2015. Morphological word-embeddings. In Proc. of NAACL.
16. Ryan Cotterell, Nanyun Peng, and Jason Eisner. 2015. Modeling word forms using latent underlying morphs and phonology. Transactions of the Association for Computational Linguistics, 3:433-447.
17. Ryan Cotterell, Tim Vieria, and Hinrich Schütze. 2016. A joint model of orthography and morphological segmentation. In Proc. of NAACL.
18. Mathias Creutz and Krista Lagus. 2005. Unsupervised morpheme segmentation and morphology induction from text corpora using Morfessor 1.0. Helsinki University of Technology.
19. Markus Dreyer and Jason Eisner. 2011. Discovering morphological paradigms from plain text using a dirichlet process mixture model. In Proc. of EMNLP.
20. Greg Durrett and John DeNero. 2013. Supervised learning of complete morphological paradigms. In Proc. of NAACL.
21. Jason Eisner. 2002. Parameter estimation for probabilistic finite-state transducers. In Proc. of ACL.
22. Alexander Fraser, Marion Weller, Aoife Cahill, and Fabienne Cap. 2012. Modeling inflection and wordformation in SMT. In Proc. of EACL.
23. Sharon Goldwater and David McClosky. 2005. Improving statistical MT through morphological analysis. In Proc. of EMNLP, pages 676-683.
24. Alex Graves, Santiago Fernández, and Jürgen Schmidhuber. 2005. Bidirectional lstm networks for improved phoneme classification and recognition. In Proc. of ICANN.
25. Alex Graves. 2013. Generating sequences with recurrent neural networks. CoRR, abs/1308.0850.
26. Jan Hajič, Barbora Vidová-Hladká, and Petr Pajas. 2001. The Prague Dependency Treebank: Annotation structure and support. In Proc. of the IRCS Workshop on Linguistic Databases.
27. Lars Kai Hansen and Peter Salamon. 1990. Neural network ensembles. In Proc. of PAMI.
28. Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural Computation, 9(8):1735-1780.
29. Mark Hopkins and Jonathan May. 2011. Tuning as ranking. In Proc. of EMNLP.
30. Mans Hulden. 2014. Generalizing inflection tables into paradigms with finite state operations. In Proc. of the Joint Meeting of SIGMORPHON and SIGFSM.
31. Ronald M Kaplan and Martin Kay. 1994. Regular models of phonological rule systems. Computational linguistics, 20(3):331-378.
32. Kimmo Koskenniemi. 1983. Two-level morphology: A general computational model for word-form recognition and production. University of Helsinki.
33. Wang Ling, Tiago Luís, Luís Marujo, Rámon Fernandez Astudillo, Silvio Amir, Chris Dyer, Alan W Black, and Isabel Trancoso. 2015. Finding function in form: Compositional character models for open vocabulary word representation. In Proc. of EMNLP.
34. Einat Minkov, Kristina Toutanova, and Hisami Suzuki. 2007. Generating complex morphology for machine translation. In Proc. of ACL.
35. Karthik Narasimhan, Regina Barzilay, and Tommi Jaakkola. 2015. An unsupervised method for uncovering morphological chains. TACL.
36. Garrett Nicolai, Colin Cherry, and Grzegorz Kondrak. 2015. Inflection generation as discriminative string transduction. In Proc. of NAACL.
37. Kemal Oflazer, Özlem çetinoǧlu, and Bilge Say. 2004. Integrating morphology with multi-word expression processing in turkish. In Proc. of the Workshop on Multiword Expressions.
38. Kemal Oflazer. 1996. Error-tolerant finite-state recognition with applications to morphological analysis and spelling correction. Computational Linguistics, 22(1):73-89.
39. Jose Oncina and Marc Sebban. 2006. Learning stochastic edit distance: Application in handwritten character recognition. Pattern recognition, 39(9):1575-1587.
40. Hoifung Poon, Colin Cherry, and Kristina Toutanova. 2009. Unsupervised morphological segmentation with log-linear models. In Proc. of NAACL.
41. Kanishka Rao, Fuchun Peng, Hasim Sak, and Françoise Beaufays. 2015. Grapheme-to-phoneme conversion using long short-term memory recurrent neural networks. In Proc. of ICASSP.
42. Pushpendre Rastogi, Ryan Cotterell, and Jason Eisner. 2016. Weighting finite-state transductions with neural context. In Proc. of NAACL.
43. Cicero D. Santos and Bianca Zadrozny. 2014. Learning character-level representations for part-of-speech tagging. In Proc. of ICML.
44. Sunita Sarawagi and William W Cohen. 2004. Semimarkov conditional random fields for information extraction. In Proc. of NIPS.
45. Benjamin Snyder and Regina Barzilay. 2008. Unsupervised multilingual learning for morphological segmentation. In In The Annual Conference of the.
46. Andreas Stolcke. 2002. Srilm-an extensible language modeling toolkit. In Proc. of Interspeech.
47. Ilya Sutskever, Oriol Vinyals, and Quoc VV Le. 2014. Sequence to sequence learning with neural networks. In Proc. of NIPS.
48. Kristina Toutanova, Hisami Suzuki, and Achim Ruopp. 2008. Applying morphology generation models to machine translation. In Proc. of ACL, pages 514-522.
49. Laurens van der Maaten and Geoffrey Hinton. 2008. Visualizing Data using t-SNE. Journal of Machine Learning Research, 9:2579-2605.
50. Richard Wicentowski. 2004. Multilingual noise-robust supervised morphological analysis using the wordframe model. In Proc. of SIGPHON.
51. Kaisheng Yao and Geoffrey Zweig. 2015. Sequence-to-sequence neural net models for grapheme-to-phoneme conversion. In Proc. of ICASSP.
52. David Yarowsky and Richard Wicentowski. 2000. Minimally supervised morphological analysis by multimodal alignment. In Proc. of ACL.
53. Matthew D Zeiler. 2012. Adadelta: An adaptive learning rate method. arXiv preprint arXiv:1212.5701.