Non-lexical neural architecture for fine-grained POS tagging

Conference Proceedings - EMNLP 2015: Conference on Empirical Methods in Natural Language Processing

Volumn , Issue , 2015, Pages 232-237

  Labeau, Matthieu ^a   Löser, Kevin ^a   Allauzen, Alexandre ^a  

^a UNIVERSITÉ PARIS SACLAY   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ARTS COMPUTING; CONVOLUTION; NATURAL LANGUAGE PROCESSING SYSTEMS; NETWORK ARCHITECTURE;

CHARACTER STREAMS; CONVOLUTIONAL NETWORKS; FEATURE ENGINEERINGS; FINE GRAINED; MORPHOLOGICAL TAGGING; NEURAL ARCHITECTURES; STATE OF THE ART; WORD REPRESENTATIONS;

COMPUTATIONAL LINGUISTICS;

EID: 84959912038     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.18653/v1/d15-1025     Document Type: Conference Paper

References (19)

1. Yoshua Bengio, Rejean Ducharme, Pascal Vincent, and Christian Jauvin. 2003. A neural probabilistic language model. Journal of Machine Learning Research, 3:1137 1155.
2. James Bergstra, Olivier Breuleux, Frederic Bastien, Pascal Lamblin, Razvan Pascanu, Guillaume Desjardins, Joseph Turian, David Warde-Farley, and Yoshua Bengio. 2010. Theano: a CPU and GPU math expression compiler. In Proceedings of the Python for Scientific Computing Conference (SciPy), June. Oral Presentation.
3. Sabine Brants, Stefanie Dipper, Silvia Hansen, Wolfgang Lezius, and George Smith. 2002. The TIGER treebank. In Proceedings of the workshop on treebanks and linguistic theories, pages 24-A1.
4. Ronan Collobert, Jason Weston, Leon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural language processing (almost) from scratch. J. Mach Learn. Res., 12:2493-2537, November.
5. Ronan Collobert. 2011. Deep learning for efficient discriminative parsing. In Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, AISTATS 2011, Fort Lauderdale, USA, April 11-13, 2011, pages 224-232.
6. John Duchi, Elad Hazan, and Yoram Singer. 2011. Adaptive subgradient methods for online learning and stochastic optimization. J. Mach Learn. Res., 12:2121-2159, July.
7. Alexander Fraser, Helmut Schmid, Richard Farkas, Renjing Wang, and Hinrich Schiitze. 2013. Knowledge sources for constituent parsing of German, a morphologically rich and less-configurational language. Comput. Linguist, 39(1):57-85, March.
8. Alex Graves, Navdeep Jaitly, and Abdel-rahman Mohamed. 2013. Hybrid speech recognition with deep bidirectional LSTM. In 2013 IEEE Workshop on Automatic Speech Recognition and Understanding, Olomouc, Czech Republic, December 8-12, 2013, pages 273-278.
9. Alex Graves. 2013. Generating sequences with recurrent neural networks. CoRR, abs/1308.0850.
10. Andrej Karpathy, Justin Johnson, and Fei-Fei Li. 2015. Visualizing and understanding recurrent networks. CoRR, abs/1506.02078.
11. Thang Luong, Richard Socher, and Christopher D. Manning. 2013. Better word representations with recursive neural networks for morphology. In Proceedings of the Seventeenth Conference on Computational Natural Language Learning, CoNLL 2013, Sofia, Bulgaria, August 8-9, 2013, pages 104-113.
12. Tomas Mikolov, Ilya Sutskever, Anoop Deoras, Hai-Son Le, Stefan Kombrink, and Jan Cernocky. 2012. Sub word language modeling with neural networks. Unpublished.
13. Thomas Mueller, Helmut Schmid, and Hinrich Schiitze. 2013. Efficient higher-order CRFs for morphological tagging. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, pages 322-332, Seattle, Washington, USA, October. Association for Computational Linguistics.
14. Cicero D. Santos and Bianca Zadrozny. 2014. Learning character-level representations for part-ofspeech tagging. In Tony Jebara and Eric P. Xing, editors, Proceedings of the 31st International Conference on Machine Learning (ICML-14), pages 1818-1826. JMLR Workshop and Conference Proceedings.
15. Helmut Schmid and Florian Laws. 2008. Estimation of conditional probabilities with decision trees and an application to fine-grained pos tagging. In Proceedings of the 22Nd International Conference on Computational Linguistics - Volume 1, COLING'08, pages 777-784, Stroudsburg, PA, USA. Association for Computational Linguistics.
16. Ilya Sutskever, James Martens, and Geoffrey Hinton. 2011. Generating text with recurrent neural networks. In Lise Getoor and Tobias Scheffer, editors, Proceedings of the 28th International Conference on Machine Learning (ICML-11), ICML'11, pages 1017-1024, New York, NY, USA, June. ACM.
17. Andrew Viterbi. 1967. Error bounds for convolutional codes and an asymptotically optimum decoding algorithm. IEEE Trans. Inf. Theor, 13(2):260-269, April.
18. Alexander Waibel, Toshiyuki Hanazawa, Geofrey Hinton, Kiyohiro Shikano, and Kevin J. Lang, 1990. Readings in Speech Recognition, chapter Phoneme Recognition Using Time-delay Neural Networks, pages 393-404. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.
19. Xiang Zhang and Yann LeCun. 2015. Text understanding from scratch. CoRR, abs/1502.01710.