Transfer Learning and Sentence Level Features for Named Entity Recognition on Tweets

3rd Workshop on Noisy User-Generated Text, W-NUT 2017 - Proceedings of the Workshop

Volumn , Issue , 2017, Pages 166-171

  Daniken, Pius Von ^a   Cieliebak, Mark ^b  

^a SpinningBytes AG   (Switzerland)

^b ZURICH UNIVERSITY OF APPLIED SCIENCES   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS;

ENTITY-LEVEL; F1 SCORES; LABELED DATA; LEARNING LEVELS; NAMED ENTITIES; NAMED ENTITY RECOGNITION; NEURAL NETWORK ARCHITECTURE; SENTENCE LEVEL; SYSTEM USE; TRANSFER LEARNING;

NETWORK ARCHITECTURE;

EID: 85080389172     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. Piotr Bojanowski, Edouard Grave, Armand Joulin, and Tomas Mikolov. 2016. Enriching word vectors with subword information. ArXiv e-prints https://arxiv.org/abs/1607.04606.
2. Jason P. C. Chiu and Eric Nichols. 2015. Named Entity Recognition with Bidirectional LSTM-CNNs. ArXiv e-prints https://arxiv.org/abs/1511.08308.
3. Ronan Collobert, Jason Weston, Ĺeon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural language processing (almost) from scratch. Journal of Machine Learning Research 12:2493-2537.
4. Leon Derczynski, Eric Nichols, Marieke van Erp, and Nut Limsopatham. 2017. Results of the WNUT2017 Shared Task on Novel and Emerging Entity Recognition. In Proceedings of the 3rd Workshop on Noisy, User-generated Text (W-NUT) at EMNLP. ACL.
5. Nicole Falkner, Stefano Dolce, Pius von Daniken, and Mark Cieliebak. 2017. Swiss Chocolate at CAp 2017 NER challenge: Partially annotated data andtransfer learning. Conference sur l'Apprentissage Automatique.
6. Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics. PMLR, Chia Laguna Resort, Italy, volume 9 of Proceedings of Machine Learning Research, pages 249-256.
7. Sepp Hochreiter and Jurgen Schmidhuber. 1997. Long short-term memory. Neural Comput. 9(8):1735- 1780.
8. Diederik P. Kingma and Jimmy Ba. 2014. Adam: A Method for Stochastic Optimization. ArXiv e-prints https://arxiv.org/abs/1412.6980.
9. Cdric Lopez, Ioannis Partalas, Georgios Balikas, Nadia Derbas, Amlie Martin, Coralie Reutenauer, Frdrique Segond, and Massih-Reza Amini. 2017. French named entity recognition in twitter challenge. Technical report.
10. Vinod Nair and Geoffrey E. Hinton. 2010. Rectified linear units improve restricted boltzmann machines. In Proceedings of the 27th International Conference on Machine Learning (ICML-10). Omnipress, pages 807-814.
11. Matteo Pagliardini, Prakhar Gupta, and Martin Jaggi. 2017. Unsupervised Learning of Sentence Embeddings using Compositional n-Gram Features. ArXiv e-prints https://arxiv.org/abs/1703.02507.
12. Razvan Pascanu, Tomas Mikolov, and Yoshua Bengio. 2012. On the difficulty of training Recurrent Neural Networks. ArXiv e-prints https://arxiv.org/abs/1211.5063.
13. Damien Sileo, Camille Pradel, Philippe Muller, and Tim Van de Cruys. 2017. Synapse at CAp 2017 NER challenge: Fasttext crf. Conference sur l'Apprentissage Automatique.
14. Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014. Dropout: A simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1):1929- 1958.
15. Benjamin Strauss, Bethany E. Toma, Alan Ritter, Marie-Catherine de Marneffe, and Wei Xu. 2016. Results of the WNUT16 named entity recognition shared task. In The 2nd Workshop on Noisy Usergenerated Text. pages 138-144.
16. Charles Sutton and Andrew McCallum. 2012. An introduction to conditional random fields. Found. Trends Mach. Learn. 4(4):267-373.
17. Erik F. Tjong Kim Sang and Fien De Meulder. 2003. Introduction to the CoNLL-2003 shared task: Language-independent named entity recognition. In Proceedings of the Seventh Conference on Natural Language Learning at HLT-NAACL 2003 - Volume 4. Association for Computational Linguistics, Stroudsburg, PA, USA, CONLL '03, pages 142- 147.
18. Zhilin Yang, Ruslan Salakhutdinov, and William W. Cohen. 2017. Transfer Learning for Sequence Tagging with Hierarchical Recurrent Networks. ArXiv e-prints https://arxiv.org/abs/1703.06345.