Deep multi-task learning with low level tasks supervised at lower layers

54th Annual Meeting of the Association for Computational Linguistics, ACL 2016 - Short Papers

Volumn , Issue , 2016, Pages 231-235

  Søgaard, Anders ^a   Goldberg, Yoav ^b  

^a UNIVERSITY OF COPENHAGEN   (Denmark)

^b BAR ILAN UNIVERSITY   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS;

BI-DIRECTIONAL; DIFFERENT LAYERS; DOMAIN ADAPTATION; MULTITASK LEARNING; POS TAGGING; SHARED REPRESENTATIONS;

DEEP LEARNING;

EID: 85002310679     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.18653/v1/p16-2038     Document Type: Conference Paper

References (17)

1. Rich Caruana. 1993. Multitask learning: a knowledgebased source of inductive bias. In ICML.
2. Kyunghyun Cho. 2015. Natural language understanding with distributed representation. CoRR, abs/1511.07916.
3. Ronan Collobert, Jason Weston, Léon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural language processing (almost) from scratch. The Journal of Machine Learning Research, 12:2493-2537.
4. Jeffrey L. Elman. 1990. Finding Structure in Time. Cognitive Science, 14(2):179-211, March.
5. Yoav Goldberg. 2015. A primer on neural network models for natural language processing. CoRR, abs/1510.00726.
6. Sepp Hochreiter and Juergen Schmidhuber. 1997. Long short-term memory. Neural Computation, 9:1735-1780.
7. Ozan Irsoy and Claire Cardie. 2014. Opinion Mining with Deep Recurrent Neural Networks. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 720-728, Doha, Qatar, October. Association for Computational Linguistics.
8. M.-T. Luong, Q. V. Le, I. Sutskever, O. Vinyals, and L. Kaiser. 2015. Multi-task Sequence to Sequence Learning. ArXiv e-prints, November.
9. Joakim Nivre, Johan Hall, Sandra Kübler, Ryan Mc- Donald, Jens Nilsson, Sebastian Riedel, and Deniz Yuret. 2007. The CoNLL 2007 shared task on dependency parsing. In Proceedings of the CoNLL Shared Task Session of EMNLP-CoNLL 2007, pages 915-932, Prague, Czech Republic, June. Association for Computational Linguistics.
10. Erik F. Tjong Kim Sang and Sabine Buchholz. 2000. Introduction to the conll-2000 shared task chunking. In Fourth Conference on Computational Natural Language Learning and of the Second Learning Language in Logic Workshop, pages 127-132.
11. M. Schuster and Kuldip K. Paliwal. 1997. Bidirectional recurrent neural networks. IEEE Transactions on Signal Processing, 45(11):2673-2681, November.
12. Hong Shen and Anoop Sarkar. 2005. Voting between multiple data representations for text chunking. In Proceedings of the 18th Meeting of the Canadian Society for Computational Intelligence.
13. Jun Suzuki and Hideki Isozaki. 2008. Semi-supervised sequential labeling and segmentation using gigaword scale unlabeled data. In ACL.
14. Wenduan Xu, Michael Auli, and Stephen Clark. 2015. Ccg supertagging with a recurrent neural network. In ACL.
15. Junho Yim, Heechul Jung, ByungIn Yoo amd Changkyu Choi, Dusik Park, and Junmo Kim. 2015. Rotating Your Face Using Multi-task Deep Neural Network. In CVPR.
16. Cha Zhang and Zhengyou Zhang. 2014. Improving Multiview Face Detection with Multi-Task Deep Convolutional Neural Networks. In WACV.
17. Jerry Zhu, Timothy Rogers, and Bryan Gibson. 2009. Human Rademacher complexity. In NIPS.