A unified architecture for natural language processing: Deep neural networks with multitask learning

Proceedings of the 25th International Conference on Machine Learning

Volumn , Issue , 2008, Pages 160-167

  Collobert, Ronan ^a   Weston, Jason ^a  

^a NEC LABORATORIES AMERICA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; EDUCATION; INFORMATION THEORY; LEARNING ALGORITHMS; LEARNING SYSTEMS; LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS; ROBOT LEARNING; SUPERVISED LEARNING; VEGETATION;

CONVOLUTIONAL NEURAL NETWORKS; LABELED DATUMS; LANGUAGE MODELS; LANGUAGE PROCESSING; MULTI-TASK LEARNINGS; NAMED ENTITIES; NATURAL LANGUAGE PROCESSING; SEMANTIC ROLES; SEMI-SUPERVISED LEARNINGS; SPEECH TAGS; UNIFIED ARCHITECTURES; LABELED DATUM; MULTI-TASK LEARNING; PART-OF-SPEECH TAGS; SEMI-SUPERVISED LEARNING; STATE-OF-THE-ART PERFORMANCE;

NEURAL NETWORKS;

EID: 56449095373     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. Ando, R., amp; Zhang, T. (2005). A Framework for Learning Predictive Structures from Multiple Tasks and Unlabeled Data. JMLR, 6, 1817-1853.
2. Bengio, Y., amp; Ducharme, R. (2001). A neural probabilistic language model. NIPS 13.
3. Bridle, J. (1990). Probabilistic interpretation of feedforward classification network outputs, with relationships to statistical pattern recognition. In F. F. Soulié and J. Hérault (Eds.), Neurocomputing: Algorithms, architectures and applications, 227-236. NATO ASI Series.
4. Caruana, R. (1997). Multitask Learning. Machine Learning, 28, 41-75.
5. Chapelle, O., Schikopf, B., amp; Zien, A. (2006). Serni-supervised learning. Adaptive computation and machine learning. Cambridge, Mass., USA: MIT Press.
6. Collobert, R., & Weston, J. (2007). Fast semantic extraction using a novel neural network architecture. Proceedings of the 45th Annual Meeting of the ACL (pp. 560-567).
7. Gildea, D., & Palmer, M. (2001). The necessity of parsing for predicate argument recognition. Proceedings of the 40th Annual Meeting of the ACL, 239-246.
8. Joachims, T. (1999). Transductive inference for text classification using support vector machines. ICML.
9. LeCun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998). Gradient-Based Learning Applied to Document Recognition. Proceedings of the IEEE, 86.
10. McClosky, D., Charniak, E., & Johnson, M. (2006). Effective self-training for parsing. Proceedings of HLT-NAACL 2006.
11. Miller, S., Fox, H., Ramshaw, L., & Weischedel, R. (2000). A novel use of statistical parsing to extract information from text. 6th Applied Natural Language Processing Conference.
12. Musillo, G., & Merlo, P. (2006). Robust Parsing of the Proposition Bank. ROMAND 2006: Robust Methods in Analysis of Natural language Data.
13. Okanohara, D., & Tsujii, J. (2007). A discriminative language model with pseudo-negative samples. Proceedings of the 45th Annual Meeting of the ACL, 73-80.
14. Palmer, M., Gildea, D., & Kingsbury, P. (2005). The proposition bank: An annotated corpus of semantic roles. Comput. Linguist., 31, 71-106.
15. Pradhan, S., Ward, W., Hacioglu, K., Martin, J., & Jurafsky, D. (2004). Shallow semantic parsing using support vector machines. Proceedings of HLT/NAACL-2004.
16. Rosenfeld, B., & Feldman, R. (2007). Using Corpus Statistics on Entities to Improve Semi-supervised Relation Extraction from the Web. Proceedings of the 45th Annual Meeting of the ACL, 600-607.
17. Schwenk, H., & Gauvain, J. (2002). Connectionist language modeling for large vocabulary continuous speech recognition. IEEE International Conference on Acoustics, Speech, and Signal Processing (pp. 765-768).
18. Sutton, C., & McCallum, A. (2005a). Composition of conditional random fields for transfer learning. Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing, 748-754.
19. Sutton, C., & McCallum, A. (2005b). Joint parsing and semantic role labeling. Proceedings of CoNLL-2005 (pp. 225-228).
20. Sutton, C., McCallum, A., & Rohanimanesh, K. (2007). Dynamic Conditional Random Fields: Factorized Probabilistic Models for Labeling and Segmenting Sequence Data. JMLR, 8, 693-723.
21. Ueffing, N., Haffari, G., & Sarkar, A. (2007). Transductive learning for statistical machine translation. Proceedings of the 45th Annual Meeting of the ACL, 25-32.
22. Waibel, A., abd G. Hinton, T. H., Shikano, K., & Lang, K. (1989). Phoneme recognition using time-delay neural networks. IEEE Transactions on Acoustics, Speech, and Signal Processing, 37, 328-339.