Effect of Non-linear Deep Architecture in Sequence Labeling

6th International Joint Conference on Natural Language Processing, IJCNLP 2013 - Proceedings of the Main Conference

Volumn , Issue , 2013, Pages 1285-1291

  Wang, Mengqiu ^a   Manning, Christopher D ^a  

^a Stanford University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARCHITECTURE; NATURAL LANGUAGE PROCESSING SYSTEMS;

DEEP ARCHITECTURES; EMPIRICAL INVESTIGATION; FEATURE REPRESENTATION; FEATURE-BASED MODEL; NAMED ENTITY RECOGNITION; NON LINEAR; NON-LINEAR MODELLING; PERFORMANCE; SEQUENCE LABELING; SEQUENCE MODELS;

RANDOM PROCESSES;

EID: 84943773375     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. Rie K. Ando and Tong Zhang. 2005. A framework for learning predictive structures from multiple tasks and unlabeled data. JMLR, 6:1817–1853.
2. Jean-Gabriel Attali and Gilles Pagés. 1997. Approximations of functions by a multilayer perceptron: a new approach. Neural Networks, 10:1069–1081.
3. Yoshua Bengio and Samy Bengio. 2000. Modeling high-dimensional discrete data with multi-layer neural networks. In Proceedings of NIPS 12.
4. Yoshua Bengio. 2009. Learning deep architectures for AI. Found. Trends Mach. Learn., 2(1):1–127, January.
5. Francesco Camastra. 2003. Data dimensionality estimation methods: A survey. Pattern Recognition, 36:2945–2954.
6. Ronan Collobert and Jason Weston. 2008. A unified architecture for natural language processing: Deep neural networks with multitask learning. In Proceedings of ICML.
7. Ronan Collobert, Jason Weston, Leon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural language processing (almost) from scratch. JMLR, 12:2461–2505.
8. Trinh-Minh-Tri Do and Thierry Artieres. 2010. Neural conditional random fields. In Proceedings of AIS-TATS.
9. Jenny R. Finkel, Trond Grenager, and Christopher D. Manning. 2005. Incorporating non-local information into information extraction systems by Gibbs sampling. In Proceedings of ACL.
10. Thorsten Joachims. 2004. Learning to Classify Text Using Support Vector Machines: Methods, Theory, and Algorithms. Kluwer Academic Publishers.
11. Percy Liang, Hal Daume, and Dan Klein. 2008. Structure compilation: Trading structure for features. In Proceedings of ICML.
12. Dong C. Liu and Jorge Nocedal. 1989. On the limited memory BFGS method for large scale optimization. Math. Programming, 45:503–528.
13. Jian Peng, Liefeng Bo, and Jinbo Xu. 2009. Conditional neural fields. In Proceedings of NIPS 22.
14. Xaq Pitkow. 2012. Compressive neural representation of sparse, high-dimensional probabilities. In Proceedings of NIPS 25.
15. Rohit Prabhavalkar and Eric Fosler-Lussier. 2010. Backpropagation training for multilayer conditional random field based phone recognition. In Proceedings of ICASSP.
16. Erik F. Tjong Kim Sang and Sabine Buchholz. 2000. Introduction to the CoNLL-2000 shared task: Chunking. In Proceedings of CoNLL.
17. Erik F. Tjong Kim Sang and Fien De Meulder. 2003. Introduction to the CoNLL-2003 shared task: language-independent named entity recognition. In Proceedings of CoNLL.
18. Richard Socher, Jeffrey Pennington, Eric H. Huang, Andrew Y. Ng, and Christopher D. Manning. 2011. Semi-supervised recursive autoencoders for predicting sentiment distributions. In Proceedings of EMNLP.
19. Joseph Turian, Lev Ratinov, and Yoshua Bengio. 2010. Word representations: A simple and general method for semi-supervised learning. In Proceedings of ACL.
20. Michel Verleysen, Damien Francois, Geoffroy Simon, and Vincent Wertz. 2003. On the effects of dimensionality on data analysis with neural networks. In Proceedings of the 7th International Work-Conference on Artificial and Natural Neural Networks: Part II.