MGNC-CNN: A simple approach to exploiting multiple word embeddings for sentence classification

2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2016 - Proceedings of the Conference

Volumn , Issue , 2016, Pages 1522-1527

  Zhang, Ye ^a   Roller, Stephen ^a   Wallace, Byron C ^b  

^a University of Texas at Austin   (United States)

^b UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTATIONAL LINGUISTICS; NETWORK ARCHITECTURE; NETWORK LAYERS;

BASELINE MODELS; CONVOLUTION NEURAL NETWORK; FEATURE VECTORS; MULTIPLE SET; REGULARIZATION STRATEGIES; SENTENCE CLASSIFICATIONS; SIMPLE APPROACH; TRAINING TIME;

EMBEDDINGS;

EID: 84994172004     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.18653/v1/n16-1178     Document Type: Conference Paper

References (26)

1. Ramon F Astudillo, Silvio Amir, Wang Lin, Mário Silva, and Isabel Trancoso. 2015. Learning word representations from scarce and noisy data with embedding subspaces. In Proceedings of Association for Computational Linguistics, pages 1074-1084.
2. Marco Baroni, Silvia Bernardini, Adriano Ferraresi, and Eros Zanchetta. 2009. The wacky wide web: a collection of very large linguistically processed web-crawled corpora. Language Resources and Evaluation, 43(3):209-226.
3. Elia Bruni, Gemma Boleda, Marco Baroni, and Nam-Khanh Tran. 2012. Distributional semantics in technicolor. In Proceedings of Association for Computational Linguistics, pages 136-145.
4. Danqi Chen and Christopher Manning. 2014. A fast and accurate dependency parser using neural networks. In Proceedings of Empirical Methods in Natural Language Processing, pages 740-750.
5. Kyunghyun Cho. 2015. Natural language understanding with distributed representation. arXiv preprint arXiv:1511.07916.
6. Ronan Collobert and Jason Weston. 2008. A unified architecture for natural language processing: Deep neural networks with multitask learning. In Proceedings of the International Conference on Machine learning, pages 160-167.
7. Katrin Erk and Sebastian Padó. 2008. A structured vector space model for word meaning in context. In Proceedings of Empirical Methods in Natural Language Processing, pages 897-906.
8. Yoav Goldberg. 2015. A primer on neural network models for natural language processing. arXiv preprint arXiv:1510.00726.
9. Rie Johnson and Tong Zhang. 2014. Effective use of word order for text categorization with convolutional neural networks. arXiv preprint arXiv:1412.1058.
10. Nal Kalchbrenner, Edward Grefenstette, and Phil Blunsom. 2014. A convolutional neural network for modelling sentences. arXiv preprint arXiv:1404.2188.
11. Yoon Kim. 2014. Convolutional neural networks for sentence classification. arXiv preprint arXiv:1408.5882.
12. Omer Levy and Yoav Goldberg. 2014. Dependencybased word embeddings. In Proceedings of Association for Computational Linguistics, pages 302-308.
13. Xin Li and Dan Roth. 2002. Learning question classifiers. In Proceedings of the International Conference on Computational Linguistics, pages 1-7.
14. Yong Luo, Jian Tang, Jun Yan, Chao Xu, and Zheng Chen. 2014. Pre-trained multi-view word embedding using two-side neural network. In Conference on Artificial Intelligence.
15. Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems, pages 3111-3119.
16. Lili Mou, Hao Peng, Ge Li, Yan Xu, Lu Zhang, and Zhi Jin. 2015. Discriminative neural sentence modeling by tree-based convolution. In Proceedings of Empirical Methods in Natural Language Processing, pages 2315-2325.
17. Sebastian Padó and Mirella Lapata. 2007. Dependencybased construction of semantic space models. Computational Linguistics, 33(2):161-199.
18. Bo Pang and Lillian Lee. 2004. A sentimental education: Sentiment analysis using subjectivity summarization based on minimum cuts. In Proceedings of Association for Computational Linguistics, page 271.
19. Jeffrey Pennington, Richard Socher, and Christopher D Manning. 2014. Glove: Global vectors for word representation. In Proceedings of the Empirical Methods in Natural Language Processing, pages 1532-1543.
20. Richard Socher, Alex Perelygin, Jean Y Wu, Jason Chuang, Christopher D Manning, Andrew Y Ng, and Christopher Potts. 2013. Recursive deep models for semantic compositionality over a sentiment treebank. In Proceedings of Empirical Methods in Natural Language Processing, pages 1631-1642.
21. Tim Van de Cruys, Thierry Poibeau, and Anna Korhonen. 2011. Latent vector weighting for word meaning in context. In Proceedings of Empirical Methods in Natural Language Processing, pages 1012-1022.
22. Byron C. Wallace, Do Kook Choe, Laura Kertz, and Eugene Charniak. 2014. Humans require context to infer ironic intent (so computers probably do, too). In Proceedings of Association for Computational Linguistics, pages 512-516.
23. Byron C. Wallace, Do Kook Choe, and Eugene Charniak. 2015. Sparse, contextually informed models for irony detection: Exploiting user communities, entities and sentiment. In Proceedings of Association for Computational Linguistics, pages 1035-1044.
24. Wenpeng Yin and Hinrich Schütze. 2015. Multichannel variable-size convolution for sentence classification. In Proceedings of the Conference on Computational Natural Language Learning, pages 204-214.
25. Dani Yogatama and Noah Smith. 2014. Making the most of bag of words: Sentence regularization with alternating direction method of multipliers. In Proceedings of the International Conference on Machine Learning, pages 656-664.
26. Ye Zhang and Byron C. Wallace. 2015. A sensitivity analysis of (and practitioners' guide to) convolutional neural networks for sentence classification. arXiv preprint arXiv:1510.03820.