Deep pyramid convolutional neural networks for text categorization

ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers)

Volumn 1, Issue , 2017, Pages 562-570

  Johnson, Rie ^a   Zhang, Tong ^b  

^a RJ Research Consulting   (United States)

^b TENCENT AI LAB   (China)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPLEX NETWORKS; COMPUTATIONAL LINGUISTICS; CONVOLUTION; DEEP NEURAL NETWORKS; LINGUISTICS; NEURAL NETWORKS; TEXT PROCESSING;

BENCHMARK DATASETS; COMPLEX NEURAL NETWORKS; COMPUTATIONAL COSTS; CONVOLUTIONAL NEURAL NETWORK; GLOBAL REPRESENTATION; SENTIMENT CLASSIFICATION; STATE OF THE ART; TEXT CATEGORIZATION;

NETWORK ARCHITECTURE;

EID: 85040914735     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.18653/v1/P17-1052     Document Type: Conference Paper

References (15)

1. Alexis Conneau, Holger Schwenk, Loïc Barrault, and Yann LeCun. 2016. Very deep convolutional networks for natural language processing. arXiv:1606.01781v1 (6 June 2016 version).
2. Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2015. Deep residual learning for image recognition. arXiv:1512.03385.
3. Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Identity mappings in deep residual networks. arXiv:1603.05027.
4. Geoffrey E. Hinton, Nitish Srivastava, Alex Krizhevsky, Ilya Sutskever, and Ruslan R. Salakhut-dinov. 2012. Improving neural networks by preventing co-adaptation of feature detectors. arXiv:1207.0580.
5. Sepp Hochreiter and Jürgen Schmidhuder. 1997. Long short-term memory. Neural Computation 9(8):1735-1780.
6. Rie Johnson and Tong Zhang. 2015a. Effective use of word order for text categorization with convolutional neural networks. In Proceedings of the North American Chapter of the Association for Computational Linguistics Human Language Technologies (NAACL HLT).
7. Rie Johnson and Tong Zhang. 2015b. Semi-supervised convolutional neural networks for text categorization via region embedding. In Advances in Neural Information Processing Systems 28 (NIPS 2015).
8. Rie Johnson and Tong Zhang. 2016. Convolutional neural networks for text categorization: Shallow word-level vs. deep character-level. arXiv:1609.00718.
9. Armand Joulin, Edouard Grave, Piotr Bojanowski, and Tomas Mikolov. 2016. Bag of tricks for efficient text classification. arXiv:1607.01795v3 (9 Aug 2016 version).
10. Yoon Kim. 2014. Convolutional neural networks for sentence classification. In Proceedings of Empirical Methods in Natural Language Processing (EMNLP). pages 1746-1751.
11. Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg Cor-rado, and Jeffrey Dean. 2013. Distributed representations of words and phrases and their composition-ality. In Advances in Neural Information Processing Systems 26 (NIPS 2013).
12. Karen Simonyan and Andrew Zisserman. 2015. Very deep convolutional networks for large-scale image recognition. In Proceedings of International Conference on Learning Representations (ICLR).
13. Duyu Tang, Bing Qin, and Ting Liu. 2015. Document modeling with gated recurrent neural network for sentiment classification. In Proceedings of Empirical Methods in Natural Language Processing (EMNLP).
14. Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alex Smola, and Eduard Hovy. 2016. Hierarchical attention networks for document classification. In Proceedings of the North American Chapter of the Association for Computational Linguistics Human Language Technologies (NAACL HLT).
15. Xiang Zhang, Junbo Zhao, and Yann LeCun. 2015. Character-level convolutional networks for text classification. In Advances in Neural Information Processing Systems 28 (NIPS 2015).