Text classification improved by integrating bidirectional LSTM with two-dimensional max pooling

COLING 2016 - 26th International Conference on Computational Linguistics, Proceedings of COLING 2016: Technical Papers

Volumn , Issue , 2016, Pages 3485-3495

  Zhou, Peng ^a   Qi, Zhenyu ^a   Zheng, Suncong ^a   Xu, Jiaming ^a   Bao, Hongyun ^a   Xu, Bo ^a,b  

^a INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

^b Shenzhen Fundamental Research Institutions   (China)

Author keywords

[No Author keywords available]

Indexed keywords

BINARY TREES; CLASSIFICATION (OF INFORMATION); COMPUTATIONAL LINGUISTICS; LONG SHORT-TERM MEMORY; NATURAL LANGUAGE PROCESSING SYSTEMS; ONE DIMENSIONAL; SENTIMENT ANALYSIS; VECTORS;

BINARY CLASSIFICATION; DISTRIBUTED REPRESENTATION; FEATURE REPRESENTATION; MUTUALLY INDEPENDENTS; QUESTION CLASSIFICATION; RECURRENT NEURAL NETWORK (RNN); SUBJECTIVITY CLASSIFICATIONS; TWO DIMENSIONAL (2 D);

TEXT PROCESSING;

EID: 85054981994     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (40)

1. Ana Margarida de Jesus Cardoso Cachopo. 2007. Improving methods for single-label text categorization. Ph.D. thesis, Universidade Técnica de Lisboa.
2. Jianpeng Cheng, Li Dong, and Mirella Lapata. 2016. Long short-term memory-networks for machine reading. arXiv preprint arXiv: 1601.06733.
3. Swapnil Hingmire, Sandeep Chougule, Girish K Palshikar, and Sutanu Chakraborti. 2013. Document classification by topic labeling. In Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval, pages 877-880. ACM.
4. Geoffrey E Hinton, Nitish Srivastava, Alex Krizhevsky, Ilya Sutskever, and Ruslan R Salakhutdinov. 2012. Improving neural networks by preventing co-adaptation of feature detectors. arXiv preprint arXiv: 1207.0580.
5. Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation, 9(8): 1735-1780.
6. Ozan Irsoy and Claire Cardie. 2014. Deep recursive neural networks for compositionality in language. In Advances in Neural Information Processing Systems, pages 2096-2104.
7. Mohit Iyyer, Varun Manjunatha, Jordan Boyd-Graber, and Hal Daumé III. 2015. Deep unordered composition rivals syntactic methods for text classification. In Proceedings of the Association for Computational Linguistics.
8. Nal Kalchbrenner, Edward Grefenstette, and Phil Blunsom. 2014. A convolutional neural network for modelling sentences. arXiv preprint arXiv: 1404.2188.
9. Yoon Kim. 2014. Convolutional neural networks for sentence classification. arXiv preprint arXiv: 1408.5882.
10. Ryan Kiros, Yukun Zhu, Ruslan R Salakhutdinov, Richard Zemel, Raquel Urtasun, Antonio Torralba, and Sanja Fidler. 2015. Skip-thought vectors. In Advances in neural information processing systems, pages 3294-3302.
11. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems, pages 1097-1105.
12. Siwei Lai, Liheng Xu, Kang Liu, and Jun Zhao. 2015. Recurrent convolutional neural networks for text classification. In AAAI, pages 2267-2273.
13. Quoc V Le and Tomas Mikolov. 2014. Distributed representations of sentences and documents. arXiv preprint arXiv: 1405.4053.
14. Phong Le and Willem Zuidema. 2015. Compositional distributional semantics with long short term memory. arXiv preprint arXiv: 1503.02510.
15. Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner. 1998. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11): 2278-2324.
16. Tao Lei, Regina Barzilay, and Tommi Jaakkola. 2015. Molding cnns for text: non-linear, non-consecutive convolutions. arXiv preprint arXiv: 1508.04112.
17. Xin Li and Dan Roth. 2002. Learning question classifiers. In Proceedings of the 19th international conference on Computational linguistics-Volume 1, pages 1-7. Association for Computational Linguistics.
18. Pengfei Liu, Xipeng Qiu, and Xuanjing Huang. 2016. Recurrent neural network for text classification with multitask learning. arXiv preprint arXiv: 1605.05101.
19. Lili Mou, Hao Peng, Ge Li, Yan Xu, Lu Zhang, and Zhi Jin. 2015. Discriminative neural sentence modeling by tree-based convolution. arXiv preprint arXiv: 1504.01106.
20. Bo Pang and Lillian Lee. 2004. A sentimental education: Sentiment analysis using subjectivity summarization based on minimum cuts. In Proceedings of the 42nd annual meeting on Association for Computational Linguistics, page 271. Association for Computational Linguistics.
21. Bo Pang and Lillian Lee. 2005. Seeing stars: Exploiting class relationships for sentiment categorization with respect to rating scales. In Proceedings of the 43 rd Annual Meeting on Association for Computational Linguistics, pages 115-124. Association for Computational Linguistics.
22. Jeffrey Pennington, Richard Socher, and Christopher D Manning. 2014. Glove: Global vectors for word representation. In EMNLP, Volume 14, pages 1532-43.
23. Mike Schuster and Kuldip K Paliwal. 1997. Bidirectional recurrent neural networks. Signal Processing, IEEE Transactions on, 45(11): 2673-2681.
24. Richard Socher, Alex Perelygin, Jean Y Wu, Jason Chuang, Christopher D Manning, Andrew Y Ng, and Christopher Potts. 2013. Recursive deep models for semantic compositionality over a sentiment treebank. In Proceedings of the conference on empirical methods in natural language processing (EMNLP), Volume 1631, page 1642. Citeseer.
25. Kai Sheng Tai, Richard Socher, and Christopher D Manning. 2015. Improved semantic representations from tree-structured long short-term memory networks. arXiv preprint arXiv: 1503.00075.
26. Duyu Tang, Bing Qin, Xiaocheng Feng, and Ting Liu. 2015. Target-dependent sentiment classification with long short term memory. arXiv preprint arXiv: 1512.01100.
27. Joseph Turian, Lev Ratinov, and Yoshua Bengio. 2010. Word representations: a simple and general method for semi-supervised learning. In Proceedings of the 48th annual meeting of the association for computational linguistics, pages 384-394. Association for Computational Linguistics.
28. Sida Wang and Christopher D Manning. 2012. Baselines and bigrams: Simple, good sentiment and topic classification. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Short Papers-Volume 2, pages 90-94. Association for Computational Linguistics.
29. Alex Hai Wang. 2010. Don't follow me: Spam detection in twitter. In Security and Cryptography (SECRYPT), Proceedings of the 2010 International Conference on, pages 1-10. IEEE.
30. Ying Wen, Weinan Zhang, Rui Luo, and Jun Wang. 2016. Learning text representation using recurrent convolutional neural network with highway layers. arXiv preprint arXiv: 1606.06905.
31. Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alex Smola, and Eduard Hovy. 2016. Hierarchical attention networks for document classification. In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies.
32. Wenpeng Yin and Hinrich Schütze. 2016. Multichannel variable-size convolution for sentence classification. arXiv preprint arXiv: 1603.04513.
33. Matthew D Zeiler. 2012. Adadelta: An adaptive learning rate method. arXiv preprint arXiv: 1212.5701.
34. Daojian Zeng, Kang Liu, Siwei Lai, Guangyou Zhou, Jun Zhao, et al. 2014. Relation classification via convolutional deep neural network. In COLING, pages 2335-2344.
35. Ye Zhang and Byron Wallace. 2015. A sensitivity analysis of (and practitioners' guide to) convolutional neural networks for sentence classification. arXiv preprint arXiv: 1510.03820.
36. Rui Zhang, Honglak Lee, and Dragomir Radev. 2016. Dependency sensitive convolutional neural networks for modeling sentences and documents. In Proceedings of NAACL-HLT, pages 1512-1521.
37. Han Zhao, Zhengdong Lu, and Pascal Poupart. 2015. Self-adaptive hierarchical sentence model. arXiv preprint arXiv: 1504.05070.
38. Chunting Zhou, Chonglin Sun, Zhiyuan Liu, and Francis Lau. 2015. A c-lstm neural network for text classification. arXiv preprint arXiv: 1511.08630.
39. Peng Zhou, Wei Shi, Jun Tian, Zhenyu Qi, Bingchen Li, Hongwei Hao, and Bo Xu. 2016. Attention-based bidirectional long short-term memory networks for relation classification. In The 54th Annual Meeting of the Association for Computational Linguistics, page 207.
40. Xiaodan Zhu, Parinaz Sobhani, and Hongyu Guo. 2015. Long short-term memory over recursive structures. In Proceedings of the 32nd International Conference on Machine Learning, pages 1604-1612.