Long short-term memory over recursive structures

32nd International Conference on Machine Learning, ICML 2015

Volumn 2, Issue , 2015, Pages 1604-1612

  Zhu, Xiaodan ^a   Sobhani, Parinaz ^b   Guo, Hongyu ^a  

^a NATIONAL RESEARCH COUNCIL CANADA   (Canada)

^b UNIVERSITY OF OTTAWA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; BRAIN; COMPUTATIONAL LINGUISTICS; SEMANTICS; SPEECH RECOGNITION; SPEECH TRANSMISSION; TREES (MATHEMATICS);

COMPOSITION LAYERS; LONG DISTANCE INTERACTIONS; LONG SHORT TERM MEMORY; MACHINE TRANSLATIONS; NATURAL LANGUAGE UNDERSTANDING; RECURSIVE MODELING; RECURSIVE STRUCTURE; SEMANTIC COMPOSITION;

LEARNING SYSTEMS;

EID: 84969812378     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (36)

1. Chater, N; Conkey, p. finding linguistic structure with recurrent neural networks, lawrence erlbaum assoc publ. In Proceedings of the Annual Conference of the Cognitive Science Scoiety. (pp. 402-407, 1992.
2. Cho, Kyunghyun, van Merrienboer, Bart, Gülçehre, Çaglar, Bougares, Fethi, Schwenk, Holger, and Bengio, Yoshua. Learning phrase representations using RNN encoder-decoder for statistical machine translation. CoRR, abs/1406.1078, 2014.
3. Choi, Yejin and Cardie, Claire. Learning with compositional semantics as structural inference for subsentential sentiment analysis. In Proceedings of EMNLP, pp. 793-801, Honolulu, Hawaii, 2008.
4. Eck, Douglas and Schmidhuber, Juergen. Finding temporal structure in music: Blues improvisation with lstm recurrent networks. In Proceedings of IEEE Workshop on Neural Networks for Signal Processing, pp. 747-756. IEEE, 2002a.
5. Eck, Douglas and Schmidhuber, Juergen. Learning the long-term structure of the blues. In Proceedings of ICANN, pp. 284-289, 2002b.
6. Goller, Christoph and Kuchler, Andreas. Learning task-dependent distributed representations by backpropagation through structure. In Proceedings of ICNN, pp. 347-352, Bochum, Germany, 1996.
7. Graves, Alex. Supervised sequence labelling with recurrent neural networks. PhD thesis, Technische Universitat Munchen, 2008.
8. Graves, Alex, Mohamed, Abdel-rahman, and Hinton, Geoffrey E. Speech recognition with deep recurrent neural networks. CoRR, abs/1303.5778, 2013.
9. Guo, Hongyu, Zhu, Xiaodan, and Min, Renqiang. A Deep Learning Model for Structured Outputs with High-order Interaction. In Proceedings of NIPS Workshop on Representation and Learning Methods for Complex Outputs, 2014.
10. Hammer, Barbara, Micheli, Alessio, Sperduti, Alessandro, and Strickert, Marc. A general framework for unsupervised processing of structured data. Neurocomputing, 57, 2004.
11. Hermann, Karl Moritz and Blunsom, Phil. The Role of Syntax in Vector Space Models of Compositional Semantics. In Proceedings of ACL, pp. 894-904, Sofia, Bulgaria, August 2013.
12. Hochreiter, S. and Schmidhuber, J. Long short-term memory. Neural Computation, (8): 1735-1780, 1997.
13. Irsoy, Ozan and Cardie, Claire. Deep recursive neural networks for compositionality in language. In Proceedings of NIPS, pp. 2096-2104. 2014.
14. Kalchbrenner, Nal, Grefenstette, Edward, and Blunsom, Phil. A convolutional neural network for modelling sentences. Proceedings of ACL, June 2014.
15. Kiritchenko, Svetlana, Zhu, Xiaodan, and Mohammad, Saif. NRC-Canada-2014: Detecting Aspects and Sentiment in Customer Reviews. In Proceedings of the International Workshop on Semantic Evaluation, 2014.
16. Klein, Dan and Manning, Christopher D. Accurate unlex-icalized parsing. In Proceedings of ACL, pp. 423-430, Sapporo, Japan, 2003.
17. Le, Phong and Zuidema, Willem. Compositional Distributional Semantics with Long Short Term Memory. In Proceedings of Joint Conference on Lexical and Computational Semantics (to appear), 2015.
18. Liu, Bing and Zhang, Lei. A survey of opinion mining and sentiment analysis. In Mining Text Data, pp. 415-463. 2012.
19. Liwicki, Marcus, Graves, Alex, Bunke, Horst, and Schmid-huber, Juergen. A novel approach to on-line handwriting recognition based on bidirectional long short-term memory networks. In Proceedings of ICDAR, 2007.
20. Manning, Christopher D. and Schutze, Hinrich. Foundations of Statistical Natural Language Processing. MIT Press, Cambridge, MA, USA, 1999. ISBN 0-262-13360-1.
21. Mohammad, Saif M., Kiritchenko, Svetlana, and Martin, Joel. Identifying purpose behind electoral tweets. In Proceedings of the 2nd International Workshop on Issues of Sentiment Discovery and Opinion Mining, pp. 1-9, 2013.
22. Moilanen, Karo and Pulman, Stephen. Sentiment composition. In Proceedings of RAN LP, Borovets, Bulgaria, 2007.
23. Pang, Bo and Lee, Lillian. Seeing stars: Exploiting class relationships for sentiment categorization with respect to rating scales. In Proceedings of ACL, pp. 115-124, 2005.
24. Pang, Bo and Lee, Lillian. Opinion mining and sentiment analysis. Foundations and Trends in Information Retrieval, 2(1-2):1-135, 2008.
25. Pennington, Jeffrey, Socher, Richard, and Manning, Christopher. Glove: Global vectors for word representation. In Proceedings of EMNLP, August 2013.
26. Pinheiro, P. H. O. and Collobert, R. Recurrent convolutional neural networks for scene labeling. In Proceedings of ICML, 2014.
27. Socher, Richard, Lin, Cliff C., Ng, Andrew Y., and Manning, Christopher D. Parsing Natural Scenes and Natural Language with Recursive Neural Networks. In Proceedings of ICML, 2011.
28. Socher, Richard, Huval, Brody, Manning, Christopher D., and Ng, Andrew Y. Semantic compositionality through recursive matrix-vector spaces. In Proceedings of EMNLP, 2012.
29. Socher, Richard, Perelygin, Alex, Wu, Jean Y., Chuang, Jason, Manning, Christopher D., Ng, Andrew Y., and Potts, Christopher. Recursive deep models for semantic compositionality over a sentiment treebank. In Proceedings of EMNLP, 2013.
30. Starzyk, Janusz A. and He, Haibo. Anticipation-based temporal sequences learning in hierarchical structure. IEEE Transactions on Neural Networks, 18(2), 2007.
31. Sutskever, Ilya, Vinyals, Oriol, and Le, Quoc V. Sequence to sequence learning with neural networks. CoRR, abs/1409.3215, 2014.
32. Tai, Kai Sheng, Socher, Richard, and Manning, Christopher. Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks. In Proceedings of ACL (to appear), 2015.
33. Vinyals, Oriol, Toshev, Alexander, Bengio, Samy, and Er-han, Dumitru. Show and tell: A neural image caption generator. CoRR, abs/1411.4555, 2014.
34. Wilson, Theresa, Wiebe, Janyce, and Hoffmann, Paul. Recognizing contextual polarity in phrase-level sentiment analysis. In Proceedings of EMNLP, Vancouver, Canada, 2005.
35. Zhu, Xiaodan, Guo, Hongyu, Mohammad, Saif, and Kiritchenko Svetlana. An empirical study on the effect of negation words on sentiment. In Proceedings of ACL, Baltimore, Maryland, USA, June 2014a.
36. Zhu, Xiaodan, Kiritchenko, Svetlana, and Mohammad, Saif. NRC-Canada-2014: Recent Improvements in the Sentiment Analysis of Tweets. In Proceedings of the International Workshop on Semantic Evaluation, 2014b.