Hierarchical recurrent neural network for document modeling

Conference Proceedings - EMNLP 2015: Conference on Empirical Methods in Natural Language Processing

Volumn , Issue , 2015, Pages 899-907

  Lint, Rui ^a   Liu, Shujie ^b   Yang, Muyun ^a   Li, Mu ^b   Zhou, Ming ^b   Li, Sheng ^a  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

^b MICROSOFT RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS; RECURRENT NEURAL NETWORKS; TRANSLATION (LANGUAGES);

CONTEXTUAL INFORMATION; DOCUMENT MODEL; DOCUMENT TRANSLATION; HISTORY INFORMATIONS; LANGUAGE MODEL; RE-RANKING; SENTENCE LEVEL; TWO-STEP TRAINING;

MODELING LANGUAGES;

EID: 84959935599     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (25)

1. Regina Barzilay and Mirella Lapata. 2008. Modeling local coherence: An entity-based approach. Computational Linguistics, 34(1):1-34.
2. Yoshua Bengio, Rejean Ducharme, Pascal Vincent, and Christian Janvin. 2003. A neural probabilistic language model. The Journal of Machine Learning Research, 3:1137-1155.
3. th Conference of the European Association for Machine Translation (EAMT), pages 261-268, Trento, Italy, May.
4. Kyunghyun Cho, Bart Van Merrienboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Fearning phrase representations using rnn encoder-decoder for statistical machine translation, pages 1724-1734, October.
5. Ronan Collobert, Jason Weston, Feon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural language processing (almost) from scratch. The Journal of Machine Learning Research, 12:2493-2537.
6. George E Dahl, Dong Yu, Fi Deng, and Alex Acero. 2012. Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition. Audio, Speech, and Language Processing, IEEE Transactions on, 20(1):30-42.
7. Geoffrey Hinton, Simon Osindero, and Yee-Whye Feh. 2006. A fast learning algorithm for deep belief nets. Neural computation, 18(7):1527-1554.
8. Michael I Jordan. 1997. Serial order: A parallel distributed processing approach. Advances in psychology, 121:471-495.
9. Koray Kavukcuoglu, Pierre Sermanet, Y-Lan Boureau, Karol Gregor, Michael Mathieu, and Yann L Cun. 2010. Learning convolutional feature hierarchies for visual recognition. In Advances in neural information processing systems, pages 1090-1098.
10. Quoc Le and Tomas Mikolov. 2014. Distributed representations of sentences and documents, pages 1188-1196.
11. Jiwei Li and Eduard Hovy. 2014. A model of coherence based on distributed sentence representation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 2039-2048. Association for Computational Linguistics.
12. Shujie Liu, Nan Yang, Mu Li, and Ming Zhou. 2014. A recursive recurrent neural network for statistical machine translation. In Proceedings of ACL, pages 1491-1500.
13. Matthew V Mahoney. 2000. Fast text compression with neural networks. In FLAIRS Conference, pages 230-234.
14. Tomas Mikolov and Geoffrey Zweig. 2012. Context dependent recurrent neural network language model. In Spoken Language Technology Workshop, IEEE, pages 234-239.
15. Tomas Mikolov, Martin Karafiat, Lukas Burget, Jan Cernocky, and Sanjeev Khudanpur. 2010. Recurrent neural network based language model. In INTERSPEECH 2010, 11th Annual Conference of the International Speech Communication Association, Makuhari, Chiba, Japan, September 26-30, 2010, pages 1045-1048.
16. Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. CoRR, abs/1301.3781.
17. Tomas Mikolov. 2012. Statistical language models based on neural networks. Ph. D. thesis, Ph. D. thesis, Brno University of Technology.
18. Franz Josef Och. 2003. Minimum error rate training in statistical machine translation. In Proceedings of the 41st Annual Meeting on Association for Computational Linguistics-Volume 1, pages 160-167. Association for Computational Linguistics.
19. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. Bleu: a method for automatic evaluation of machine translation. In Proceedings of the 40th annual meeting on association for computational linguistics, pages 311-318. Association for Computational Linguistics.
20. Richard Socher, Alex Perelygin, Jean Y Wu, Jason Chuang, Christopher D Manning, Andrew Y Ng, and Christopher Potts. 2013. Recursive deep models for semantic compositionality over a sentiment treebank. In Proceedings of the conference on empirical methods in natural language processing (EMNLP), volume 1631, page 1642. Citeseer.
21. Ilya Sutskever, James Martens, and Geoffrey E Hinton. 2011. Generating text with recurrent neural networks. In Proceedings of the 28th International Conference on Machine Learning (ICML-11), pages 1017-1024.
22. Dekai Wu. 1997. Stochastic inversion transduction grammars and bilingual parsing of parallel corpora. Computational linguistics, 23(3):377-403.
23. Deyi Xiong, Qun Liu, and Shouxun Lin. 2006. Maximum entropy based phrase reordering model for statistical machine translation. In Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Associationfor Computational Linguistics, pages 521-528. Association for Computational Linguistics.
24. Puyang Xu and Ruhi Sarikaya. 2014. Contextual domain classification in spoken language understanding systems using recurrent neural network. In A-coustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on, pages 136-140. IEEE.
25. Nan Yang, Shujie Liu, Mu Li, Ming Zhou, and Nenghai Yu. 2013. Word alignment modeling with context dependent deep neural network. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 166-175, Sofia, Bulgaria, August. Association for Computational Linguistics.