A novel neural topic model and its supervised extension

Proceedings of the National Conference on Artificial Intelligence

Volumn 3, Issue , 2015, Pages 2210-2216

  Cao, Ziqiang ^a   Li, Sujian ^a   Liu, Yang ^a   Li, Wenjie ^b   Ji, Heng ^c  

^a BEIJING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

^b HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

^c RENSSELAER POLYTECHNIC INSTITUTE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; LEARNING ALGORITHMS; LEARNING SYSTEMS;

DEEP LEARNING; PROBABILISTIC FRAMEWORK; TOPIC DISCOVERY; TOPIC DISTRIBUTIONS; TOPIC MODELING; UNIFORM FRAMEWORK;

DATA MINING;

EID: 84959877831     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. Bengio, Y.; Ducharme, R.; Vincent, R; and Jauvin, C. 2003. A neural probabilistic language model. Journal of Machine Learning Research 3:1137-1155.
2. Bengio, Y; Lamblin, R; Popovici, D.; and Larochelle, H. 2007. Greedy layer-wise training of deep networks. Advances in neural information processing systems 19:153.
3. Blei, D. M.; Ng, A. Y; and Jordan, M. I. 2003. Latent dirichlet allocation. J. Mach. Learn, Res. 3:993-1022.
4. Collobert, R., and Weston. J. 2008. A unified architecture for natural language processing: Deep neural networks with multitask learning. In Proceedings of the 25th international conference on Machine learning, 160-167.
5. Collobert, R.; Weston, J.; Bottou, L.; Karlen, M.; Kavukcuoglu, K.; and Kuksa, P. 2011. Natural language processing (almost) from scratch. The Journal of Machine Learning Research 12:2493-2537.
6. Hinton, G. E., and Salakhutdinov, R. 2009. Replicated soft-max: an undirected topic model. In Advances in neural information processing systems, 1607-1614.
7. Hofmann, T. 1999. Probabilistic latent semantic indexing. In Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, 50-57.
8. Huang, E. H.; Socher, R.; Manning, C. D.; and Ng, A. Y. 2012. Improving word representations via global context and multiple word prototypes. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, 873-882.
9. Huang, P.-S.; He, X.; Gao, J.; Deng, L.; Acero, A.; and Heck, L. 2013. Learning deep structured semantic models for web search using clickthrough data. In Proceedings of the 22nd ACM international conference on Conference on information & knowledge management, 2333-2338.
10. Keller, M., and Bengio, S. 2005. A neural network for text representation. In Artificial Neural Networks: Formal Models and Their Applications-ICANN 2005. 667-672.
11. Lacoste-Julien, S.; Sha, F.; and Jordan, M. I. 2009. Dis-clda: Discriminative learning for dimensionality reduction and classification. In Advances in neural information processing systems, 897-904.
12. Larochelle, H., and Lauly, S. 2012. A neural autoregressive topic model. In Advances in Neural Information Processing Systems, 2111-2125.
13. Lewis, D. D.; Yang, Y; Rose, T. G.; and Li, F. 2004. Rev 1 : A new benchmark collection for text categorization research. The Journal of Machine Learning Research 5:361-397.
14. Mcauliffe, J. D., and Blei, D. M. 2007. Supervised topic models. In Advances in Neural Information Processing Systems, 121-128.
15. Mikolov, T.; Chen, K.; Corrado, G.; and Dean, J. 2013. Efficient estimation of word representations in vector space. arXiv preprint arXiv:!301.3781.
16. Mnih, A., and Hinton, G. 2007. Three new graphical models for statistical language modelling. In Proceedings of the 24th international conference on Machine learning, 641-648.
17. Pang, B., and Lee, L. 2005. Seeing stars: Exploiting class relationships for sentiment categorization with respect to rating scales. In Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics, 115-124.
18. Ramage, D.; Hall, D.; Nallapati, R.; and Manning, C. D. 2009. Labeled Ida: A supervised topic model for credit attribution in multi-labeled corpora. In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, 248-256.
19. Ranzato, M., and Szummer, M. 2008. Semi-supervised learning of compact document representations with deep networks. In Proceedings of the 25th international conference on Machine learning, 792-799.
20. Srivastava, N.; Salakhutdinov, R. R.; and Hinton, G. E. 2013. Modeling documents with deep boltzmann machines. arXiv preprint arXiv:1309.6865.
21. Wang, C; Blei, D.; and Li, F.-F. 2009. Simultaneous image classification and annotation. In IEEE Conference on Computer Vision and Pattern Recognition 2009., 1903-1910.
22. Zhu, J.; Ahmed, A.; and Xing, E. P. 2009. Medida: maximum margin supervised topic models for regression and classification. In Proceedings of the 26th Annual International Conference on Machine Learning.
23. Zubiaga, A. 2012. Enhancing navigation on wikipedia with social tags. arXiv preprint arXiv: 1202.5469.