Pre-trained multi-view Word embedding using two-side neural network

Proceedings of the National Conference on Artificial Intelligence

Volumn 3, Issue , 2014, Pages 1982-1988

  Luo, Yong ^a,b   Tang, Jian ^a   Yan, Jun ^b   Xu, Chao ^a   Chen, Zheng ^b  

^a PEKING UNIVERSITY   (China)

^b MICROSOFT RESEARCH ASIA   (China)

Author keywords

[No Author keywords available]

Indexed keywords

MULTI-VIEWS;

EID: 84908205795     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. Bengio, Y.; Ducharme, R.; Vincent, P.; and Jauvin, C. 2003. A neural probabilistic language model. Journal of Machine Learning Research 3:1137-1155.
2. Bengio, Y.; Courville, A.; and Vincent, P. 2013. Representation learning: A review and new perspectives. IEEE Transactions on Pattern Analysis and Machine Intelligence 35(8):1798-1828.
3. Bengio, Y 2009. Learning deep architectures for ai. Foundations and trends in Machine Learning 2(1):1-127.
4. Brown, P. F.; Desouza, P. V.; Mercer, R. L.; Pietra, V. J. D.; and Lai, J. C. 1992. Class-based n-gram models of natural language. Computational Linguistics 18(4):467-479.
5. Collobert, R., and Weston, J. 2008. A unified architecture for natural language processing: Deep neural networks with multitask learning. In International Conference on Machine Learning, 160-167.
6. Collobert, R.; Weston, J.; Bottou, L.; Karlen, M.; Kavukcuoglu, K.; and Kuksa, P. 2011. Natural language processing (almost) from scratch. The Journal of Machine Learning Research 12:2493-2537.
7. Dhillon, P.; Foster, D. P.; and Ungar, L. H. 2011. Multi-view learning of word embeddings via cca. In Advances in Neural Information Processing Systems, 199-207.
8. Dumais, S. T.; Furnas, G. W.; Landauer, T. K.; Deerwester, S.; and Harshman, R. 1988. Using latent semantic analysis to improve access to textual information. In SIGCHI conference on Human factors in computing systems, 281-285.
9. Finkelstein, L.; Gabrilovich, E.; Matias, Y.; Rivlin, E.; Solan, Z.; Wolfman, G.; and Ruppin, E. 2002. Placing search in context: The concept revisited. ACM Transactions on Information Systems 20(1):116-131.
10. Gabrilovich, E., and Markovitch, S. 2007. Computing semantic relatedness using wikipedia-based explicit semantic analysis. In International Joint Conference on Artificial Intelligence, 1606-1611.
11. Huang, P.-S.; He, X.; Gao, J.; Deng, L.; Acero, A.; and Heck, L. 2013. Learning deep structured semantic models for web search using clickthrough data. In ACM international conference on Conference on Information & Knowledge Management, 2333-2338.
12. Jarvelin, K., and Kekalainen, J. 2000. Ir evaluation methods for retrieving highly relevant documents. In ACM SIGIR conference on Research and development in information retrieval, 41-8.
13. Krasnopolsky, V. M., and Lin, Y 2012. A neural network nonlinear multimodel ensemble to improve precipitation forecasts over continental us. Advances in Meteorology 2012 (doi: 10.1155/2012/649450).
14. Kung, S.-Y., and Hwang, J.-N. 1998. Neural networks for intelligent multimedia processing. Proceedings of the IEEE 86(6):1244-1272.
15. Lin, D., and Wu, X. 2009. Phrase clustering for discriminative learning. In Joint Conference of the Annual Meeting of the ACL and the International Joint Conference on Natural Language Processing, 1030-1038.
16. Luo, Y.; Tao, D.; Xu, C.; Li, D.; and Xu, C. 2013a. Vectorvalued multi-view semi-supervised learning for multi-label image classification. In AAAI Conference on Artificial Intelligence, 647-653.
17. Luo, Y.; Tao, D.; Xu, C.; Liu, H.; and Wen, Y 2013b. Multiview vector-valued manifold regularization for multilabel image classification. IEEE Transactions on Neural Networks and Learning Systems 24(5):709-722.
18. Mikolov, T.; Chen, K.; Corrado, G.; and Dean, J. 2013a. Efficient estimation of word representations in vector space. In ICLR Workshop.
19. Mikolov, T.; Sutskever, I.; Chen, K.; Corrado, G. S.; and Dean, J. 2013b. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems, 3111-3119.
20. Mnih, A., and Hinton, G. 2007. Three new graphical models for statistical language modelling. In International Conference on Machine Learning, 641-648.
21. Mnih, A., and Hinton, G. E. 2008. A scalable hierarchical distributed language model. In Advances in Neural Information Processing Systems, 1081-1088.
22. Montavon, G.; Orr, G. B.; and Muller, K.-R. 2012. Neural networks: tricks of the trade (2nd edition). Springer.
23. Ngiam, J.; Khosla, A.; Kim, M.; Nam, J.; Lee, H.; and Ng, A. 2011. Multimodal deep learning. In International Conference on Machine Learning, 689-696.
24. Srivastava, N., and Salakhutdinov, R. 2012. Multimodal learning with deep boltzmann machines. In Advances in Neural Information Processing Systems, 2231-2239.
25. Strube, M., and Ponzetto, S. P. 2006. Wikirelate! computing semantic relatedness using wikipedia. In AAAI Conference on Artificial Intelligence, 1419-1424.
26. Turian, J.; Ratinov, L.; and Bengio, Y 2010. Word representations: a simple and general method for semi-supervised learning. In Annual Meeting of the Association for Computational Linguistics, 384-394.