Automatic image dataset construction from click-Through logs using deep neural network

MM 2015 - Proceedings of the 2015 ACM Multimedia Conference

Volumn , Issue , 2015, Pages 441-450

  Bai, Yalong ^a   Yang, Kuiyuan ^b   Yu, Wei ^a   Xu, Chang ^c   Ma, Wei Ying ^b   Zhao, Tiejun ^a  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

^b MICROSOFT RESEARCH   (United States)

^c NANKAI UNIVERSITY   (China)

Author keywords

Automatic Image Dataset Construction; Deep Learning; Image Representa Tion; Word Representation

Indexed keywords

CONVOLUTION; NEURAL NETWORKS;

APPLICATION SCENARIO; CONVOLUTIONAL NEURAL NETWORK; DEEP LEARNING; IMAGE DATASETS; IMAGE REPRESENTA-TION; IMAGE REPRESENTATIONS; WORD REPRESENTATIONS; WORD-WORD SIMILARITIES;

QUERY PROCESSING;

EID: 84962821266     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2733373.2806243     Document Type: Conference Paper

References (31)

1. Y. Bai, W. Yu, T. Xiao, C. Xu, K. Yang, W.-Y. Ma, and T. Zhao. Bag-of-words based deep neural network for image retrieval. In Proceedings of the ACM International Conference on Multimedia, pages 229-232. ACM, 2014.
2. D. Borth, R. Ji, T. Chen, T. Breuel, and S.-F. Chang. Large-scale visual sentiment ontology and detectors using adjective noun pairs. In Proceedings of the 21st ACM international conference on Multimedia, pages 223-232. ACM, 2013.
3. X. Chen, A. Shrivastava, and A. Gupta. Neil: Extracting visual knowledge from web data. In Computer Vision (ICCV), 2013 IEEE International Conference on, pages 1409-1416. IEEE, 2013.
4. T.-S. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y.-T. Zheng. NUS-WIDE: A Real-World Web Image Database from National University of Singapore. In CIVR, Santorini, Greece., 2009.
5. B. Collins, J. Deng, K. Li, and L. Fei-Fei. Towards scalable dataset construction: An active learning approach. In ECCV. 2008.
6. R. Collobert and J. Weston. A unified architecture for natural language processing: Deep neural networks with multitask learning. In ICML, 2008.
7. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. Imagenet: A large-scale hierarchical image database. In CVPR, 2009.
8. S. K. Divvala, A. Farhadi, and C. Guestrin. Learning everything about anything: Webly-supervised visual concept learning. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 3270-3277. IEEE, 2014.
9. M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman. The PASCAL Visual Object Classes Challenge 2007 (VOC2007) Results.
10. L. Fei-Fei, R. Fergus, and P. Perona. One-shot learning of object categories. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 28(4):594-611, 2006.
11. A. Frome, G. S. Corrado, J. Shlens, S. Bengio, J. Dean, T. Mikolov, et al. Devise: A deep visual-semantic embedding model. In Advances in Neural Information Processing Systems, pages 2121-2129, 2013.
12. G. Grifin, A. Holub, and P. Perona. Caltech-256 object category dataset. 2007.
13. X.-S. Hua and J. Li. Prajna: Towards recognizing whatever you want from images without image labeling. AAAI-Association for the Advancement of Artificial Intelligence, January 2015.
14. X.-S. Hua, L. Yang, J. Wang, J. Wang, M. Ye, K. Wang, Y. Rui, and J. Li. Clickage: Towards bridging semantic and intent gaps via mining click logs of search engines. In ACM Multimedia, 2013.
15. A. Krizhevsky. cuda-convnet2, 2014. http://code.google.com/p/cuda-convnet2/.
16. A. Krizhevsky and G. Hinton. Learning multiple layers of features from tiny images. Computer Science Department, University of Toronto, Tech. Rep, 2009.
17. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In NIPS, 2012.
18. L.-J. Li and L. Fei-Fei. Optimol: Automatic online picture collection via incremental model learning. International journal of computer vision, 88(2):147-168, 2010.
19. G. A. Miller. WordNet: A lexical database for English. Communications of the ACM, 38(11):39-41, 1995.
20. J. Pennington, R. Socher, and C. D. Manning. Glove: Global vectors for word representation. Proceedings of the Empiricial Methods in Natural Language Processing (EMNLP 2014), 12, 2014.
21. B. C. Russell, A. Torralba, K. P. Murphy, and W. T. Freeman. Labelme: A database and web-based tool for image annotation. IJCV, 77(1-3):157-173, 2008.
22. A. Shrivastava, S. Singh, and A. Gupta. Constrained semi-supervised learning using attributes and comparative attributes. In ECCV, pages 369-383. 2012.
23. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014.
24. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper with convolutions. arXiv preprint arXiv:1409.4842, 2014.
25. A. Torralba and A. A. Efros. Unbiased look at dataset bias. In CVPR, 2011.
26. A. Torralba, R. Fergus, and W. T. Freeman. 80 million tiny images: A large data set for nonparametric object and scene recognition. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 30(11):1958-1970, 2008.
27. L. Van der Maaten and G. Hinton. Visualizing data using t-sne. Journal of Machine Learning Research, 9(2579-2605):85, 2008.
28. J. Weston, S. Bengio, and N. Usunier. Wsabie: Scaling up to large vocabulary image annotation. In IJCAI, volume 11, pages 2764-2770, 2011.
29. J. Xiao, J. Hays, K. A. Ehinger, A. Oliva, and A. Torralba. SUN database: large-scale scene recognition from abbey to zoo. In CVPR, 2010.
30. W. Yu, K. Yang, Y. Bai, H. Yao, and Y. Rui. Visualizing and comparing convolutional neural networks. arXiv preprint arXiv:1412.6631, 2014.
31. M. D. Zeiler and R. Fergus. Visualizing and understanding convolutional networks. In ECCV. 2014.