Start from scratch: Towards automatically identifying, modeling, and naming visual attributes

MM 2014 - Proceedings of the 2014 ACM Conference on Multimedia

Volumn , Issue , 2014, Pages 187-196

  Zhang, Hanwang ^a   Yang, Yang ^b   Luan, Huanbo ^a,c   Yan, Shuicheng ^a   Chua, Tat Seng ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b UNIVERSITY OF ELECTRONIC SCIENCE AND TECHNOLOGY OF CHINA   (China)

^c TSINGHUA UNIVERSITY   (China)

Author keywords

Attribute discovery; Deep learning; Multimodal analysis

Indexed keywords

IMAGE CODING; ITERATIVE METHODS; KNOWLEDGE BASED SYSTEMS; MODAL ANALYSIS; SEMANTICS;

ATTRIBUTE DISCOVERY; DEEP ARCHITECTURES; INDEPENDENT COMPONENTS; MULTIMEDIA APPLICATIONS; MULTIMODAL ANALYSIS; STATE-OF-THE-ART APPROACH; VISUAL ATTRIBUTES; VISUAL KNOWLEDGE;

DEEP LEARNING;

EID: 84913592052     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2647868.2654915     Document Type: Conference Paper

References (41)

1. G. Andrew, R. Arora, J. Bilmes, and K. Livescu. Deep canonical correlation analysis. In ICML, 2013.
2. Y. Bengio. Learning deep architectures for ai. Foundations and Trends in Machine Learning, 2009.
3. T. L. Berg, A. C. Berg, and J. Shih. Automatic attribute discovery and characterization from noisy web data. In ECCV, 2010.
4. A. Bergamo, L. Torresani, and A. W. Fitzgibbon. Picodes: Learning a compact code for novel-category recognition. In NIPS, 2011.
5. P. Blunsom, E. Grefenstette, N. Kalchbrenner, et al. A convolutional neural network for modelling sentences. In ACL, 2014.
6. X. Chen, A. Shrivastava, and A. Gupta. Neil: Extracting visual knowledge from web data. In ICCV, 2013.
7. T.-S. Chua, H. Luan, M. Sun, and S. Yang. Next: Nus-tsinghua center for extreme search of user-generated content. Multi Media, 2012.
8. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. Imagenet: A large-scale hierarchical image database. In CVPR, 2009.
9. L. Deng, J. Li, J.-T. Huang, K. Yao, D. Yu, F. Seide, M. Seltzer, G. Zweig, X. He, J. Williams, et al. Recent advances in deep learning for speech research at microsoft. In ICASSP, 2013.
10. J. Donahue, Y. Jia, O. Vinyals, J. Hoffman, N. Zhang, E. Tzeng, and T. Darrell. Decaf: A deep convolutional activation feature for generic visual recognition. arXiv preprint arXiv:1310.1531, 2013.
11. J. Dong, B. Cheng, X. Chen, T.-S. Chua, S. Yan, and X. Zhou. Robust image annotation via simultaneous feature and sample outlier pursuit. TOMCCAP, 2013.
12. A. Farhadi, I. Endres, D. Hoiem, and D. Forsyth. Describing objects by their attributes. In CVPR, 2009.
13. B. J. Frey and D. Dueck. Clustering by passing messages between data points. Science, 2007.
14. G. E. Hinton and R. R. Salakhutdinov. Reducing the dimensionality of data with neural networks. Science, 2006.
15. A. Hyvúrinen, J. Karhunen, and E. Oja. Independent component analysis, volume 46. John Wiley & Sons, 2004.
16. J.-W. Jeong, X.-J. Wang, and D.-H. Lee. Towards measuring the visualness of a concept. In CIKM, 2012.
17. P. Kankuekul, A. Kawewong, S. Tangruamsub, and O. Hasegawa. Online incremental attribute-based zero-shot learning. In CVPR, 2012.
18. Q. V. Le, A. Karpenko, J. Ngiam, and A. Y. Ng. Ica with reconstruction cost for efficient overcomplete feature learning. In NIPS, 2011.
19. L.-J. Li and L. Fei-Fei. Optimol: automatic online picture collection via incremental model learning. IJCV, 2010.
20. Q. Li, J. Wu, and Z. Tu. Harvesting mid-level visual concepts from large-scale internet images. In CVPR, 2013.
21. T. Mikolov, K. Chen, G. Corrado, and J. Dean. Efficient estimation of word representations in vector space. In ICLR, 2013.
22. Y.-I. Moon, B. Rajagopalan, and U. Lall. Estimation of mutual information using kernel density estimators. Physical Review E, 1995.
23. G. L. Murphy. The big book of concepts. The MIT Press, 2004.
24. M. Naphade, J. R. Smith, J. Tesic, S.-F. Chang, W. Hsu, L. Kennedy, A. Hauptmann, and J. Curtis. Large-scale concept ontology for multimedia. Multi Media, 2006.
25. J. Ngiam, A. Khosla, M. Kim, J. Nam, H. Lee, and A. Y. Ng. Multimodal deep learning. In ICML, 2011.
26. P. Over, G. Awad, M. Michel, J. Fiscus, G. Sanders, B. Shaw, W. Kraaij, A. F. Smeaton, and G. Quleĺęnot. Trecvid 2012 - an overview of the goals, tasks, data, evaluation mechanisms and metrics. In TRECVID, 2012.
27. D. Parikh and K. Grauman. Interactively building a discriminative vocabulary of nameable attributes. In CVPR, 2011.
28. P. Perona. Vision of a visipedia. Proceedings of the IEEE, 2010.
29. N. Qian. On the momentum term in gradient descent learning algorithms. NN, 1999.
30. M. Rastegari, A. Farhadi, and D. Forsyth. Attribute discovery via predictable discriminative binary codes. In ECCV, 2012.
31. B. Scholkopf and A. Smola. Learning with kernels, 2002.
32. N. Srivastava and R. Salakhutdinov. Multimodal learning with deep boltzmann machines. In NIPS, 2012.
33. B. Thomee and A. Popescu. Overview of the imageclef 2012 flickr photo annotation and retrieval task. In CLEF, 2012.
34. T. Tieleman. Training restricted boltzmann machines using approximations to the likelihood gradient. In ICML, 2008.
35. A. Torralba and A. A. Efros. Unbiased look at dataset bias. In CVPR, 2011.
36. L. Torresani, M. Szummer, and A. Fitzgibbon. Efficient object category recognition using classemes. In ECCV. 2010.
37. J. Wang, K. Markert, and M. Everingham. Learning models for object recognition from natural language descriptions. In BMVC, 2009.
38. M. Wang, R. Hong, X.-T. Yuan, S. Yan, and T.-S. Chua. Movie2comics: Towards a lively video content presentation. TMM, 2012.
39. L. Xie and X. He. Picture tags and world knowledge: Learning tag relations from visual semantic sources. In MM, 2013.
40. H. Zhang, Z.-J. Zha, S. Yan, J. Bian, and T.-S. Chua. Attribute feedback. In MM, 2012.
41. K. Zhang, I. W. Tsang, and J. T. Kwok. Maximum margin clustering made practical. TNN, 2009.