Deep classifiers from image tags in the wild

MMCommons 2015 - Proceedings of the 2015 Workshop on Community-Organized Multimodal Mining: Opportunities for Novel Solutions, co-located with ACM MM 2015

Volumn , Issue , 2015, Pages 13-18

  Izadinia, Hamid ^a   Russell, Bryan C ^b   Farhadi, Ali ^a   D Hoffman, Matthew ^b   Hertzmann, Aaron ^b  

^a UNIVERSITY OF WASHINGTON   (United States)

^b ADOBE RESEARCH   (United States)

Author keywords

Deep Learning; Image Retrieval; Image Tag Suggestion; Large scale Robust Classification; Tags in the Wild

Indexed keywords

IMAGE RETRIEVAL;

CALIBRATION PROCEDURE; DEEP LEARNING; IMAGE DATASETS; LARGE DATABASE; MANUAL ANNOTATION; ROBUST CLASSIFICATION; TAG SUGGESTIONS; TAGS IN THE WILD;

IMAGE CLASSIFICATION;

EID: 84958611219     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2814815.2814821     Document Type: Conference Paper

References (31)

1. M. Ames and M. Naaman. Why we tag: Motivations for annotation in mobile and online media. In Proc. CHI, 2007.
2. A. C. Berg, T. L. Berg, H. Daumé III, J. Dodge, A. Goyal, X. Han, A. Mensch, M. Mitchell, A. Sood, K. Stratos, and K. Yamaguchi. Understanding and predicting importance in images. In Proc. CVPR, 2012.
3. O. Cappe and E. Moulines. On-line expectation-maximization algorithm for latent data models. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 71(3):593-613, 2009.
4. T.-S. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y. Zheng. NUS-WIDE: a real-world web image database from National University of Singapore. In Proc. CIVR, 2009.
5. P. Duygulu, K. Barnard, N. D. Freitas, and D. a. Forsyth. Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary. In Proc. ECCV, 2002.
6. Y. Gong, Y. Jia, T. K. Leung, A. Toshev, and S. Ioffe. Deep convolutional ranking for multilabel image annotation. In Proc. ICLR, 2014.
7. Y. Gong, L. Wang, M. Hodosh, J. Hockenmaier, and S. Lazebnik. Improving image-sentence embeddings using large weakly annotated photo collections. In Proc. ECCV, 2014.
8. M. Guillaumin, T. Mensink, J. Verbeek, and C. Schmid. Tagprop: Discriminative metric learning in nearest neighbor models for image auto-annotation. In Proc. ICCV, 2009.
9. J. Hoffman, E. Rodner, J. Donahue, K. Saenko, and T. Darrell. Efficient learning of domain-invariant image representations. In Proc. ICLR, 2013.
10. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding, 2014. http://arxiv.org/abs/1408.5093.
11. S. Karayev, M. Trentacoste, H. Han, A. Agarwala, T. Darrell, A. Hertzmann, and H. Winnemoeller. Recognizing image style. In Proc. BMVC, 2014.
12. A. Krizhevsky, I. Sutskever, and G. E. Hinton. ImageNet Classification with Deep Convolutional Neural Networks. In NIPS, 2012.
13. X. Li and C. G. M. Snoek. Classifying tag relevance with relevant positive and negative examples. In Proc. MM, 2013.
14. X. Li, T. Uricchio, L. Ballan, M. Bertini, C. G. M. Snoek, and A. del Bimbo. Socializing the semantic gap: A comparative study on image tag assignment, refinement and retreival, 2015. http://arxiv.org/abs/1503.08248.
15. A. Makadia, V. Pavlovic, and S. Kumar. A new baseline for image annotation. In Proc. ECCV, 2008.
16. G. A. Miller. Wordnet: A lexical database for english. Commun. ACM, 38(11), 1995.
17. S. Moran and V. Lavrenko. A sparse kernel relevance model for automatic image annotation. Int J Multimed. Info Retr, 3(4), 2014.
18. N. Murray, D. Barcelona, L. Marchesotti, and F. Perronnin. AVA: A Large-Scale Database for Aesthetic Visual Analysis. In CVPR, 2012.
19. N. Natarajan, I. S. Dhillon, P. Ravikumar, and A. Tewari. Learning with noisy labels. In Proc. NIPS, 2013.
20. O. Nov, M. Naaman, and C. Ye. What drives content tagging: The case of photos on flickr. In Proc. CHI, 2008.
21. V. Ordonez, J. Deng, Y. Choi, A. C. Berg, and T. L. Berg. From large scale image categorization to entry-level categories. In Proc. ICCV, 2013.
22. G. Patterson, C. Xu, H. Su, and J. Hays. The sun attribute database: Beyond categories for deeper scene understanding. IJCV, 108:59-81, 2014.
23. V. C. Raykar, S. Y, L. H. Zhao, G. H. Valadez, C. Florin, L. Bogoni, and L. Moy. Learning from crowds. JMLR, 11:1297-1322, 2010.
24. S. E. Reed, H. Lee, D. Anguelov, C. Szegedy, D. Erhan, and A. Rabinovich. Training deep neural networks on noisy labels with bootstrapping. In Proc. ICLR, 2015.
25. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, and L. Fei-Fei. Imagenet large scale visual recognition challenge, 2014. http://arxiv.org/abs/1409.0575.
26. K. Saenko and T. Darrell. Unsupervised learning of visual sense models for polysemous words. In Proc. NIPS, 2008.
27. W. J. Scheirer, N. Kumar, P. N. Belhumeur, and T. E. Boult. Multi-attribute spaces: Calibration for attribute fusion and similarity search. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2012.
28. S. Sukhbaatar, J. Bruna, M. Paluri, L. Bourdev, and R. Fergus. Training convolution networks with noisy labels. In Proc. ICLR, 2015.
29. L. von Ahn and L. Dabbish. Labeling images with a computer game. In Proc. CHI, 2004.
30. J. Xiao, J. Hays, K. Ehinger, A. Oliva, and A. Torralba. Sun database: Large-scale scene recognition from abbey to zoo. In Proc. CVPR, 2010.
31. B. Zhou, A. Lapedriza, J. Xiao, A. Torralba, and A. Oliva. Learning Deep Features for Scene Recognition using Places Database. In Proc. NIPS, 2014.