Love thy neighbors: Image annotation by exploiting image metadata

Proceedings of the IEEE International Conference on Computer Vision

Volumn 2015 International Conference on Computer Vision, ICCV 2015, Issue , 2015, Pages 4624-4632

  Johnson, Justin ^a   Ballan, Lamberto ^a   Fei Fei, Li ^a  

^a Stanford University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; IMAGE ANALYSIS;

DEEP NEURAL NETWORKS; IMAGE ANNOTATION; IMAGE METADATAS; MULTI-LABEL; NON-PARAMETRIC; STATE-OF-THE-ART METHODS; TRAINING AND TESTING; VISUAL INFORMATION;

METADATA;

EID: 84973879692     PISSN: 15505499     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCV.2015.525     Document Type: Conference Paper

References (50)

1. L. Ballan, T. Uricchio, L. Seidenari, and A. Del Bimbo. A cross-media model for automatic image annotation. In ICMR, 2014.
2. K. Barnard, P. Duygulu, D. Forsyth, N. De Freitas, D. M. Blei, and M. I. Jordan. Matching words and pictures. JMLR, 3:1107-1135, 2003.
3. A. Bergamo and L. Torresani. Exploiting weakly-labeled web images to improve object classification: A domain adaptation approach. In NIPS, 2010.
4. G. Carneiro, A. B. Chan, P. J. Moreno, and N. Vasconcelos. Supervised learning of semantic classes for image annotation and retrieval. IEEE TPAMI, 29(3):394-410, 2007.
5. L. Chen, D. Xu, I. W. Tsang, and J. Luo. Tag-based web photo retrieval improved by batch mode re-tagging. In CVPR, 2010.
6. X. Chen and A. Gupta. Webly supervised learning of convolutional networks. In ICCV, 2015.
7. X. Chen, A. Shrivastava, and A. Gupta. NEIL: Extracting visual knowledge from web data. In ICCV, 2013.
8. T.-S. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y. Zheng. NUS-WIDE: A realworld web image database from National University of Singapore. In CIVR, 2009.
9. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. ImageNet: A large-scale hierarchical image database. In CVPR, 2009.
10. S. K. Divvala, A. Farhadi, and C. Guestrin. Learning everything about anything: Webly-supervised visual concept learning. In CVPR, 2014.
11. K. Duan, D. Crandall, and D. Batra. Multimodal learning in loosely-organized web images. In CVPR, 2014.
12. C. Fang, H. Jin, J. Yang, and Z. Lin. Collaborative feature learning from social media. In CVPR, 2015.
13. Z. Feng, S. Feng, R. Jin, and A. K. Jain. Image tag completion by noisy matrix recovery. In ECCV, 2014.
14. R. Fergus, L. Fei-Fei, P. Perona, and A. Zisserman. Learning object categories from google's image search. In ICCV, 2005.
15. Y. Gong, Y. Jia, T. K. Leung, A. Toshev, and S. Ioffe. Deep convolutional ranking for multilabel image annotation. In ICLR, 2014.
16. Y. Gong, Q. Ke, M. Isard, and S. Lazebnik. A multi-view embedding space for internet images, tags, and their semantics. IJCV, 106(2):210-233, 2014.
17. D. Grangier and S. Bengio. A discriminative kernel-based approach to rank images from text queries. IEEE TPAMI, 30(8):1371-1384, 2008.
18. M. Guillaumin, T. Mensink, J. Verbeek, and C. Schmid. Tagprop: Discriminative metric learning in nearest neighbor models for image auto-annotation. In ICCV, 2009.
19. M. Guillaumin, J. Verbeek, and C. Schmid. Multimodal semi-supervised learning for image classification. In CVPR, 2010.
20. J. Hays and A. A. Efros. IM2GPS: estimating geographic information from a single image. In CVPR, 2008.
21. K. He, X. Zhang, S. Ren, and J. Sun. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. ArXiv preprint arXiv:1502. 01852, 2015.
22. G. Hinton, N. Srivastava, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov. Improving neural networks by preventing co-adaptation of feature detectors. ArXiv preprint arXiv:1207. 0580, 2012.
23. S. J. Hwang and K. Grauman. Learning the relative importance of objects from tagged images for retrieval and cross-modal search. IJCV, 100(2):134-153, 2012.
24. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. In MM, 2014.
25. M. M. Kalayeh, H. Idrees, and M. Shah. NMF-KNN: Image annotation using weighted multi-view non-negative matrix factorization. In CVPR, 2014.
26. G. Kim, E. P. Xing, and A. Torralba. Modeling and analysis of dynamic behaviors of web image collections. In ECCV, 2010.
27. A. Krizhevsky, I. Sutskever, and G. Hinton. ImageNet classification using deep convolutional neural networks. In NIPS, 2012.
28. N. Kumar and S. Seitz. Photo recall: Using the internet to label your photos. In CVPR Workshops, 2014.
29. T. Lan and G. Mori. A max-margin riffled independence model for image tag ranking. In CVPR, 2013.
30. V. Lavrenko, R. Manmatha, and J. Jeon. A model for learning the semantics of pictures. In NIPS, 2003.
31. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proc. of the IEEE, 86(11):2278-2324, 1998.
32. L.-J. Li and L. Fei-Fei. OPTIMOL: Automatic online picture collection via incremental model learning. IJCV, 88(2):147-168, 2010.
33. X. Li, C. G. M. Snoek, and M. Worring. Learning social tag relevance by neighbor voting. IEEE TMM, 11(7):1310-1322, 2009.
34. X. Li, T. Uricchio, L. Ballan, M. Bertini, C. G. M. Snoek, and A. Del Bimbo. Socializing the semantic gap: A comparative survey on image tag assignment, refinement and retrieval. ArXiv preprint, arXiv:1503. 08248, 2015.
35. Y. Li, D. Crandall, and D. Huttenlocker. Landmark classification in large-scale image collections. In ICCV, 2009.
36. A. Makadia, V. Pavlovic, and S. Kumar. A new baseline for image annotation. In ECCV, 2008.
37. J. McAuley and J. Leskovec. Image labeling on a network: using socialnetwork metadata for image classification. In ECCV, 2012.
38. Z. Niu, G. Hua, X. Gao, and Q. Tian. Semi-supervised relational topic model for weakly annotated image recognition in social media. In CVPR, 2014.
39. K. Simonyan and A. Zisserman. Very deep convolutional networks for largescale image recognition. In ICLR, 2015.
40. N. Srivastava and R. Salakhutdinov. Multimodal learning with deep boltzmann machines. In NIPS, 2012.
41. Z. Stone, T. Zickler, and T. Darrell. Autotagging facebook: Social network context improves photo annotation. In CVPR Workshops, 2008.
42. T. Tieleman and G. Hinton. Lecture 6. 5-rmsprop: Divide the gradient by a running average of its recent magnitude. Coursera: Neural Networks for Machine Learning, 2012.
43. D. Tsai, Y. Jing, Y. Liu, H. A. Rowley, S. Ioffe, and J. M. Rehg. Large-scale image annotation using visual synset. In ICCV, 2011.
44. Y. Verma and C. Jawahar. Image annotation using metric learning in semantic neighbourhoods. In ECCV, 2012.
45. G. Wang, D. Hoiem, and D. Forsyth. Learning image similarity from flickr groups using stochastic intersection kernel machines. In ICCV, 2009.
46. J. Weston, S. Bengio, and N. Usunier. Wsabie: Scaling up to large vocabulary image annotation. In IJCAI, 2011.
47. A. Yu and K. Grauman. Predicting useful neighborhoods for lazy local learning. In NIPS, 2014.
48. A. Zamir, S. Ardeshir, and M. Shah. Gps-tag refinement using random walks with an adaptive damping factor. In CVPR, 2014.
49. S. Zhang, J. Huang, Y. Huang, Y. Yu, H. Li, and D. N. Metexas. Automatic image annotation using group sparsity. In CVPR, 2010.
50. G. Zhu, S. Yan, and Y. Ma. Image tag refinement towards low-rank, content-tag prior and error sparsity. In MM, 2010.