Unsupervised semantic feature discovery for image object retrieval and tag refinement

IEEE Transactions on Multimedia

Volumn 14, Issue 4 PART1, 2012, Pages 1079-1090

  Kuo, Yin Hsi ^a   Cheng, Wen Huang ^b   Lin, Hsuan Tien ^a   Hsu, Winston H ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

^b RESEARCH CENTER FOR INFORMATION TECHNOLOGY INNOVATION   (Taiwan)

Author keywords

Image graph; image object retrieval; semantic feature discovery; tag refinement

Indexed keywords

CONTEXTUAL CUE; EXPONENTIAL GROWTH; FACEBOOK; IMAGE CONTENT; IMAGE GRAPHS; IMAGE OBJECTS; IMAGE SEARCH; LIGHTING CONDITIONS; LOW-LEVEL FEATURES; OPTIMIZATION METHOD; RECALL RATE; RETRIEVAL APPLICATIONS; SEMANTIC FEATURES; SEMANTIC REPRESENTATION; SOCIAL MEDIA; SOCIAL SERVICE; TAG REFINEMENT; TEXTUAL INFORMATION; VISUAL IMAGE;

SEARCH ENGINES; SEMANTICS;

IMAGE RETRIEVAL;

EID: 84864120669     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2012.2190386     Document Type: Article

References (36)

1. M. Ames and M. Naaman, "Why we tag: Motivations for annotation in mobile and online media," in Proc. SIGCHI Conf. Human Factors Comput. Syst., 2007, pp. 971-980.
2. X.-J. Wang, L. Zhang, F. Jing, and W.-Y. Ma, "Annosearch: Image autoannotation by search," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2006, pp. 1483-1490.
3. X.-J.Wang, L. Zhang,M. Liu, Y. Li, andW.-Y.Ma, "ARISTA-Image search to annotation on billions of web photos," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2010, pp. 2987-2994.
4. J. Hays and A. A. Efros, "IM2GPS: Estimating geographic information from a single image," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2008, pp. 1-8.
5. J. Sivic and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos," in Proc. IEEE Int. Conf. Comput. Vis., 2003, vol. 2, pp. 1470-1477.
6. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, "Lost in quantization: Improving particular object retrieval in large scale image databases," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2008, pp. 1-8.
7. X. Zhang, Z. Li, L. Zhang,W.Ma, and H. Shum, "Efficient indexing for large scale visual search," in Proc. IEEE Int. Conf. Comput. Vis., 2009, pp. 1103-1110.
8. O. Chum, J. Philbin, J. Sivic,M. Isard, and A. Zisserman, "Total recall: Automatic query expansion with a generative feature model for object retrieval," in Proc. IEEE Int. Conf. Comput. Vis., 2007, pp. 1-8.
9. H. Ma, J. Zhu, M. R.-T. Lyu, and I. King, "Bridging the semantic gap between image contents and tags," IEEE Trans. Multimedia, vol. 12, no. 5, pp. 462-473, Aug. 2010.
10. L. Kennedy, M. Naaman, S. Ahern, R. Nair, and T. Rattenbury, "How flickr helps usmake sense of the world: Context and content in community-contributed media collections," in Proc. ACM Multimedia, 2007, pp. 631-640.
11. V. Mezaris, H. Doulaverakis, S. Herrmann, B. Lehane, I. Kompatsiaris, and M. G. Strintzis, "Combining textual and visual information processing for interactive video retrieval: SCHEMA's participation in TRECVID 2004," presented at the TRECVID Workshop, Gaithersburg, MD, 2004.
12. A. F. Smeaton, P. Over, and W. Kraaij, "Evaluation campaigns and TRECVid," in Proc. 8th Int. ACM WorkshopMultimedia Inf. Retrieval, 2006, pp. 321-330.
13. X.Wang, K. Liu, and X. Tang, "Query-specific visual semantic spaces for web image re-ranking," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2011, pp. 857-864.
14. B. Thomee, E.M. Bakker, and M. S. Lew, "TOP-SURF:Avisualwords toolkit," in Proc. Int. Conf. Multimedia, 2010, pp. 1473-1476.
15. Y.-H. Kuo, H.-T. Lin,W.-H. Cheng, Y.-H. Yang, andW. H. Hsu, "Unsupervised auxiliary visual words discovery for large-scale image object retrieval," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2011, pp. 905-912.
16. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
17. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, "Object retrieval with large vocabularies and fast spatial matching," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2007, pp. 1-8.
18. J. Philbin, M. Isard, J. Sivic, and A. Zisserman, "Descriptor learning for efficient retrieval," in Proc. Eur. Conf. Comput. Vis., 2010, pp. 677-691.
19. L. Wu, S. C. Hoi, and N. Yu, "Semantics-preserving bag-of-words models for efficient image annotation," in Proc. ACMWorkshop Large-Scale Multimedia Retrieval Mining, 2009, pp. 19-26.
20. P. Turcot and D. Lowe, "Better matching with fewer features: The selection of useful features in large database recognition problems," in Proc. ICCV Workshop Emergent Issues Large Amounts Vis. Data, 2009, pp. 2109-2116.
21. S. Gammeter, L. Bossard, T. Quack, and L. Van Gool, "I know what you did last summer: Object-level auto-Annotation of holiday snaps," in Proc. IEEE Int. Conf. Comput. Vis., 2009, pp. 614-621.
22. P. K. Mallapragada, R. Jin, and A. K. Jain, "Online visual vocabulary pruning using pairwise constraints," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2010, pp. 3073-3080.
23. X.-J. Wang, W.-Y. Ma, G.-R. Xue, and X. Li, "Multi-model similarity propagation and its application for web image retrieval," in Proc. ACM Multimedia, 2004, pp. 944-951.
24. X. Li, C. G. M. Snoek, and M. Worring, "Learning tag relevance by neighbor voting for social image retrieval," in Proc. Multimedia Inf. Retrieval, 2008, pp. 180-187.
25. O. Chum,M. Perdoch, and J. Matas, "Geometric min-hashing: Finding a (thick) needle in a haystack," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2009, pp. 17-24.
26. J. Dean and S. Ghemawat, "Mapreduce: Simplified data processing on large clusters," in Proc. Symp. Oper. Syst. Design Implem., 2004, pp. 137-150.
27. T. Elsayed, J. Lin, and D. Oard, "Pairwise document similarity in large collections with mapreduce," in Proc. Assoc. Comput. Linguistics, 2008, pp. 265-268.
28. B. J. Frey and D.Dueck, "Clustering by passing messages between data points," Science, vol. 315, pp. 972-976, 2007.
29. L. Kennedy, M. Slaney, and K. Weinberger, "Reliable tags using image similarity: Mining specificity and expertise from large-scale multimedia databases," in Proc. 1st Workshop Web-Scale Multimedia Corpus, 2009, pp. 17-24.
30. X. Li, C. G. M. Snoek, and M. Worring, "Unsupervised multi-feature tag relevance learning for social image retrieval," in Proc. ACM Int. Conf. Image Video Retrieval, 2010, pp. 10-17.
31. J.Mairal, F. Bach, J. Ponce, and G. Sapiro, "Online dictionary learning for sparse coding," in Proc. Int. Conf. Mach. Learning, 2009, pp. 689-696.
32. J. Mairal, F. R. Bach, J. Ponce, and G. Sapiro, "Online learning for matrix factorization and sparse coding," J. Mach. Learning Res., pp. 19-60, 2010.
33. H. Lee, A. Battle, R. Raina, and A. Y. Ng, "Efficient sparse coding algorithms," in Neural Inf. Process. Syst., 2006, pp. 801-808.
34. Y.-H. Yang, P.-T. Wu, C.-W. Lee, K.-H. Lin, and W. H. Hsu, "Contextseer: Context search and recommendation at query time for shared consumer photos," presented at the ACM Multimedia, Vancouver, BC, Canada, 2008.
35. D. Chen, G. Baatz, Köser, S. Tsai, R. Vedantham, T. Pylvanainen, K. Roimela, X. Chen, J. Bach,M. Pollefeys, B. Girod, and R. Grzeszczuk, "City-scale landmark identification on mobile devices," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2011, pp. 737-744.
36. M. Douze, A. Ramisa, and C. Schmid, "Combining attributes and Fisher vectors for efficient image retrieval," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2011, pp. 745-752.