Image Tag Refinement with View-Dependent Concept Representations

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 25, Issue 8, 2015, Pages 1409-1422

  Fu, Jianlong ^a   Wang, Jinqiao ^a   Rui, Yong ^b   Wang, Xin Jing ^b   Mei, Tao ^b   Lu, Hanqing ^a  

^a INSTITUTE OF AUTOMATION   (China)

^b MICROSOFT RESEARCH   (United States)

Author keywords

Concept representations; image tag refinement; image tagging

Indexed keywords

VIDEO SIGNAL PROCESSING;

CLICKTHROUGH DATA; COARSE TO FINE; CONCEPT REPRESENTATIONS; IMAGE TAGGING; OBJECTIVE FUNCTIONS; TAG REFINEMENTS; VIEW-DEPENDENT; VISUAL APPEARANCE;

NETWORKS (CIRCUITS);

EID: 84938942041     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2014.2380211     Document Type: Article

References (28)

1. Y. Jin, L. Khan, L. Wang, and M. Awad, "Image annotations by combining multiple evidence & wordNet," in Proc. 13th Annu. ACM Int. Conf. Multimedia, 2005, pp. 706-715.
2. M. Wang, B. Ni, X.-S. Hua, and T.-S. Chua, "Assistive tagging: A survey of multimedia tagging with human-computer joint exploration," ACM Comput. Surv., vol. 44, no. 4, Sep. 2012, Art. ID 25.
3. X.-J. Wang, L. Zhang, M. Liu, Y. Li, and W.-Y. Ma, "ARISTA-Image search to annotation on billions of web photos," in Proc. IEEE Conf. CVPR, Jun. 2010, pp. 2987-2994.
4. J. Tang, Q. Chen, M. Wang, S. Yan, T.-S. Chua, and R. Jain, "Towards optimizing human labeling for interactive image tagging," ACM Trans. Multimedia Comput., Commun., Appl., vol. 9, no. 4, Aug. 2013, Art. ID 29.
5. D. Liu, X.-S. Hua, L. Yang, M. Wang, and H.-J. Zhang, "Tag ranking," in Proc. 18th Int. Conf. World Wide Web, 2009, pp. 351-360.
6. G. Zhu, S. Yan, and Y. Ma, "Image tag refinement towards low-rank, content-tag prior and error sparsity," in Proc. ACM Int. Conf. Multimedia, 2010, pp. 461-470.
7. D. Liu, X.-S. Hua, M. Wang, and H.-J. Zhang, "Image retagging," in Proc. ACM Int. Conf. Multimedia, 2010, pp. 491-500.
8. X.-J. Wang, L. Zhang, and W.-Y. Ma, "Duplicate-search-based image annotation using web-scale data," Proc. IEEE, vol. 100, no. 9, pp. 2705-2721, Sep. 2012.
9. X. Li, C. G. M. Snoek, and M. Worring, "Unsupervised multi-feature tag relevance learning for social image retrieval," in Proc. ACM Int. Conf. Image Video Retr., 2010, pp. 10-17.
10. X.-J. Wang, L. Zhang, X. Li, and W.-Y. Ma, "Annotating images by mining image search results," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 11, pp. 1919-1932, Nov. 2008.
11. T.-S. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y. Zheng, "NUS-WIDE: A real-world web image database from National University of Singapore," in Proc. ACM Int. Conf. Image Video Retr., 2009, Art. ID 48.
12. Y. Gao, M. Wang, Z.-J. Zha, J. Shen, X. Li, and X. Wu, "Visual-textual joint relevance learning for tag-based social image search," IEEE Trans. Image Process., vol. 22, no. 1, pp. 363-376, Jan. 2013.
13. X. Li, C. G. M. Snoek, and M. Worring, "Learning tag relevance by neighbor voting for social image retrieval," in Proc. 1st ACM Int. Conf. Multimedia Inf. Retr., 2008, pp. 180-187.
14. X. Li, C. G. M. Snoek, and M. Worring, "Learning social tag relevance by neighbor voting," IEEE Trans. Multimedia, vol. 11, no. 7, pp. 1310-1322, Nov. 2009.
15. X.-J. Wang, L. Zhang, F. Jing, and W.-Y. Ma, "AnnoSearch: Image autoannotation by search," in Proc. IEEE Comput. Soc. Conf. CVPR, Jun. 2006, pp. 1483-1490.
16. M. Guillaumin, T. Mensink, J. Verbeek, and C. Schmid, "Tag-Prop: Discriminative metric learning in nearest neighbor models for image auto-Annotation," in Proc. IEEE 12th ICCV, Sep./Oct. 2009, pp. 309-316.
17. C. Wang, F. Jing, L. Zhang, and H.-J. Zhang, "Content-based image annotation refinement," in Proc. IEEE Conf. CVPR, Jun. 2007, pp. 1-8.
18. D. Tsai, Y. Jing, Y. Liu, H. A. Rowley, S. Ioffe, and J. M. Rehg, "Large-scale image annotation using visual synset," in Proc. IEEE ICCV, Nov. 2011, pp. 611-618.
19. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. Roy. Statist. Soc., Ser. B (Methodological), vol. 39, no. 1, pp. 1-38, 1977.
20. D. Zoran and Y. Weiss, "Natural images, Gaussian mixtures and dead leaves," in Advances in Neural Information Processing Systems. Red Hook, NY, USA: Curran & Associates Inc., 2012, pp. 1736-1744.
21. S. Kullback and R. A. Leibler, "On information and sufficiency," Ann. Math. Statist., vol. 22, no. 1, pp. 79-86, 1951.
22. G. H. Golub and H. A. van der Vorst, "Eigenvalue computation in the 20th century," J. Comput. Appl. Math., vol. 123, nos. 1-2, pp. 35-65, 2000.
23. J. V. Stone, Bayes' Rule: A Tutorial Introduction to Bayesian Analysis. London, U.K.: Sebtel Press, 2013.
24. R. L. Cilibrasi and P. M. B. Vitanyi, "The Google similarity distance," IEEE Trans. Knowl. Data Eng., vol. 19, no. 3, pp. 370-383, Mar. 2007.
25. V. Kolmogorov and R. Zabih, "What energy functions can be minimized via graph cuts?" IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 2, pp. 147-159, Feb. 2004.
26. M. J. Huiskes and M. S. Lew, "The MIR flickr retrieval evaluation," in Proc. 1st ACM Int. Conf. Multimedia Inf. Retr., 2008, pp. 39-43.
27. L. Wu, R. Jin, and A. K. Jain, "Tag completion for image retrieval," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 3, pp. 716-727, Mar. 2013.
28. L. Chen, D. Xu, I. W. Tsang, and J. Luo, "Tag-based image retrieval improved by augmented features and group-based refinement," IEEE Trans. Multimedia, vol. 14, no. 4, pp. 1057-1067, Aug. 2012.