Duplicate-search-based image annotation using web-scale data

Proceedings of the IEEE

Volumn 100, Issue 9, 2012, Pages 2705-2721

  Wang, Xin Jing ^a   Zhang, Lei ^a   Ma, Wei Ying ^a  

^a MICROSOFT RESEARCH ASIA   (China)

Author keywords

Automatic image annotation; duplicate search based image annotation

Indexed keywords

IMAGE ANALYSIS; LEARNING SYSTEMS; SEMANTICS;

AUTOMATIC IMAGE ANNOTATION; LARGE SCALE DATA SETS; MACHINE LEARNING METHODS; SEARCH-BASED IMAGE ANNOTATION; SIMILARITY SEARCH; SOCIAL INFORMATION; TRADITIONAL COMPUTERS; WEB IMAGE ANNOTATIONS;

IMAGE ANNOTATION;

EID: 84865439919     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2012.2193109     Document Type: Article

References (46)

1. A. Torralba, R. Fergus, and W. T. Freeman, "80 million tiny images: A large dataset for non-parametric object and scene recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 11, pp. 1958-1970, Nov. 2008.
2. A. Ulges, M. Worring, and T. Breuel, "Learning visual contexts for image annotation from Flickr groups," IEEE Trans. Multimedia, vol. 13, no. 2, pp. 330-341, Apr. 2011.
3. B. Wang, Z. W. Li, M. Li, and W.-Y. Ma, "Large-scale duplicate detection for web image search," in Proc. IEEE Int. Conf. Multimedia Expo, 2006, pp. 353-356. (Pubitemid 46679727)
4. C. Wang, F. Jing, L. Zhang, and H.-J. Zhang, "Content-based image annotation refinement," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2007, DOI: 10.1109/CVPR. 2007.383221.
5. C. Wang, F. Jing, L. Zhang, and H.-J. Zhang, "Scalable search-based image annotation," J. Multimedia Syst., vol. 14, no. 4, pp. 205-220, 2008.
6. C. Wang, L. Zhang, and H.-J. Zhang, "Learning to reduce the semantic gap in web image retrieval and annotation," in Proc. ACM Conf. Res. Develop. Inf. Retrieval, 2008, DOI: 10.1145/1390334.1390396.
7. C. Wang, S. C. Yan, L. Zhang, and H.-J. Zhang, "Multi-label sparse coding for automatic image annotation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2009, pp. 1643-1650.
8. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
9. D. C. Lee, Q. Ke, and M. Isard, "Partition min-hash for partial duplicate image discovery," inProc Eur. Conf. Comput. Vis., Sep. 2010, pp. 648-662.
10. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent Dirichlet allocation," J. Mach. Learn. Res., vol. 3, pp. 993-1022, 2003.
11. H. J. Zeng, Q. He, Z. Chen, W.-Y. Maa, and J. Ma, "Learning to cluster Web search results," in Proc. Int. SIGIR Conf. Res. Develop. Inf. Retrieval, 2004, pp. 210-217.
12. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, "ImageNet: A large-scale hierarchical image database," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2009, pp. 248-255.
13. J. Li and J. Z. Wang, "Real-time computerized annotation of pictures," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 6, pp. 985-1002, Jun. 2008. (Pubitemid 351650103)
14. J. Tang, R. Hong, S. C. Yan, T.-S. Chua, G.-J. Qi, and R. Jain, "Image annotation by kNN-sparse graph-based label propagation over noisily tagged web images," ACM Trans. Intell. Syst. Technol., vol. 2, no. 2, 2011, DOI: 10.1145/1899412.1899418.
15. J. Wang and X.-S. Hua, "Interactive image search by color map," ACM Trans. Intell. Syst. Technol., vol. 3, no. 1, Jun. 2010, DOI: 10.1145/2036264.2036276.
16. J. H. Tang, H. Li, G.-J. Qi, and T.-S. Chua, "Image annotation by graph-based inference with integrated multiple/single instance representations," IEEE Trans. Multimedia, vol. 12, no. 2, pp. 131-141, Feb. 2010.
17. J. P. Fan, Y. Gao, and H. Luo, "Integrating concept ontology and multitask learning to achieve more effective classifier training for multilevel image annotation," IEEE Trans. Image Process., vol. 17, no. 3, pp. 407-426, Mar. 2008. (Pubitemid 351395085)
18. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, 'Object retrieval with large vocabularies and fast spatial matching," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2007, DOI: 10.1109/CVPR.2007.383172.
19. J. Sivic and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos," in Proc. Int. Conf. Comput. Vis., 2003, vol. 2, pp. 1470-1477.
20. K. Barnard, P. Duygulu, D. A. Forsyth, N. de Freitas, D. M. Blei, and M. I. Jordon, "Matching words and pictures," J. Mach. Learn. Res., vol. 3, pp. 1107-1135, 2003.
21. K.-S. Goh and E. Y. Chang, 'One, two class SVMs for multiclass image annotation," IEEE Trans. Knowl. Data Eng., vol. 17, no. 10, pp. 1333-1346, Oct. 2005. (Pubitemid 41560421)
22. L. Du, L. Ren, D. B. Dunson, and L. Carin, "A Bayesian model for simultaneous image clustering, annotation and object segmentation," Advances in Neural Information Processing Systems, vol. 22. Cambridge, MA: MIT Press, 2009, pp. 486-494.
23. L.-J. Li, C. Wang, Y. Lim, D. Blei, and L. Fei-Fei, "Building and using a semantivisual image hierarchy," inProc. IEEE Conf. Comput. Vis. Pattern Recognit., 2010, pp. 3336-3343.
24. L. Page, S. Brin, R. Motwani, and T. Winograd, "The PageRank citation ranking: Bringing order to the Web," Stanford InfoLab, Stanford, CA, Tech. Rep., 1999.
25. O. Chum, J. Philbin, and A. Zisserman, "Near duplicate image detection: Min-hash and tf-idf weighting," in Proc. British Mach. Vis. Conf., 2008DOI: 10.5244/C.22.50.
26. O. Yakhnenko and V. Honavar, "Multiple label prediction for image annotation with multiple Kernel correlation models," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2009, pp. 8-15.
27. The Open Directory Project, 2011. [Online]. Available: http://dmoz.org/
28. P. Duygulu, K. Barnard, N. de Fretias, and D. Forsyth, 'Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary," inProc Eur. Conf. Comput. Vis., 2002, pp. 97-112.
29. R. Jin, J. Y. Chai, and L. Si, "Effective automatic image annotation via a coherent language model and active learning," in Proc. 12th Annu. ACM Int. Conf. Multimedia, 2004, DOI: 10.1145/1027527.1027732.
30. R. W. Picard and T. P. Minka, "Vision texture for annotation," Multimedia Syst., 1995.
31. S. Siersdorfer, J. S. Pedro, and M. Sanderson, "Automatic video tagging using content redundancy," in Proc. 32nd Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 2009, DOI: 10.1145/1571941.1572010.
32. T. Tsikrika, C. Diou, A. P. de Vries, and A. Delopoulos, "Image annotation using clickthrough data," in Proc. ACM Int. Conf. Image Video Retrieval, 2009, DOI: 10.1145/1646396.1646415.
33. TheNextWeb, 2011. [Online]. Available: http://the nextweb.com
34. V. Lavrenko, R. Manmatha, and J. Jeon, "A model for learning the semantics of pictures Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2003.
35. W.-L. Zhao, X. Wu, and C.-W. Ngo, "On the annotation of web videos by efficient near-duplicate search," IEEE Trans. Multimedia, vol. 12, no. 5, pp. 448-461, Aug. 2010.
36. X. Chen, Y. Mu, S. Yan, and T.-S. Chua, "Efficient large-scale image annotation by probabilistic collaborative multi-label propagation," in Proc. Int. ACM Conf. Multimedia, 2010, DOI: 10.1145/1873951. 1873959.
37. X. He and R. S. Zemel, "Learning hybrid models for image annotation with partially labeled data," Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2008, pp. 625-632.
38. X. Li, C. G. M. Snoek, and M. Worring, "Learning social tag relevance by neighbor voting," IEEE Trans. Multimedia, vol. 11, no. 7, pp. 1310-1322, Jul. 2009.
39. X. Zhang, L. Zhang, X.-J. Wang, and H.-Y. Shum, "Finding celebrities frombillions of web images," IEEE Trans. Multimedia, 2012, DOI: 10.1109/TMM.2012.2186121.
40. X.-J. Wang, L. Zhang, F. Jing, and W.-Y. Ma, "AnnoSearch: Image auto-annotation by search," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2006, pp. 1483-1490. (Pubitemid 44931495)
41. X.-J. Wang, L. Zhang, M. Liu, Y. Li, and W.-Y. Ma, "ARISTA-Image search to annotation on billions of web photos," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2010, pp. 2987-2994.
42. X.-J. Wang, L. Zhang, X. Li, and W.-Y. Ma, "Annotating images by mining image search results," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 11, pp. 1919-1932, Nov. 2008.
43. Y. Cao, H. Wang, C. Wang, Z. Li, L. Zhang, and L. Zhang, "MindFinder: Interactive sketch-based image search on millions of images," in Proc. ACM Multimedia Conf, 2010, pp. 1605-1608.
44. Y. S. Jing and S. Baluja, "VisualRank: Applying pagerank to large-scale image search," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 11, pp. 1877-1890, Nov. 2008.
45. Y. Lu, J. Liu, Q. Tian, and L. Zhang, "LCSS: Lexica of high-level concepts with small semantic gaps," IEEE Trans. Multimedia, vol. 12, no. 4, pp. 288-299, Jun. 2009.
46. Y. Xiang, X. Zhou, T.-S. Chua, and C.-W. Ngo, "A revisit of generative model for automatic image annotation using Markov random fields," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2009, pp. 1153-1160.