Beyond tag relevance: Integrating visual attention model and multi-instance learning for tag saliency ranking

CIVR 2010 - 2010 ACM International Conference on Image and Video Retrieval

Volumn , Issue , 2010, Pages 288-295

  Feng, Songhe ^a   Lang, Congyan ^a   Xu, De ^a  

^a BEIJING JIAOTONG UNIVERSITY   (China)

Author keywords

Image annotation; Multi instance learning; Tag saliency ranking; Visual attention model

Indexed keywords

IMAGE ANNOTATION; IMAGE CONTENT; IMAGE DATASETS; INTEGRATED FRAMEWORKS; MULTI-INSTANCE LEARNING; POTENTIAL APPLICATIONS; RANKING APPROACH; RELEVANCE RANKING; RESEARCH TOPICS; SIMILARITY MEASUREMENTS; TAG SALIENCY RANKING; VISUAL ATTENTION MODEL; WEB IMAGE SEARCH;

IMAGE ANALYSIS; IMAGE RETRIEVAL; WORLD WIDE WEB;

LEARNING ALGORITHMS;

EID: 77955898502     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1816041.1816084     Document Type: Conference Paper

References (27)

1. R. Achanta and S. Hemam. Frequency-tuned salient region detection. In Proc. of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'09), pages 1597-1604, Miami, Florida, USA, 2009.
2. G. Carneiro, A. B. Chan, P. J. Moreno, and N. Vasconcelos. Supervised learning of semantic classes for image annotation and retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(3):394-410, 2007.
3. Y. Chen, J. Bi, and J. Wang. Miles: Multiple-instance learning via embedded instance selection. IEEE Transaction on Pattern Analysis and Machine Intelligence, 28(12):1931-1947, 2006.
4. Y. Chen and J. Wang. Image categorization by learning and reasoning with regions. Journal of Machine Learning Research, 5:913-939, 2004.
5. T. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y. Zheng. Nus-wide: A real-world web image database from national university of singapore. In Proc. of ACM Int. Conf. on Image and Video Retrieval(ACM CIVR'09), pages 1-9, Santorini, Fira, Greece, 2009.
6. R. Datta, D. Joshi, J. Li, and J. Wang. Image retrieval: ideas, influences, and trends of the new age. ACM Computing Surveys, 40(2):1-60, 2008.
7. Y. Deng and B. Manjunath. Unsupervised segmentation of color-texture regions in images and video. IEEE Transactions on Pattern Analysis and Machine Learning, 23(8):800-810, 2001.
8. P. Duygulu, K. Barnard, N. Freitas, and D. Forsyth. Object recognition as machine translation: learning a lexicon for a fixed image vocabulary. In Proc. of European Conference on Computer Vision (ECCV'02), pages 97-112, Copenhagen, Denmark, 2002.
9. S. Feng, R. Manmatha, and V. Lavrenko. Multiple bernoulli relevance models for image and video annotation. In Proc. of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'04), pages 1002-1009, Washington DC, USA, 2004.
10. S. Feng, D. Xu, and X. Yang. Attention-driven salient edge(s) and region(s) extraction with application to cbir. Signal Processing, 90:1-15, 2010.
11. X. Hou and L. Zhang. Saliency detection: a spectral residual approach. In Proc. of IEEE Computer Society Conference on Computer Vision and Pattern Recognition(CVPR'07), pages 1-8, Pittsburgh, Pennsylvania, USA, 2007.
12. L. Itti, C. Koch, and E. Niebur. A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(11):1254-1259, 1998.
13. T. Li, T. Mei, and S. C. Yan. Contextual decomposition of multi-label images. In Proc. of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'09), pages 2270-2277, Miami, Florida, USA, 2009.
14. X. R. Li, C. G. M. Snoek, and M. Worring. Learning social tag relevance by neighbor voting. IEEE Transactions on Multimedia, 11(7):1310-1322, 2009.
15. D. Liu, X. Hua, M. Wang, and H. Zhang. Boost search relevance for tag-based social image retrieval. In Proc. of Int. Conf. on Multimedia and Expro (ICME'09), pages 1636-1639, New York, USA, 2009.
16. D. Liu, X. S. Hua, L. J. Yang, M. Wang, and H. J. Zhang. Tag ranking. In Proc. of ACM Int. Conf. on World Wide Web (WWW'09), pages 351 - 360, Madrid, Spain, 2009.
17. T. Liu, Z. Yuan, J. Sun, J. Wang, N. Zheng, X. Tang, and H.-Y. Shum. Learning to detect a salient object. IEEE Transactions on Pattern Analysis and Machine Learning, 2010 (In press).
18. X. Liu, B. Cheng, and S. C. Yan. Label to region by bi-layer sparsity priors. In Proc. of ACM Int. Conf on Multimedia (ACM MM'09), pages 115-124, Beijing, China, 2009.
19. Y. Liu, D. Xu, I. Tsang, and J. Luo. Using large-scale web data to facilitate textual query based retrieval of consumer photos. In Proc. of ACM Int. Conf on Multimedia (ACM MM'09), pages 55-64, Beijing, China, 2009.
20. Y. Ma and H. Zhang. Contrast-based image attention analysis by using fuzzy growing. In Proc. of ACM Int. Conf on Multimedia (ACM MM'03), pages 374-381, Berkeley, CA, USA, 2003.
21. O. Maron and T. Lozano-Pierez. A framework for multiple-instance learning. In Proc. of Advances in Neural Information Processing Systems (NIPS'98), pages 570-576, 1998.
22. X. Qi and Y. Han. Incorporating multiple svms for automatic image annotation. Pattern Recognition, 40(2):728-741, 2007.
23. R. Rahmani and S. Goldman. Missl: multiple-instance semi-supervised learning. In Proc. of Int. Conf. on Machine Learning (ICML'06), pages 705-712, Pittsburgh, Pennsylvania, USA, 2006.
24. A. Sun and S. Bhowmick. Image tag clarity: in search of visual-representative tags for social images. In Proc. of ACM Multimedia Workshop on Social Media (ACM WSM'09), pages 19-26, Beijing, China, 2009.
25. J. Tang, X. Hua, G. Qi, and X. Wu. Typicality ranking via semi-supervised multiple-instance learning. In Proc. of ACM Int. Conf. on Multimedia (ACM MM'07), pages 297-300, Augsburg, Germany, 2007.
26. X. Wang, L. Zhang, X. Li, and W. Ma. Annotating images by mining image search results. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(11):1919 - 1932, 2008.
27. C. Yang, M. Dong, and F. Fotouhi. Region-based image annotation through multiple-instance learning. In Proc. of ACM Int. Conf on Multimedia (ACM MM'05), pages 435-438, Singapore, Singapore, 2005.