Object retrieval using visual query context

IEEE Transactions on Multimedia

Volumn 13, Issue 6, 2011, Pages 1295-1307

  Yang, Linjun ^a   Geng, Bo ^b   Cai, Yang ^c   Hanjalic, Alan ^d   Hua, Xian Sheng ^a  

^a MICROSOFT RESEARCH ASIA   (China)

^b PEKING UNIVERSITY   (China)

^c ZHEJIANG UNIVERSITY   (China)

^d DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

BAG-OF-VISUAL-WORDS; CONTEXTUAL INFORMATION; DISCRIMINATIVE FEATURES; FEATURE-BASED; IMAGE COLLECTIONS; IMAGE DATASETS; IMAGE FEATURES; IMAGE REPRESENTATIONS; LANGUAGE MODELING; OBJECT RETRIEVAL; QUERY IMAGES; QUERY OBJECT; REAL-LIFE APPLICATIONS; REGION OF INTEREST; RELEVANCE SCORE; SALIENCY MAP; UNCERTAIN OBSERVATIONS; VISUAL CONTEXT; VISUAL ELEMENTS; VISUAL QUERY;

COMPUTATIONAL LINGUISTICS; IMAGE SEGMENTATION;

INFORMATION RETRIEVAL;

EID: 82055208419     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2011.2162399     Document Type: Article

References (38)

1. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
2. [Online]. Available: http://www.tineye.com.
3. [Online]. Available: http://www.google.com/mobile/goggles/.
4. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, "Object retrieval with large vocabularies and fast spatial matching," in Proc. 2007 IEEE Conf. Computer Vision and Pattern Recognition (CVPR '07), Jun. 2007, pp. 1-8.
5. B. Geng, L. Yang, and C. Xu, "A study of language model for image retrieval," in Proc. 2009 IEEE Int. Conf. Data MiningWorkshops, IEEE Computer Society (ICDMW '09),Washington, DC, 2009, pp. 158-163.
6. C. Zhai, Statistical Language Models for Information Retrieval. San Rafael, CA: Morgan & Claypool, 2009.
7. C. Galleguillos and S. Belongie, "Context based object categorization: A critical survey," Comput. Vis. Image Understand. (CVIU), vol. 114, pp. 712-722, 2010.
8. A. Rabinovich, A. Vedaldi, C. Galleguillos, E. Wiewiora, and S. Belongie, "Objects in context," in Proc. 11th IEEE Int. Conf. Computer Vision (ICCV '07), Oct. 2007, pp. 1-8.
9. A. Oliva and A. Torralba, "The role of context in object recognition," Trends Cognit. Sci., vol. 11, no. 12, pp. 520-527, Dec. 2007. (Pubitemid 350181571)
10. A. Torralba, K. P. Murphy, W. T. Freeman, and M. A. Rubin, "Context- based vision system for place and object recognition," in Proc. 9th IEEE Int. Conf. Computer Vision, IEEE Computer Society (ICCV '03), Washington, DC, 2003, p. 273.
11. [Online]. Available: http://www.robots.ox.ac.uk/~vgg/data/oxbuildings.
12. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, "Imagenet: A large-scale hierarchical image database," in Proc. 2009 IEEE Conf. Computer Vision and Pattern Recognition (CVPR '09), Jun. 2009, pp. 248-255.
13. X. S. Zhou and T. S. Huang, "Relevance feedback in image retrieval: A comprehensive review," Multimedia Syst., vol. 8, no. 6, pp. 536-544, Apr. 2003.
14. C. D. Manning, P. Raghavan, and H. Schütze, Introduction to Information Retrieval, 1st ed. Cambridge, U.K.: Cambridge Univ. Press, 2008.
15. J. Luo, A. Hanjalic, Q. Tian, and A. Jaimes, "Integration of context and content for multimedia management: An introduction to the special issue," IEEE Trans. Multimedia, vol. 11, no. 2, pp. 193-195, Feb. 2009.
16. J. Allan, J. Aslam, N. Belkin, C. Buckley, J. Callan, B. Croft, S. Dumais, N. Fuhr, D. Harman, D. J. Harper, D. Hiemstra, T. Hofmann, E. Hovy, W. Kraaij, J. Lafferty, V. Lavrenko, D. Lewis, L. Liddy, R. Manmatha, A. McCallum, J. Ponte, J. Prager, D. Radev, P. Resnik, S. Robertson, R. Rosenfeld, S. Roukos, M. Sanderson, R. Schwartz, A. Singhal, A. Smeaton, H. Turtle, E. Voorhees, R.Weischedel, J. Xu, and C. Zhai, "Challenges in information retrieval and language modeling: report of a workshop held at the center for intelligent information retrieval," in Proc. SIGIR Forum, University of Massachusetts Amherst, Sep. 2003, vol. 37, pp. 31-47.
17. J. Callan and N. Belkin, "Context-based information access," in Report of the Discussion Group on Context-Based Information Access of the Workshop on Information Retrieval and Databases: Synergies and Syntheses, 2003.
18. N. J. Belkin, "Some(what) grand challenges for information retrieval," in Proc. SIGIR Forum, 2008, vol. 42, no. 1, pp. 47-54.
19. S. Lawrence, "Context in web search," IEEE Data Eng. Bull., vol. 23, no. 3, pp. 25-32, 2000.
20. Z.-J. Zha, L. Yang, T. Mei, M. Wang, and Z. Wang, "Visual query suggestion," in Proc. 17th ACM Int. Conf. Multimedia (MULTIMEDIA '09), New York, 2009, pp. 15-24.
21. L. Kennedy, M. Naaman, S. Ahern, R. Nair, and T. Rattenbury, "How flickr helps us make sense of the world: Context and content in community- contributed media collections," in Proc. 15th Int. Conf. Multimedia (MULTIMEDIA '07), New York, 2007, pp. 631-640.
22. P. Sinha and R. Jain, "Semantics in digital photos: A contextual analysis," in Proc. IEEE Int. Conf. Semantic Computing, 2008.
23. X. Yang, S. Pang, and K. Cheng, "Mobile image search with multimodal context-aware queries," in Proc. Int. Workshop Mobile Vision (in conjunction with CVPR 2010), Jun. 2010.
24. J. Sivic and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos," in Proc. 9th IEEE Int. Conf. Computer Vision, IEEE Computer Society (ICCV '03),Washington, DC, 2003, p. 1470.
25. C. Rother, V. Kolmogorov, and A. Blake, "GrabCut: Interactive foreground extraction using iterated graph cuts," ACM Trans. Graph. (TOG), vol. 23, no. 3, pp. 309-314, Aug. 2004.
26. J. Wang and M. F. Cohen, Image and Video Matting: A survey. Hanover, MA: Now Publishers, 2007, vol. 3.
27. K. Mikolajczyk and C. Schmid, "Scale & affine invariant interest point detectors," Int. J. Comput. Vis., vol. 60, no. 1, pp. 63-86, 2004.
28. J. Lafferty and C. Zhai, "Document language models, query models, and risk minimization for information retrieval," in Proc. 24th Annu. Int. ACM SIGIR Conf. Research and Development in Information Retrieval (SIGIR '01), New York, 2001, pp. 111-119. (Pubitemid 32951063)
29. C. Zhai and J. Lafferty, "A study of smoothing methods for language models applied to information retrieval," ACMTrans. Inf. Syst., vol. 22, no. 2, pp. 179-214, 2004.
30. Y.-F. Ma and H.-J. Zhang, "Contrast-based image attention analysis by using fuzzy growing," in Proc. 11th ACM Int. Conf. Multimedia (MULTIMEDIA '03), 2003, pp. 374-381.
31. J. K. Tsotsos, S. M. Culhane, W. Y. K. Winky, Y. Lai, N. Davis, and F. Nuflo, "Modeling visual attention via selective tuning," Artif. Intell., vol. 78, no. 1-2, pp. 507-545, Oct. 1995.
32. L. Itti, C.Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998. (Pubitemid 128742001)
33. X. Bai and G. Sapiro, "A geodesic framework for fast interactive image and video segmentation and matting," in Proc. 11th IEEE Int. Conf. Computer Vision (ICCV '07), 2007, pp. 1-8.
34. [Online]. Available: http://www.flickr.com.
35. R. Datta, D. Joshi, J. Li, and J. Z. Wang, "Image retrieval: Ideas, influences, and trends of the new age," ACM Comput. Surv., vol. 40, no. 2, pp. 1-60, 2008.
36. A. W. M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain, "Content-based image retrieval at the end of the early years," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 12, pp. 1349-1380, Dec. 2000. (Pubitemid 32088465)
37. C. G. M. Snoek and M. Worring, "Concept-based video retrieval," Found. Trends Inf. Retriev., vol. 4, no. 2, pp. 215-322, 2009.
38. Z.-J. Zha, L. Yang, T. Mei, M. Wang, Z. Wang, T.-S. Chua, and X.-S. Hua, "Visual query suggestion: Towards capturing user intent in internet image search," ACM Trans. Multimedia Comput., Commun., Appl. (TOMCCAP), vol. 6, pp. 13:1-13:19, Aug. 2010.