Query Difficulty Estimation for Image Search with Query Reconstruction Error

IEEE Transactions on Multimedia

Volumn 17, Issue 1, 2015, Pages 79-91

  Tian, Xinmei ^a   Jia, Qianghuai ^a   Mei, Tao ^b  

^a UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA   (China)

^b MICROSOFT RESEARCH   (United States)

Author keywords

Image retrieval; image search quality; query difficulty estimation; query reconstruction

Indexed keywords

ERRORS; IMAGE PROCESSING; IMAGE RECONSTRUCTION; IMAGE RETRIEVAL;

CURRENT IMAGE; DIFFICULTY ESTIMATIONS; IMAGE SEARCH; IMAGE SEARCH SYSTEM; REAL WORLD WEB; RECONSTRUCTION ERROR; RETRIEVAL PERFORMANCE; STATISTICAL CHARACTERISTICS;

SEARCH ENGINES;

EID: 84937566178     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2014.2368714     Document Type: Article

References (56)

1. S. Cronen-Townsend, Y. Zhou, andW. B. Croft, "Predicting query performance," in Proc. ACM SIGIR Special Interest Group Inf. Retrieval, 2002, pp. 299-306.
2. E. Yom-Tov, S. Fine, D.Carmel, andA.Darlow, "Learning to estimate query difficulty: Including applications to missing content detection and distributed information retrieval," in Proc. ACM SIGIR Special Interest Group Inf. Retrieval, 2005, pp. 512-519.
3. Y. Zhou and W. B. Croft, "Ranking robustness: A novel framework to predict query performance," in Proc. 15th ACM Int. Conf. Inf. Knowl. Manag., 2006, pp. 567-574.
4. D. Carmel, E. Yom-Tov, A. Darlow, and D. Pelleg, "What makes a query difficult," in Proc. ACM SIGIR Special Interest Group Inf. Retrieval, 2006, pp. 390-397.
5. Y. Zhou andW. B. Croft, "Query performance prediction in web search environments," in Proc. ACM SIGIR Special Interest Group Inf. Retrieval, 2007, pp. 543-550.
6. F. Diaz, "Performance prediction using spatial autocorrelation," in Proc. ACM SIGIR Special Interest Group Inf. Retrieval, 2007, pp. 583-590.
7. J. He, M. Larson, and M. De Rijke, "Using coherence-based measures to predict query difficulty," in Proc. Eur. Conf. Inf. Retrieval, 2008, pp. 689-694.
8. H. Imran and A. Sharan, "Co-occurrence based predictors for estimating query difficulty," in Proc. IEEE Int. Conf. Data Mining Workshops, Dec. 2010, pp. 867-874.
9. A. Shtok, O. Kurland, D. Carmel, F. Raiber, and G. Markovits, "Predicting query performance by query-drift estimation," ACM Trans. Inf. Syst., vol. 30, no. 2, pp. 1-11, 2012.
10. O. Kurland, A. Shtok, S. Hummel, F. Raiber, D. Carmel, and O. Rom, "Back to the roots: A probabilistic framework for query-performance prediction," in Proc. CIKM, 2012, pp. 823-832.
11. S. Rudinac, M. Larson, and A. Hanjalic, "Leveraging visual concepts and query performance prediction for semantic-theme-based video retrieval," IJMIR, vol. 1, no. 4, pp. 263-280, 2012.
12. Y. Li, B. Geng, D. Tao, Z.-J. Zha, L. Yang, and C. Xu, "Difficulty guided image retrieval using linear multiple feature embedding," IEEE Trans. Multimedia, vol. 14, no. 6, pp. 1618-1630, Dec. 2012.
13. X.Tian, Y. Lu, andL.Yang, "Query difficulty prediction for web image search," IEEE Trans. Multimedia, vol. 14, no. 4, pp. 951-962, Aug. 2012.
14. J. Sivic and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos," in Proc. ICCV, 2003, pp. 1470-1477.
15. S. Rudinac, M. Larson, and A. Hanjalic, "Exploiting result consistency to select query expansions for spoken content retrieval," in Proc. Eur. Conf. Inf. Retrieval, 2010, pp. 645-648.
16. Y. Li, Y. Luo, D. Tao, and C. Xu, "Query difficulty guided image retrieval system," in Advances in Multimedia Modeling, ser. Lecture Notes in Comput. Sci. Berlin, Germany: Springer-Verlag, 2011, pp. 479-482.
17. X. Xing, Y. Zhang, and M. Han, "Query difficulty prediction for contextual image retrieval," in Proc. Eur. Conf. Inf. Retrieval, 2010, pp. 581-585.
18. C. Kofler, L. Yang, M. Larson, T. Mei, A. Hanjaliic, and S. Li, "When video search goes wrong: Predicting query failure using search engine logs and visual search results," in Proc. ACM Multimedia, 2012, pp. 319-328.
19. C. Kofler, L. Yang, M. Larson, T. Mei, A. Hanjalic, and S. Li, "Predicting failing queries in video search," IEEE Trans. Multimedia, vol. 16, no. 7, pp. 1973-1985, Nov. 2014.
20. X. Tian, Y. Lu, L. Yang, and Q. Tian, "Learning to judge image search results," in Proc. ACM Multimedia, 2011, pp. 363-372.
21. O. Chum, J. Philbin, J. Sivic, M. Isard, and A. Zisserman, "Total recall: Automatic query expansion with a generative feature model for object retrieval," in Proc. ICCV, 2007, pp. 1-8.
22. A. Joly and O. Buisson, "Logo retrieval with a contrario visual query expansion," in Proc. ACM Multimedia, 2009, pp. 581-584.
23. O.Chum, A. Mikulk, M. Perdoch, and J. Matas, "Total recall II:Query expansion revisited," inProc. IEEEConf.Comput. Vis. PatternRecog., Jun. 2011, pp. 889-896.
24. R. Arandjelovic and A. Zisserman, "Three things everyone should know to improve object retrieval," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2012, pp. 2911-2918.
25. H. Xie, Y. Zhang, J. Tan, L. Guo, and J. Li, "Contextual query expansion for image retrieval," IEEE Trans. Multimedia, vol. 16, no. 4, pp. 1104-1114, Jun. 2014.
26. X. Li, C. G. Snoek, and M. Worring, "Learning tag relevance by neighbor voting for social image retrieval," in Proc. MIR, 2008, pp. 180-187.
27. G.-J. Qi, C. C. Aggarwal, Q. Tian, H. Ji, and T. S. Huang, "Exploring context and content links in socialmedia:Alatent spacemethod," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 5, pp. 850-862, May 2012.
28. D. Rafailidis, A. Axenopoulos, J. Etzold, S. Manolopoulou, and P. Daras, "Content-based tag propagation and tensor factorization for personalized item recommendation based on social tagging," ACM Trans. Interactive Intell. Syst., vol. 3, no. 4, pp. 1-27, 2014.
29. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Jun. 2006, vol. 2, pp. 2169-2178.
30. D. Liu, G. Hua, P. A. Viola, and T. Chen, "Integrated feature selection and higher-order spatial feature extraction for object categorization," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2008, pp. 590-597.
31. T. Chen, K.-H. Yap, and D. Zhang, "Discriminative soft bag-of-visual phrase formobile landmark recognition," IEEE Trans.Multimedia, vol. 16, no. 3, pp. 612-622, Apr. 2014.
32. J. M. Winn, A. Criminisi, and T. P. Minka, "Object categorization by learned universal visual dictionary," in Proc. ICCV, 2005, pp. 1800-1807.
33. L. Yang, P. Meer, and D. J. Foran, "Multiple class segmentation using a unified framework over mean-shift patches," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2007, pp. 1-8.
34. I. González-Díaz, C. E. Baz-Hormigos, and F. Díaz-de-María, "A generative model for concurrent image retrieval and ROI segmentation," IEEE Trans. Multimedia, vol. 16, no. 1, pp. 169-183, 2014.
35. D. Nistér and H. Stewénius, "Scalable recognition with a vocabulary tree," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jan. 2006, pp. 2161-2168.
36. W. Zhou, M. Yang, H. Li, X. Wang, Y. Lin, and Q. Tian, "Towards codebook-free: Scalable cascaded hashing for mobile image search," IEEE Trans. Multimedia, vol. 16, no. 3, pp. 601-611, Apr. 2014.
37. B. Liu, Z. Li, L. Yang, M. Wang, and X. Tian, "Real-time video copylocation detection in large-scale repositories," IEEE MultiMedia, vol. 18, no. 3, pp. 22-31, Mar. 2011.
38. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
39. J. G. Carbonell, Y. Yang, R. E. Frederking, R. D. Brown, Y. Geng, and D. Lee, "Translingual information retrieval: A comparative evaluation," in Proc. 15th Int. Joint Conf. Artificial Intelligence, 1997, pp. 708-714.
40. R. Yan, A. G. Hauptmann, and R. Jin, "Multimedia search with pseudorelevance feedback," in Proc. ACM Int. Conf. Image Video Retrieval, 2003, pp. 238-247.
41. C. Carpineto, R. de Mori, G. Romano, and B. Bigi, "An informationtheoretic approach to automatic query expansion," ACM Trans. Inf. Syst., vol. 19, no. 1, pp. 1-27, 2001.
42. T.M. Cover and J.A. Thomas, Elements of Information Theory. New York, NY, USA: Wiley-Interscience, 1991.
43. X. Tian, D. Tao, X.-S. Hua, and X. Wu, "Active reranking for web image search," IEEE Trans. Image Process., vol. 19, no. 3, pp. 805-820, Mar. 2010.
44. X. Tian, D. Tao, and Y. Rui, "Sparse transfer learning for interactive video search reranking," ACM Trans. Multimedia Comput., Commun., Appl., vol. 8, no. 3, pp. 1-19, 2012.
45. Y. Liu, T. Mei, and X.-S. Hua, "Crowdreranking: Exploring multiple search engines for visual search reranking," in Proc. ACM SIGIR Special Interest Group Inf. Retrieval, 2009, pp. 500-507.
46. T. Mei, Y. Rui, S. Li, and Q. Tian, "Multimedia search reranking: A literature survey," ACM Comput. Survey, vol. 46, no. 3, pp. 1-38, 2014.
47. T. Yao, C.-W. Ngo, and T. Mei, "Circular reranking for visual search," IEEE Trans. Image Process., vol. 22, no. 4, pp. 1644-1655, Apr. 2013.
48. Y. Jing and S. Baluja, "Visualrank: Applying pagerank to large-scale image search," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 11, pp. 1877-1890, Nov. 2008.
49. C. Zhai and J.D. Lafferty, "A study of smoothing methods for language models applied to information retrieval,"ACMTrans. Inf. Syst., vol. 22, no. 2, pp. 179-214, 2004.
50. K. Järvelin and J. Kekäläinen, "Cumulated gain-based evaluation of ir techniques," ACM Trans. Inf. Syst., vol. 20, no. 4, pp. 422-446, 2002.
51. J. Krapac, M. Allan, J. Verbeek, and F. Juried, "Improving web image search results using query-relative classifiers," Proc. IEEE Conf. Comput, Vis, Pattern Recog., pp. 1094-1101, 2010.
52. E. Kreyszig, Advanced Engineering Mathematics. NewYork, NY, USA: Wiley, 1997.
53. S. M. Kendall and J. D. Gibbons, Rank Correlation Methods. London, U.K.: Edward Arnold, 1990.
54. J. D. Gibbons and S. Chakraborty, Nonparametric Statistical Inference. New York, NY, USA: Chapman and Hall, 1992.
55. M. Wang, L. Yang, and X.-S. Hua, "Msra-mm: Bridging research and industrial societies for multimedia information retrieval," Microsoft Research Asia, Beijing, China, Tech. Rep. MSR-TR-2009-30, 2009.
56. T.-S. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y. Zheng, "Nuswide: A real-world web image database from National University of Singapore," in Proc. CIVR, 2009, p. 48.