Query difficulty prediction for web image search

IEEE Transactions on Multimedia

Volumn 14, Issue 4 PART1, 2012, Pages 951-962

  Tian, Xinmei ^a   Lu, Yijuan ^b   Yang, Linjun ^c  

^a UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA   (China)

^b Texas State University   (United States)

^c MICROSOFT RESEARCH ASIA   (China)

Author keywords

Image retrieval; image search quality; query difficulty prediction (QDP)

Indexed keywords

DAILY LIVES; DATA SETS; DOCUMENT RETRIEVAL; IMAGE QUERY; IMAGE SEARCH; IMAGE SEARCH ENGINE; OPTIMAL IMAGES; PREDICTION METHODS; PREDICTION PROBLEM; QUERY DIFFICULTY PREDICTION (QDP); REAL IMAGES; SEARCH RESULTS; SEARCH RESULTS MERGING; SEMANTIC GAP; TEXT DOCUMENT; VISUAL FEATURE; WEB IMAGE SEARCH;

FORECASTING; SEARCH ENGINES; SEMANTICS;

IMAGE RETRIEVAL;

EID: 84864119641     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2011.2177647     Document Type: Article

References (54)

1. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
2. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2006, pp. 2169-2178.
3. J. Tang,X.-S. Hua,M. Wang, Z.Gu, G.-J.Qi, andX.Wu, "Correlative linear neighborhood propagation for video annotation," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 39, no. 2, pp. 409-416, 2009.
4. M. Wang,X.-S. Hua, R.Hong, J.Tang,G.-J. Qi, and Y. Song, "Unified video annotation via multigraph learning," IEEE Trans. Circuits, Syst. Video Technol., vol. 19, no. 5, pp. 733-746, 2009.
5. J. Tang, H. Li, G.-J. Qi, and T.-S. Chua, "Image annotation by graph-based inference with integrated multiple/single instance representations," IEEE Trans. Multimedia, vol. 12, no. 2, pp. 131-141, 2010.
6. Y. Jing and S. Baluja, "Visualrank: Applying pagerank to large-scale image search," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 11, pp. 1877-1890, 2008.
7. J. Krapac, M. Allan, J. Verbeek, and F. Juried, "Improving web image search results using query-relative classifiers," in IEEE Conf. Comput. Vis. Pattern Recognit., 2010, pp. 1094-1101.
8. X. Tian, D. Tao, X.-S. Hua, and X. Wu, "Active reranking for web image search," IEEE Trans. Image Process., vol. 19, no. 3, pp. 805-820, 2010.
9. M. Wang, K. Yang, X.-S. Hua, and H.-J. Zhang, "Towards a relevant and diverse search of social images," IEEE Trans. Multimedia, vol. 2, no. 8, pp. 829-842, 2010.
10. B. Geng, L. Yang, C. Xu, and X.-S. Hua, "Content-Aware ranking for visual search," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2010, pp. 3400-3407.
11. L. Yang and A. Hanjalic, "Learning from search engine and human supervision for web image search," in Proc. ACM Int. Conf. Multimedia, 2011, pp. 1365-1368.
12. E. Yom-Tov, S. Fine, D. Carmel, and A. Darlow, "Learning to estimate query difficulty: Including applications to missing content detection and distributed information retrieval," Proc. ACM SIGIR Special Interest Group on Inf. Retrieval, pp. 512-519, 2005.
13. J. A. Aslam and V. Pavlu, "Query hardness estimation using Jensen-Shannon divergence among multiple scoring functions," in Proc. Eur. Conf. Inf. Retrieval, 2007, pp. 198-209.
14. S. Cronen-Townsend, Y. Zhou, andW. B. Croft, "Predicting query performance," in Proc. ACM SIGIR Special Interest Group on Inf. Retrieval, 2002, pp. 299-306.
15. E. C. Jensen, S. M. Beitzel, D. Grossman, O. Frieder, and A. Chowdhury, "Predicting query difficulty on the web by learning visual clues," in Proc. ACM SIGIR Special Interest Group on Inf. Retrieval, 2005, pp. 615-616.
16. Y.Zhou andW. B. Croft, "Query performance prediction in web search environments," in Proc. ACM SIGIR Special Interest Group on Inf. Retrieval, 2007, pp. 543-550.
17. C. Hauff, V. Murdock, and R. Baeza-Yates, "Improved query difficulty prediction for the web," in Proc. ACM Int. Conf. Inf. and Knowl. Manag., 2008, pp. 439-448.
18. A. W. M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain, "Content-based image retrieval at the end of the early years," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 12, pp. 1349-1380, 2000.
19. X. Geng, Z.-H. Zhou, and K. Smith-Miles, "Automatic age estimation based on facial aging patterns," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 12, pp. 2234-2240, 2007.
20. G. Guo, Y. Fu, C. R. Dyer, and T. S. Huang, "Image-based human age estimation by manifold learning and locally adjusted robust regression," IEEE Trans. Image Process., vol. 17, no. 7, pp. 1178-1188, 2008.
21. S. Rudinac,M. Larson, and A. Hanjalic, "Exploiting result consistency to select query expansions for spoken content retrieval," in Proc. Eur. Conf. Inf. Retrieval, 2010, pp. 645-648.
22. B. He and I. Ounis, "Inferring query performance using pre-retrieval predictors," in Proc. Symp. String Process. Inf. Retrieval, 2004, pp. 43-54.
23. K.-L. Kwok, L. Grunfeld, H. L. Sun, and P. Deng, "Trec 2004 robust track experiments using PIRCs," in Proc. TREC, 2004.
24. H. Imran and A. Sharan, "Co-occurrence based predictors for estimating query difficulty," in Proc. 2010 IEEE Int. Conf. Data Mining Workshops, 2010, pp. 867-874.
25. G. Amati, C. Carpineto, and G. Romano, "Query difficulty, robustness, and selective application of query expansion," in Proc. Eur. Conf. Inf. Retrieval, 2004, pp. 127-137.
26. Y. Zhou and W. B. Croft, "Ranking robustness: A novel framework to predict query performance," in Proc. ACM Int. Conf. Inf. Knowl. Manag., 2006, pp. 567-574.
27. D. Carmel, E. Yom-Tov, A. Darlow, and D. Pelleg, "What makes a query difficult?," in Proc. ACM SIGIR Special Interest Group on Inf. Retrieval, 2006, pp. 390-397.
28. T. M. Cover and J.A. Thomas, Elements of Information Theory. New York: Wiley-Interscience, 1991.
29. J. Lin, "Divergence measures based on the Shannon entropy," IEEE Trans. Inf. Theory, vol. 37, no. 1, pp. 145-151, 1991.
30. J. He, M. Larson, and M. De Rijke, "Using coherence-based measures to predict query difficulty," in Proc. Eur. Conf. Inf. Retrieval, 2008, pp. 689-694.
31. X. Xing, Y. Zhang, and M. Han, "Query difficulty prediction for contextual image retrieval," in Proc. Eur. Conf. Inf. Retrieval, 2010, pp. 581-585.
32. Y. Li, Y. Luo, D. Tao, and C. Xu, "Query difficulty guided image retrieval system," in Proc. Int. Conf. Adv. Multimedia Model., 2011, pp. 479-482.
33. Trecvid Video Retrieval Evaluation [Online]. Available: Hppt://wwwnlpir. nist.gov/projects/trecvid/
34. K. Järvelin and J. Kekäläinen, "Cumulated gain-based evaluation of IR techniques," ACM Trans. Inf. Syst., vol. 20, no. 4, pp. 422-446, 2002.
35. V. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
36. J. B.MacQueen, "Some methods for classification and analysis of multivariate observations," in Proc. 5th Berkeley Symp. Math. Stat. Probability, 1967, pp. 281-297, Univ. of California Press.
37. J. G. Carbonell, Y. Yang, R. E. Frederking, R. D. Brown, Y. Geng, and D. Lee, "Translingual information retrieval: A comparative evaluation," in Proc. Int. Joint Conf. Artif. Intell., 1997, pp. 708-714.
38. R. Yan, A. G. Hauptmann, and R. Jin, "Multimedia search with pseudorelevance feedback," in ACM Int. Conf. Image Video Retrieval, 2003, pp. 238-247.
39. M. J. Swain and D. H. Ballard, "Color indexing," Int. J. Comput. Vis., vol. 7, no. 1, pp. 11-32, 1991.
40. W. H. Hsu, L. S. Kennedy, and S.-F. Chang, "Video search reranking through random walk over document-level context graph," in ACM Int. Conf. Multimedia, 2007, pp. 971-980.
41. E. Parzen, "On estimation of a probability density function and mode," Ann. Math. Stat., vol. 33, no. 3, pp. 1065-1076, 1962.
42. J. Deng, A. C. Berg, K. Li, and F.-F. Li, "What does classifying more than 10 000 image categories tell us?," in Proc. Eur. Conf. Comput. Vis., 2010, pp. 71-84.
43. C.-C. Chang and C.-J. Lin, Libsvm: A Library for Support Vector Machines [Online]. Available: Http://www.csie.ntu.edu.tw/cjlin/libsvm/2004
44. R.O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification. New York: Wiley, 2001.
45. E. Kreyszig, Advanced Engineering Mathematics. New York:Wiley, 1997.
46. S. M. Kendall and J. D. Gibbons, Rank Correlation Methods. London, U.K.: Edward Arnold, 1990.
47. J. D. Gibbons and S. Chakraborty, Nonparametric Statistical Inference. New York: Marcel Dekker, 1992.
48. J. L. Herlocker, J. A. Konstan, L. G. Terveen, John, and T. Riedl, "Evaluating collaborative filtering recommender systems," ACM Trans. Inf. Syst., vol. 22, no. 1, pp. 5-53, 2004.
49. M. R. McLaughlin and J. L. Herlocker, "A collaborative filtering algorithm and evaluationmetric that accuratelymodel the user experience," in Proc. ACM SIGIR Special Interest Group on Inf. Retrieval, 2004, pp. 329-336.
50. X. Tian, L. Yang, J.Wang, X.Wu, and X.-S. Hua, "Transductive video annotation via local learnable kernel classifier," in Proc. IEEE Int. Conf. Multimedia and Expo., Hannover, Germany, Jun. 23-26, 2008, pp. 1509-1512.
51. J. Tang, S. Yan, R.Hong,G.-J. Qi, and T.-S.Chua, "Inferring semantic concepts from community-contributed images and noisy tags," in Proc. ACM Int. Conf. Multimedia, 2009, pp. 223-232.
52. R. Hong, M. Wang, M. Xu, S. Yan, and T.-S. Chua, "Dynamic captioning: Video accessibility enhancement for hearing impairment," in Proc. ACM Int. Conf. Multimedia, 2010, pp. 421-430.
53. X. Tian, L. Yang, J. Wang, Y. Yang, X. Wu, and X.-S. Hua, "Bayesian video search reranking," in Proc. ACM Int. Conf. Multimedia, 2008, pp. 131-140.
54. L. Yang and A. Hanjalic, "Supervised reranking for web image search," in Proc. ACM Int. Conf. Multimedia, 2010, pp. 183-192.