Click prediction for web image reranking using multimodal sparse coding

IEEE Transactions on Image Processing

Volumn 23, Issue 5, 2014, Pages 2019-2032

  Yu, Jun ^a   Rui, Yong ^b   Tao, Dacheng ^c  

^a HANGZHOU DIANZI UNIVERSITY   (China)

^b MICROSOFT RESEARCH ASIA   (China)

^c UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

click; Image reranking; manifolds; sparse codes.

Indexed keywords

ALGORITHMS; AUTOMOBILE ENGINE MANIFOLDS; FORECASTING; GRAPH THEORY; SEMANTICS;

ALTERNATING OPTIMIZATIONS; CLICK; CRITICAL PROBLEMS; IMAGE RE RANKINGS; LARGE-SCALE DATABASE; SEMANTIC SIMILARITY; SPARSE CODES; VOTING STRATEGIES;

IMAGE CODING;

EID: 84898031966     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2311377     Document Type: Article

References (50)

1. Y. Gao, M. Wang, Z. J. Zha, Q. Tian, Q. Dai, and N. Zhang, "Less is more: Efficient 3D object retrieval with query view selection," IEEE Trans. Multimedia, vol. 13, no. 5, pp. 1007-1018, Oct. 2011.
2. S. Clinchant, J. M. Renders, and G. Csurka, "Trans-media pseudo relevance feedback methods in multimedia retrieval," in Proc. CLEF, 2007, pp. 1-12.
3. L. Duan, W. Li, I. W. Tsang, and D. Xu, "Improving web image search by bag-based reranking," IEEE Trans. Image Process., vol. 20, no. 11, pp. 3280-3290, Nov. 2011.
4. B. Geng, L. Yang, C. Xu, and X. Hua, "Content-aware Ranking for visual search," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 3400-3407.
5. B. Carterette and R. Jones, "Evaluating search engines by modeling the relationship between relevance and clicks," in Proc. Adv. Neural Inf. Process. Syst., 2007, pp. 1-9.
6. G. Dupret and C. Liao, "A model to estimate intrinsic document relevance from the clickthrough logs of a web search engine," in Proc. ACM Int. Conf. Web Search Data Mining, 2010, pp. 181-190.
7. G. Smith and H. Ashman, "Evaluating implicit judgments from image search interactions," in Proc. WebSci. Soc., 2009, pp. 1-3.
8. M. Shokouhi, F. Scholer, and A. Turpin, "Investigating the effectiveness of clickthrough data for document reordering," in Proc. Eur. Conf. Adv. Inf. Retr., 2008, pp. 591-595. (Pubitemid 351499109)
9. V. Jain and M. Varma, "Random walks on the click graph," in Proc. ACM SIGIR Conf. Res. Develop. Inf. Retr., 2007, pp. 239-246.
10. V. Jain and M. Varma, "Learning to re-rank: Query-dependent image re-ranking using click data," in Proc. Int. Conf. World Wide Web, 2011, pp. 277-286.
11. E. Candès, J. Romberg, and T. Tao, "Stable signal recovery from incomplete and inaccurate measurements," Commun. Pure Appl. Math., vol. 59, no. 8, pp. 1207-1223, 2006. (Pubitemid 43988295)
12. A. Eriksson and A. van den Hengel, "Efficient computation of robust low-rank matrix approximations in the presence of missing data using the l1 norm," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 771-778.
13. J. Mairal, F. Bach, J. Ponce, G. Sapiro, and A. Zisserman, "Non-local sparse models for image restoration," in Proc. IEEE Int. Conf. Comput. Vis., Oct. 2009, pp. 2272-2279.
14. J. Yang, K. Yu, Y. Gong, and T. Huang, "Linear spatial pyramid matching using sparse coding for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 1794-1801.
15. S. Gao, I. Tsang, and L. T. Chia, "Kernel sparse representation for image classification and face recognition," in Proc. Eur. Conf. Comput. Vis., 2010, pp. 1-14.
16. J. Wright, A. Yang, A. Ganesh, S. Sastry, and Y. Ma, "Robust face recognition via sparse representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 210-227, Feb. 2009.
17. C. Wang, S. Yan, L. Zhang, and H. Zhang, "Multi-label sparse coding for automatic image annotation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 1643-1650.
18. D. Donoho, "For most large underdetermined systems of linear equations, the minimal l1-norm solution is also the sparsest solution," Dept. Statist., Stanford Univ., Stanford, CA, USA, Tech. Rep., 2004.
19. S. Gao, I. Tsang, and L. Chia, "Laplacian sparse coding, hypergraph Laplacian sparse coding, and applications," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 1, pp. 92-104, Jan. 2013.
20. C. Snoek, M. Worring, and A. Smeulders, "Early versus late fusion in semantic video analysis," in Proc. ACM Int. Conf. Multimedia, 2005, pp. 399-402.
21. D. Zhou, O. Bousquet, T. Lal, J. Weston, and B. Scholkopf, "Learning with local and global consistency," in Proc. Int. Conf. Neural Inf. Process. Syst., 2004, pp. 321-328.
22. X. He, W. Y. Ma, and H. J. Zhang, "Learning an image manifold for retrieval," in Proc. ACM Int. Conf. Multimedia, 2004, pp. 17-23. (Pubitemid 40211713)
23. M. Belkin and P. Niyogiy, "Laplacian eigenmaps for dimensionality reduction and data representation," Neural Comput., vol. 15, no. 6, pp. 1373-1396, 2003. (Pubitemid 37049796)
24. R. Zass and A. Shashua, "Probabilistic graph and hypergraph matching," in Proc. Int. Conf. Comput. Vis. Pattern Recognit., 2008, pp. 1-8.
25. L. Sun, S. Ji, and J. Ye, "Hypergraph spectral learning for multi-label classification," in Proc. Int. Conf. Know. Discovery Data Mining, 2008, pp. 668-676.
26. Y. Huang, Q. Liu, and D. Metaxas, "Video object segmentation by hypergraph cut," in Proc. Int. Conf. Comput. Vis. Pattern Recognit., 2009, pp. 1738-1745.
27. Z. Tian, T. Hwang, and R. Kuang, "A hypergraph-based learning algorithm for classifying gene expression and array CGH data with prior knowledge," Bioinformatics, vol. 25, no. 21, pp. 2831-2838, 2009.
28. Y. Huang, Q. Liu, S. Zhang, and D. Metaxas, "Image retrieval via probabilistic hypergraph ranking," in Proc. Int. Conf. Comput. Vis. Pattern Recognit., 2010, pp. 3376-3383.
29. D. Zhou, J. Huang, and B. Schölkopf, "Learning with hypergraphs: Clustering, classification, and embedding," in Proc. Neural Inf. Process. Syst., 2006, pp. 1601-1608.
30. M. Wang, X. S. Hua, R. Hong, J. Tang, G. Qi, and Y. Song, "Unified video annotation via multigraph learning," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 5, pp. 733-746, May 2009.
31. B. Geng, C. Xu, D. Tao, L. Yang, and X. S. Hua, "Ensemble manifold regularization," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 2396-2402.
32. H. Lee, A. Battle, R. Raina, and A. Y. Ng, "Efficient sparse coding algorithms," in Proc. Adv. Neural Inf. Process. Syst., 2006, pp. 801-808.
33. M. Wang, X. S. Hua, X. Yuan, Y. Song, and L. R. Dai, "Optimizing multigraph learning: Towards a unified video annotation scheme," in Proc. ACM Int. Conf. Multimedia, 2007, pp. 862-870.
34. Y. Lv and C. Zhai, "Positional relevance model for pseudo-relevance feedback," in Proc. Int. Conf. Res. Develop. Inf. Retr., 2010, pp. 579-586.
35. R. Yan, A. Hauptmann, and R. Jin, "Multimedia search with pseudorelevance feedback," in Proc. Int. Conf. Image Video Retr., 2003, pp. 238-247.
36. W. Hsu, L. Kennedy, and S. Chang, "Video search reranking via information bottleneck principle," in Proc. ACM Int. Conf. Multimedia, 2006, pp. 35-44. (Pubitemid 47113499)
37. W. Hsu, L. Kennedy, and S. Chang, "Video search reranking through random walk over document-level context graph," in Proc. ACM Int. Conf. Multimedia, 2007, pp. 971-980.
38. X. Tian, L. Yang, J. Wang, X. Wu, and X. Hua, "Bayesian visual reranking," IEEE Trans. Multimedia, vol. 13, no. 4, pp. 639-652, Aug. 2010.
39. T. Joachims, L. Granka, B. Pan, H. Hembrooke, F. Radlinski, and G. Gay, "Evaluating the accuracy of implicit feedback from clicks and query reformulations in web search," ACM TOIS, vol. 25, no. 2, pp. 1-6, 2007.
40. D. Zhou, O. Bousquet, T. Lal, J. Weston, and B. Scholkopf, "Learning with local and global consistency," in Proc. Neural Inf. Process. Syst., 2004, pp. 321-328.
41. R. Tibshirani, "Regression shrinkage and selection via the lasso," J. R. Statist. Soc., Series B, vol. 58, no. 8, pp. 267-288, 1994.
42. K. Jarvelin and J. Kekalainen, "Cumulated gain-based evaluation of ir techniques," ACM Trans. Inf. Syst., vol. 20, no. 4, pp. 422-446, 2002. (Pubitemid 44642296)
43. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Jan. 2006, pp. 2169-2178. (Pubitemid 44931582)
44. A. Oliva and A. Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope," Int. J. Comput. Vis., vol. 42, no. 3, pp. 145-175, 2001. (Pubitemid 32680801)
45. D. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
46. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, and Y. Gong, "Localityconstrained linear coding for image classification," in Proc. Comput. Vis. Pattern Recognit., 2010, pp. 3360-3367.
47. B. Efron, T. Hastie, I. Johnstone, and R. Tibshirani, "Least angle regression," Ann. Statist., vol. 32, no. 2, pp. 407-499, 2004. (Pubitemid 41250302)
48. S. Perkins and J. Theiler, "Online feature selection using grafting," in Proc. ICML, 2003, pp. 592-599.
49. S. Chen, D. Donoho, and M. Saunders, "Atomic decomposition by basis pursuit," SIAM J. Sci. Comput., vol. 20, no. 1, pp. 33-61, 1998. (Pubitemid 128689501)
50. C. Xu, D. Tao, and C. Xu, "A survey on multi-view learning," Neural Comput. Appl., vol. 23, no. 7-8, pp. 2031-2038, 2013.