Image retrieval based on query by saliency content

Digital Signal Processing: A Review Journal

Volumn 36, Issue C, 2015, Pages 156-173

  Papushoy, Alex ^a   Bors, Adrian G ^a  

^a UNIVERSITY OF YORK   (United Kingdom)

Author keywords

Content based image retrieval; Earth mover's distance; Human visual attention model; Saliency; Salient edges

Indexed keywords

BEHAVIORAL RESEARCH; CONTENT BASED RETRIEVAL; SEMANTICS;

CONTENT BASED IMAGE RETRIEVAL; EARTH MOVER'S DISTANCE; HUMAN VISUAL ATTENTION; SALIENCY; SALIENT EDGES;

SEARCH ENGINES;

EID: 84928028163     PISSN: 10512004     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.dsp.2014.09.005     Document Type: Article

References (41)

1. M. Corbetta, A sparse support vector machine approach to region-based image categorization, in: Proc. of the National Academy of Sciences of the USA, vol.95, 1990, pp.831-838.
2. J.M. Wolfe, Visual search, in: H. Pashler (Ed.), Attention, Psychology Press, U.K., 1998.
3. S. Frintrop, E. Rome, H. Christensen, Computational visual attention systems and their cognitive foundations: A survey, ACM Trans. Appl. Percept. 7(1) (2010) 61-646.
4. A. Smeulders, M. Worring, S. Santini, A. Gupta, R. Jain, Content-based image retrieval at the end of the early years, IEEE Trans. Pattern Anal. Mach. Intell. 22(12) (2000) 1349-1380.
5. R. Datta, D. Joshi, J. Li, J.Z. Wan, Image retrieval: Ideas, influences, and trends of the new age, ACM Comput. Surv. 40(2) (2008) 51-560.
6. J.Z. Wang, G. Wiederhold, O. Firschein, X.W. Sha, Content-based image indexing and searching using Daubechies' wavelets, Int. J. Digit. Libr. 1(4) (1998) 311-328.
7. J. Wang, J. Li, G. Wiederhold, Simplicity: Semantics-sensitive integrated matching for picture libraries, IEEE Trans. Pattern Anal. Mach. Intell. 23(9) (2001) 947-963.
8. C. Carson, S. Belongie, H. Greenspan, J. Malik, Blob world: Image segmentation using expectation-maximization and its application to image querying, IEEE Trans. Pattern Anal. Mach. Intell. 24(8) (2002) 1026-1038.
9. R. Rahmani, S.A. Goldman, H. Zhang, S.R. Cholleti, J.E. Fritts, Localized content-based image retrieval, IEEE Trans. Pattern Anal. Mach. Intell. 30(11) (2008) 1902-1912.
10. Y.X. Chen, J.Z. Wang, Image categorization by learning and reasoning with images, J. Mach. Learn. Res. 5 (2004) 913-939.
11. Y. Rui, T. Huang, M. Ortega, S. Mehrotra, Relevance feedback: A power tool in interactive content-based image retrieval, IEEE Trans. Circuits Syst. Video Technol. 8(5) (1998) 644-655.
12. J. Bi, Y. Chen, J. Wang, A sparse support vector machine approach to region-based image categorization, in: Proc. IEEE Int. Conf. on Computer Vision and Pattern Recognition, vol.19, 2005, pp.1121-1128.
13. R. Rahmani, S.A. Goldman, H. Zhang, S.R. Cholleti, J.E. Fritts, Localized content-based image retrieval, IEEE Trans. Pattern Anal. Mach. Intell. 30(11) (2008) 1902-1912.
14. Y. Rubner, C. Tomasi, L.J. Guibas, The earth mover distance as a metric for image retrieval, Int. J. Comput. Vis. 40(2) (2000) 99-121.
15. F. Jing, M. Li, H.J. Zhang, B. Zhang, An efficient and effective region-based image retrieval framework, IEEE Trans. Image Process. 13(5) (2004) 699-709.
16. L. Itti, C. Koch, Computational modelling of visual attention, Nat. Rev. Neurosci. 2(3) (2001) 194-203.
17. S. Feng, D. Xu, X. Yang, Attention-driven salient edge(s) and region(s) extraction with application to CBIR, Signal Process. 90(1) (2010) 1-15.
18. J. Harel, C. Koch, P. Perona, Graph-based visual saliency, in: Proc. Advances in Neural Information Processing Systems, NIPS, vol.19, 2007, pp.545-552.
19. J. Wang, H. Zha, R. Cipolla, Combining interest points and edges for content-based image retrieval, in: Proc. IEEE Int. Conf. on Image Processing, 2005, pp.1256-1259.
20. F. Baluch, L. Itti, Mechanisms of top-down attention, Trends Neurosci. 34(4) (2011) 210-224.
21. V. Gopalakrishnan, Y. Hu, D. Rajan, Random walks on graphs for salient object detection in images, IEEE Trans. Image Process. 19(12) (2010) 3232-3242.
22. T. Kadir, M. Brady, Saliency, scale and image description, Int. J. Comput. Vis. 45(2) (2001) 83-105.
23. X. Hou, L. Zhang, Saliency detection: A spectral residual approach, in: Proc. IEEE Int. Conf. on Computer Vision and Pattern Recognition, 2007, pp.1-8.
24. D. Gao, S. Han, N. Vasconcelos, Discriminant saliency, the detection of suspicious coincidences, and applications to visual recognition, IEEE Trans. Pattern Anal. Mach. Intell. 31(6) (2009) 989-1005.
25. L. Itti, C. Koch, E. Niebur, A model of saliency-based visual attention for rapid scene analysis, IEEE Trans. Pattern Anal. Mach. Intell. 20(11) (1998) 1254-1259.
26. L. Itti, S. Ullman, Shifts in selective visual attention: Towards the underlying neural circuitry, Hum. Neurobiol. 4(4) (1985) 219-227.
27. L. Zhang, M.H. Tong, T.K. Marks, H. Shan, G.W. Cottrell, SUN: A Bayesian frame-work for saliency using natural statistics, J. Vis. 8(7) (2008) 321-3220.
28. R. Achanta, S. Hemami, F. Estrada, S. Susstrunk, Frequency-tuned salient region detection, in: Proc. IEEE Int. Conf. on Computer Vision and Pattern Recognition, 2009, pp.1597-1604.
29. J.M. Wolfe, T.S. Horowitz, What attributes guide the deployment of visual attention and how do they do it? Nat. Rev. Neurosci. 5 (2004) 1-7.
30. Y. Cheng, Mean shift, mode seeking, and clustering, IEEE Trans. Pattern Anal. Mach. Intell. 17(8) (1995) 790-799.
31. D. Comaniciu, P. Meer, Mean shift: A robust approach toward feature space analysis, IEEE Trans. Pattern Anal. Mach. Intell. 24(5) (2002) 603-619.
32. A.G. Bors, N. Nasios, Kernel bandwidth estimation for nonparametric modelling, IEEE Trans. Syst. Man Cybern., Part B, Cybern. 39(6) (2009) 1543-1555.
33. S.G. Mallat, A Wavelet Tour of Signal Processing: The Sparse Way, Academic Press, 2009.
34. T. Chang, C.-C.J. Kuo, Texture analysis and classification with tree-structured wavelet transform, IEEE Trans. Image Process. 2(4) (1993) 429-441.
35. N. Otsu, A threshold selection method from gray-level histograms, IEEE Trans. Syst. Man Cybern. 9(1) (1979) 62-66.
36. J. Canny, A computational approach to edge detection, IEEE Trans. Pattern Anal. Mach. Intell. 8(6) (1986) 679-698.
37. G. Stamou, S. Kollias, Multimedia Content and the Semantic Web: Standards, Methods and Tools, Wiley & Sons, 2005.
38. G. Sharma, W. Wu, E.N. Dalal, The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations, Color Res. Appl. 30(1) (2005) 1-24.
39. O. Pele, B. Taskar, The tangent earth mover's distance, in: Proc. Geometric Science of Information, in: Lect. Notes Comput. Sci., vol.8085, 2013, pp.397-404.
40. J. Hanley, B. McNeil, The meaning and use of the area under a receiver operating characteristic (ROC) curve, Radiology 143(1) (1982) 29-36.
41. R.F. Chang, C.-J. Chen, C.H. Liao, Region-based image retrieval using edge flow segmentation and region adjacency graph, in: Inter. Conf. on Multimedia and Expo, 2004, pp.1883-1886.