Saliency tree: A novel saliency detection framework

IEEE Transactions on Image Processing

Volumn 23, Issue 5, 2014, Pages 1937-1952

  Liu, Zhi ^a,b   Zou, Wenbin ^c,d   Le Meur, Olivier ^e  

^a SHANGHAI UNIVERSITY   (China)

^b CAMPUS DE BEAULIEU   (France)

^c SHENZHEN UNIVERSITY   (China)

^d UNIVERSITÉ EUROPÉENNE DE BRETAGNE   (France)

^e UNIVERSITÉ DE RENNES 1   (France)

Author keywords

saliency detection; saliency model; Saliency tree

Indexed keywords

IMAGE SEGMENTATION; PIXELS;

ADAPTIVE COLOR QUANTIZATION; GLOBAL CONTRASTS; REGION MERGING APPROACH; REGION SEGMENTATION; REGIONAL SIMILARITIES; SALIENCY DETECTION; SALIENCY MODELING; SALIENCY TREE;

FORESTRY;

FORESTRY; IMAGE ANALYSIS; MATHEMATICAL MODELS;

EID: 84898025441     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2307434     Document Type: Article

References (61)

1. B. Alexe, T. Deselaers, and V. Ferrari, "What is an object," in Proc. IEEE CVPR, Jun. 2010, pp. 73-80.
2. R. Shi, Z. Liu, H. Du, X. Zhang, and L. Shen, "Region diversity maximization for salient object detection," IEEE Signal Process. Lett., vol. 19, no. 4, pp. 215-218, Apr. 2012.
3. J. Han, K. N. Ngan, M. Li, and H. Zhang, "Unsupervised extraction of visual attention objects in color images," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 1, pp. 141-145, Jan. 2006. (Pubitemid 43172623)
4. E. Rahtu, J. Kannala, M. Salo, and J. Heikkila, "Segmenting salient objects from images and videos," in Proc. ECCV, Sep. 2010, pp. 366-379.
5. C. Jung, and C. Kim, "A unified spectral-domain approach for saliency detection and its application to automatic object segmentation," IEEE Trans. Image Process., vol. 21, no. 3, pp. 1272-1283, Mar. 2012.
6. Z. Liu, R. Shi, L. Shen, Y. Xue, K. N. Ngan, and Z. Zhang, "Unsupervised salient object segmentation based on kernel density estimation and two-phase graph cut," IEEE Trans. Multimedia, vol. 14, no. 4, pp. 1275-1289, Aug. 2012.
7. V. Setlur, T. Lechner, M. Nienhaus, and B. Gooch, "Retargeting images and video for preserving information saliency," IEEE Comput. Graph. Appl., vol. 27, no. 5, pp. 80-88, Sep. 2007. (Pubitemid 47434072)
8. A. Shamir, and S. Avidan, "Seam carving for media retargeting," Commun. ACM, vol. 52, no. 1, pp. 77-85, Jan. 2009.
9. Y. Luo, J. Yuan, P. Xue, and Q. Tian, "Saliency density maximization for efficient visual objects discovery," IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 12, pp. 1822-1834, Dec. 2011.
10. C. Guo, and L. Zhang, "A novel multiresolution spatiotemporal saliency detection model and its applications in image and video compression," IEEE Trans. Image Process., vol. 19, no. 1, pp. 185-198, Jan. 2010.
11. Z. Li, S. Qin, and L. Itti, "Visual attention guided bit allocation in video compression," Image Vis. Comput., vol. 29, no. 1, pp. 1-14, Jan. 2011.
12. H. Fu, Z. Chi, and D. Feng, "Attention-driven image interpretation with application to image retrieval," Pattern Recognit., vol. 39, no. 9, pp. 1604-1621, Sep. 2006. (Pubitemid 43867564)
13. A. Borji, D. N. Sihite, and L. Itti, "Salient object detection: A benchmark," in Proc. ECCV, Oct. 2012, pp. 414-429.
14. C. Koch and S. Ullman, "Shifts in selective visual attention: Towards the underlying neural circuitry," Human Neurobiol., vol. 4, no. 4, pp. 219-227, 1985. (Pubitemid 16176695)
15. A. M. Treisman and G. Gelade, "A feature-integration theory of attention," Cognit. Psychol., vol. 12, no. 1, pp. 97-136, Jan. 1980.
16. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998. (Pubitemid 128742001)
17. Y. F. Ma and H. J. Zhang, "Contrast-based image attention analysis by using fuzzy growing," in Proc. ACM Multimedia, Nov. 2003, pp. 374-381.
18. O. Le Meur and J.-C. Chevet, "Relevance of a feed-forward model of visual attention for goal-oriented and free-viewing tasks," IEEE Trans. Image Process., vol. 19, no. 11, pp. 2801-2813, Nov. 2010.
19. W. Kim, C. Jung, and C. Kim, "Spatiotemporal saliency detection and its applications in static and dynamic scenes," IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 4, pp. 446-456, Apr. 2011.
20. D. Gao, V. Mahadevan, and N. Vasconcelos, "The discriminant centersurround hypothesis for bottom-up saliency," in Proc. NIPS, Dec. 2007, pp. 497-504.
21. H. J. Seo and P. Milanfar, "Static and space-time visual saliency detection by self-resemblance," J. Vis., vol. 9, no. 12, pp. 1-27, Nov. 2009.
22. Y. Lin, Y. Tang, B. Fang, Z. Shang, Y. Huang, and S. Wang, "A visual-attention model using earth Mover's distance based saliency measurement and nonlinear feature combination," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 2, pp. 314-328, Feb. 2013.
23. R. Achanta, S. Hemami, F. Estrada, and S. Susstrunk, "Frequencytuned salient region detection," in Proc. IEEE CVPR, Jun. 2009, pp. 1597-1604.
24. R. Achanta and S. Susstrunk, "Saliency detection using maximum symmetric surround," in Proc. IEEE ICIP, Sep. 2010, pp. 2653-2656.
25. M. Z. Aziz and B. Mertsching, "Fast and robust generation of feature maps for region-based visual attention," IEEE Trans. Image Process., vol. 17, no. 5, pp. 633-644, May 2008. (Pubitemid 351597156)
26. L. Zhang, M. H. Tong, T. K. Marks, H. Shan, and G. W. Cottrell, "SUN: A Bayesian framework for saliency using natural statistics," J. Vis., vol. 8, no. 7, pp. 1-20, Dec. 2008.
27. T. Kadir and M. Brady, "Saliency, scale and image description," Int. J. Comput. Vis., vol. 45, no. 2, pp. 83-105, Nov. 2001. (Pubitemid 33125858)
28. W. Wang, Y. Wang, Q. Huang, and W. Gao, "Measuring visual saliency by site entropy rate," in Proc. IEEE CVPR, Jun. 2010, pp. 2368-2375.
29. X. Hou and L. Zhang, "Saliency detection: A spectral residual approach," in Proc. IEEE CVPR, Jun. 2007, pp. 1-8.
30. O. Le Meur, P. Le Callet, D. Barba, and D. Thoreau, "A coherent computational approach to model bottom-up visual attention," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 5, pp. 802-817, May 2006.
31. J. Harel, C. Koch, and P. Perona, "Graph-based visual saliency," in Proc. NIPS, Dec. 2006, pp. 545-552.
32. V. Gopalakrishnan, Y. Hu, and D. Rajan, "Random walks on graphs for salient object detection in images," IEEE Trans. Image Process., vol. 19, no. 12, pp. 3232-3242, Dec. 2010.
33. T. Avraham and M. Lindenbaum, "Esaliency (extended saliency): Meaningful attention using stochastic image modeling," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 4, pp. 693-708, Apr. 2010.
34. T. Liu, J. Sun, N. Zheng, X. Tang, and H. Y. Shum, "Learning to detect a salient object," in Proc. IEEE CVPR, Jun. 2007, pp. 1-8.
35. H. Jiang, J. Wang, Z. Yuan, Y. Wu, N. Zheng, and S. Li, "Salient object detection: A discriminative regional feature integration approach," in Proc. IEEE CVPR, Jun. 2013, pp. 2083-2090.
36. T. Judd, K. Ehinger, F. Durand, and A. Torralba, "Learning to predict where humans look," in Proc. IEEE ICCV, Sep. 2009, pp. 2106-2113.
37. S. Goferman, L. Zelnik-Manor, and A. Tal, "Context-aware saliency detection," in Proc. IEEE CVPR, Jun. 2010, pp. 2376-2383.
38. V. Gopalakrishnan, Y. Hu, and D. Rajan, "Salient region detection by modeling distributions of color and orientation," IEEE Trans. Multimedia, vol. 11, no. 5, pp. 892-905, Aug. 2009.
39. W. Zhang, Q. M. J. Wu, G. Wang, and H. Yin, "An adaptive computational model for salient object detection," IEEE Trans. Multimedia, vol. 12, no. 4, pp. 300-316, Jun. 2010.
40. Z. Liu, Y. Xue, H. Yan, and Z. Zhang, "Efficient saliency detection based on Gaussian models," IET Image Process., vol. 5, no. 2, pp. 122-131, Mar. 2011.
41. Z. Liu, Y. Xue, L. Shen, and Z. Zhang, "Nonparametric saliency detection using kernel density estimation," in Proc. IEEE ICIP, Sep. 2010, pp. 253-256.
42. M. M. Cheng, G. X. Zhang, N. J. Mitra, X. Huang, and S. M. Hu, "Global contrast based salient region detection," in Proc. IEEE CVPR, Jun. 2011, pp. 409-416.
43. X. Zhang, Z. Ren, D. Rajan, and Y. Hu, "Salient object detection through over-segmentation," in Proc. IEEE ICME, Jul. 2012, pp. 1033-1038.
44. Z. Liu, O. Le Meur, S. Luo, and L. Shen, "Saliency detection using regional histograms," Opt. Lett., vol. 38, no. 5, pp. 700-702, Mar. 2013.
45. Z. Liu, O. Le Meur, and S. Luo, "Superpixel-based saliency detection," in Proc. IEEE WIAMIS, Jul. 2013, pp. 1-4.
46. F. Perazzi1, P. Krähenbül, Y. Pritch, and A. Hornung, "Saliency filters: Contrast based filtering for salient region detection," in Proc. IEEE CVPR, Jun. 2012, pp. 733-740.
47. Q. Yan, L. Xu, J. Shi, and J. Jia, "Hierarchical saliency detection," in Proc. IEEE CVPR, Jun. 2013, pp. 1155-1162.
48. K. Y. Chang, T. L. Liu, H. T. Chen, and S. H. Lai, "Fusing generic objectness and visual saliency for salient object detection," in Proc. IEEE ICCV, Nov. 2011, pp. 914-921.
49. H. Jiang, J. Wang, Z. Yuan, T. Liu, N. Zheng, and S. Li, "Automatic salient object segmentation based on context and shape prior," in Proc. BMVC, Aug. 2011, pp. 1-12.
50. X. Shen and Y. Wu, "A unified approach to salient object detection via low rank matrix recovery," in Proc. IEEE CVPR, Jun. 2012, pp. 853-860.
51. W. Zou, K. Kpalma, Z. Liu, and J. Ronsin, "Segmentation driven lowrank matrix recovery for saliency detection," in Proc. BMVC, Sep. 2013, pp. 1-13.
52. Y. Wei, F. Wen, W. Zhu, and J. Sun, "Geodesic saliency using background priors," in Proc. ECCV, vol. 3. Oct. 2012, pp. 29-42.
53. Y. Xie, H. Lu, and M. H. Yang, "Bayesian saliency via low and mid level cues," IEEE Trans. Image Process., vol. 22, no. 5, pp. 1689-1698, May 2013.
54. P. Arbelaez, M. Maire, C. Fowlkes, and J. Malik, "Contour detection and hierarchical image segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 5, pp. 898-916, May 2011.
55. P. Salembier and L. Garrido, "Binary partition tree as an efficient representation for image processing, segmentation, and information retrieval," IEEE Trans. Image Process., vol. 9, no. 4, pp. 561-576, Apr. 2000. (Pubitemid 30594737)
56. S. Alpert, M. Galun, R. Basri, and A. Brandt, "Image segmentation by probabilistic bottom-up aggregation and cue integration," in Proc. IEEE CVPR, Jun. 2007, pp. 1-8.
57. V. Movahedi, and J. H. Elder, "Design and perceptual validation of performance measures for salient object segmentation," in Proc. IEEE POCV, Jun. 2010, pp. 49-56.
58. D. Martin, C. Fowlkes, D. Tal, and J. Malik, "A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics," in Proc. IEEE ICCV, vol. 2. Jul. 2001, pp. 416-423. (Pubitemid 32795086)
59. M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman, "The pascal visual object classes (VOC) challenge," Int. J. Comput. Vis., vol. 88, no. 2, pp. 303-338, Jun. 2010.
60. N. Otsu, "A threshold selection method from gray-level histograms," IEEE Trans. Syst. Man Cybern., vol. 9, no. 1, pp. 62-66, Jan. 1979. (Pubitemid 9413341)
61. B. Catanzaro, B.-Y. Su, N. Sundaram, Y. Lee, M. Murphy, and K. Keutzer, "Efficient, high-quality image contour detection," in Proc. IEEE ICCV, Sep. 2009, pp. 2381-2388.