Hierarchical Image Saliency Detection on Extended CSSD

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 38, Issue 4, 2016, Pages 717-729

  Shi, Jianping ^a   Yan, Qiong ^b   Xu, Li ^b   Jia, Jiaya ^a  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^b Lenovo Group Ltd   (United States)

Author keywords

Region scale; saliency detection

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER VISION;

COMPLEX SCENES; COMPLEX STRUCTURE; HIGH CONTRAST PATTERNS; IMAGE SALIENCIES; INFERENCE MODELS; NATURAL IMAGES; REGION SCALE; SALIENCY DETECTION;

IMAGE SEGMENTATION;

EID: 84963725053     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2015.2465960     Document Type: Article

References (48)

1. M.-M. Cheng, G.-X. Zhang, N. J. Mitra, X. Huang, S.-M. Hu, "Global contrast based salient region detection, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2011, pp. 409-416.
2. K.-Y. Chang, T.-L. Liu, H.-T. Chen, S.-H. Lai, "Fusing generic objectness and visual saliency for salient object detection, " in Proc. IEEE Int. Conf. Comput. Vis., 2011, pp. 914-921.
3. A. Borji, D. N. Sihite, L. Itti, "Salient object detection: A benchmark, " in Proc. Eur. Conf. Comput. Vis., 2012, pp. 414-429.
4. C. Yang, L. Zhang, H. Li, X. Ruan, M.-H. Yang, "Saliency detection via graph-based manifold ranking, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 3166-3173.
5. Y. Wei, F. Wen, W. Zhu, J. Sun, "Geodesic saliency using background priors, " in Proc. Eur. Conf. Comput. Vis., 2012, pp. 9-42.
6. L. Itti and C. Koch, "A saliency-based search mechanism for overt and covert shifts of visual attention, " Vis. Res., vol. 40, nos. 10-12, pp. 1489-1506, 2000.
7. G. Sharma, F. Jurie, C. Schmid, "Discriminative spatial saliency for image classification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 3506-3513.
8. P. Hiremath and J. Pujari, "Content based image retrieval using color boosted salient points and shape features of an image, " Int. J. Image Process., vol. 2, no. 1, pp. 10-17, 2008.
9. K.-Y. Chang, T.-L. Liu, S.-H. Lai, "From co-saliency to co-segmentation: An efficient and fully unsupervised energy minimization model, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2011, pp. 2129-2136.
10. R. Achanta, F. J. Estrada, P. Wils, S. Susstrunk, "Salient region detection and segmentation, " in Proc. 6th Int. Conf. Comput. Vis. Syst., 2008, pp. 66-75.
11. D. A. Klein and S. Frintrop, "Center-surround divergence of feature statistics for salient object detection, " in Proc. IEEE Int. Conf. Comput. Vis., 2011, pp. 2214-2219.
12. F. Perazzi, P. Krahenbuhl, Y. Pritch, A. Hornung, "Saliency filters: Contrast based filtering for salient region detection, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 733-740.
13. D. Walther, L. Itti, M. Riesenhuber, T. Poggio, C. Koch, "Attentional selection for object recognition a gentle way, " in Proc. Biologically Motivated Comput. Vis., 2002, pp. 251-267.
14. E. Macaluso, C. Frith, J. Driver, "Directing attention to locations and to sensory modalities: Multiple levels of selective processing revealed with pet, " Cerebral Cortex, vol. 12, no. 4, pp. 357-368, 2002.
15. T. Lee and D. Mumford, "Hierarchical Bayesian inference in the visual cortex, " J. Opt. Soc. Amer. Opt. Image Sci. Vis. A, vol. 20, no. 7, pp. 1434-1448, 2003.
16. Q. Yan, L. Xu, J. Shi, J. Jia, "Hierarchical saliency detection, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 1155-1162.
17. S. Palmer, Vision Science: Photons to Phenomenology, vol. 1. Cambridge, MA, USA: MIT Press, 1999.
18. A. Toet, "Computational versus psychophysical bottom-up image saliency: A comparative evaluation study, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 11, pp. 2131-2146, Nov. 2011.
19. L. Itti, C. Koch, E. Niebur, "A model of saliency-based visual attention for rapid scene analysis, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998.
20. Y.-F. Ma and H. Zhang, "Contrast-based image attention analysis by using fuzzy growing, " in Proc. ACM Multimedia, 2003, pp. 374-381.
21. J. Harel, C. Koch, P. Perona, "Graph-based visual saliency, " in Proc. Adv. Neural Inf. Process. Syst., 2006, pp. 545-552.
22. T. Judd, K. A. Ehinger, F. Durand, A. Torralba, "Learning to predict where humans look, " in Proc. IEEE Int. Conf. Comput. Vis., 2009, pp. 2106-2113.
23. A. Borji and L. Itti, "Exploiting local and global patch rarities for saliency detection, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 478-485.
24. M.-M. Cheng, Z. Zhang, W.-Y. Lin, P. Torr, "Bing: Binarized normed gradients for objectness estimation at 300fps, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 3286-3293.
25. I. Endres and D. Hoiem, "Category independent object proposals, " in Proc. Eur. Conf. Comput. Vis., 2010, pp. 575-588.
26. B. Alexe, T. Deselaers, V. Ferrari, "Measuring the objectness of image windows, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 11, pp. 2189-2202, Nov. 2012.
27. T. Liu, J. Sun, N. Zheng, X. Tang, H.-Y. Shum, "Learning to detect a salient object, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2007, pp. 1-8.
28. Y. Zhai and M. Shah, "Visual attention detection in video sequences using spatiotemporal cues, " in Proc. ACM Multimedia, 2006, pp. 815-824.
29. R. Achanta, S. S. Hemami, F. J. Estrada, S. Susstrunk, "Frequency-tuned salient region detection, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2009, pp. 1597-1604.
30. X. Shen and Y. Wu, "A unified approach to salient object detection via low rank matrix recovery, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 853-860.
31. S. Goferman, L. Zelnik-Manor, A. Tal, "Context-aware saliency detection, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2010, pp. 2376-2383.
32. P. Khuwuthyakorn, A. Robles-Kelly, J. Zhou, "Object of interest detection by saliency learning, " in Proc. Eur. Conf. Comput. Vis., 2010, pp. 636-649.
33. C. Scharfenberger, A. Wong, K. Fergani, J. S. Zelek, D. A. Clausi, "Statistical textural distinctiveness for salient region detection in natural images, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 979-986.
34. P. Siva, C. Russell, T. Xiang, L. Agapito, "Looking beyond the image: Unsupervised learning for object saliency and detection, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 3238-3245.
35. Y. Li, X. Hou, C. Koch, J. Rehg, A. Yuille, "The secrets of salient object segmentation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 280-287.
36. R. Gonzalez and R. Woods, Digital Image Processing. Englewood Cliffs, NJ, USA: Prentice-Hall, 2002.
37. D. Comaniciu and P. Meer, "Mean shift: A robust approach toward feature space analysis, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 5, pp. 603-619, May 2002.
38. P. F. Felzenszwalb and D. P. Huttenlocher, "Efficient graph-based image segmentation, " Int. J. Comput. Vis., vol. 59, no. 2, pp. 167-181, 2004.
39. B. Tatler, "The central fixation bias in scene viewing: Selecting an optimal viewing position independently of motor biases and image feature distributions, " J. Vis., vol. 7, no. 14, pp. 1-17, 2007.
40. K. P. Murphy, Y. Weiss, M. I. Jordan, "Loopy belief propagation for approximate inference: An empirical study, " in Proc. 15th Conf. Uncertainty Artif. Intell., 1999, pp. 467-475.
41. F. R. Kschischang, B. J. Frey, H.-A. Loeliger, "Factor graphs and the sum-product algorithm, " IEEE Trans. Inf. Theory, vol. 47, no. 2, pp. 498-519, Feb. 2001.
42. S. Wu, X. He, H. Lu, A. L. Yuille, "A unified model of shortrange and long-range motion perception, " in Proc. Adv. Neural Inf. Process. Syst., 2010, pp. 2478-2486.
43. L. Ladicky, C. Russell, P. Kohli, P. Torr, "Associative hierarchical random fields, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 6, pp. 1056-1077, May 2014.
44. Y. Sun, R. Fisher, F. Wang, H. M. Gomes, "A computer vision model for visual-object-based attention and eye movements, " Comput. Vis. Image Understanding, vol. 112, no. 2, pp. 126-142, 2008.
45. M. Schmidt. UGM: Matlab code for undirected graphical models [online]. Available: http://www. di. ens. fr/mschmidt/Software/UGM. html, 2007.
46. M.-M. Cheng, N. J. Mitra, X. Huang, P. H. S. Torr, S.-M. Hu, "Global contrast based salient region detection, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 37, no. 3, pp. 569-582, Mar. 2015.
47. X. Hou and L. Zhang, "Saliency detection: A spectral residual approach, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2007, pp. 1-8.
48. H. Jiang, J. Wang, Z. Yuan, Y. Wu, N. Zheng, S. Li, "Salient object detection: A discriminative regional feature integration approach, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 2083-2090.