Salient Region Detection by Fusing Bottom-Up and Top-Down Features Extracted from a Single Image

IEEE Transactions on Image Processing

Volumn 23, Issue 10, 2014, Pages 4389-4398

  Tian, Huawei ^a   Fang, Yuming ^b   Zhao, Yao ^c   Lin, Weisi ^d   Ni, Rongrong ^c   Zhu, Zhenfeng ^c  

^a PEOPLE S PUBLIC SECURITY UNIVERSITY OF CHINA   (China)

^b JIANGXI UNIVERSITY OF FINANCE AND ECONOMICS   (China)

^c BEIJING JIAOTONG UNIVERSITY   (China)

^d NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

bottom up and top down visual attention; Human visual system (HVS); salient region detection

Indexed keywords

BEHAVIORAL RESEARCH; COLOR; IMAGE PROCESSING;

ADAPTIVE WEIGHTS; BOTTOM-UP AND TOP-DOWN; CONFIDENCE LEVELS; GLOBAL CONTRASTS; HUMAN VISUAL SYSTEMS; LOW-LEVEL FEATURES; ORIENTATION FEATURES; SALIENT REGION DETECTIONS;

FEATURE EXTRACTION;

EID: 84939816499     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2350914     Document Type: Article

References (58)

1. Y. Tian, J. Li, S. Yu, and T. Huang, "Learning complementary saliency priors for foreground object segmentation in complex scenes," Int. J. Comput. Vis., Jul. 2014, doi: 10.1007/s11263-014-0737-1.
2. U. Rutishauser, D. Walther, C. Koch, and P. Perona, "Is bottom-up attention useful for object recognition?" in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), vol. 2. Jun. 2004, pp. II-37-II-44.
3. Y. Fang, Z. Chen, W. Lin, and C.-W. Lin, "Saliency detection in the compressed domain for adaptive image retargeting," IEEE Trans. Image Process., vol. 21, no. 9, pp. 3888-3901, Sep. 2012.
4. M. Ding and R.-F. Tong, "Content-aware copying and pasting in images," Vis. Comput., vol. 26, nos. 6-8, pp. 721-729, Jun. 2010.
5. H. Wu, Y.-S. Wang, K.-C. Feng, T.-T. Wong, T.-Y. Lee, and P.-A. Heng, "Resizing by symmetry-summarization," in Proc. ACM SIGGRAPH Asia, Dec. 2010, pp. 159-1-159-10.
6. T. Chen, M.-M. Cheng, P. Tan, A. Shamir, and S.-M. Hu, "Sketch2photo: Internet image montage," ACM Trans. Graph., vol. 28, no. 5, pp. 124-1-124-10, Dec. 2009.
7. X. Hou, J. Harel, and C. Koch, "Image signature: Highlighting sparse salient regions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 1, pp. 194-201, Jan. 2012.
8. M.-M. Cheng, N. J. Mitra, X. Huang, P. H. S. Torr, and S.-M. Hu, "Salient object detection and segmentation," Dept. Comput. Sci. Technol., Tsinghua Univ., Beijing, China, Tech. Rep. 1, 2012.
9. A. Borji and L. Itti, "State-of-the-art in visual attention modeling," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 1, pp. 185-207, Jan. 2013.
10. A. M. Treisman and G. Gelade, "A feature-integration theory of attention," Cognit. Psychol., vol. 12, no. 1, pp. 97-136, Jan. 1980.
11. A. Treisman, "Preattentive processing in vision," Comput. Vis., Graph., Image Process., vol. 31, no. 2, pp. 156-177, Aug. 1985.
12. A. Treisman and S. Gormican, "Feature analysis in early vision: Evidence from search asymmetries," Psychol. Rev., vol. 95, no. 1, pp. 15-48, Jan. 1988.
13. J. M. Wolfe, "Guided search 4.0: Current progress with a model of visual search," in Integrated Models of Cognitive Systems, W. Gray, Ed. New York, NY, USA: Oxford, 2007, pp. 99-119.
14. J. M. Wolfe and T. S. Horowitz, "What attributes guide the deployment of visual attention and how do they do it?" Nature Rev. Neurosci., vol. 5, pp. 495-501, Jun. 2004.
15. A. Thiele and G. Stoner, "Neuronal synchrony does not correlate with motion coherence in cortical area MT," Nature, vol. 421, no. 6921, pp. 366-370, Jun. 2003.
16. P. Fries, S. Neuenschwander, A. K. Engel, R. Goebel, and W. Singer, "Rapid feature selective neuronal synchronization through correlated latency shifting," Nature Neurosci., vol. 4, no. 2, pp. 495-501, Jun. 2001.
17. A. Treisman, "The binding problem," Current Opinion Neurobiol., vol. 6, no. 2, pp. 171-178, Aug. 1996.
18. J. W. Bisley and M. E. Goldberg, "Attention, intention, and priority in the parietal lobe," Annu. Rev. Neurosci., vol. 33, no. 1, pp. 1-21, Jul. 2010.
19. D. Kahneman, A. Treisman, and B. J. Gibbs, "The reviewing of object files: Object-specific integration of information," Cognit. Psychol., vol. 24, no. 2, pp. 175-219, Apr. 1992.
20. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998.
21. Y.-F. Ma and H.-J. Zhang, "Contrast-based image attention analysis by using fuzzy growing," in Proc. 11th Int. Conf. ACM Multimedia, Nov. 2003, pp. 374-381.
22. T. Liu, J. Sun, N.-N. Zheng, X. Tang, and H.-Y. Shum, "Learning to detect a salient object," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2007, pp. 1-8.
23. J. Harel, C. Koch, and P. Perona, "Graph-based visual saliency," in Neural Information Processing System. Cambridge, MA, USA: MIT Press, 2006, pp. 545-552.
24. S. Goferman, L. Zelnik-Manor, and A. Tal, "Context-aware saliency detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2010, pp. 2376-2383.
25. R. Achanta, S. Hemami, F. Estrada, and S. Susstrunk, "Frequency-tuned salient region detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2009, pp. 1597-1604.
26. M.-M. Cheng, G.-X. Zhang, N. J. Mitra, X. Huang, and S.-M. Hu, "Global contrast based salient region detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2011, pp. 409-416.
27. F. Perazzi, P. Krahenbuhl, Y. Pritch, and A. Hornung, "Saliency filters: Contrast based filtering for salient region detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2012, pp. 733-740.
28. V. Gopalakrishnan, Y. Hu, and D. Rajan, "Salient region detection by modeling distributions of color and orientation," IEEE Trans. Multimedia, vol. 11, no. 5, pp. 892-905, Aug. 2009.
29. Y. Hu, X. Xie, W.-Y. Ma, L.-T. Chia, and D. Rajan, "Salient region detection using weighted feature maps based on the human visual attention model," in Advances in Multimedia Information Processing-PCM. New York, NY, USA: Springer-Verlag, 2005, pp. 993-1000.
30. C. T. Vu and D. M. Chandler, "Main subject detection via adaptive feature refinement," J. Electron. Imag., vol. 20, no. 1, p. 013011, Mar. 2011.
31. A. Torralba, A. Oliva, M. S. Castelhano, and J. M. Henderson, "Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search," Psychol. Rev., vol. 113, no. 4, p. 766, 2006.
32. Y. Fang, W. Lin, C. T. Lau, and B.-S. Lee, "A visual attention model combining top-down and bottom-up mechanisms for salient object detection," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process. (ICASSP), May 2011, pp. 1293-1296.
33. A. Borji, "Boosting bottom-up and top-down visual features for saliency estimation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2012, pp. 438-445.
34. X. Shen and Y. Wu, "A unified approach to salient object detection via low rank matrix recovery," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2012, pp. 853-860.
35. J. H. Reynolds and D. J. Heeger, "The normalization model of attention," Neuron, vol. 61, no. 2, pp. 168-185, 2009.
36. F. Baluch and L. Itti, "Mechanisms of top-down attention," Trends Neurosci., vol. 34, no. 4, pp. 210-224, 2011.
37. L. Elazary and L. Itti, "Interesting objects are visually salient," J. Vis., vol. 8, no. 3, pp. 3.1-3.15, Mar. 2008.
38. T. Judd, K. Ehinger, F. Durand, and A. Torralba, "Learning to predict where humans look," in Proc. IEEE 12th Int. Conf. Comput. Vis. (ICCV), Sep./Oct. 2009, pp. 2106-2113.
39. S. Frintrop, E. Rome, and H. I. Christensen, "Computational visual attention systems and their cognitive foundations: A survey," ACM Trans. Appl. Perception, vol. 7, no. 1, p. 6, 2010.
40. R. Achanta, A. Shaji, K. Smith, A. Lucchi, P. Fua, and S. Susstrunk, "Slic superpixels compared to state-of-the-art superpixel methods," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 11, pp. 2274-2282, Nov. 2012.
41. T. Ojala, M. Pietikainen, and T. Maenpaa, "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 971-987, Jul. 2002.
42. M. Greenacre. (2008). Measures of Distance Between Samples: Euclidean. [Online]. Available: http://www.econ.upf.edu/?michael/stanford/maeb4.pdf
43. A. Pentland, T. Darrell, M. Turk, and W. Huang, "A simple, real-time range camera," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 1989, pp. 256-261.
44. J. H. Elder and S. W. Zucker, "Local scale control for edge detection and blur estimation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 7, pp. 699-716, Jul. 1998.
45. S. Zhuo and T. Sim, "Defocus map estimation from a single image," Pattern Recognit., vol. 44, no. 9, pp. 1852-1858, Sep. 2011.
46. S.Wu,W. Lin, S. Xie, Z. Lu, E. P. Ong, and S. Yao, "Blind blur assessment for vision-based applications," J. Vis. Commun. Image Represent., vol. 20, no. 4, pp. 231-241, May 2009.
47. R. Liu, Z. Li, and J. Jia, "Image partial blur detection and classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2008, pp. 1-8.
48. Y.-W. Tai and M. S. Brown, "Single image defocus map estimation using local contrast prior," in Proc. 16th IEEE Int. Conf. Image Process. (ICIP), Nov. 2009, pp. 1797-1800.
49. M.-K. Hu, "Visual pattern recognition by moment invariants," IRE Trans. Inf. Theory, vol. 8, no. 2, pp. 179-187, Feb. 1962.
50. J. Dolson, J. Baek, C. Plagemann, and S. Thrun, "Upsampling range data in dynamic environments," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2010, pp. 1141-1148.
51. X. Hou and L. Zhang, "Saliency detection: A spectral residual approach," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2007, pp. 1-8.
52. Y. Zhai and M. Shah, "Visual attention detection in video sequences using spatiotemporal cues," in Proc. 14th Annu. ACM Int. Conf. Multimedia, 2006, pp. 815-824.
53. X. Hou, J. Harel, and C. Koch, "Image signature: Highlighting sparse salient regions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 1, pp. 194-201, Jan. 2012.
54. N. D. B. Bruce and J. K. Tsotsos, "Saliency based on information maximization," in Advances in Neural Information Processing Systems. Cambridge, MA, USA: MIT Press, 2005, pp. 155-162.
55. A. Garcia-Diaz, V. Leborán, X. R. Fdez-Vidal, and X. M. Pardo, "On the relationship between optical variability, visual saliency, and eye fixations: A computational approach," J. Vis., vol. 12, no. 6, pp. 1-22, 2012.
56. N. Murray, M. Vanrell, X. Otazu, and C. A. Parraga, "Saliency estimation using a non-parametric low-level vision model," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2011, pp. 433-440.
57. B. W. Tatler, R. J. Baddeley, and I. D. Gilchrist, "Visual correlates of fixation selection: Effects of scale and time," Vis. Res., vol. 45, no. 5, pp. 643-659, 2005.
58. L. Zhang, M. H. Tong, T. K. Marks, H. Shan, and G. W. Cottrell, "Sun: A Bayesian framework for saliency using natural statistics," J. Vis., vol. 8, no. 7, pp. 1-3, 2008.