Unsupervised salient object segmentation based on kernel density estimation and two-phase graph cut

IEEE Transactions on Multimedia

Volumn 14, Issue 4 PART 2, 2012, Pages 1275-1289

  Liu, Zhi ^a   Shi, Ran ^a   Shen, Liquan ^a   Xue, Yinzhu ^a   Ngan, King Ngi ^b   Zhang, Zhaoyang ^a  

^a SHANGHAI UNIVERSITY   (China)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Color saliency; graph cut; kernel density estimation; saliency model; salient object segmentation; seed adjustment; spatial saliency

Indexed keywords

ADJUSTMENT METHOD; BALANCING WEIGHT; DATA SETS; GRAPH CUT; GROUND TRUTH; INITIAL SEGMENTATION; INPUT IMAGE; KERNEL DENSITY ESTIMATION; MINIMUM CUT; MODEL-BASED OPC; PRE-SEGMENTATION; SALIENCY MAP; SALIENCY MEASURE; SALIENT OBJECTS; SECOND PHASE; SEGMENTATION PERFORMANCE; SPATIAL SALIENCIES; TEST IMAGES;

COLOR; GRAPHIC METHODS; PIXELS; STATISTICAL TESTS; STATISTICS;

IMAGE SEGMENTATION;

EID: 84864140615     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2012.2190385     Document Type: Article

References (40)

1. H. Fu, Z. Chi, and D. Feng, "Attention-driven image interpretation with application to image retrieval," Pattern Recognit., vol. 39, no. 9, pp. 1604-1621, Sep. 2006.
2. W. H. Cheng, C. W. Wang, and J. L. Wu, "Video adaptation for small display based on content recomposition," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 1, pp. 43-58, Jan. 2007.
3. V. Setlur, T. Lechner, M. Nienhaus, and B. Gooch, "Retargeting images and video for preserving information saliency," IEEE Comput. Graphics Appl., vol. 27, no. 5, pp. 80-88, Sep. 2007.
4. K. N. Ngan andH. Li, "Semantic object segmentation," IEEE Communications Society Multimedia Communications Technical Committee E-Letter, vol. 4, no. 6, pp. 6-8, Jul. 2009.
5. A. Toet, "Computational versus psychophysical bottom-up image saliency: A comparative evaluation study," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 11, pp. 2131-2146, Nov. 2011.
6. C. Koch and S. Ullman, "Shifts in selective visual attention: Towards the underlying neural circuitry," Human Neurobiol., vol. 4, no. 4, pp. 219-227, 1985.
7. A. M. Treisman and G. Gelade, "A feature-integration theory of attention," Cognitive Psychol., vol. 12, no. 1, pp. 97-136, Jan. 1980.
8. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998.
9. Y. F. Ma and H. J. Zhang, "Contrast-based image attention analysis by using fuzzy growing," in Proc. ACM Int. Conf.Multimedia, Nov. 2003, pp. 374-381.
10. F. Liu and M. Gleicher, "Region enhanced scale-invariant saliency detection," in Proc. IEEE ICME, Jul. 2006, pp. 1477-1480.
11. W. Kim, C. Jung, and C. Kim, "Saliency detection: A self-ordinal resemblance approach," in Proc. IEEE ICME, Jul. 2010, pp. 1260-1265.
12. O. Le Meur and J. C. Chevet, "Relevance of a feed-forward model of visual attention for goal-oriented and free-viewing tasks," IEEE Trans. Image Process., vol. 19, no. 11, pp. 2801-2813, Nov. 2010.
13. H. J. Seo and P. Milanfar, "Nonparametric bottom-up saliency detection by self-resemblance," in Proc. IEEE CVPR Workshops, Jun. 2009, pp. 45-52.
14. R. Achanta, S. Hemami, F. Estrada, and S. Susstrunk, "Frequencytuned salient region detection," in Proc. IEEE CVPR, Jun. 2009, pp. 1597-1604.
15. R. Achanta and S. Susstrunk, "Saliency detection using maximumsymmetric surround," in Proc. IEEE ICIP, Sep. 2010, pp. 2653-2656.
16. M. Z. Aziz and B. Mertsching, "Fast and robust generation of feature maps for region-based visual attention," IEEE Trans. Image Process., vol. 17, no. 5, pp. 633-644, May 2008.
17. X. Hou and L. Zhang, "Saliency detection: A spectral residual approach," in Proc. IEEE CVPR, Jun. 2007, p. 4270292.
18. C. Guo and L. Zhang, "Anovelmultiresolution spatiotemporal saliency detection model and its applications in image and video compression," IEEE Trans. Image Process., vol. 19, no. 1, pp. 185-198, Jan. 2010.
19. L. Zhang, M. H. Tong, T. K.Marks, H. Shan, and G.W. Cottrell, "Sun: A Bayesian framework for saliency using natural statistics," J. Vision, vol. 8, no. 7, Dec. 2008, article 32.
20. W.Wang, Y.Wang,Q.Huang, and W. Gao, "Measuring visual saliency by site entropy rate," in Proc. IEEE CVPR, Jun. 2010, pp. 2368-2375.
21. T. Liu, J. Sun, N. Zheng, X. Tang, and H. Y. Shum, "Learning to detect a salient object," in Proc. IEEE CVPR, Jun. 2007, p. 4270072.
22. V. Gopalakrishnan, Y. Hu, and D. Rajan, "Salient region detection by modeling distributions of color and orientation," IEEE Trans. Multimedia, vol. 11, no. 5, pp. 892-905, Aug. 2009.
23. Z. Liu, Y. Xue, L. Shen, and Z. Zhang, "Nonparametric saliency detection using kernel density estimation," in Proc. IEEE ICIP, Sep. 2010, pp. 253-256.
24. M. M. Cheng, G. X. Zhang, N. J. Mitra, X. Huang, and S. M. Hu, "Global contrast based salient region detection," in Proc. IEEE CVPR, Jun. 2011, pp. 409-416.
25. Y. Hu, X. Xie, W. Y. Ma, L. T. Chia, and D. Rajan, "Salient region detection using weighted feature maps based on the human visual attention model," in Proc. Pacific Conf. Multimedia, Nov. 2004, vol. 2, pp. 993-1000.
26. K. T. Park and Y. S. Moon, "Automatic extraction of salient objects using feature maps," in Proc. IEEE ICASSP, Apr. 2007, vol. 1, pp. 617-620.
27. W. Zhang, Q. M. J. Wu, G. Wang, and H. Yin, "An adaptive computational model for salient object detection," IEEE Trans. Multimedia, vol. 12, no. 4, pp. 300-316, Jun. 2010.
28. J. Han, K. N. Ngan, M. Li, and H. Zhang, "Unsupervised extraction of visual attention objects in color images," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 1, pp. 141-145, Jan. 2006.
29. B. C. Ko and J. Y. Nam, "Object-of-interest image segmentation based on human attention and semantic region clustering," J. Opt. Soc. Amer. A, vol. 23, no. 10, pp. 2462-2470, Oct. 2006.
30. V. Gopalakrishnan, Y. Hu, and D. Rajan, "Random walks on graphs for salient object detection in images," IEEE Trans. Image Process., vol. 19, no. 12, pp. 3232-3242, Dec. 2010.
31. Y. Boykov and G. Funka-Lea, "Graph cuts and efficient N-D image segmentation," Int. J. Comput. Vision, vol. 70, no. 2, pp. 109-131, Nov. 2006.
32. Y. Fu, J. Cheng, Z. Li, and H. Lu, "Saliency cuts: An automatic approach to object segmentation," in Proc. IEEE ICPR, Dec. 2008, pp. 1-4.
33. C. Jung, B. Kim, and C. Kim, "Automatic segmentation of salient objects using iterative reversible graph cut," in Proc. IEEE ICME, Jul. 2010, pp. 590-595.
34. E. Rahtu, J. Kannala, M. Salo, and J. Heikkila, "Segmenting salient objects fromimages and videos," in Proc. ECCV, Sep. 2010, pp. 366-379.
35. D. Comaniciu and P. Meer, "Mean shift: A robust approach toward feature space analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 5, pp. 603-619, May 2002.
36. A. Elgammal, R. Duraiswami, D. Harwood, and L. S. Davis, "Background and foreground modeling using nonparametric kernel density estimation for visual surveillance," Proc. IEEE, vol. 90, no. 7, pp. 1151-1163, Jul. 2002.
37. P. Hall and M. Wand, "On the accuracy of binned kernel density estimators," J. Multivar. Anal., vol. 56, no. 2, pp. 165-184, Feb. 1996.
38. Y. Boykov and V. Kolmogorov, "An experimental comparison of mincut/max-flow algorithms for energy minimization in vision," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 9, pp. 1124-1137, Sep. 2004.
39. D.Walther and C. Koch, "Modeling attention to salient proto-objects," Neural Netw., vol. 19, no. 9, pp. 1395-1407, Nov. 2006.
40. S. Xiang, C. Pan, F. Nie, and C. Zhang, "TurboPixel segmentation using eigen-images," IEEE Trans. Image Process., vol. 19, no. 11, pp. 3024-3034, Nov. 2010.