A multisize superpixel approach for salient object detection based on multivariate normal distribution estimation

IEEE Transactions on Image Processing

Volumn 23, Issue 12, 2014, Pages 5094-5107

  Zhu, Lei ^a   Klein, Dominik A ^b   Frintrop, Simone ^b   Cao, Zhiguo ^a   Cremers, Armin B ^b  

^a HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b UNIVERSITY OF BONN   (Germany)

Author keywords

Center surround contrasts; Cluster compactness; Multi size superpixels; Random walk; Saliency detection; Wasserstein distance

Indexed keywords

CENTER-SURROUND CONTRASTS; CLUSTER COMPACTNESS; RANDOM WALK; SALIENCY DETECTION; SUPERPIXELS; WASSERSTEIN DISTANCE;

EID: 84908430743     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2361024     Document Type: Article

References (58)

1. H. Pashler, The Psychology of Attention. Cambridge, MA, USA:MIT Press, Oct. 1997.
2. S. Frintrop, E. Rome, and H. I. Christensen, "Computational visualattention systems and their cognitive foundations: A survey," ACM Trans.Appl. Perception, vol. 7, no. 1, pp. 1-39, Jan. 2010.
3. J.-Y. Zhu, J. Wu, Y. Wei, E. Chang, and Z. Tu, "Unsupervised objectclass discovery via saliency-guided multiple class learning," in Proc.IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 3218-3225.
4. B. Alexe, T. Deselaers, and V. Ferrari, "Measuring the objectness ofimage windows," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34,no. 11, pp. 2189-2202, Nov. 2012.
5. H. Fu, Z. Chi, and D. Feng, "Attention-driven image interpretationwith application to image retrieval," Pattern Recognit., vol. 39, no. 9,pp. 1604-1621, Sep. 2006.
6. E. Nowak, F. Jurie, and B. Triggs, "Sampling strategies for bag-offeaturesimage classification," in Proc. 9th Eur. Conf. Comput. Vis.,May 2006, pp. 490-503.
7. L. Itti, "Automatic foveation for video compression using a neuro biological model of visual attention," IEEE Trans. Image Process., vol. 13,no. 10, pp. 1304-1318, Oct. 2004.
8. C. Guo and L. Zhang, "A novel multiresolution spatiotemporal saliencydetection model and its applications in image and video compression,"IEEE Trans. Image Process., vol. 19, no. 1, pp. 185-198, Jan. 2010.
9. R. Achanta, S. Hemami, F. Estrada, and S. Süsstrunk, "Frequency-tunedsalient region detection," in Proc. IEEE Conf. Comput. Vis. PatternRecognit., Jun. 2009, pp. 1597-1604.
10. L. Wang, J. Xue, N. Zheng, and G. Hua, "Automatic salient objectextraction with contextual cue," in Proc. IEEE Int. Conf. Comput. Vis.,Nov. 2011, pp. 105-112.
11. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visualattention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach.Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998.
12. D. A. Klein and S. Frintrop, "Center-surround divergence of featurestatistics for salient object detection," in Proc. IEEE Int. Conf. Comput.Vis., Nov. 2011, pp. 2214-2219.
13. J. Feng, Y. Wei, L. Tao, C. Zhang, and J. Sun, "Salient object detectionby composition," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011,pp. 1028-1035.
14. T. Liu et al., "Learning to detect a salient object," IEEE Trans. PatternAnal. Mach. Intell., vol. 33, no. 2, pp. 353-367, Feb. 2011.
15. E. Rahtu, J. Kannala, M. Salo, and J. Heikkilä, "Segmenting salientobjects from images and videos," in Proc. 11th Eur. Conf. Comput. Vis.,Sep. 2010, pp. 366-379.
16. R. Achanta and S. Süsstrunk, "Saliency detection using maximumsymmetric surround," in Proc. 17th IEEE Int. Conf. Image Process.,Sep. 2010, pp. 2653-2656.
17. M.-M. Cheng, N. J. Mitra, X. Huang, P. H. S. Torr, and S.-M. Hu,"Salient object detection and segmentation," IEEE Trans. Pattern Anal.Mach. Intell., no. 99, p. 1, Aug. 2014, to be published.
18. F. Perazzi, P. Krähenbül, Y. Pritch, and A. Hornung, "Saliency filters:Contrast based filtering for salient region detection," in Proc. IEEE Conf.Comput. Vis. Pattern Recognit., Jun. 2012, pp. 733-740.
19. X. Hou and L. Zhang, "Saliency detection: A spectral residual approach,"in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2007, pp. 1-8.
20. C. Guo, Q. Ma, and L. Zhang, "Spatio-temporal Saliency detection usingphase spectrum of quaternion Fourier transform," in Proc. IEEE Conf.Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
21. Y. Zhai and M. Shah, "Visual attention detection in video sequencesusing spatiotemporal cues," in Proc. 14th ACM Int. Conf. Multimedia,Oct. 2006, pp. 815-824.
22. V. Gopalakrishnan, Y. Hu, and D. Rajan, "Salient region detection bymodeling distributions of color and orientation," IEEE Trans. Multimedia,vol. 11, no. 5, pp. 892-905, Aug. 2009.
23. V. Gopalakrishnan, Y. Hu, and D. Rajan, "Random walks on graphs forsalient object detection in images," IEEE Trans. Image Process., vol. 19,no. 12, pp. 3232-3242, Dec. 2010.
24. Y. Wei, F. Wen, W. Zhu, and J. Sun, "Geodesic saliency using backgroundpriors," in Proc. 12th Eur. Conf. Comput. Vis., Oct. 2012,pp. 29-42.
25. C. Yang, L. Zhang, H. Lu, X. Ruan, and M.-H. Yang, "Saliency detectionvia graph-based manifold ranking," in Proc. IEEE Conf. Comput. Vis.Pattern Recognit., Jun. 2013, pp. 3166-3173.
26. B. Jiang, L. Zhang, H. Lu, C. Yang, and M.-H. Yang, "Saliency detectionvia absorbing Markov chain," in Proc. IEEE Int. Conf. Comput. Vis.,Dec. 2013, pp. 1665-1672.
27. H. Jiang, J. Wang, Z. Yuan, Y. Wu, N. Zheng, and S. Li, "Salientobject detection: A discriminative regional feature integration approach,"in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013,pp. 2083-2090.
28. R. Margolin, A. Tal, and L. Zelnik-Manor, "What makes a patchdistinct?" in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013,pp. 1139-1146.
29. D. A. Klein and S. Frintrop, "Salient pattern detection using W2 onmultivariate normal distributions," in Proc. Joint 34th DAGM-OAGMSymp., Aug. 2012, pp. 246-255.
30. S. Yantis, "Goal-directed and stimulus-driven determinants of attentionalcontrol," in Attention and Performance, vol. 18. Cambridge, MA, USA:MIT Press, 2000, pp. 73-103.
31. J. Harel, C. Koch, and P. Perona, "Graph-based visual saliency," inAdvances in Neural Information Processing Systems. Red Hook, NY,USA: Curran & Associates Inc., Dec. 2007, pp. 545-552.
32. S. Goferman, L. Zelnik-Manor, and A. Tal, "Context-aware saliencydetection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 10,pp. 1915-1926, Dec. 2011.
33. H. J. Seo and P. Milanfar, "Nonparametric bottom-up saliency detectionby self-resemblance," in Proc. IEEE Comput. Soc. Conf. Comput. Vis.Pattern Recognit. Workshops, Jun. 2009, pp. 45-52.
34. Y. Li, Y. Zhou, J. Yan, Z. Niu, and J. Yang, "Visual saliency based onconditional entropy," in Proc. 9th Asian Conf. Comput. Vis., Sep. 2010,pp. 246-257.
35. X. Hou, J. Harel, and C. Koch, "Image signature: Highlighting sparsesalient regions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 1,pp. 194-201, Jan. 2012.
36. P. F. Felzenszwalb and D. P. Huttenlocher, "Efficient graph-basedimage segmentation," Int. J. Comput. Vis., vol. 59, no. 2, pp. 167-181,Sep. 2004.
37. M. Park, M. Kumar, and A. C. Loui, "Saliency detection using region based incremental center-surround distance," in Proc. IEEE Int. Symp.Multimedia, Dec. 2011, pp. 249-256.
38. Z. Ren, Y. Hu, L.-T. Chia, and D. Rajan, "Improved saliency detectionbased on superpixel clustering and saliency propagation," in Proc. Int.Conf. Multimedia, Oct. 2010, pp. 1099-1102.
39. R. Achanta, A. Shaji, K. Smith, A. Lucchi, P. Fua, and S. Süsstrunk,"SLIC superpixels compared to state-of-the-art superpixel methods,"IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 11, pp. 2274-2282,Nov. 2012.
40. O. Michailovich, Y. Rathi, and A. Tannenbaum, "Image segmentationusing active contours driven by the Bhattacharyya gradient flow," IEEE Trans. Image Process., vol. 16, no. 11, pp. 2787-2801, Nov. 2007.
41. D. C. Dowson and B. V. Landau, "The Fréchet distance between multi variate normal distributions," J. Multivariate Anal., vol. 12, no. 3,pp. 450-455, Sep. 1982.
42. C. R. Givens and R. M. Shortt, "A class of Wasserstein metricsfor probability distributions," Michigan Math. J., vol. 31, no. 2,pp. 231-240, 1984.
43. O. K. Smith, "Eigenvalues of a symmetric 3×3 matrix," Commun. ACM,vol. 4, no. 4, p. 168, Apr. 1961.
44. H. Li and K. N. Ngan, "A co-saliency model of image pairs," IEEE Trans. Image Process., vol. 20, no. 12, pp. 3365-3375, Dec. 2011.
45. B. J. Frey and D. Dueck, "Clustering by passing messages between datapoints," Science, vol. 315, no. 5814, pp. 972-976, Feb. 2007.
46. M.-M. Cheng, J. Warrell, W.-Y. Lin, S. Zheng, V. Vineet, and N. Crook,"Efficient salient region detection with soft image abstraction," in Proc.IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 1529-1536.
47. Y. Xie, H. Lu, and M.-H. Yang, "Bayesian saliency via low and midlevel cues," IEEE Trans. Image Process., vol. 22, no. 5, pp. 1689-1698,May 2013.
48. T. Geweniger, D. Zühlke, B. Hammer, and T. Villmann, "Fuzzy variantof affinity propagation in comparison to median fuzzy c-means," in Proc.7th Int. Workshop Adv. Self-Org. Maps, Jun. 2009, pp. 72-79.
49. A. Borji and L. Itti, "Exploiting local and global patch rarities forsaliency detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit.,Jun. 2012, pp. 478-485.
50. X. Li, Y. Li, C. Shen, A. Dick, and A. van den Hengel, "Contextual hyper graph modeling for salient object detection," in Proc. IEEE Int.Conf. Comput. Vis., Dec. 2013, pp. 3328-3335.
51. Q. Yan, L. Xu, J. Shi, and J. Jia, "Hierarchical saliency detection,"in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013,pp. 1155-1162.
52. J. Zhang and S. Sclaroff, "Saliency detection: A Boolean map approach,"in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 153-160.
53. C. Scharfenberger, A. Wong, K. Fergani, J. S. Zelek, and D. A. Clausi,"Statistical textural distinctiveness for salient region detection in naturalimages," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013,pp. 979-986.
54. V. Movahedi and J. H. Elder, "Design and perceptual validationof performance measures for salient object segmentation," in Proc.IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops,Jun. 2010, pp. 49-56.
55. D. Martin, C. Fowlkes, D. Tal, and J. Malik, "A database of humansegmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics," in Proc. 8th IEEE Int.Conf. Comput. Vis., Jul. 2001, pp. 416-423.
56. S. Alpert, M. Galun, A. Brandt, and R. Basri, "Image segmentation byprobabilistic bottom-up aggregation and cue integration," IEEE Trans.Pattern Anal. Mach. Intell., vol. 34, no. 2, pp. 315-327, Feb. 2012.
57. C. Rother, V. Kolmogorov, and A. Blake, "'GrabCut': Interactive fore ground extraction using iterated graph cuts," ACM Trans. Graph.,vol. 23, no. 3, pp. 309-314, Aug. 2004.
58. Y. Boykov and V. Kolmogorov, "An experimental comparison of mincut/max-flow algorithms for energy minimization in vision," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 9, pp. 1124-1137,Sep. 2004.