Co-salient object detection from multiple images

IEEE Transactions on Multimedia

Volumn 15, Issue 8, 2013, Pages 1896-1909

  Li, Hongliang ^a   Meng, Fanman ^a   Ngan, King Ngi ^a,b  

^a UNIVERSITY OF ELECTRONIC SCIENCE AND TECHNOLOGY OF CHINA   (China)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Attention model; Co saliency; Minimum spanning tree; Similarity

Indexed keywords

ATTENTION MODEL; CO SALIENCIES; EXPERIMENTAL EVALUATION; MINIMUM SPANNING TREES; MULTISCALE SEGMENTATION; REGION-MATCHING PROBLEMS; SIMILARITY; SIMILARITY RANKINGS;

IMAGE MATCHING; OBJECT RECOGNITION;

IMAGE SEGMENTATION;

EID: 84888312735     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2013.2271476     Document Type: Article

References (48)

1. H. Li and K. N. Ngan, "A co-saliency model of image pairs," IEEE Trans. Image Process., vol. 20, no. 12, pp. 3365-3375, Dec. 2011.
2. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998. (Pubitemid 128742001)
3. J. Huang, X. Yang, X. Fang, W. Lin, and R. Zhang, "Integrating visual saliency and consistency for re-ranking image search results," IEEE Trans. Multimedia, vol. 13, no. 4, pp. 653-661, 2011.
4. Y. Fang, W. Lin, B.-S. Lee, C.-T. Lau, Z. Chen, and C.-W. Lin, "Bottom-up saliency detection model based on human visual sensitivity and amplitude spectrum," IEEE Trans. Multimedia, vol. 14, no. 1, pp. 187-198, 2012.
5. Z. Liu, R. Shi, L. Shen, Y. Xue, K.N. Ngan, and Z. Zhang, "Unsupervised salient object segmentation based on kernel density estimation and two-phase Graph Cut," IEEE Trans. Multimedia, vol. 14, no. 4, pp. 1275-1289, 2012.
6. C. Koch and S. Ullman, "Shifts in selective visual attention: Towards the underlying neural circuitry," Human Neurobiol., vol. 4, pp. 219-227, 1985. (Pubitemid 16176695)
7. H. Li and K. N. Ngan, "Saliency model based face segmentation in head-and-shoulder video sequences," J. Visual Commun. Image Represent. (Elsevier Science), vol. 19, no. 5, pp. 320-333, 2008.
8. H. Li and K. N. Ngan, "Unsupervised video segmentation with low depth of field," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 12, pp. 1742-1751, Nov. 2007. (Pubitemid 350183925)
9. J. Harel, C. Koch, and P. Perona, "Graph-based visual saliency," Adv. Neural Inf. Process. Syst., vol. 19, pp. 545-552, 2007.
10. W. Wang, Y. Wang, Q. Huang, and W. Gao, "Measuring visual saliency by site entropy rate," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition (CVPR), Jun. 13-18, 2010, pp. 2368-2375.
11. T. Liu, Z. Yuan, J. Sun, J. Wang, N. Zheng, X. Tang, and H. Shum, "Learning to detect a salient object," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition (CVPR), Minneapolis, MN, 2007, pp. 1-8.
12. R. Achanta, F. Estrada, P. Wils, and Süsstrunk, "Salient region detection and segmentation," in Proc. Int. Conf. Computer Vision Systems, 2008, pp. 66-75. (Pubitemid 351775955)
13. Y.-F. Ma and H.-J. Zhang, "Contrast-based image attention analysis by using fuzzy growing," in Proc. ACM Int. Conf. Multimedia, New York, NY, USA, 2003, pp. 374-381.
14. X. Hou and L. Zhang, "Saliency detection: A spectral residual approach," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition (CVPR), 2007, pp. 1-8.
15. R. Achanta, S. S. Hemami, F. J. Estrada, and S. Ssstrunk, "Frequency-tuned salient region detection," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition (CVPR), 2009, pp. 1597-1604.
16. R. Achanta and S. Süsstrunk, "Saliency detection using maximum symmetric surround," in Proc. 17th IEEE Int. Conf. Image Processing (ICIP), Hong Kong, Sep. 2010, pp. 2653-2656.
17. S. Goferman and L. Zelnik-Manor, "Context-aware saliency detection," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition (CVPR), 2010, pp. 2376-2383.
18. Y. Zhai and M. Shah, "Visual attention detection in video sequences using spatiotemporal cues," in Proc. ACM Multimedia, 2006, pp. 815-824. (Pubitemid 47113641)
19. M. M. Cheng, G. Zhang, N. J. Mitra, X. Huang, and S. Hu, "Global contrast based salient region detection," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition (CVPR), Colorado Springs, CO, USA, 2011, pp. 409-416.
20. A. Borji and L. Itti, "Exploiting local and global patch rarities for saliency detection," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition (CVPR), Jun. 16-21, 2012, pp. 478-485.
21. M. Wang, J. Konrad, P. Ishwar, K. Jing, and H. Rowley, "Image saliency: From intrinsic to extrinsic context," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition (CVPR), 2011, pp. 417-424.
22. X. Shen and Y. Wu, "A unified approach to salient object detection via low rank matrix recovery," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition (CVPR), Jun. 16-21, 2012, pp. 853-860.
23. H.-K. Tan and C.-W. Ngo, "Common pattern discovery using earth mover's distance and local flow maximization," in Proc. IEEE Int. Conf. Computer Vision (ICCV), 2005, pp. 1222-1229. (Pubitemid 44042320)
24. J. Yuan and Y. Wu, "Spatial random partition for common visual pattern discovery," in Proc. IEEE Int. Conf. Computer Vision (ICCV), 2007, pp. 1-8.
25. A. Toshev, J. Shi, and K. Daniilidis, "Image matching via saliency region correspondences," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition (CVPR), 2007, pp. 1-8.
26. M. Cho, Y. M. Shin, and K. M. Lee, "Co-recognition of image pairs by data-driven Monte Carlo image exploration," in Proc. Eur. Conf. Computer Vision (ECCV), 2008, pp. 144-157.
27. C. Rother, T. Minka, A. Blake, and V. Kolmogorov, "Cosegmentation of image pairs by histogram matching-incorporating a global constraint into MRFs," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition (CVPR), 2006, vol. 1, pp. 993-1000.
28. L. Mukherjee, V. Singh, and C. R. Dyer, "Half-integrality based algorithms for cosegmentation of images," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition (CVPR), 2009, pp. 2028-2035.
29. D. S. Hochbaum and V. Singh, "An efficient algorithm for co-segmentation," in Proc. IEEE Int. Conf. Computer Vision (ICCV), 2009, pp. 269-276.
30. A. Joulin, F. Bach, and J. Ponce, "Discriminative clustering for image co-segmentation," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Jun. 2010, pp. 1943-1950.
31. S. Vicente, V. Kolmogorov, and C. Rother, "Cosegmentation revisited: Models and optimization," in Proc. Eur. Conf. Computer Vision (ECCV), 2010, pp. 465-479.
32. D. Batra, A. Kowdle, D. Parikh, J. Luo, and T. Chen, "iCoseg: Interactive Co-segmentation with Intelligent Scribble Guidance," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition (CVPR), 2010, pp. 3169-3176.
33. G. Kim, E. P. Xing, L. Fei-Fei, and T. Kanade, "Distributed cosegmentation via submodular optimization on anisotropic diffusion," in Proc. Int. Conf. Computer Vision, Nov. 2011, pp. 169-176.
34. F. Meng, H. Li, G. Liu, and K. N. Ngan, "Object co-segmentation based on shortest path algorithm and saliency model," IEEE Trans. Multimedia, vol. 14, no. 5, pp. 1429-1441, 2012.
35. S. Vicente, C. Rother, and V. Kolmogorov, "Object cosegmentation," in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), Jun. 2011, pp. 2217-2224.
36. K. Chang, T. Liu, and S. Lai, "From co-saliency to co-segmentation: An efficient and fully unsupervised energy minimization model," in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2011, pp. 2129-2136.
37. L. Mukherjee, V. Singh, and J. Peng, "Scale invariant cosegmentation for image groups," in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), Jun. 2011, pp. 1881-1888.
38. Y. Lu, W. Zhang, H. Lu, and X. Xue, "Salient object detection using concavity context," in Proc. IEEE Int. Conf. Computer Vision (ICCV), Nov. 6-13, 2011, pp. 233-240.
39. B. Alexe, T. Deselaers, and V. Ferrari, "What is an object?," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition (CVPR), San Francisco, CA, USA, Jun. 13-18, 2010, pp. 73-80.
40. A. Levinshtein, A. Stere, K. N. Kutulakos, D. J. Fleet, and S. J. Dickinson, "Turbopixels: Fast superpixels using geometric flows," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 12, pp. 2290-2297, Dec. 2009.
41. Y. Boykov and M.-P. Jolly, "Interactive graph cuts for optimal boundary & region segmentation of objects in n-d images," in Proc. IEEE Int. Conf. Computer Vision (ICCV), Vancouver, BC, Canada, Jul. 7-14, 2001, vol. 1, pp. 105-112. (Pubitemid 32794944)
42. Y. Li, J. Sun, C.-K. Tang, and H.-Y. Shum, "Lazy snapping," in Proc. SIGGRAPH, 2004, pp. 303-308.
43. C. Rother, V. Kolmogorov, and A. Blake, "GrabCut-interactive foreground extraction using iterated graph cuts," in Proc. SIGGRAPH 2004, Los Angeles, CA, USA, Aug. 10-12, 2004.
44. S. L. Franconeri, A. Hollingworth, and D. J. Simons, "Do new objects capture attention?," Psychol. Sci., vol. 16, no. 4, pp. 275-281, 2005. (Pubitemid 40550736)
45. D. Ballard, M. Hayhoe, P. Pook, and R. Rao, "Deictic codes for the embodiment of cognition," Behav. Brain Sci., vol. 20, no. 4, pp. 723-767, 1997. (Pubitemid 28172612)
46. M. Maire, P. Arbelaez, C. Fowlkes, and J. Malik, "Using contours to detect and localize junctions in natural images," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition (CVPR), 2008, pp. 1-8.
47. A. Joulin, F. Bach, and J. Ponce, "Multi-class cosegmentation," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Jun. 2012, pp. 542-549.
48. J. B. Kruskal, "On the Shortest Spanning Subtree of a Graph and the Traveling Salesman Problem," Proc. Amer. Math. Soc., vol. 7, no. 1, pp. 48-50, 1956.