A co-saliency model of image pairs

IEEE Transactions on Image Processing

Volumn 20, Issue 12, 2011, Pages 3365-3375

  Li, Hongliang ^a   Ngan, King Ngi ^b  

^a UNIVERSITY OF ELECTRONIC SCIENCE AND TECHNOLOGY OF CHINA   (China)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Attention model; Co saliency; Similarity; SimRank

Indexed keywords

ATTENTION MODEL; CO-SALIENCY; DESCRIPTORS; DETECTION TASKS; EXPERIMENTAL EVALUATION; IMAGE PAIRS; LINEAR COMBINATIONS; SALIENCY DETECTION; SALIENCY MAP; SIMILARITY; SIMILARITY SCORES; SIMRANK; TEXTURE PROPERTIES;

MATHEMATICAL MODELS;

IMAGE PROCESSING;

EID: 82055163013     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2011.2156803     Document Type: Article

References (45)

1. J. Van de Weijer, T. Gevers, and A. D. Bagdanov, "Boosting color saliency in image feature detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 1, pp. 150-156, Jan. 2006. (Pubitemid 46395313)
2. A. Toshev, J. Shi, and K. Daniilidis, "Image matching via saliency region correspondences," in Proc. IEEE Comp. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), 2007, pp. 1-8.
3. Y. Sugano, Y. Matsushita, and Y. Sato, "Calibration-free gaze sensing using saliency maps," in Proc. IEEE Comp. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), 2010, pp. 2667-2674.
4. E. Rahtu, J. Kannala, M. Salo, and J. Heikkil, "Segmenting salient object from images and videos," in Proc. Eur. Conf. Comput. Vis. (ECCV 2010), 2010, pp. 366-379.
5. Z. Chen, J. Han, and K. N. Ngan, "Dynamic bit allocation for multiple video object coding," IEEE Trans. Multimedia, vol. 8, no. 6, pp. 1117-1124, Jun. 2006. (Pubitemid 44955677)
6. V. Mahadevan, "Saliency-based discriminant tracking," in Proc. IEEE Comp. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), 2009, pp. 1007-1013.
7. J. You, G. Liu, L. Sun, and H. Li, "A multiple visual models based perceptive framework for multilevel video summarization," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 3, pp. 273-285, Mar. 2007. (Pubitemid 46394438)
8. H. Li and K. N. Ngan, "Automatic video segmentation and tracking for content-based applications," IEEE Commun. Mag., vol. 45, no. 1, pp. 27-33, 2007. (Pubitemid 46358113)
9. A. Berengolts and M. Lindenbaum, "On the distribution of saliency," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 12, pp. 1973-1990, Dec. 2006. (Pubitemid 46405708)
10. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell, vol. 20, no. 11, pp. 1254-1259, Nov. 1998. (Pubitemid 128742001)
11. J. Han, K. N. Ngan, M. Li, and H.-J. Zhang, "Unsupervised extraction of visual attention objects in color images," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 1, pp. 141-145, Jan. 2006. (Pubitemid 43172623)
12. H. Li and K. N. Ngan, "Saliency model based face segmentation in headand- shoulder video sequences," J. Vis. Commun. Image Represent., vol. 19, no. 5, pp. 320-333, 2008.
13. H. Li and K. N. Ngan, "Unsupervised video segmentation with low depth of field," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 12, pp. 1742-1751, Dec. 2007. (Pubitemid 350183925)
14. W. Wang, Y. Wang, Q. Huang, and W. Gao, "Measuring visual saliency by site entropy rate," in Proc. IEEE Comp. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), 2010, pp. 2368-2375.
15. S. Goferman and L. Zelnik-Manor, "Context-aware saliency detection," in Proc. IEEE Comp. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), 2010, pp. 2376-2383.
16. C. Koch and T. Poggio, "Predicting the visual world: Silence is golden," Nature Neurosci., vol. 2, pp. 9-10, 1999. (Pubitemid 30488932)
17. K. Koffka, Principles of Gestalt Psychology. London, U.K.: Routledge & Kegan Paul, 1955.
18. A. Treisman and G. Gelade, "A feature-integration theory of attention," Cognit. Psychol., vol. 12, no. 1, pp. 97-136, 1980.
19. J. Wolfe, "Guided search 2. 0. a revised model of visual search," Psychonomic Bull. Rev., vol. 1, no. 2, pp. 202-238, 1994.
20. M. M. Cheng, G. X. Zhang, N. J. Mitra, X. Huang, and S. M. Hu, "Global contrast based salient region detection," in Proc. IEEE Comp. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), 2011, pp. 409-416.
21. H.-K. Tan and C.-W. Ngo, "Common pattern discovery using earth mover's distance and local flow maximization," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), 2005, pp. 1222-1229. (Pubitemid 44042320)
22. J. Yuan and Y. Wu, "Spatial random partition for common visual pattern discovery," Proc. IEEE Int. Conf. Comput. Vis. (ICCV), pp. 1-8, 2007.
23. M. Cho, Y. M. Shin, and K. M. Lee, "Co-recognition of image pairs by data- driven monte carlo image exploration," in Proc. Eur. Conf. Comput. Vis. (ECCV), 2008, pp. 144-157.
24. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, 2004.
25. C. Rother, T. Minka, A. Blake, and V. Kolmogorov, "Cosegmentation of image pairs by histogram matching-incorporating a global constraint into MRFs," in Proc. IEEE Comp. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), 2006, vol. 1, pp. 993-1000.
26. L. Mukherjee, V. Singh, and C. R. Dyer, "Half-integrality based algorithms for cosegmentation of images," in Proc. IEEE Comp. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), 2009, pp. 2028-2035.
27. D. S. Hochbaum and V. Singh, "An efficient algorithm for co-segmentation," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), 2009, pp. 269-276.
28. A. Joulin, F. Bach, and J. Ponce, "Discriminative clustering for image co-segmentation," in Proc. IEEE Comp. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), 2010, pp. 1943-1950.
29. S. Vicente, V. Kolmogorov, and C. Rother, "Cosegmentation revisited: Models and optimization," in Proc. Eur. Conf. Comput. Vis. (ECCV), 2010, pp. 465-479.
30. D. Batra, D. Parikh, A. Kowdle, T. Chen, and J. Luo, "Seed image selection in interactive cosegmentation," in Proc. IEEE Int. Conf. Image Process. (ICIP), 2009.
31. L. Tang and H. Li, "Extract salient objects from natural images," in Proc. Int. Symp. Intell. Signal Process. Commun. Syst. (ISPACS), 2010, pp. 1-4.
32. R. Achanta, S. S. Hemami, F. J. Estrada, and S. Süsstrunk, "Frequencytuned salient region detection," in IEEEComp. Soc. Conf.Comput. Vis. Pattern Recognit. (CVPR), 2009, pp. 1597-1604.
33. X. Hou and L. Zhang, "Saliency detection: A spectral residual approach," in Proc. IEEE Comp. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), 2009.
34. S. L. Franconeri, A. Hollingworth, and D. J. Simons, "Do new objects capture attention?," Psycholog. Sci., vol. 16, no. 4, pp. 275-281, 2005. (Pubitemid 40550736)
35. D. Ballard, M. Hayhoe, P. Pook, and R. Rao, "Deictic codes for the embodiment of cognition," Behavioral Brain Sci., vol. 20, no. 4, pp. 723-767, 1997. (Pubitemid 28172612)
36. X. Ren and J. Malik, "Learning a classification model for segmentation," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), 2003, pp. 10-17.
37. G. Mori, X. Ren, A. Efros, and J. Malik, "Recovering human body configurations: Combining segmentation and recognition," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), 2004, pp. 326-333.
38. P. F. Felzenszwalb and D. P. Huttenlocher, "Efficient graph-based image segmentation," Int. J. Comput. Vis., vol. 59, no. 2, pp. 167-181, 2004.
39. J. Shi and J. Malik, "Normalized cuts and image segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 888-905, Aug. 2000.
40. M. S. Lewicki and T. J. Sejnowski, "Learning overcomplete representations," Neural Comput., vol. 12, no. 2, pp. 337-365, 2000.
41. Y. Wu and T. S. Huang, "Color tracking by transductive learning," in IEEE Comp. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), Hilton Head Island, SC, 2000, vol. 1, pp. 133-138.
42. G. Jeh and J. Widom, "Simrank: A measure of structural- context similarity," in KDD, 2002, pp. 538-543.
43. P. Li, H. Liu, J. X. Yu, J. He, and X. Du, "Fast single-pair SimRank computation," in Proc. SIAM Int. Conf. Data Mining (SDM 2010), 2010, pp. 571-582.
44. Y. Boykov and M.-P. Jolly, "Interactive graph cuts for optimal boundary & region segmentation of objects in n-d images," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), 2001, pp. 105-112. (Pubitemid 32794944)
45. H. Li, K. N. Ngan, and Q. Liu, "Faceseg: Automatic face segmentation for real-time video," IEEE Trans.Multimedia, vol. 11, no. 1, pp. 77-88, Jan. 2009.