Improving bottom-up saliency detection by looking into neighbors

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 23, Issue 6, 2013, Pages 1016-1028

  Lang, Congyan ^a   Feng, Jiashi ^b   Liu, Guangcan ^c   Tang, Jinhui ^d   Yan, Shuicheng ^b   Luo, Jiebo ^e  

^a BEIJING JIAOTONG UNIVERSITY   (China)

^b NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^c University of Illinois at Urbana Champaign   (United States)

^d NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^e University of Rochester   (United States)

Author keywords

Multimodal modeling; multitask learning; saliency detection; sparsity and low rankness; visual attention

Indexed keywords

LOW RANKNESS; MULTIMODAL MODELING; MULTITASK LEARNING; SALIENCY DETECTION; VISUAL ATTENTION;

MEDIA STREAMING; NETWORKS (CIRCUITS);

LAGRANGE MULTIPLIERS;

EID: 84878782489     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2013.2248495     Document Type: Article

References (45)

1. D. DeCarlo, D. Salesin, A. Santella, M. Agrawala, and M. Cohen, "Gaze-based interaction for semi-automatic photo cropping," in Proc. SIGCHI Conf. Human Factors Comput. Syst., 2006, pp. 771-780. (Pubitemid 44032166)
2. R. Achanta, S. Hemami, F. Estrada, and S. Susstrunk, "Frequency- tuned salient region detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 1597-1604.
3. T. Avraham and M. Lindenbaum, "Esaliency (extended saliency): Meaningful attention using stochastic image modeling," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 4, pp. 693-708, Apr. 2010.
4. M. Z. Aziz and B. Mertsching, "Fast and robust generation of feature maps for region-based visual attention," IEEE Trans. Image Process., vol. 17, no. 5, pp. 633-644, May 2008. (Pubitemid 351597156)
5. A. P. Bradley and F. W. M. Stentiford, "Visual attention for region of interest coding in JPEG 2000," J. Vis. Commun. Image Represent., vol. 14, no.3, pp. 232-250, 2003.
6. N. Bruce and J. Tsotsos, "Saliency based on information maximization," in Proc. Adv. Neural Inf. Process. Syst., 2006, pp. 155-162.
7. Y. Hamadi, C. Rother, L. Bordeaux, and A. Blake, "Autocollage," in Proc. ACM SIGGRAPH, 2006, pp. 847-852. (Pubitemid 44481046)
8. J.-F. Cai, E. J. Candes, and Z. Shen, "A singular value thresholding algorithm for matrix completion," SIAM J. Optim., vol. 20, no. 4, pp. 1956-1982, 2010.
9. M. Cerf, J. Harel, W. Einhauser, and C. Koch, "Predicting human gaze using low-level saliency combined with face detection," in Proc. Adv. Neural Inf. Process. Syst., 2008, pp. 241-248.
10. L. Elazary and L. Itti, "Interesting objects in natural scenes are more salient," in Proc. Vis. Sci. Soc. Annu. Meet., 2007, pp. 1-6.
11. D. Gao and N. Vasconcelos, "Bottom-up saliency is a discriminant process," in Proc. Int. Conf. Comput. Vis., 2007, pp. 1-6.
12. S. Goferman, L. Zelnikmanor, and A. Tal, "Context aware saliency detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 2376-2383.
13. V. Gopalakrishnan and Y. Huand D. Rajan, "Random walks on graphs for salient object detection in images," IEEE Trans. Image Process., vol. 19, no. 12, pp. 3232-3242, Dec. 2010.
14. J. Harel, C. Koch, and P. Perona, "Graph-based visual saliency," in Proc. Adv. Neural Inf. Process. Syst., 2006, pp. 545-552.
15. X. Hou and L. Zhang, "Saliency detection: A spectral residual approach," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2007, pp. 1-8.
16. X. Hou and L. Zhang, "Thumbnail generation based on global saliency," in Proc. Int. Conf. Cognitive Neurodynam., 2007, pp. 999-1003.
17. X. Hou and L. Zhang, "Dynamic visual attention: Searching for coding length increments," in Proc. Adv. Neural Inf. Process. Syst., 2008, pp. 681-688.
18. Y. Q. Hu, D. Rajan, and L. T. Chia, "Detection of visual attention regions in images using robust subspace analysis," J. Vis. Commun. Image Represent., vol. 19, no. 3, pp. 199-216, 2008.
19. J. Huang, R. Kumar, M. Mitra, W.-J. Zhu, and R. Zabih, "Image indexing using color correlograms," in Proc. IEEE Comput. Vis. Pattern Recognit., Jun. 1997, pp. 762-768.
20. L. Itti and C. Koch, "A comparison of feature combination strategies for saliency-based visual attention systems," J. Electron. Imag., vol. 10, pp. 473-482, Jan. 1999.
21. L. Itti and C. Koch, "Computational modelling of visual attention," Nature Rev. Neurosci., vol. 2, no. 3, pp. 194-203, 2001. (Pubitemid 33673372)
22. L. Itti and C. Koch, "Feature combination strategies for saliency-based visual attention systems," J. Electron. Imag., vol. 10, no. 1, pp. 161-169, 2001. (Pubitemid 32279366)
23. L. Itti, C. Koch, and, E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998. (Pubitemid 128742001)
24. T. Judd, K. Ehinger, F. Durand, and A. Torralba, "Learning to predict where humans look," in Proc. IEEE Int. Conf. Comput. Vis., Sep.-Oct. 2009, pp. 2106-2113.
25. T. Kadir and M. Brady, "Saliency, scale and image description," Int. J. Comput. Vis., vol. 45, no. 2, pp. 1573-1405, 2001.
26. C. Lang, G. Liu, J. Yu, and S. Yan, "Saliency detection by multi-task sparsity pursuit," IEEE Trans. Image Process., vol. 21, no. 3, pp. 1327-1338, Mar. 2012.
27. O. Le Meur, P. Le Callet, D. Barba, and D. Thoreau, "A coherent computational approach to model bottom-up visual attention," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 5, pp. 802-817, May 2006.
28. Z. Lin, M. Chen, L. Wu, and Y. Ma, "The augmented Lagrange multiplier method for exact recovery of corrupted low-rank matrices," Univ. Illinois Urbana-Champaign, Urbana, UIUC Tech. Rep. UILUENG-09-2215, 2009.
29. G. Liu, Z. Lin, S.C. Yan, J. Sun, Y. Yu, and Yi Ma. "Robust recovery of subspace structures by low-rank representation," IEEE Trans. Pattern Anal. Mach. Intell. vol. 35, no. 1. pp. 171-184, Jan. 2013
30. G. Liu, Z. Lin, and Y. Yu, "Robust subspace segmentation by low-rank representation," in Proc. Int. Conf. Mach. Learning, 2010, pp. 663-670.
31. T. Liu, J. Sun, N. N. Zheng, X. Tang, and H. Y. Shum, "Learning to detect a salient object," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2007, pp. 1-8.
32. O. Le Meur and J.C. Chevet, "Relevance of a feed-forward model of visual attention for goal-oriented and free-viewing tasks," IEEE Trans. Image Process., vol. 19, no. 11, pp. 2801-2813, Nov. 2010.
33. V. Navalpakkam and L. Itti, "A goal oriented attention guidance model," in Proc. 2nd Int. Workshop Biologically Motivated Comput. Vis., vol. 2525. 2002, pp. 453-461.
34. V. Navalpakkam and L. Itti, "Search goal tunes visual features optimally," Neuron, vol. 53, no. 4, pp. 605-617, 2007. (Pubitemid 46216750)
35. A. Oliva and A. Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope," Int. J. Comput. Vis., vol. 42, no. 3, pp. 145-175, 2001. (Pubitemid 32680801)
36. N. Ouerhani, R. von Wartburg, and H. Hugli, "Empirical validation of the saliency-based model of visual attention," Electron. Lett. Comput. Vis. Image Anal., vol. 3, no. 1, pp. 13-24, 2004.
37. R. J. Peters and L. Itti, "Beyond bottom-up: Incorporating taskdependent influences into a computational model of spatial attention," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2007, pp. 1-8.
38. D. Qin, S. Gammeter, L. Bossard, T. Quack, and L. van Gool, "Hello neighbor: Accurate object retrieval with k-reciprocal nearest neighbors," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 777-784.
39. H.J. Seo and P. Milanfar, "Nonparametric bottom-up saliency detection by self-resemblance," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 45-52.
40. E. P. Simoncelli and W. T. Freeman, "The steerable Pyramid: A flexible architecture for multi-scale derivative computation," in Proc. IEEE Int. Conf. Image Process., Oct. 1995, pp. 444-447.
41. A. Torralba, A. Oliva, M. Castelhano, and J. Henderson, "Contextual guidance of eye movements and attention in real-world scenes: The role of global features on object search," Psychol. Rev., vol. 113, no. 4, pp. 766-786, 2006. (Pubitemid 44629917)
42. A.M. Treisman and G. Gelade, "A feature-integration theory of attention," Cognitive Psychol., vol. 12, no. 1, pp. 97-136, 1980.
43. K. Tsotsos, "Analyzing visioin at the complexity level," Brain Behav. Sci., vol. 13, no. 3, pp. 423-469, 1990.
44. D. Walther, L. Itti, M. Riesenhuber, T. Poggio, and C. Koch, "Attentional selection for object recognition-a gentle way," in Proc. Workshop Biologically Motivated Comput. Vis., 2002, pp. 472-479.
45. L. Zhang, M. H. Tong, T. K. Marks, H. Shan, and G. W. Cottrell, "Sun: A Bayesian framework for saliency using natural statistics," J. Vis., vol. 8, no. 7, pp. 1-20, 2008.