Region-based saliency detection and its application in object recognition

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 24, Issue 5, 2014, Pages 769-779

  Ren, Zhixiang ^a   Gao, Shenghua ^b   Chia, Liang Tien ^a   Tsang, Ivor Wai Hung ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b ADVANCED DIGITAL SCIENCES CENTER   (Singapore)

Author keywords

Object Recognition; Saliency Detection; Saliency Propagation; Superpixed; Weighted Sparse Coding

Indexed keywords

ALGORITHMS; ENCODING (SYMBOLS); IMAGE CODING; IMAGE MATCHING; IMAGE SEGMENTATION;

ADAPTIVE MEAN SHIFT ALGORITHMS; GAUSSIAN MIXTURE MODEL; IMAGE REPRESENTATIONS; SALIENCY DETECTION; SALIENT REGION DETECTIONS; SPARSE CODING; SPATIAL PYRAMID MATCHING; SUPERPIXED;

OBJECT RECOGNITION;

EID: 84900544075     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2013.2280096     Document Type: Article

References (69)

1. R. Achanta, S. H. F. Estrada, and S. Susstrunk, "Frequency-tuned salient region detection," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2009, pp. 1597-1604.
2. B. Alexe, T. Deselaers, and V. Ferrari, "What is an object," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2010, pp. 73-80.
3. S. Avidan and A. Shamir, "Seam carving for content-aware image resizing," ACM Trans. Graph., SIGGRAPH, vol. 26, no. 3, Jul. 2007.
4. D. Batra, A. Kowdle, D. Parikh, J. Luo, and T. Chen, "iCoseg: Interactive co-segmentation with intelligent scribble guidance," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2010, pp. 3169-3176.
5. C. M. Bishop, Pattern Recognition and Machine Learning, 1st ed. Berlin, Germany: Springer, 2007.
6. A. Borji, D. N. Sihite, and L. Itti, "Quantitative analysis of humanmodel agreement in visual saliency modeling: A comparative study," IEEE Trans. Image Process., vol. 22, no. 1, pp. 55-69, Jan. 2013.
7. A. Bosch, A. Zisserman, and X. Munoz. "Representing shape with a spatial pyramid kernel," in Proc. Int. Conf. Image Video Retrieval, 2007.
8. Y.-L. Boureau, F. Bach, Y. LeCun, and J. Ponce, "Learning mid-level features for recognition," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2010, pp. 2559-2566.
9. Y.-L. Boureau, J. Ponce, and Y. LeCun, "A theoretical analysis of feature pooling in visual recognition," in Proc. Int. Conf. Mach. Learn., 2010, pp. 111-118.
10. S. Brin and L. Page, "The anatomy of a large-scale hypertextual web search engine," in Proc. World Wide Web, Apr. 1998, pp. 107-117.
11. N. Bruce and J. Tsotsos, "Saliency based on information maximization," in Proc. Adv. Neural Inform. Process. Syst. 19, Dec. 2006, pp. 155-162.
12. M. Cheng, G. Zhang, N. J. Mitra, X. Huang, and S. Hu, "Global contrast based salient region detection," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2011, pp. 409-416.
13. C. M. Christoudias, B. Georgescu, and P. Meer, "Synergism in low level vision," in Proc. Int. Conf. Pattern Recognit., Aug. 2002, pp. 150-155. (Pubitemid 44850969)
14. O. Chum and A. Zisserman, "An exemplar model for learning object classes," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2007, pp. 1-8.
15. D. Comaniciu and P. Meer, "Mean shift: A robust approach toward feature space analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 5, pp. 603-619, May 2002. (Pubitemid 34550429)
16. S. K. Divvala, D. Hoiem, J. H. Hays, A. A. Efros, and M. Hebert, "An empirical study of context in object detection," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., 2009.
17. W. Einhäuser, M. Spain, and P. Perona, "Objects predict fixations better than early saliency," J. Vision, vol. 8, no. 14, pp. 1-26, 2008.
18. L. Elazary and L. Itti, "Interesting objects are visually salient," J. Vision, vol. 8, no. 3, pp. 1-15, 2008.
19. M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman. (2010). The PASCAL Visual Object Classes Challenge Results [Online]. Available: http://www.pascalnetwork.org/challenges/VOC/voc2010/workshop/index.html
20. S. Frintrop, A. Nüchter, H. Surmann, and J. Hertzberg, "Saliency-based object recognition in 3-D data," in Proc. Int. Conf. Intell. Robots Syst., 2004, pp. 2167-2172. (Pubitemid 40275919)
21. Y. Fu, J. Cheng, Z. Li, and H. Lu, "Saliency cuts: An automatic approach to object segmentation," in Proc. Int. Conf. Pattern Recognit., 2008, pp. 1-4.
22. K. Fukuchi, K. Miyazato, A. Kimura, S. Takagi, and J. Yamato, "Saliency-based video segmentation with graph cuts and sequentially updated priors," in Proc. IEEE Int. Conf. Multimedia Expo, pp. 638-641, Jun.-Jul. 2009.
23. B. Gao, T.-Y. Liu, W. Wei, T. Wang, and H. Li, "Semi-supervised ranking on very large graphs with rich metadata," in Proc. 17th Int. Conf. Knowl. Discovery Data Mining, 2011, pp. 96-104.
24. D. Gao, V. Mahadevan, and N. Vasconcelos, "The discriminant centersurround hypothesis for bottom-up saliency," in Proc. Adv. Neural Inf. Process. Syst. 20, Dec. 2007, pp. 497-504.
25. D. Gao and N. Vasconcelos, "Discriminant saliency for visual recognition from cluttered scenes," in Proc. Adv. Neural Inf. Process. Syst. 17, Dec. 2004, pp. 481-488.
26. D. Gao and N. Vasconcelos, "Integrated learning of saliency, complex features, and object detectors from cluttered scenes," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., vol 2. Jun. 2005, pp. 282-287.
27. S. Gao, L.-T. Chia, and I. W.-H. Tsang, "Multi-layer group sparse coding for concurrent image classification and annotation," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2011, pp. 2809-2816.
28. S. Gao, I. W. Tsang, and L.-T. Chia, "Sparse representation with kernels," IEEE Trans. Image Process., vol. 22, no. 2, pp. 423-434, Feb. 2013.
29. S. Gao, I. W.-H. Tsang, and L.-T. Chia, "Laplacian sparse coding, hypergraph Laplacian sparse coding, and applications," IEEE Trans. Pattern Anal. Mach. Intell., 99(PrePrints), 2012.
30. S. Goferman, L. Zelnik-Manor, and A. Tal, "Context-aware saliency detection," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2010, pp. 2376-2383.
31. V. Gopalakrishnan, Y. Hu, and D. Rajan, "Random walks on graphs to model saliency in images," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2009, pp. 1698-1705.
32. V. Gopalakrishnan, Y. Hu, and D. Rajan, "Salient region detection by modeling distributions of color and orientation," IEEE Trans. Multimedia, vol. 11, no. 5, pp. 892-905, Aug. 2009.
33. K. Grauman and T. Darrell, "The pyramid match kernel: Discriminative classification with sets of image features," in Proc. Int. Conf. Comput. Vision, 2005, pp. 1458-1465. (Pubitemid 44042350)
34. C. Guo, Q. Ma, and L. Zhang, "Spatio-temporal saliency detection using phase spectrum of quaternion fourier transform," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2008, pp. 1-8.
35. S. Han and N. Vasconcelos, "Biologically plausible saliency mechanisms improve feedforward object recognition," Vision Res., vol. 50, no. 22, pp. 2295-2307, 2010.
36. J. Harel, C. Koch, and P. Perona, "Graph-based visual saliency," in Proc. Adv. Neural Inform. Process. Syst. 20, Dec. 2007, pp. 545-552.
37. X. Hou and L. Zhang, "Saliency detection: A spectral residual approach," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2007, pp. 1-8.
38. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998. (Pubitemid 128742001)
39. H. Jiang, J. Wang, Z. Yuan, T. Liu, N. Zheng, and S. Li, "Automatic salient object segmentation based on context and shape prior," in Proc. Brit. Mach. Vision Conf., 2011, pp. 1-12.
40. T. Judd, K. Ehinger, F. Durand, and A. Torralba, "Learning to predict where humans look," in Proc. Int. Conf. Comput. Vision, 2009, pp. 2106-2113.
41. C. Kanan, M. H. Tong, L. Zhang, and G. W. Cottrell, "SUN: Top-down saliency using natural statistics," Vis. Cogn., vol. 17, pp. 979-1003, Aug. 2009.
42. C.-C. Kao, J.-H. Lai, and S.-Y. Chien, "Automatic object segmentation with salient color model," in Proc. IEEE Int. Conf. Multimedia Expo, 2011, pp. 1-6.
43. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2006, pp. 2169-2178. (Pubitemid 44931582)
44. H. Lee, A. Battle, R. Raina, and A. Y. Ng, "Efficient sparse coding algorithms," in Proc. Adv. Neural Inform. Process. Syst., Dec. 2006, pp. 801-808.
45. Y. Li, Y. Zhou, J. Yan, Z. Liu, and J. Yang, "Visual saliency based on conditional entropy," in Proc. Asian Conf. Comput. Vision, 2009, pp. 246-257.
46. T. Liu, J. Sun, N.-N. Zheng, X. Tang, and H.-Y. Shum, "Learning to detect a salient object," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2007, pp. 1-8.
47. Y. Luo, J. Yuan, P. Xue, and Q. Tian, "Saliency density maximization for efficient visual objects discovery," IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 12, pp. 1822-1834, Dec. 2011.
48. L. Marchesotti, C. Cifarelli, and G. Csurka, "A framework for visual saliency detection with applications to image thumbnailing," in Proc. Int. Conf. Comput. Vision, 2009, pp. 2232-2239.
49. F. Moosmann, D. Larlus, and F. Jurie, "Learning saliency maps for object categorization," in Proc. Eur. Conf. Comput. Vision Workshop Represent. Use Prior Knowl. Vision, 2006.
50. A. Oliva and A. Torralba, "The role of context in object recognition," Trends in Cogn. Sci., vol. 11, pp. 520-527, Dec. 2007. (Pubitemid 350181571)
51. A. Oliva, A. Torralba, M. S. Castelhano, and J. M. Henderson, "Top-down control of visual attention in object detection," in Proc. IEEE Conf. Image Process., Sep. 2003, pp. 253-256.
52. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, "Object retrieval with large vocabularies and fast spatial matching," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2007, pp. 1-8.
53. O. Ramström and H. I. Christensen, "Object detection using background context," in Proc. Int. Conf. Pattern Recognit., 2004, pp. 45-48.
54. X. Ren and J. Malik, "Learning a classification model for segmentation," in Proc. Int. Conf. Comput. Vision, Oct. 2003, pp. 10-17.
55. Z. Ren, Y. Hu, L.-T. Chia, and D. Rajan, "Improved saliency detection based on superpixel clustering and saliency propagation," in Proc. ACM Int. Conf. Multimedia, 2010.
56. L. W. Renninger, J. M. Coughlan, P. Verghese, and J. Malik, "An information maximization model of eye movements," in Proc. Adv. Neural Inform. Process. Syst. 17, 2004, pp. 1121-1128.
57. H. J. Seo and P. Milanfar, "Static and space-time visual saliency detection by self-resemblance," J. Vision, vol. 9, no. 12, pp. 1-17, 2009.
58. A. Shokoufandeh, I. Marsic, and S. J. Dickinson, "View-based object recognition using saliency maps," Image Vision Comput., vol. 17, pp. 445-460, Apr. 1999.
59. J. Sivic and A. Zisserman, "Video google: A text retrieval approach to object matching in videos," in Proc. Int. Conf. Comput. Vision, 2003, pp. 1470-1477.
60. J. Tang, X.-S. Hua, G.-J. Qi, and X. Wu, "Typicality ranking via semi-supervised multiple-instance learning," in Proc. ACM Int. Conf. Multimedia, 2007, pp. 297-300.
61. A. Torralba, A. Oliva, M. S. Castelhano, and J. M. Henderson, "Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search," Psychol. Rev., vol. 113, no. 4, pp. 766-786, Oct. 2006. (Pubitemid 44629917)
62. D. Walther, U. Rutishauser, C. Koch, and P. Perona, "On the usefulness of attention for object recognition," in Proc. Eur. Conf. Comput. Vision, 2004, pp. 96-103.
63. J. Wang, J. Yang, K. Yu, F. Lv, and Y. Gong, "Learning localityconstraint linear coding for image classification," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2010, pp. 3360-3367.
64. W. Wang, Y. Wang, Q. Huang, and W. Gao, "Measuring visual saliency by site entropy rate," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2010, pp. 2368-2375.
65. J. Yang, K. Yu, Y. Gong, and T. Huang, "Linear spatial pyramid matching using sparse coding for image classification," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2009, pp. 1794-1801.
66. H. Yu, J. Li, Y. Tian, and T. Huang, "Automatic interesting object extraction from images using complementary saliency maps," in Proc. ACM Int. Conf. Multimedia, 2010, pp. 891-894.
67. X.-T. Yuan and S. Yan, "Visual classification with multi-task joint sparse representation," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2010, pp. 3493-3500.
68. Y. Zhai and M. Shah, "Visual attention detection in video sequences using spatiotemporal cues," in Proc. ACM Int. Conf. Multimedia, Oct. 2006, pp. 815-824. (Pubitemid 47113641)
69. L. Zhang, M. H. Tong, T. K. Marks, H. Shan, and G. W. Cottrell, "SUN: A Bayesian framework for saliency using natural statistics," J. Vision, vol. 8, no. 7, pp. 1-20, 2008.