Recurrent Attentional Networks for Saliency Detection

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 3668-3677

  Kuen, Jason ^a   Wang, Zhenhua ^a   Wang, Gang ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; CONVOLUTION; ITERATIVE METHODS;

CONTEXT-AWARE FEATURES; END TO END; MULTIPLE SCALE; RECURRENT NETWORKS; SALIENCY DETECTION; STATE OF THE ART; SUB-REGIONS;

PATTERN RECOGNITION;

EID: 84986334038     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.399     Document Type: Conference Paper

References (50)

1. R. Achanta, S. Hemami, F. Estrada, and S. Susstrunk. Frequency-tuned salient region detection. In IEEE Confer-ence on Computer Vision and Pattern Recognition, pages 1597-1604. IEEE, 2009.
2. S. Alpert, M. Galun, R. Basri, and A. Brandt. Image segmentation by probabilistic bottom-up aggregation and cue integration. In IEEE Conference on Computer Vision and Pattern Recognition, pages 1-8, 2007.
3. J. Ba, V. Mnih, and K. Kavukcuoglu. Multiple object recognition with visual attention. In International Conference on Learning Representations, 2015.
4. A. Borji, M. Cheng, H. Jiang, and J. Li. Salient object detection: A benchmark. IEEE Transactions on Image Processing, 24(12):5706-5722, 2015.
5. A. Borji, S. Frintrop, D. N. Sihite, and L. Itti. Adaptive object tracking by learning background context. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, pages 23-30. IEEE, 2012.
6. K. Chatfield, K. Simonyan, A. Vedaldi, and A. Zisserman. Return of the devil in the details: Delving deep into convolutional nets. In British Machine Vision Conference, 2014.
7. T. Chen, M.-M. Cheng, P. Tan, A. Shamir, and S.-M. Hu. Sketch2photo: internet image montage. ACM Transactions on Graphics, 28(5):124, 2009.
8. M.-M. Cheng, N. Mitra, X. Huang, and S.-M. Hu. Salientshape: group saliency in image collections. The Visual Computer, 30(4):443-453, 2014.
9. M.-M. Cheng, N. J. Mitra, X. Huang, P. H. S. Torr, and S.-M. Hu. Global contrast based salient region detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 37(3):569-582, 2015.
10. A. Dosovitskiy, J. Tobias Springenberg, and T. Brox. Learning to generate chairs with convolutional neural networks. In IEEE Conference on Computer Vision and Pattern Recognition, pages 1538-1546, 2015.
11. J. L. Elman. Finding structure in time. Cognitive science, 14(2):179-211, 1990.
12. S. Frintrop, T. Werner, and G. Martin Garcia. Traditional saliency reloaded: A good old model in new shape. In IEEE Conference on Computer Vision and Pattern Recognition, June 2015.
13. G. Garcia, E. Potapova, T. Werner, M. Zillich, M. Vincze, and S. Frintrop. Saliency-based object discovery on rgbd data with a late-fusion approach. In IEEE International Conference on Robotics and Automation, pages 1866-1873, 2015.
14. K. Gregor, I. Danihelka, A. Graves, D. Rezende, and D. Wierstra. Draw: A recurrent neural network for image generation. In International Conference on Machine Learning. JMLR Workshop and Conference Proceedings, 2015.
15. J. Gu, Z. Wang, J. Kuen, L. Ma, A. Shahroudy, B. Shuai, T. Liu, X. Wang, and G. Wang. Recent advances in convolutional neural networks. arXiv preprint arXiv:1512.07108, 2015.
16. M. Guillaumin, D. Küttel, and V. Ferrari. Imagenet autoannotation with segmentation propagation. International Journal of Computer Vision, 110(3):328-348, 2014.
17. J. Harel, C. Koch, and P. Perona. Graph-based visual saliency. In Advances in Neural Information Processing Systems, pages 545-552, 2006.
18. K. He, X. Zhang, S. Ren, and J. Sun. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In IEEE International Conference on Computer Vision, 2015.
19. X. Hou and L. Zhang. Saliency detection: A spectral residual approach. In IEEE Conference on Computer Vision and Pattern Recognition, pages 1-8. IEEE, 2007.
20. S. Ioffe and C. Szegedy. Batch normalization: Accelerating deep network training by reducing internal covariate shift. Journal of Machine Learning Research, 2015.
21. L. Itti, C. Koch, and E. Niebur. A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, (11):1254-1259, 1998.
22. M. Jaderberg, K. Simonyan, A. Zisserman, and K. Kavukcuoglu. Spatial transformer networks. In Advances in Neural Information Processing Systems, 2015.
23. B. Jiang, L. Zhang, H. Lu, C. Yang, and M.-H. Yang. Saliency detection via absorbing markov chain. In IEEE International Conference on Computer Vision, ICCV '13, pages 1665-1672, 2013.
24. H. Jiang, J. Wang, Z. Yuan, Y. Wu, N. Zheng, and S. Li. Salient object detection: A discriminative regional feature integration approach. In IEEE Conference on Computer Vision and Pattern Recognition, pages 2083-2090. IEEE, 2013.
25. R. Ju, Y. Liu, T. Ren, L. Ge, and G. Wu. Depth-aware salient object detection using anisotropic center-surround difference. Signal Processing: Image Communication, 2015.
26. T. Judd, K. Ehinger, F. Durand, and A. Torralba. Learning to predict where humans look. In IEEE Conference on Computer Vision and Pattern Recognition, pages 2106-2113. IEEE, 2009.
27. D. Kingma and J. Ba. Adam: A method for stochastic optimization. In International Conference on Learning Representations, 2014.
28. C. Li, Y. Yuan, W. Cai, Y. Xia, and D. Dagan Feng. Robust saliency detection via regularized random walks ranking. In IEEE Conference on Computer Vision and Pattern Recognition, June 2015.
29. G. Li and Y. Yu. Visual saliency based on multiscale deep features. In IEEE Conference on Computer Vision and Pattern Recognition, 2015.
30. X. Li, H. Lu, L. Zhang, X. Ruan, and M.-H. Yang. Saliency detection via dense and sparse reconstruction. In IEEE International Conference on Computer Vision, ICCV '13, pages 2976-2983, 2013.
31. N. Liu, J. Han, D. Zhang, S. Wen, and T. Liu. Predicting eye fixations using convolutional neural networks. In IEEE Conference on Computer Vision and Pattern Recognition, pages 362-370, 2015.
32. T. Liu, Z. Yuan, J. Sun, J. Wang, N. Zheng, X. Tang, and H.-Y. Shum. Learning to detect a salient object. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(2):353-367, 2011.
33. J. Long, E. Shelhamer, and T. Darrell. Fully convolutional networks for semantic segmentation. In IEEE Conference on Computer Vision and Pattern Recognition, pages 3431-3440, 2015.
34. R. Margolin, A. Tal, and L. Zelnik-Manor. What makes a patch distinct? In IEEE Conference on Computer Vision and Pattern Recognition, pages 1139-1146, 2013.
35. V. Mnih, N. Heess, A. Graves, et al. Recurrent models of visual attention. In Advances in Neural Information Processing Systems, pages 2204-2212, 2014.
36. H. Noh, S. Hong, and B. Han. Learning deconvolution network for semantic segmentation. In IEEE International Conference on Computer Vision, 2015.
37. H. Peng, B. Li, W. Xiong, W. Hu, and R. Ji. Rgbd salient object detection: a benchmark and algorithms. In European Conference on Computer Vision, pages 92-109, 2014.
38. P. Pinheiro and R. Collobert. Recurrent convolutional neural networks for scene labeling. In International Conference on Machine Learning, pages 82-90, 2014.
39. Y. Qin, H. Lu, Y. Xu, and H. Wang. Saliency detection via cellular automata. In IEEE Conference on Computer Vision and Pattern Recognition, June 2015.
40. Z. Ren, S. Gao, L.-T. Chia, and I. W.-H. Tsang. Regionbased saliency detection and its application in object recognition. IEEE Transactions Circuits and Systems for Video Technology, 24(5):769-779, 2014.
41. J. Shi, Q. Yan, L. Xu, and J. Jia. Hierarchical image saliency detection on extended cssd. IEEE Transactions on Pattern Analysis and Machine Intelligence, PP(99):1-1, 2015.
42. T. Tieleman and G. Hinton. Lecture 6.5-RmsProp: Divide the gradient by a running average of its recent magnitude. COURSERA: Neural Networks for Machine Learning, 2012.
43. E. Vig, M. Dorr, and D. Cox. Large-scale optimization of hierarchical features for saliency prediction in natural images. In IEEE Conference on Computer Vision and Pattern Recognition, pages 2798-2805. IEEE, 2014.
44. L. Wang, H. Lu, X. Ruan, and M.-H. Yang. Deep networks for saliency detection via local estimation and global search. In IEEE Conference on Computer Vision and Pattern Recognition, June 2015.
45. C. Yang, L. Zhang, H. Lu, X. Ruan, and M.-H. Yang. Saliency detection via graph-based manifold ranking. In IEEE Conference on Computer Vision and Pattern Recognition, pages 3166-3173. IEEE, 2013.
46. J. Yang and M.-H. Yang. Top-down visual saliency via joint crf and dictionary learning. In IEEE Conference on Computer Vision and Pattern Recognition, pages 2296-2303. IEEE, 2012.
47. D. Zhang, J. Han, C. Li, and J. Wang. Co-saliency detection via looking deep and wide. In IEEE Conference on Computer Vision and Pattern Recognition, June 2015.
48. L. Zhang, M. H. Tong, T. K. Marks, H. Shan, and G.W. Cottrell. Sun: A Bayesian framework for saliency using natural statistics. Journal of vision, 8(7):32, 2008.
49. R. Zhao, W. Ouyang, H. Li, and X. Wang. Saliency detection by multi-context deep learning. In IEEE Conference on Computer Vision and Pattern Recognition, pages 1265-1274, 2015.
50. W. Zhu, S. Liang, Y. Wei, and J. Sun. Saliency optimization from robust background detection. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR '14, pages 2814-2821, 2014.