Look and think twice: Capturing top-down visual attention with feedback convolutional neural networks

Proceedings of the IEEE International Conference on Computer Vision

Volumn 2015 International Conference on Computer Vision, ICCV 2015, Issue , 2015, Pages 2956-2964

  Cao, Chunshui ^a   Liu, Xianming ^b   Yang, Yi ^c   Yu, Yinan ^c   Wang, Jiang ^c   Wang, Zilei ^a   Huang, Yongzhen ^d   Wang, Liang ^d   Huang, Chang ^c   Xu, Wei ^c   Ramanan, Deva ^e   Huang, Thomas S ^b  

^a UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA   (China)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^c BAIDU INC   (China)

^d INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

^e CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BEHAVIORAL RESEARCH; CLASSIFICATION (OF INFORMATION); COMPUTER VISION; CONVOLUTION; FEEDBACK; IMAGE CLASSIFICATION; NEURAL NETWORKS; SEMANTICS;

CLUTTERED BACKGROUNDS; CONVOLUTIONAL NEURAL NETWORK; DEEP NEURAL NETWORKS; FEEDFORWARD CONNECTIONS; HIDDEN LAYER NEURONS; HIGH LEVEL SEMANTICS; HUMAN VISUAL CORTEX; TOP-DOWN VISUAL ATTENTIONS;

FEEDFORWARD NEURAL NETWORKS;

EID: 84973861662     PISSN: 15505499     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCV.2015.338     Document Type: Conference Paper

References (34)

1. D. M. Beck and S. Kastner. Top-down and bottom-up mechanisms in biasing competition in the human brain. Vision research, 49 (10): 1154-1165, 2009.
2. Y. Bengio, A. Courville, and P. Vincent. Representation learning: A review and new perspectives. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 35 (8): 1798-1828, 2013.
3. R. M. Cichy, D. Pantazis, and A. Oliva. Resolving human object recognition in space and time. Nature Publishing Group, 17 (3): 455-462, Jan. 2014.
4. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. Imagenet: A large-scale hierarchical image database. In Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pages 248-255. IEEE, 2009.
5. R. Desimone. Visual attention mediated by biased competition in extrastriate visual cortex. Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences, 353 (1373): 1245-1255, 1998.
6. R. Desimone and J. Duncan. Neural mechanisms of selective visual attention. Annual review of neuroscience, 18 (1): 193-222, 1995.
7. D. Erhan, C. Szegedy, A. Toshev, and D. Anguelov. Scalable object detection using deep neural networks. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 2155-2162. IEEE, 2014.
8. P. F. Felzenszwalb, R. B. Girshick, D. McAllester, and D. Ramanan. Object Detection with Discriminatively Trained Part-Based Models. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 32 (9): 1627-1645, 2010.
9. R. Girshick, J. Donahue, T. Darrell, and J. Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 580-587. IEEE, 2014.
10. K. Gregor, I. Danihelka, A. Graves, and D. Wierstra. Draw: A recurrent neural network for image generation. arXiv preprint arXiv: 1502. 04623, 2015.
11. K. He, X. Zhang, S. Ren, and J. Sun. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. arXiv preprint arXiv: 1502. 01852, 2015.
12. S. Hochreiter and J. Schmidhuber. Long short-term memory. Neural computation, 9 (8): 1735-1780, 1997.
13. S. Ioffe and C. Szegedy. Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv: 1502. 03167, 2015.
14. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. arXiv preprint arXiv: 1408. 5093, 2014.
15. A. Krizhevsky, I. Sutskever, and G. E. Hinton. ImageNet classification with deep convolutional neural networks, 2012.
16. N. Kruger, P. Janssen, S. Kalkan, M. Lappe, A. Leonardis, J. Piater, A. J. Rodriguez-Sanchez, and L. Wiskott. Deep Hierarchies in the Primate Visual Cortex: What Can We Learn for Computer Vision? 35 (8): 1847-1871.
17. Q. V. Le. Building high-level features using large scale unsupervised learning. In Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on, pages 8595-8598. IEEE, 2013.
18. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradientbased learning applied to document recognition. Proceedings of the IEEE, 86 (11): 2278-2324, 1998.
19. T. S. Lee and D. Mumford. Hierarchical Bayesian inference in the visual cortex. JOSA A, 20 (7): 1434-1448, 2003.
20. M. Lin, Q. Chen, and S. Yan. Network in network. arXiv preprint arXiv: 1312. 4400, 2013.
21. V. Mnih, N. Heess, A. Graves, and K. Kavukcuoglu. Recurrent Models of Visual Attention. NIPS, June 2014.
22. N. C. Rust and J. J. DiCarlo. Selectivity and Tolerance ("Invariance") Both Increase as Visual Information Propagates from Cortical Area V4 to IT. Journal of Neuroscience, 30 (39): 12978-12995, Sept. 2010.
23. R. Salakhutdinov and G. E. Hinton. Deep boltzmann machines. In International Conference on Artificial Intelligence and Statistics, pages 448-455, 2009.
24. K. Simonyan, A. Vedaldi, and A. Zisserman. Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv preprint arXiv: 1312. 6034, 2013.
25. K. Simonyan and A. Zisserman. Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv. org, Sept. 2014.
26. K. Sohn, G. Zhou, C. Lee, and H. Lee. Learning and selecting features jointly with point-wise gated {B} oltzmann machines. In Proceedings of The 30th International Conference on Machine Learning, pages 217-225, 2013.
27. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov. Dropout: A simple way to prevent neural networks from overfitting. The Journal of Machine Learning Research, 15 (1): 1929-1958, 2014.
28. M. Stollenga, J. Masci, F. Gomez, and J. Schmidhuber. Deep Networks with Internal Selective Attention through Feedback Connections. arXiv. org, July 2014.
29. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going Deeper with Convolutions. arXiv. org, Sept. 2014.
30. J. R. Uijlings, K. E. van de Sande, T. Gevers, and A. W. Smeulders. Selective search for object recognition. International journal of computer vision, 104 (2): 154-171, 2013.
31. Q. Wang, J. Zhang, S. Song, and Z. Zhang. Attentional neural network: Feature selection using cognitive feedback. In Advances in Neural Information Processing Systems, pages 2033-2041, 2014.
32. B. Yuri and J. Marie-Pierre. Interactive graph cuts for optimal boundary and region segmentation of objects in nd images. In IEEEInternational Conference on Computer Vision. USA: IEEE, volume 112, 2001.
33. M. D. Zeiler and R. Fergus. Visualizing and understanding convolutional networks. In Computer Vision-ECCV 2014, pages 818-833. Springer, 2014.
34. M. D. Zeiler, G. W. Taylor, and R. Fergus. Adaptive deconvolutional networks for mid and high level feature learning. Computer Vision (ICCV., pages 2018-2025, 2011.