Predicting eye fixations using convolutional neural networks

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 07-12-June-2015, Issue , 2015, Pages 362-370

  Liu, Nian ^a   Han, Junwei ^a   Zhang, Dingwen ^a   Wen, Shifeng ^a   Liu, Tianming ^b  

^a NORTHWESTERN POLYTECHNICAL UNIVERSITY   (China)

^b UNIVERSITY OF GEORGIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; CONVOLUTION; FORECASTING; NEURAL NETWORKS; PATTERN RECOGNITION; VISUALIZATION;

BENCHMARK DATASETS; BOTTOM-UP AND TOP-DOWN; COMPUTATIONAL FRAMEWORK; CONVOLUTIONAL NEURAL NETWORK; LOGISTIC REGRESSIONS; MULTIPLE RESOLUTIONS; OPTIMAL INTEGRATION; STATE OF THE ART;

EYE MOVEMENTS;

EID: 84946554818     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2015.7298633     Document Type: Conference Paper

References (40)

1. L. Itti, C. Koch, and E. Niebur. A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell., 20(11):1254-1259, 1998
2. T. Judd, K. Ehinger, F. Durand, and A. Torralba. Learning to predict where humans look. In ICCV, 2009
3. A. Borji. Boosting bottom-up and top-down visual features for saliency estimation. In CVPR, 2012
4. A. Borji, and L. Itti. Exploiting local and global patch rarities for saliency detection. In CVPR, 2012
5. A. Garcia-Diaz, X. R. Fdez-Vidal, X. M. Pardo, and R. Dosil. Saliency from hierarchical adaptation through decorrelation and variance normalization. Image Vision Comput., 30(1): 51-64, 2012
6. J. Zhang, and S. Sclaroff. Saliency detection: A boolean map approach. In ICCV, 2013
7. S. Goferman, L. Zelnik-Manor, and A. Tal. Context-aware saliency detection. IEEE Trans. Pattern Anal. Mach. Intell., 34(10):1915-1926, 2012
8. F. Liu, and M. Gleicher. Video retargeting: automating pan and scan. In ACM Multimedia, 2006
9. J. Sun, and H. Ling. Scale and object aware image retargeting for thumbnail browsing. In ICCV, 2011
10. J. Han, K. Li, L. Shao, X. Hu, S. He, L. Guo, J. Han, and T. Liu. Video abstraction based on fMRI-driven visual attention model. Information Sciences, 2014
11. N. Bruce, and J. Tsotsos. Saliency based on information maximization. In NIPS, 2005
12. X. Hou, and L. Zhang. Dynamic visual attention: Searching for coding length increments. In NIPS, 2009
13. B. Han, H. Zhu, and Y. Ding. Bottom-up saliency based on weighted sparse coding residual. In ACM Multimedia, 2011
14. X. Hou, and L. Zhang. Saliency detection: A spectral residual approach. In CVPR, 2007
15. C. Guo, and L. Zhang. A novel multiresolution spatiotemporal saliency detection model and its applications in image and video compression. IEEE Trans. Image Process., 19(1):185-198, 2010
16. X. Hou, J. Harel, and C. Koch. Image signature: Highlighting sparse salient regions. IEEE Trans. Pattern Anal. Mach. Intell., 34(1):194-201, 2012
17. B. Schauerte, and R. Stiefelhagen. Quaternion-based spectral saliency detection for eye fixation prediction. In ECCV, 2012
18. Q. Zhao, and C. Koch. Learning a saliency map using fixated locations in natural scenes. J. Vision, 11(3):9, 2011
19. W. Einhäuser, M. Spain, and P. Perona. Objects predict fixations better than early saliency. J. Vision, 8(14):18, 2008
20. L. Elazary, and L. Itti. Interesting objects are visually salient. J. Vision, 8(3):3, 2008
21. S. Ramanathan, H. Katti, N. Sebe, M. Kankanhalli, and T.-S. Chua. An eye fixation database for saliency detection in images. In ECCV, 2010
22. R. Carmi, and L. Itti. Visual causes versus correlates of attentional selection in dynamic scenes. Vision Research, 46(26):4333-4345, 2006
23. B. W. Tatler. The central fixation bias in scene viewing: Selecting an optimal viewing position independently of motor biases and image feature distributions. J. Vision, 7(14):4, 2007
24. M. Cerf, J. Harel, W. Einhäuser, and C. Koch. Predicting human gaze using low-level saliency combined with face detection. In NIPS, 2008
25. C. Shen, M. Song, and Q. Zhao. Learning high-level concepts by training a deep network on eye fixations. In NIPS Deep Learning and Unsup Feat Learn Workshop, 2012
26. E. Vig, M. Dorr, and D. Cox. Large-scale optimization of hierarchical features for saliency prediction in natural images. In CVPR, 2014
27. Y. Lin, S. Kong, D. Wang, and Y. Zhuang. Saliency detection within a deep convolutional architecture. In Workshops at the Twenty-Eighth AAAI Conference on Artificial Intelligence, 2014
28. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11):2278-2324, 1998
29. V. Nair, and G. E. Hinton. Rectified linear units improve restricted boltzmann machines. In ICML, 2010
30. K. He, X. Zhang, S. Ren, and J. Sun. Spatial pyramid pooling in deep convolutional networks for visual recognition. In ECCV, 2014
31. C. Farabet, C. Couprie, L. Najman, and Y. LeCun. Learning hierarchical features for scene labeling. IEEE Trans. Pattern Anal. Mach. Intell., 35(8):1915-1929, 2013
32. A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and F. Li. Large-scale video classification with convolutional neural networks. In CVPR, 2014
33. D. E. Rumelhart, G. E. Hinton, and R. J. Williams. Learning internal representations by error propagation. MIT Press, Cambridge, MA, USA, 1986
34. B. W. Tatler, R. J. Baddeley, and I. D. Gilchrist. Visual correlates of fixation selection: effects of scale and time. Vision Research, 45(5):643-659, 2005
35. L. Zhang, M. H. Tong, T. K. Marks, H. Shan, and G. W. Cottrell. SUN: A Bayesian framework for saliency using natural statistics. J. Vision, 8(7):32, 2008
36. G. E. Hinton, N. Srivastava, A. Krizhevsky, I. Sutskever, and R. R. Salakhutdinov. Improving neural networks by preventing co-adaptation of feature detectors. arXiv preprint arXiv:1207. 0580, 2012
37. J. Li, M. D. Levine, X. An, X. Xu, and H. He. Visual saliency based on scale-space analysis in the frequency domain. IEEE Trans. Pattern Anal. Mach. Intell., 35(4):996-1010, 2013
38. H. J. Seo, and P. Milanfar. Static and space-time visual saliency detection by self-resemblance. J. Vision, 9(12):15, 2009
39. J. Han, S. He, X. Qian, D. Wang, L. Guo, and T. Liu. An object-oriented visual saliency detection framework based on sparse coding representations. IEEE Trans. Circuits Syst. Video Technol., 23(12):2009-2021, 2013
40. J. Han, D. Zhang, X. Hu, L. Guo, J. Ren, and F. Wu. Background prior based salient object detection via deep reconstruction residual. IEEE Trans. Circuits Syst. Video Technol., 2014. DOI: 10. 1109/TCSVT. 2014. 2381471.