Deep Gaze I: Boosting saliency prediction with feature maps trained on ImageNet

3rd International Conference on Learning Representations, ICLR 2015 - Workshop Track Proceedings

Volumn , Issue , 2015, Pages

  Kümmerer, Matthias ^a   Theis, Lucas ^a   Bethge, Matthias ^a  

^a UNIVERSITY OF TÜBINGEN   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

FORECASTING; OBJECT RECOGNITION;

FEATURE MAP; IMAGE FEATURES; NEURAL IMPLEMENTATIONS; POINT PROCESS; SALIENCY MODELING; STATE OF THE ART; TRAINING DATA;

DEEP NEURAL NETWORKS;

EID: 85083953536     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (29)

1. Barthelmé, Simon, Trukenbrod, Hans, Engbert, Ralf, and Wichmann, Felix. Modelling fixation locations using spatial point processes. Journal of Vision, 13(12), 2013. doi: 10.1167/13.12.1.
2. Bergstra, James, Breuleux, Olivier, Bastien, Frédéric, Lamblin, Pascal, Pascanu, Razvan, Desjardins, Guillaume, Turian, Joseph, Warde-Farley, David, and Bengio, Yoshua. Theano: a CPU and GPU math expression compiler. In Proceedings of the Python for Scientific Computing Conference (SciPy), June 2010. Oral Presentation.
3. Bruce, Neil DB and Tsotsos, John K. Saliency, attention, and visual search: An information theoretic approach. Journal of vision, 9(3), 2009.
4. Buswell, Guy Thomas. How people look at pictures. University of Chicago Press Chicago, 1935.
5. Bylinskii, Zoya, Judd, Tilke, Durand, Frédo, Oliva, Aude, and Torralba, Antonio. Mit saliency benchmark. http://saliency.mit.edu/.
6. Cerf, Moran, Harel, Jonathan, Einhaeuser, Wolfgang, and Koch, Christof. Predicting human gaze using low-level saliency combined with face detection. In Platt, J.C., Koller, D., Singer, Y., and Roweis, S.T. (eds.), Advances in Neural Information Processing Systems 20, pp. 241–248. Curran Associates, Inc., 2008. URL http://papers.nips.cc/paper/3169-predicting-human-gaze-using-low-level-saliency-combined-with-face-detection. pdf.
7. Deng, Jia, Dong, Wei, Socher, Richard, Li, Li-Jia, Li, Kai, and Fei-Fei, Li. Imagenet: A large-scale hierarchical image database. In Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pp. 248–255. IEEE, 2009.
8. Donahue, Jeff, Jia, Yangqing, Vinyals, Oriol, Hoffman, Judy, Zhang, Ning, Tzeng, Eric, and Darrell, Trevor. Decaf: A deep convolutional activation feature for generic visual recognition. arXiv preprint arXiv:1310.1531, 2013.
9. Garcia-Diaz, Antón, Leborán, Víctor, Fdez-Vidal, Xosé R, and Pardo, Xosé M. On the relationship between optical variability, visual saliency, and eye fixations: A computational approach. Journal of vision, 12(6):17, 2012.
10. Itti, Laurent, Koch, Christof, and Niebur, Ernst. A model of saliency-based visual attention for rapid scene analysis. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 20(11): 1254–1259, 1998. doi: 10.1109/34.730558.
11. Jia, Yangqing, Shelhamer, Evan, Donahue, Jeff, Karayev, Sergey, Long, Jonathan, Girshick, Ross, Guadarrama, Sergio, and Darrell, Trevor. Caffe: Convolutional architecture for fast feature embedding. arXiv preprint arXiv:1408.5093, 2014.
12. Judd, Tilke, Ehinger, Krista, Durand, Frédo, and Torralba, Antonio. Learning to predict where humans look. In Computer Vision, 2009 IEEE 12th international conference on, pp. 2106–2113. IEEE, 2009.
13. Krizhevsky, Alex, Sutskever, Ilya, and Hinton, Geoffrey E. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems, pp. 1097–1105, 2012.
14. Kümmerer, M., Wallis, T., and Bethge, M. How close are we to understanding image-based saliency? arXiv preprint arXiv:1409.7686, Sep 2014. URL http://arxiv.org/abs/1409.7686.
15. Michell, Joel. Quantitative science and the definition of measurement in psychology. British Journal of Psychology, 88(3):355–383, 1997.
16. Mnih, Volodymyr, Heess, Nicolas, Graves, Alex, et al. Recurrent models of visual attention. In Advances in Neural Information Processing Systems, pp. 2204–2212, 2014.
17. Razavian, Ali Sharif, Azizpour, Hossein, Sullivan, Josephine, and Carlsson, Stefan. Cnn features off-the-shelf: an astounding baseline for recognition. In Computer Vision and Pattern Recognition Workshops (CVPRW), 2014 IEEE Conference on, pp. 512–519. IEEE, 2014.
18. Riche, Nicolas, Mancas, Matei, Duvinage, Matthieu, Mibulumukini, Makiese, Gosselin, Bernard, and Dutoit, Thierry. RARE2012: A multi-scale rarity-based saliency detection with its comparative statistical analysis. Signal Processing: Image Communication, 28(6):642–658, July 2013. ISSN 09235965. doi: 10.1016/j.image.2013.03.009. URL http://linkinghub.elsevier.com/retrieve/pii/S0923596513000489.
19. Simonyan, Karen and Zisserman, Andrew. Very deep convolutional networks for large-scale image recognition. CoRR, abs/1409.1556, 2014. URL http://arxiv.org/abs/1409.1556.
20. Sohl-Dickstein, Jascha, Poole, Ben, and Ganguli, Surya. An adaptive low dimensional quasi-newton sum of functions optimizer. In International Conference on Machine Learning, 2014.
21. Szegedy, Christian, Liu, Wei, Jia, Yangqing, Sermanet, Pierre, Reed, Scott, Anguelov, Dragomir, Erhan, Dumitru, Vanhoucke, Vincent, and Rabinovich, Andrew. Going deeper with convolutions. CoRR, abs/1409.4842, 2014. URL http://arxiv.org/abs/1409.4842.
22. Tang, Yichuan, Srivastava, Nitish, and Salakhutdinov, Ruslan R. Learning generative models with visual attention. In Advances in Neural Information Processing Systems, pp. 1808–1816, 2014.
23. Tatler, Benjamin W. The central fixation bias in scene viewing: Selecting an optimal viewing position independently of motor biases and image feature distributions. Journal of Vision, 7(14):4, 2007. doi: 10.1167/7.14.4.
24. Tatler, Benjamin W., Baddeley, Roland J., and Gilchrist, Iain D. Visual correlates of fixation selection: effects of scale and time. Vision Research, 45(5):643 – 659, 2005. ISSN 0042-6989. doi: http://dx.doi.org/10.1016/j.visres.2004.09.017. URL http://www.sciencedirect.com/science/article/pii/S0042698904004626.
25. Vig, Eleonora, Dorr, Michael, and Cox, David. Large-scale optimization of hierarchical features for saliency prediction in natural images. In Computer Vision and Pattern Recognition, 2014. CVPR’14. IEEE Conference on. IEEE, 2014.
26. Yamins, Daniel LK, Hong, Ha, Cadieu, Charles F, Solomon, Ethan A, Seibert, Darren, and DiCarlo, James J. Performance-optimized hierarchical models predict neural responses in higher visual cortex. Proceedings of the National Academy of Sciences, pp. 201403112, 2014.
27. Zeiler, Matthew D and Fergus, Rob. Visualizing and understanding convolutional neural networks. arXiv preprint arXiv:1311.2901, 2013.
28. Zhang, Jianming and Sclaroff, Stan. Saliency detection: a boolean map approach. In Computer Vision (ICCV), 2013 IEEE International Conference on, pp. 153–160. IEEE, 2013.
29. Zhang, Lingyun, Tong, Matthew H, Marks, Tim K, Shan, Honghao, and Cottrell, Garrison W. Sun: A bayesian framework for saliency using natural statistics. Journal of Vision, 8(7), 2008.