Learning to predict eye fixations for semantic contents using multi-layer sparse network

Neurocomputing

Volumn 138, Issue , 2014, Pages 61-68

  Shen, Chengyao ^a   Zhao, Qi ^b  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Deep learning; Gaze prediction; Semantic saliency; Sparse coding

Indexed keywords

IMAGE RETRIEVAL; SEMANTICS; SUPPORT VECTOR MACHINES;

DEEP LEARNING; FEATURE INTEGRATION; HIERARCHICAL ORGANIZATIONS; HIGH-LEVEL FEATURES; HIGH-LEVEL SEMANTIC FEATURES; LINEAR SUPPORT VECTOR MACHINES; SEMANTIC INFORMATION; SPARSE CODING;

FORECASTING;

ARTICLE; EYE FIXATION; EYE TRACKING; LEARNING THEORY; MATHEMATICAL MODEL; MULTILAYER SPARSE NETWORK; PREDICTION; PRIORITY JOURNAL; SALIENCY MODEL; SEMANTICS; SUPPORT VECTOR MACHINE; SYSTEM ANALYSIS;

EID: 84899945571     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2013.09.053     Document Type: Article

References (31)

1. Treisman A., Gelade G. A feature-integration theory of attention. Cogn. Psychol. 1980, 12(1):97-136.
2. Koch C., Ullman S. Shifts in selective visual attention. towards the underlying neural circuitry. Hum. Neurobiol. 1985, 4(4):219-227.
3. Zhao Q., Koch C. Learning saliency-based visual attention. a review. Signal Process. 2013, 93(6):1401-1407.
4. Itti L., Koch C. A saliency-based search mechanism for overt and covert shifts of visual attention. Vis. Res. 2000, 40(10-12):1489-1506.
5. Harel J., Koch C., Perona P. Graph-based visual saliency. Adv. Neural Inf. Process. Syst. 2007, 19:545.
6. W. Einhäuser, M. Spain, P. Perona, Objects predict fixations better than early saliency, J. Vis. 8(14) (2008).
7. T. Judd, K. Ehinger, F. Durand, A. Torralba, Learning to predict where humans look, in: 2009 IEEE 12th International Conference on Computer Vision, Koyto, Japan, 2009, pp. 2106-2113.
8. M. Cerf, J. Harel, W. Einhäuser, C. Koch, Predicting human gaze using low-level saliency combined with face detection, Adv. Neural Inf. Process. Syst. 20 (2008).
9. Q. Zhao, C. Koch, Learning a saliency map using fixated locations in natural scenes, J. Vis. 11(3) (2011).
10. Q. Zhao, C. Koch, Learning visual saliency, in: 2011 45th Annual Conference on Information Sciences and Systems (CISS), IEEE, Baltimore, USA, 2011, pp. 1-6.
11. H. Lee, R. Grosse, R. Ranganath, A. Ng, Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations, in: Proceedings of the 26th Annual International Conference on Machine Learning, ACM, Montreal, Canada, 2009, pp. 609-616.
12. M. Zeiler, G. Taylor, R. Fergus, Adaptive deconvolutional networks for mid and high level feature learning, in: 2011 IEEE International Conference on Computer Vision (ICCV), IEEE, Barcelona, Spain, 2011, pp. 2018-2025.
13. Q. Le, R. Monga, M. Devin, G. Corrado, K. Chen, M. Ranzato, J. Dean, A. Ng, Building High-Level Features using Large Scale Unsupervised Learning, Arxiv Preprint. http://arxiv:1112.6209.
14. T. Serre, M. Kouh, C. Cadieu, U. Knoblich, G. Kreiman, T. Poggio, A Theory of Object Recognition: Computations and Circuits in the Feedforward Path of the Ventral Stream in Primate Visual Cortex, Technical Report, DTIC Document, 2005.
15. Bengio Y. Learning deep architectures for AI. Found. Trends Mach. Learn. 2009, 2(1):1-127.
16. C. Shen, M. Song, Q. Zhao, Learning high-level concepts by training a deep network on eye fixations, in: Deep Learning and Unsupervised Feature Learning Workshop, In Conduction with NIPS, Lake Tahoe, USA, December 2012.
17. M. Cerf, E. Frady, C. Koch, Faces and text attract gaze independent of the task: experimental data and computer model, J. Vis. 9(12) (2009).
18. Y. Lu, W. Zhang, C. Jin, X. Xue, Learning attention map from images, in: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, Rhode Island, USA, 2012, pp. 1067-1074.
19. Fei-Fei L., Fergus R., Perona P. Learning generative visual models from few training examples. an incremental Bayesian approach tested on 101 object categories. Comput. Vis. Image Underst. 2007, 106(1):59-70.
20. Fukushima K. Neocognitron. a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cybern. 1980, 36(4):193-202.
21. Riesenhuber M., Poggio T., et al. Hierarchical models of object recognition in cortex. Nat. Neurosci. 1999, 2:1019-1025.
22. Serre T., Wolf L., Bileschi S., Riesenhuber M., Poggio T. Robust object recognition with cortex-like mechanisms. IEEE Trans. Pattern Anal. Mach. Intell. 2007, 29(3):411-426.
23. Lecun Y., Boser B., Denker J., Henderson D., Howard R., Hubbard W., Jackel L. Backpropagation applied to handwritten zip code recognition. Neural Comput. 1989, 1(4):541-551.
24. Vanrullen R. Visual saliency and spike timing in the ventral visual pathway. J. Physiol.-Paris 2003, 97(2-3):365-377.
25. Barlow H. Possible principles underlying the transformation of sensory messages. Sens. Commun. 1961, 217-234.
26. Olshausen B., Field D. Sparse coding with an overcomplete basis set. a strategy employed by v1?. Vis. Res. 1997, 37(23):3311-3325.
27. J. Yang, M. Yang, Learning hierarchical image representation with sparsity, saliency and locality, in: Jesse Hoey, Stephen McKenna, Emanuele Trucco (Eds.), Proceedings of the British Machine Vision Conference, Dundee, Scotland, 2011, pp. 19.1-19.11.
28. Lee H., Battle A., Raina R., Ng A. Efficient sparse coding algorithms. Adv. Neural Inf. Process. Syst. 2007, 19:801.
29. Y. Boureau, J. Ponce, Y. Lecun, A theoretical analysis of feature pooling in visual recognition, in: International Conference on Machine Learning, Haifa, Israel, 2010, pp. 111-118.
30. Dan Y., Atick J., Reid R. Efficient coding of natural scenes in the lateral geniculate nucleus. experimental test of a computational theory. J. Neurosci. 1996, 16(10):3351-3362.
31. A. Hyvärinen, J. Hurri, P. Hoyer, Natural Image Statistics: A Probabilistic Approach to Early Computational Vision, vol. 39, Springer, 2009.