Transfer learning with deep networks for saliency prediction in natural video

Proceedings - International Conference on Image Processing, ICIP

Volumn 2016-August, Issue , 2016, Pages 1604-1608

  Chaabouni, Souad ^a   Benois Pineau, Jenny ^a   Ben Amar, Chokri ^b  

^a UNIVERSITÉ DE BORDEAUX   (France)

^b UNIVERSITY OF SFAX   (Tunisia)

Author keywords

Deep learning; Residual motion; Saliency map; Transfer learning; Visual attention

Indexed keywords

BEHAVIORAL RESEARCH; FORECASTING; SAMPLING;

DEEP LEARNING; RESIDUAL MOTION; SALIENCY MAP; TRANSFER LEARNING; VISUAL ATTENTION;

IMAGE PROCESSING;

EID: 85006826726     PISSN: 15224880     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICIP.2016.7532629     Document Type: Conference Paper

References (22)

1. J. Harel, Ch. Koch, and P. Perona, "Graph-based visual saliency, ", in ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 19. 2007, pp. 545-552, MIT Press.
2. I. González-Daz, J. Benois-Pineau, V. Buso, and H. Boujut, "Fusion of Multiple Visual Cues for Object Recognition in Videos, ", pp. 79-107, 2014.
3. Y. Pinto, A. R. van der Leij, I. G. Sligte, V. A. F. Lamme, and H. S. Scholte, "Bottom-up and top-down attention are independent, ", Journal of Vision, vol. 13, no. 3, pp. 16, 2013.
4. J. Shen and L. Itti, "Top-down influences on visual attention during listening are modulated by observer sex, ", Vision Research, vol. 65, pp. 6276, 2012.
5. A. Borji, D. N. Sihite, and L. Itti, "What stands out in a scene A study of human explicit saliency judgment, ", Vision Research, vol. 91, pp. 6277, Aug 2013.
6. E. Vig, M. Dorr, and D. Cox, "Large-Scale Optimization of Hierarchical Features for Saliency Prediction in Natural Images, ", IEEE Computer Vision and Pattern Recognition (CVPR), 2014.
7. K. Simonyan, A. Vedaldi, and A. Zisserman, "Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps, ", CoRR, vol. Abs/1312. 6034, 2013.
8. Ch. Shen and Q. Zhao, "Learning to Predict Eye Fixations for Semantic Contents Using Multi-layer Sparse Network, ", Neurocomputing, vol. 138, pp. 61-68, 2014.
9. S. Chaabouni, J. Benois-Pineau, O. Hadar, and Ch. Ben Amar, "Deep learning for saliency prediction in natural video, ", https: //hal. Archives-ouvertes. fr/hal-01251614, 2016.
10. J. Yosinski, J. Clune, Y. Bengio, and H. Lipson, "How transferable are features in deep neural networks, ", in Advances in Neural Information Processing Systems 27, Z. Ghahramani, M. Welling, C. Cortes, N. d. Lawrence, and K. q. Weinberger, Eds., pp. 3320-3328. Curran Associates, Inc., 2014.
11. M. D. Zeiler and R. Fergus, "Visualizing and Understanding Convolutional Networks, ", CoRR, vol. Abs/1311. 2901, 2013.
12. G. Mesnil, Y. Dauphin, X. Glorot, S. Rifai, Y. Bengio, I. J. Goodfellow, E. Lavoie, X. Muller, G. Desjardins, D. Warde-Farley, P. Vincent, A. Courville, and J. Bergstra, "Unsupervised and Transfer Learning Challenge: A Deep Learning approach, ", in JMLR W& CP: Proceedings of the Unsupervised and Transfer Learning challenge and workshop, 2012, vol. 27, pp. 97-110.
13. D. S. Wooding, "Eye movements of large populations: II. Deriving regions of interest, coverage, and similarity using fixation maps, ", Behavior Research Methods, Instruments, Computers, vol. 34, no. 4, pp. 518-528, Nov. 2002.
14. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell, "Caffe: Convolutional Architecture for Fast Feature Embedding, ", arXiv preprint arXiv: 1408. 5093, 2014.
15. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell, "Caffe: Convolutional Architecture for Fast Feature Embedding, ", arXiv preprint arXiv: 1408. 5093, 2014.
16. M. Marszaek, I. Laptev, and C. Schmid, "Actions in Context, ", in IEEE Conference on Computer Vision & Pattern Recognition, 2009.
17. S. Mathe and C. Sminchisescu, "Actions in the Eye: Dynamic Gaze Datasets and Learnt Saliency Models for Visual Recognition, ", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 37, 2015.
18. L. Itti, "CRCNS Data Sharing: Eye movements during free-viewing of natural videos, ", in Collaborative Research in Computational Neuroscience Annual Meeting, Los Angeles, California, Jun 2008.
19. F. Boulos, W. Chen, B. Parrein, and P. Le Callet, "Region-of-Interest Intra Prediction for H. 264/AVC Error Resilience, ", in IEEE International Conference on Image Processing, Cairo, Egypt, Nov. 2009, pp. 3109-3112.
20. O. Le Meur and T. Baccino, "Methods for comparing scanpaths and saliency maps: strengths and weaknesses, ", Behavior Research Methods, vol. 45, no. 1, pp. 251-266.
21. X. Hou, J. Harel, and Ch. Koch, "Image Signature: Highlighting Sparse Salient Regions., ", IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 1, pp. 194-201, 2012.
22. H. J. Seo and P. Milanfar, "Static and space-time visual saliency detection by self-resemblance, ", Journal of Vision, no. 9 (12): 15, pp. 1-27, 2009.