Analysis of scores, datasets, and models in visual saliency prediction

Proceedings of the IEEE International Conference on Computer Vision

Volumn , Issue , 2013, Pages 921-928

  Borji, Ali ^a   Tavakoli, Hamed R ^b   Sihite, Dicky N ^b   Itti, Laurent ^b  

^a University of Southern California   (United States)

^b UNIVERSITY OF OULU   (Finland)

Author keywords

eye movements; model benchmarking; saliency; visual attention

Indexed keywords

FORECASTING;

AFFECT MODELING; FUTURE RESEARCH DIRECTIONS; MODEL BENCHMARKING; PREDICTION ACCURACY; RECENT PROGRESS; SALIENCY; SALIENCY MODELING; VISUAL ATTENTION;

EYE MOVEMENTS;

EID: 84897056830     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCV.2013.118     Document Type: Conference Paper

References (63)

1. A. Borji and L. Itti. State-of-the-art in Visual Attention Modeling. PAMI, 2013.
2. T. Judd, K. Ehinger, F. Durand and, A. Torralba. Learning to predict where humans look. ICCV, 2009.
3. L. Itti, C. Koch, and E. Niebur. A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. PAMI, 20(11):1254-1259, 1998.
4. R. Subramanian, H. Katti, N. Sebe, M. Kankanhalli, and T.S. Chua. An eye fixation database for saliency detection in images. ECCV, 2010.
5. C. Koch and S. Ullman. Shifts in selective visual attention: Towards the underlying neural circuitry. Human Neurobiology, 1985.
6. S. Frintrop. VOCUS: A visual attention system for object detection and goaldirected search. PhD Thesis. Springer 2006.
7. J. Harel, C. Koch, and P. Perona. Graph-based visual saliency. NIPS, 2006.
8. G. Kootstra, A. Nederveen, and B. de Boer. Paying attention to symmetry. British Machine Vision Conference, 2008.
9. L. Itti and P. Baldi. Bayesian surprise attracts human attention. NIPS, 2005.
10. N.D.B. Bruce and J.K. Tsotsos. Saliency based on information maximization. Advances in Neural Information Processing Systems (NIPS), 2005.
11. X. Hou and L. Zhang. Saliency detection: A spectral residual approach. Computer Vision and Pattern Recognition (CVPR), 2007.
12. X. Hou and L. Zhang. Dynamic visual attention: Searching for coding length increments. NIPS, 2008.
13. M. Mancas. Computational attention: Modelisation and application to audio and image processing. PhD. thesis, 2007.
14. T. Avraham, M. Lindenbaum. Esaliency (Extended Saliency): Meaningful attention using stochastic image modeling. PAMI, 2010.
15. C. Guo and L. Zhang. A novel multiresolution spatiotemporal saliency detection model and Its applications in image and video compression. IEEE Trans. on Image Processing, 2010.
16. P. Bian and L. Zhang. Biological plausibility of spectral domain approach for spatiotemporal visual saliency. LNCS, 2009.
17. A. Garcia-Diaz, X. R. Fdez-Vidal, X. M. Pardo, and R. Dosil. Decorrelation and distinctiveness provide with human-like saliency. ACIVS, 5807, 2009.
18. Y. Li, Y. Zhou, J. Yan, and J. Yang. Visual saliency based on conditional entropy. ACCV, 2009.
19. J. Yan, J. Liu, Y. Li, and Y. Liu. Visual saliency via sparsity rank decomposition. ICIP, 2010.
20. A. Torralba. Modeling global scene factors in attention. Journal of Optical Society of America, 20(7), 2003.
21. O. Le Meur, P. Le Callet, and D. Barba. Predicting visual fixations on video based on low-level visual features. Vision Research, 47(19), 2007.
22. H.J. Seo and P. Milanfar. Static and space-time visual saliency detection by self-resemblance. Journal of Vision, 9:1-27, 2009.
23. S. Marat, T. Ho-Phuoc, L. Granjon, N. Guyader, D. Pellerin, and A. Gúerin-Dugúe. Modeling saliency to predict gaze direction for short videos. IJCV, 2009.
24. D. Walther and C. Koch. Modeling attention to salient proto-objects. Neural Networks, 19(9):1395-1407, 2006.
25. L. Zhang, M. H. Tong, T. K. Marks, H. Shan, and G. W. Cottrell, SUN: A Bayesian framework for saliency using natural statistics. JOV, 2008.
26. J. Li, Y. Tian, T. Huang, and W. Gao. Probabilistic multi-task learning for visual saliency estimation in video. IJCV, 90(2):150-165, 2010.
27. A.M. Treisman and G. Gelade. A feature integration theory of attention. Cognitive Psych., 12:97-136, 1980.
28. B.W. Tatler. The central fixation bias in scene viewing: selecting an optimal viewing position independently of motor bases and image feature distributions. J. Vision, 14(7): 2007.
29. O. Le Meur and T. Baccino. Methods for comparing scanpaths and saliency maps: strengths and weaknesses. Behavioral Research, 2012.
30. A. Borji, D. N. Sihite, and L. Itti. Quantitative Analysis of Human-Model Agreement in Visual Saliency Modeling: A Comparative Study. IEEE Transactions on Image Processing, 2012.
31. D. Noton and L. Stark. Scanpaths in Saccadic Eye Movements While Viewing and Recognizing Patterns. Vision Research, 11, 929-942, 1971
32. C.M. Privitera and L. Stark. Algorithms for defining visual regions-of-interest: comparison with eye fixations. PAMI, 2000.
33. L. Itti, L. and C. Koch. A saliency-based search mechanism for overt and covert shifts of visual attention. Vision research, 40, 2000.
34. H.R. Tavakoli, E. Rahtu, and J. Heikkil̈a. Fast and efficient saliency detection using sparse sampling and kernel density estimation. SCIA, 2011.
35. M. Cerf, J. Harel, W. Einḧauser, and C. Koch. Predicting human gaze using low-level saliency combined with face detection. NIPS, 2007.
36. Q. Zhao and C. Koch. Learning a saliency map using fixated locations in natural scenes. Journal of Vision, 11(3), 2011.
37. D. Gao, S. Han, and N. Vasconcelos. Discriminant saliency, the detection of suspicious coincidences and applications to visual recognition. PAMI, 2009.
38. A. Borji and L. Itti. Exploiting Local and Global Patch Rarities for Saliency Detection. CVPR, 2012.
39. A. Borji, Boosting Bottom-up and Top-down Visual Features for Saliency Estimation, CVPR, 2012.
40. J. B. Huang and N. Ahuja, Saliency Detection via Divergence Analysis: A Unified Perspective, ICPR, 2012.
41. T. Judd, F. Durand, and A. Torralba. A Benchmark of Computational Models of Saliency to Predict Human Fixations. MIT technical report, 2012.
42. T. Ho-Phuoc, L. Alacoque, A. Dupret, A. Guerin-Dugue, and A. Verdant. A unified method for comparison of algorithms of saliency extraction, SPIE, 2012.
43. X. Hou, J. Harel, and C. Koch. Image Signature: Highlighting Sparse Salient Regions. PAMI, 2012.
44. L. Elazary and L. Itti, Interesting objects are visually salient, J. Vision, 2008.
45. K. Humphrey, G. Underwood, and T. Lambert. Salience of the lambs: A test of the saliency map hypothesis with pictures of emotive objects, J. of vision, 2012.
46. P. Lang, , M. Bradley, and B. Cuthbert. (iaps): Affective ratings of pictures and instruction manual. Technical report, University of Florida, 2008.
47. N. Murray, M. Vanrell, X. Otazu, and C. A. Parraga. Saliency Estimation Using a Non-Parametric Low-Level Vision Model. CVPR, 2011.
48. M. Spain and P. Perona. Measuring and predicting object importance. International Journal of Computer Vision, 2010.
49. A. Khosla, J. Xiao, A. Torralba, and A. Oliva. Memorability of Image Regions. NIPS, 2012.
50. W. Einḧauser, M. Spain, and P. Perona. Objects Predict Fixations Better Than Early Saliency. Journal of Vision, 2008.
51. R.J. Peters, A. Iyer, L. Itti, C. Koch. Components of bottom-up gaze allocation in natural images. Vision Research, 2005.
52. M.S. Gide and L.J. Karam. Comparative evaluation of visual saliency models for quality assessment task, 6th Int. Workshop on Video Processing, 2012.
53. S.B. Needleman, C.D. Wunsch. A general method applicable to the search for similarities in the amino acid sequence of two proteins. Molecular Biology, 1970.
54. A. Borji, D. N. Sihite, and L. Itti. Probabilistic Learning of Task-Specific Visual Attention, CVPR, 2012.
55. S. Winkler and R. Subramanian, Overview of Eye tracking Datasets, Quality of Multimedia Experience (QoMEX, 2013.
56. U. Engelke, H. Liu, J. Wang, P. Le Callet, I. Heynderickx, H.J Zepernick, and A. Maeder, A Comparative Study of Fixation Density Maps, IEEE T. IP, 2013.
57. M.R. Greene, T. Liu, J.M. Wolfe, Reconsidering Yarbus: A failure to predict observers' task from eye movement patterns, Vision Research, 2012.
58. J.B Huang and N. Ahuja, Saliency Detection via Divergence Analysis: A Unified Perspective, International Conference on Pattern Recognition, 2012.
59. B. Schauerte and R. Stiefelhagen, Quaternion-based spectral saliency detection for eye fixation prediction, ECCV, 2012.
60. E. Erdem and A. Erdem, Visual saliency estimation by nonlinearly integrating features using region covariances, Journal of Vision, 13:4, 1-20, 2013.
61. A. Nuthmann and J. M. Henderson, Object-based attentional selection in scene viewing. Journal of Vision, 10(8):20, 1-19, 2010.
62. A. Borji, D. N. Sihite, and L. Itti. Objects do not predict fixations better than early saliency: A re-analysis of Einḧauser et al.'s data, Journal of Vision, 2013.
63. A., Yarbus, Eye movements and vision.. New York: Plenum, 1967.