Stochastic bottom-up fixation prediction and saccade generation

Image and Vision Computing

Volumn 31, Issue 9, 2013, Pages 686-693

  Rezazadegan Tavakoli, Hamed ^a   Rahtu, Esa ^a   Heikkilä, Janne ^a  

^a UNIVERSITY OF OULU   (Finland)

Author keywords

Fixation prediction; Saccadic eye movement; Saliency; Scanpaths

Indexed keywords

ESTIMATION; FORECASTING; STOCHASTIC MODELS; STOCHASTIC SYSTEMS;

INHIBITION OF RETURNS; MOVEMENT MECHANISM; NOVEL TECHNIQUES; SACCADIC EYE MOVEMENTS; SALIENCY; SCANPATHS; STOCHASTIC FILTERING; SYSTEM MODELS;

EYE MOVEMENTS;

EID: 84880913172     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2013.06.006     Document Type: Article

References (61)

1. S. Martinez-Conde, S.L. Macknik, and D.H. Hubel The role of fixational eye movements in visual perception Nat. Rev. Neurosci. 5 2004 229 240 (Pubitemid 38252479)
2. M.F. Land, S.M. Furneaux, and I.D. Gilchrist The organization of visually mediated actions in a subject without eye movements Neurocase 8 2002 80 87 (Pubitemid 34552342)
3. J. Otero-Millan, X.G. Troncoso, S.L. Macknik, I. Serrano-Pedraza, and S. Martinez-Conde Saccades and microsaccades during visual fixation, exploration, and search: Foundations for a common saccadic generator J. Vis. 8 14 2008
4. B.W. Tatler, and B.T. Vincent The prominence of behavioural biases in eye guidance Vis. Cogn. 17 6-7 2009 1029 1054
5. K C., and U S. Shifts in selective visual attention: towards the underlying neural circuitry Hum. Neurobiol. 4 1985 219 227
6. D. Brockmann, and T. Geisel Are human scanpaths levy flights? Artificial Neural Networks, 1999. ICANN 99. Ninth International Conference on (Conf. Publ. No. 470) vol. 1 1999
7. J. Najemnik, and W.S. Geisler Optimal eye movement strategies in visual search Nature 434 7031 2005 387 391 (Pubitemid 40469182)
8. L.W. Renninger, P. Verghese, and J. Coughlan Where to look next? eye movements reduce local uncertainty J. Vis. 7 3 2007
9. L. Itti, C. Koch, and E. Niebur A model of saliency-based visual attention for rapid scene analysis IEEE Trans. Pattern Anal. Mach. Intell. 20 11 1998 1254 1259 (Pubitemid 128742001)
10. G. Boccignone, and M. Ferraro Modelling gaze shift as a constrained random walk Physica A 331 2004 207 218
11. X. Hou, and L. Zhang Dynamic visual attention: searching for coding length increments NIPS 2008 681 688
12. W. Wang, C. Chen, Y. Wang, T. Jiang, F. Fang, and Y. Yao Simulating human saccadic scanpaths on natural images IEEE Computer Vision and Pattern Recognition (CVPR) 2011
13. W. Wang, Y. Wang, Q. Huang, and W. Gao Measuring visual saliency by site entropy rate CVPR'10 2010 2368 2375
14. C. Bundesen A theory of visual attention Psychol. Rev. 97 4 1990 523 547
15. R. Achanta, F. Estrada, P. Wils, and S. Süsstrunk Salient region detection and segmentation International Conference on Computer Vision Systems (ICVS'08) Springer Lecture Notes in Computer Science vol. 5008 2008 Springer Berlin/Heidelberg 66 75 (Pubitemid 351775955)
16. D. Gao, V. Mahadevan, and N. Vasconcelos Vasconcelos, On the plausibility of the discriminant center-surround hypothesis for visual saliency J. Vis. 8 7 2008
17. H.J. Seo, and P. Milanfar Nonparametric bottom-up saliency detection by self-resemblance Computer Vision and Pattern Recognition Workshops, 2009. CVPR Workshops 2009 IEEE Computer Society Conference on 2009 45 52
18. E. Rahtu, J. Kannala, M. Salo, and J. Heikkilä Segmenting salient objects from images and videos Proc. 11th European Conference on Computer Vision (ECCV 2010), Crete, Greece 2010
19. V. Mahadevan, and N. Vasconcelos Spatiotemporal saliency in dynamic scenes IEEE Trans. Pattern Anal. Mach. Intell. 32 1 2010 171 177
20. X. Hou, and L. Zhang Saliency detection: a spectral residual approach Computer Vision and Pattern Recognition, 2007. CVPR'07 IEEE Conference on 2007 1 8
21. C. Guo, Q. Ma, and L. Zhang Spatio-temporal saliency detection using phase spectrum of quaternion fourier transform Computer Vision and Pattern Recognition, 2008. CVPR 2008 IEEE Conference on 2008 1 8
22. R. Achanta, S. Hemami, F. Estrada, and S. Süsstrunk Frequency-tuned salient region detection IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) 2009
23. S. Goferman, L. Zelnik-Manor, and A. Tal Context-aware saliency detection Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference 2010 2376 2383
24. M.-M. Cheng, G.-X. Zhang, N.J. Mitra, X. Huang, and S.-M. Hu Global contrast based salient region detection CVPR 2011 409 416
25. J. Harel, C. Koch, and P. Perona Graph-based visual saliency Advances in Neural Information Processing Systems 19 2007 MIT Press 545 552
26. V. Gopalakrishnan, Y. Hu, and D. Rajan Random walks on graphs for salient object detection in images, image processing IEEE Trans. 19 12 2010 3232 3242
27. A. Borji, and L. Itti State-of-the art in visual attention modeling IEEE Trans. Pattern Anal. Mach. Intell. 35 1 2013 185 207
28. A. Borji, D.N. Sihite, and L. Itti Quantitative analysis of human-model agreement in visual saliency modeling: A comparative study IEEE Trans. Image Process. 22 1 2013 55 69
29. L. Zhang, M.H. Tong, T.K. Marks, H. Shan, and G.W. Cottrell Sun: A bayesian framework for saliency using natural statistics J. Vis. 8 7 2008
30. Y. Yang, M. Song, N. Li, J. Bu, and C. Chen What is the chance of happening: a new way to predict where people look K. Daniilidis, P. Maragos, N. Paragios, Computer Vision - ECCV 2010, Vol. 6315 of Lecture Notes in Computer Science 2010 Springer Berlin/Heidelberg 631 643
31. H. Rezazadegan Tavakoli, E. Rahtu, and J. Heikkilä Fast and efficient saliency detection using sparse sampling and kernel density estimation A. Heyden, F. Kahl, Image Analysis, Vol. 6688 of Lecture Notes in Computer Science 2011 Springer Berlin/Heidelberg 666 675
32. T.S. Wolfe, and Jeremy M. Horowitz What attributes guide the deployment of visual attention and how do they do it? Nat. Rev. Neurosci. 5 6 2004 495 501
33. I.T. Hooge, E.A. Over, R.J. van Wezel, and M.A. Frens Inhibition of return is not a foraging facilitator in saccadic search and free viewing Vis. Res. 45 14 2005 1901 1908 (Pubitemid 40432079)
34. P. Unema, S. Pannasch, M. Joos, and B. Velichkovsky Time course of information processing during scene perception: the relationship between saccade amplitude and fixation duration Vis. Cogn. 12 3 2005 473 494 (Pubitemid 40514704)
35. Z. Chen Bayesian filtering: from Kalman filters to particle filters, and beyond Tech. rep 2003 Adaptive Systems Lab, McMaster University Hamilton, ON, Canada
36. M. Arulampalam, S. Maskell, N. Gordon, and T. Clapp A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking, signal processing IEEE Trans. 50 2 2002 174 188 (Pubitemid 34291500)
37. O. Le Meur, P. Le Callet, D. Barba, and D. Thoreau A coherent computational approach to model bottom-up visual attention IEEE Trans. Pattern Anal. Mach. Intell. 28 5 2006 802 817
38. S. Ramanathan, H. Katti, N. Sebe, M. Kankanhalli, and T.-S. Chua An eye fixation database for saliency detection in images Proceedings of the 11th European Conference on Computer Vision: Part IV ECCV'10 2010 Springer-Verlag Berlin, Heidelberg 30 43
39. V. Yanulevskaya, J. Uijlings, E. Bruni, A. Sartori, E. Zamboni, F. Bacci, D. Melcher, and N. Sebe In the eye of the beholder: employing statistical analysis and eye tracking for analyzing abstract paintings Proceedings of the 20th ACM international conference on Multimedia, MM'12 2012 ACM New York, NY, USA 349 358
40. J.K. Tsotsos, and N.D.B. Bruce Saliency based on information maximization Y. Weiss, B. Schölkopf, J. Platt, Advances in Neural Information Processing Systems 18 2006 MIT Press, MIT Press 155 162
41. T. Judd, K. Ehinger, F. Durand, and A. Torralba Learning to predict where humans look IEEE International Conference on Computer Vision (ICCV) 2009
42. H. Jarodzka, K. Holmqvist, and M. Nyström A vector-based, multidimensional scanpath similarity measure Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications, ETRA'10 2010 ACM New York, NY, USA 211 218
43. O. Le Meur, and T. Baccino Methods for comparing scanpaths and saliency maps: strengths and weaknesses Behav. Res. Methods 45 1 2013 251 266
44. B.W. Tatler, R.J. Baddeley, and I.D. Gilchrist Visual correlates of fixation selection: effects of scale and time Vis. Res. 45 5 2005 643 659 (Pubitemid 40037974)
45. C.M. Privitera, and L.W. Stark Algorithms for defining visual regions-of-interest: comparison with eye fixations IEEE Trans. Pattern Anal. Mach. Intell. 22 9 2000 970 982
46. A. Torralba, Modeling global scene factors in attention, J. Opt. Soc. Am. 20 (7) (2003).
47. L. Itti, and P. Baldi Bayesian surprise attracts human attention Advances in Neural Information Processing Systems (NIPS*2005) vol. 19 2005 547 554
48. D. Walther, and C. Koch Modeling attention to salient proto-objects Neural Networks 19 2006 1395 1407 (Pubitemid 44708603)
49. S. Frintrop VOCUS: A Visual Attention System for Object Detection and Goal-directed Search 2006 (Ph.D. thesis)
50. B. Tatler The central fixation bias in scene viewing: selecting an optimal viewing position independently of motor bases and image feature distributions Vis. Res. 14 7 2007
51. M. Mancas Computational Attention: Modelisation and Application to Audio and Image Processing 2007 (Ph.D. thesis)
52. A.N.G. Kootstra, and B. de Boer Paying attention to symmetry BMVC 2008
53. H.J. Seo, and P. Milanfar Static and space-time visual saliency detection by self-resemblance J. Vis. 9 12 2009 15.1 27
54. P. Bian, and L. Zhang Biological plausibility of spectral domain approach for spatiotemporal visual saliency M. Köppen, N. Kasabov, G. Coghill, Advances in Neuro-Information Processing, Vol. 5506 of Lecture Notes in Computer Science 2009 Springer Berlin Heidelberg 251 258
55. S. Marat, T. Ho Phuoc, L. Granjon, N. Guyader, D. Pellerin, and A. Guérin-Dugué Modelling spatio-temporal saliency to predict gaze direction for short videos Int. J. Comput. Vis. 82 3 2009 231 243
56. A. Garcia-Diaz, X. Fdez-Vidal, X. Pardo, and R. Dosil Decorrelation and distinctiveness provide with human-like saliency J. Blanc-Talon, W. Philips, D. Popescu, P. Scheunders, Advanced Concepts for Intelligent Vision Systems, Vol. 5807 of Lecture Notes in Computer Science 2009 Springer Berlin/Heidelberg 343 354
57. J. Li, Y. Tian, T. Huang, and W. Gao Probabilistic multi-task learning for visual saliency estimation in video Int. J. Comput. Vis. 90 2010 150 165
58. C. Guo, and L. Zhang A novel multiresolution spatiotemporal saliency detection model and its applications in image and video compression Trans. Image Process 19 1 2010 185 198
59. T. Avraham, and M. Lindenbaum Esaliency (extended saliency): meaningful attention using stochastic image modeling IEEE Trans. Pattern Anal. Mach. Intell. 32 4 2010 693 708
60. J. Yan, M. Zhu, H. Liu, and Y. Liu Visual saliency detection via sparsity pursuit, signal processing letters IEEE 17 8 2010 739 742
61. Y. Li, Y. Zhou, J. Yan, Z. Niu, and J. Yang Visual saliency based on conditional entropy H. Zha, R.-i. Taniguchi, S. Maybank, Computer Vision - ACCV 2009, Vol. 5994 of Lecture Notes in Computer Science 2010 Springer Berlin/Heidelberg 246 257