Gaze shift behavior on video as composite information foraging

Signal Processing: Image Communication

Volumn 28, Issue 8, 2013, Pages 949-966

  Boccignone, G ^a   Ferraro, M ^b  

^a UNIVERSITY OF MILAN   (Italy)

^b UNIVERSITY OF TURIN   (Italy)

Author keywords

Active vision; Eye movements; Information encoding; Random walk; Visual attention

Indexed keywords

ACTIVE VISION; COMPUTATIONAL MODEL; INFORMATION ENCODING; INFORMATION FORAGING; RANDOM WALK; STABLE DISTRIBUTIONS; UNIVERSITY OF SOUTH CALIFORNIA; VISUAL ATTENTION;

DIFFERENTIAL EQUATIONS; EYE MOVEMENTS;

COMPUTER SIMULATION;

EID: 84883462996     PISSN: 09235965     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.image.2012.07.002     Document Type: Article

References (78)

1. D. Marr Vision: A Computational Investigation into the Human Representation and Processing of Visual Information 1982 W.H. Freeman New York
2. A. Schütz, D. Braun, K. Gegenfurtner, Eye movements and perception: a selective review, Journal of Vision 11 (5).
3. E. Kowler Eye movements: the past 25 years Vision Research 51 13 2011 1457 1483 50th Anniversary Special Issue of Vision Research - Volume 2
4. A. Borji, L. Itti, State-of-the-art in visual attention modeling, IEEE Transactions on Pattern Analysis and Machine Intelligence, 10.1109/TPAMI.2012. 89, in press.
5. S. Frintrop, E. Rome, and H. Christensen Computational visual attention systems and their cognitive foundations: a survey ACM Transactions on Applied Perception 7 1 2010 6
6. M. Begum, and F. Karray Visual attention for robotic cognition: a survey IEEE Transactions on Autonomous Mental Development 3 1 2011 92 105
7. M. Dorr, T. Martinetz, K. Gegenfurtner, E. Barth, Variability of eye movements when viewing dynamic natural scenes, Journal of Vision 10 (10).
8. B. Tatler, R. Baddeley, and I. Gilchrist Visual correlates of fixation selection: effects of scale and time Vision Research 45 5 2005 643 659
9. B. Tatler, M. Hayhoe, M. Land, D. Ballard, Eye guidance in natural vision: reinterpreting salience, Journal of Vision 11 (5).
10. R. Canosa Real-world vision: selective perception and task ACM Transactions on Applied Perception 6 2 2009 11
11. C. Harris On the optimal control of behaviour: a stochastic perspective Journal of Neuroscience Methods 83 1 1998 73 88
12. H. Martinez, M. Lungarella, R. Pfeifer, Stochastic Extension to the Attention-Selection System for the iCub, University of Zurich, Technical Report.
13. Y. Nagai, From bottom-up visual attention to robot action learning, in: IEEE Eighth International Conference on Development and Learning, IEEE Press, 2009, pp. 1-6.
14. G. Boccignone, M. Ferraro, Modelling eye-movement control via a constrained search approach, in: Proceedings of Third European Workshop on Visual Information Processing (EUVIP 2011), IEEE Press, 2011, pp. 235-240.
15. B. Gnedenko, and A. Kolmogórov Limit Distributions for Sums of Independent Random Variables 1954 Addison-Wesley Publishing Co.
16. D. Brockmann, and T. Geisel The ecology of gaze shifts Neurocomputing 32 1 2000 643 650
17. G. Boccignone, and M. Ferraro Modelling gaze shift as a constrained random walk Physica A: Statistical Mechanics and its Applications 331 1-2 2004 207 218
18. A. Yarbus Eye Movements and Vision 1967 Plenum Press New York
19. G. Buswell How People Look at Pictures: A Study of the Psychology and Perception in Art 1935 University Chicago Press Chicago
20. D. Wolpert, and M. Kawato Multiple paired forward and inverse models for motor control Neural Networks 11 7-8 1998 1317 1329
21. K. Körding, and D. Wolpert Bayesian integration in sensorimotor learning Nature 427 6971 2004 244 247
22. J. Fuster Upper processing stages of the perception - action cycle Trends in Cognitive Sciences 8 4 2004 143 145
23. B. Tatler, and B. Vincent Systematic tendencies in scene viewing Journal of Eye Movement Research 2 2 2008 1 18
24. B. Tatler, and B. Vincent The prominence of behavioural biases in eye guidance Visual Cognition 17 6-7 2009 1029 1054
25. B. Tatler, R. Baddeley, and B. Vincent The long and the short of it: spatial statistics at fixation vary with saccade amplitude and task Vision Research 46 12 2006 1857 1862
26. E. Over, I. Hooge, B. Vlaskamp, and C. Erkelens Coarse-to-fine eye movement strategy in visual search Vision Research 47 2007 2272 2280
27. P. Unema, S. Pannasch, M. Joos, and B. Velichkovsky Time course of information processing during scene perception: the relationship between saccade amplitude and fixation duration Visual Cognition 12 3 2007 473 494
28. A. Faisal, L. Selen, and D. Wolpert Noise in the nervous system Nature Reviews Neuroscience 9 4 2008 292 303
29. P. Bays, and D. Wolpert Computational principles of sensorimotor control that minimize uncertainty and variability The Journal of Physiology 578 2 2007 387 396
30. R. Abrams, D. Meyer, and S. Kornblum Speed and accuracy of saccadic eye movements: characteristics of impulse variability in the oculomotor system Journal of Experimental Psychology: Human Perception and Performance 15 3 1989 529
31. C. Harris, and D. Wolpert The main sequence of saccades optimizes speed-accuracy trade-off Biological Cybernetics 95 1 2006 21 29
32. R. van Beers The sources of variability in saccadic eye movements The Journal of Neuroscience 27 33 2007 8757 8770
33. C. Quaia, W. Joiner, E. FitzGibbon, L. Optican, M. Smith, Eye movement sequence generation in humans: motor or goal updating?, Journal of Vision 10 (14).
34. G. Feng Eye movements as time-series random variables: a stochastic model of eye movement control in reading Cognitive Systems Research 7 1 2006 70 95
35. S. Marat, T. Ho Phuoc, L. Granjon, N. Guyader, D. Pellerin, and A. Guérin-Dugué Modelling spatio-temporal saliency to predict gaze direction for short videos International Journal of Computer Vision 82 3 2009 231 243
36. G. Viswanathan, E. Raposo, and M. da Luz Lévy flights and superdiffusion in the context of biological encounters and random rearches Physics of Life Review 5 3 2008 133 150
37. E. Codling, M. Plank, and S. Benhamou Random walk models in biology Journal of the Royal Society Interface 5 25 2008 813
38. M. Plank, and A. James Optimal foraging: Lévy pattern or process? Journal of the Royal Society Interface 5 26 2008 1077
39. A. Reynolds Optimal random Lévy-loop searching: new insights into the searching behaviours of central-place foragers Europhysics Letters 82 2008 20001
40. A. Bahill, D. Adler, and L. Stark Most naturally occurring human saccades have magnitudes of 15 degrees or less Investigative Ophthalmology & Visual Science 14 6 1975 468 469
41. M. Land, N. Mennie, and J. Rusted The roles of vision and eye movements in the control of activities of daily living Perception 28 1999 1311 1328
42. R. Neal, Probabilistic inference using Markov chain Monte Carlo methods, Department of Computer Science, University of Toronto, 1993. URL 〈 http://www.cs.utoronto.ca/radford/ âŒ
43. K. Holmqvist, M. Nyström, R. Andersson, R. Dewhurst, H. Jarodzka, and J. Van de Weijer Eye Tracking: A Comprehensive Guide to Methods and Measures 2011 Oxford University Press Oxford, UK
44. M. Da Luz, S. Buldyrev, S. Havlin, E. Raposo, H. Stanley, and G. Viswanathan Improvements in the statistical approach to random Lévy flight searches Physica A: Statistical Mechanics and its Applications 295 1-2 2001 89 92
45. L. Itti, C. Koch, and E. Niebur A model of saliency-based visual attention for rapid scene analysis IEEE Transactions on Pattern Analysis and Machine Intelligence 20 1998 1254 1259
46. L. Itti, and P. Baldi Bayesian surprise attracts human attention Vision Research 49 10 2009 1295 1306
47. H. Seo, and P. Milanfar Static and space-time visual saliency detection by self-resemblance Journal of Vision 9 12 2009 1 27
48. J. Harel, C. Koch, P. Perona, Graph-based visual saliency, in: Advances in Neural Information Processing Systems, vol. 19, MIT Press, Cambridge, MA, 2007, pp. 545-552.
49. J. Nolan Numerical calculation of stable densities and distribution functions Communications in Statistics-Stochastic Models 13 4 1997 759 774
50. I. Koutrouvelis Regression-type estimation of the parameters of stable laws Journal of the American Statistical Association 1980 918 928
51. J. McCulloch Simple consistent estimators of stable distribution parameters Communications in Statistics: Simulation and Computation 15 4 1986 1109 1136
52. J. Chambers, C. Mallows, and B. Stuck A method for simulating stable random variables Journal of the American Statistical Association 71 354 1976 340 344
53. L. Itti Automatic foveation for video compression using a neurobiological model of visual attention IEEE Transactions on Image Processing 13 10 2004 1304 1318
54. G. Boccignone, A. Marcelli, P. Napoletano, G. Di Fiore, G. Iacovoni, and S. Morsa Bayesian integration of face and low-level cues for foveated video coding IEEE Transactions on Circuits and Systems for Video Technology 18 12 2008 1727 1740
55. O. Le Meur, A. Ninassi, P. Le Callet, and D. Barba Overt visual attention for free-viewing and quality assessment tasks: impact of the regions of interest on a video quality metric Signal Processing: Image Communication 25 7 2010 547 558
56. A. Reynolds Lévy flight patterns are predicted to be an emergent property of a bumblebees foraging strategy Behavioral Ecology and Sociobiology 64 1 2009 19 23
57. I. Rhee, M. Shin, S. Hong, K. Lee, S. Kim, and S. Chong On the levy-walk nature of human mobility IEEE/ACM Transactions on Networking 19 3 2011 630 643
58. R. Metzler, and J. Klafter The restaurant at the end of the random walk: recent developments in the description of anomalous transport by fractional dynamics Journal of Physics A: Mathematical and General 37 2004 R161
59. T. Anderson On the distribution of the two-sample Cramer-von Mises criterion The Annals of Mathematical Statistics 1962 1148 1159
60. Y. Nagai, Stability and sensitivity of bottom-up visual attention for dynamic scene analysis, in: Proceedings of the 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, IEEE Press, 2009, pp. 5198-5203.
61. J. Lee, F. De Simone, and T. Ebrahimi Efficient video coding based on audio-visual focus of attention Journal of Visual Communication and Image Representation 22 8 2011 704 711
62. Z. Wang, L. Lu, and A.C. Bovik Foveation scalable video coding with automatic fixation selection IEEE Transactions on Image Processing 12 2003 1 12
63. C. Cotsaces, N. Nikolaidis, and I. Pitas Video shot detection and condensed representation. A review IEEE Signal Processing Magazine 23 2 2006 28 37
64. J. You, U. Reiter, M. Hannuksela, M. Gabbouj, and A. Perkis Perceptual-based quality assessment for audio-visual services: a survey Signal Processing: Image Communication 25 7 2010 482 501
65. A. Kimura, D. Pang, T. Takeuchi, J. Yamato, K. Kashino, Dynamic Markov random fields for stochastic modeling of visual attention, in: Proceedings of the 19th International Conference on Pattern Recognition, 2008, ICPR 2008, IEEE, 2008, pp. 1-5.
66. K. Miyazato, A. Kimura, S. Takagi, J. Yamato, Real-time estimation of human visual attention with dynamic Bayesian network and mcmc-based particle filter, in: Proceedings of the IEEE International Conference on Multimedia and Expo, 2009, ICME 2009, IEEE, 2009, pp. 250-257.
67. T. Ho Phuoc, A. Guérin-Dugué, N. Guyader, A computational saliency model integrating saccade programming, in: Proceedings of the International Conference on Bio-inspired Systems and Signal Processing, Porto, Portugal, 2009, pp. 57-64.
68. T. Keech, and L. Resca Eye movements in active visual search: A computable phenomenological model Attention, Perception, & Psychophysics 72 2 2010 285 307
69. U. Rutishauser, C. Koch, Probabilistic modeling of eye movement data during conjunction search via feature-based attention, Journal of Vision 7 (6).
70. S. Chikkerur, T. Serre, C. Tan, and T. Poggio What and where: a Bayesian inference theory of attention Vision Research 50 22 2010 2233 2247
71. M. Begum, F. Karray, G. Mann, and R. Gosine A probabilistic model of overt visual attention for cognitive robots IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 40 5 2010 1305 1318
72. A. Torralba Contextual priming for object detection International Journal of Computer Vision 53 2003 153 167
73. O. Braddick, and J. Atkinson Development of human visual function Vision Research 51 13 2011 1588 1609
74. J. Vandekerckhove, F. Tuerlinckx, and M. Lee Hierarchical diffusion models for two-choice response times Psychological Methods 16 1 2011 44
75. J. Najemnik, and W. Geisler Optimal eye movement strategies in visual search Nature 434 7031 2005 387 391
76. M. Wischnewski, A. Belardinelli, W. Schneider, and J. Steil Where to look next? Combining static and dynamic proto-objects in a TVA-based model of visual attention Cognitive Computation 2 4 2010 326 343
77. A. Torralba, and A. Oliva Statistics of natural image categories Network: Computation in Neural Systems 14 3 2003 391 412
78. A. Torralba, A. Oliva, M. Castelhano, and J. Henderson Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search Psychological Review 113 4 2006 766