Predicting visual fixations on video based on low-level visual features

Vision Research

Volumn 47, Issue 19, 2007, Pages 2483-2498

  Le Meur, Olivier ^a   Le Callet, Patrick ^b   Barba, Dominique ^b  

^a FCA UNESP   (Brazil)

^b UNIVERSITÉ DE NANTES   (France)

Author keywords

Bottom up; Eye movements; Salience; Top down; Visual attention

Indexed keywords

ALGORITHM; ARTICLE; EYE FIXATION; EYE MOVEMENT; EYE TRACKING; HUMAN; HUMAN EXPERIMENT; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; NORMAL HUMAN; PRIORITY JOURNAL; QUALITY CONTROL; QUANTITATIVE ANALYSIS; VISION;

ATTENTION; COLOR PERCEPTION; FIXATION, OCULAR; HUMANS; MODELS, PSYCHOLOGICAL; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; PSYCHOPHYSICS; SACCADES; SPACE PERCEPTION; VIDEO RECORDING;

EID: 34548472194     PISSN: 00426989     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.visres.2007.06.015     Document Type: Article

References (39)

1. Canosa, R. L., Pelz, J. B., Mennie, N. R., Peak, J. (2003). High-level aspects of oculomotor control during viewing of natural-task images. In B. E. Rogowitz & T. N. Pappas (Eds.), Human vision and electronic imaging VIII, Proceedings of the SPIE, (Vol. 5007, pp. 240-251).
2. Carmi, R. & Itti, L. (2006). Causal saliency effects during natural vision. In Proceedings of ACM eye tracking research and applications (pp. 11-18).
3. Cover T.M., and Thomas J.A. Elements of information theory (1983), Wiley, New York
4. Deco G., and Schurmann B. A hierarchical neural system with attentional top-down enhancement of the spatial resolution for object recognition. Vision Research 40 20 (2000) 2845-2859
5. Fecteau J.H., and Munoz D.P. Salience, relevance, and firing: A priority map for target selection. Trends in Cognitive Sciences 10 8 (2006) 617-631
6. Fencsik D.E., Urrea J., Place S.S., Wolfe J.M., and Horowitz T.S. Velocity cues improve visual search and multiple object tracking. Visual Cognition 14 (2005) 92-95
7. Findlay J.M. Saccade target selection during visual search. Vision Research 37 (1997) 617-631
8. Hoffman J.E. Visual attention and eye movements. In: Pashler H. (Ed). Attention (1998), Psychology Press, Hove, UK 119-154
9. Hoffman J.E., and Subramanian B. Saccadic eye movement and visual selective attention. Perceptives of Psychophysics 57 (1995) 787-795
10. Itti L. Quantifying the contribution of low-level saliency to human eye movements in dynamic scenes. Visual Cognition 14 4-8 (2005) 959-984
11. Itti L., and Koch C. Feature combination strategies for saliency-based visual attention systems. Journal of Electronic Imaging 10 1 (2001) 161-169
12. Itti L., Koch C., and Niebur E. A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 20 11 (1998) 1254-1259
13. Ivry R., and Cohen A. Asymmetry in visual search for targets defined by differences in movement speed. Journal of Experimental Psychology: Human Perception and Performance 18 (1992) 1045-1057
14. Jost, T., Ouerhani, N., Wartburg, R., Mri, R., & Hgli, H. (2005). Assessing the contribution of color in visual attention. Computer Vision and Image Understanding Journal: Special Issue on Attention and Performance in Computer Vision, 100(1-2) 107-123.
15. Koch C., and Ullman S. Shifts in selection in visual attention: Towards the underlying neural circuitry. Human Neurobiology 4 4 (1985) 219-227
16. Krauskopf J., Williams D.R., and Heeley D.W. Cardinal direction of color space. Vision Research 22 (1982) 1123-1131
17. Le Meur, O., Le Callet, P., Barba, D., & Thoreau, D. (2005). A spatio-temporal model of the selective human visual attention. In: Proceedings of the IEEE International Conference on Image Processing, (pp. 1188-1191). Genoa, Italia.
18. Le Meur O., Le Callet P., Barba D., and Thoreau D. A coherent computational approach to model the bottom-up visual attention. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 28 5 (2006) 802-817
19. Mack, M., Castelhano, M. S., Henderson, J. M., & Oliva, A. (2003). What the Visual System see: The relationship between fixation positions and image properties during a search task in real-wolrd scenes. OPAM Annual Workshop, Vancouver.
20. Maioli C., Benaglio I., Siri S., Sosta K., and Cappa S. The integration of parallel and serial processing mechanisms in visual search: Evidence from eye movement recordings. European Journal of Neuroscience 13 (2001) 364-372
21. Milanese, R. (1993). Detecting salient regions in an image: From biological evidence to computer implementation, Ph.D, University of Geneva, Switzerland.
22. Odobez J.M., and Bouthemy P. Robust multiresolution estimation of parametric motion models. Journal of Visual Communication and Image Representation 6 4 (1995) 348-365
23. Olshausen B.A., Anderson C.H., and van Essen D.C. A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information. Journal of Neuroscience 13 11 (1993) 4700-4719
24. Parkhurst D.J., Law K., and Niebur E. Modeling the role of salience in the allocation of overt visual attention. Vision Research 42 (2002) 107-123
25. Parkhusrt D.J., and Niebur E. Scene content selected by active vision. Spatial Vision 16 (2003) 125-154
26. Rajashekar, U., Cormack, L., & Bovik, A. (2003). Image features that draw fixations. In: Proceedings of the IEEE International Conference on Image Processing, Barcelona, Spain.
27. Reinagel P., and Zador A.M. Natural scene statistics at the centre of gaze. Network: Computational Neural Systems 10 (1999) 1-10
28. Salvucci D.D., and Goldberg J.H. Identifying fixations and saccades in eye-tracking protocols. Proceedings of the Eye Tracking Research and Applications Symposium (2000) 71-78
29. Sen, T., & Megaw, T. (1984). The effects of task variables and prolonged performance on saccadic eye movement parameters. In: A. G. Gale & F. Johnson (Eds.), Theoretical and Applied Aspects of Eye Movement Research, pp. 103-111.
30. Serences J.T., and Yantis S. Selective visual attention and perceptual coherence. Trends in Cognitive Sciences 10 (2006) 38-45
31. Seyler A.J., and Budrikis Z.L. Measurements of temporal adaptation to spatial detail vision. Nature Reviews of Neuroscience 184 (1959) 1215-1217
32. Seyler A.J., and Budrikis Z.L. Details perception after scene changes in television image presentations. IEEE Transactins of Information Theory 11 1 (1965) 31-43
33. Tam W.J. Visual masking at video scene cuts. SPIE Human Vision and Electronic Imaging 2411 (1995) 111-119
34. Tatler B.W., Baddeley R.J., and Gichrist I.D. Visual correlates of eye movements: Effects of scale and time. Vision Research 45 5 (2005) 643-659
35. Treisman A.M., and Gelade G. A feature-integration theory of attention. Cognition Psychology 12 1 (1980) 97-136
36. Tsotsos J.K. Analysing vision at the complexity level. Behavioral and Brain Sciences 13 3 (1990) 423-445
37. Tsotsos J.K., Liu Y., Martinez-Trujillo J.C., Pomplum M., Simine E., and Zhou K. Attending to visual motion. Computer Vision and Image Understanding 100 (2005) 3-40
38. Wandell B. Foundations of vision (1995), Sinauer Associates, Sunderland, Massachusetts
39. Wolfe J.M. Visual Search. In: Pashler H. (Ed). Attention (1998), Psychology Press, East Sussex, UK 13-74