Gaze allocation in natural stimuli: Comparing free exploration to head-fixed viewing conditions

Visual Cognition

Volumn 17, Issue 6-7, 2009, Pages 1132-1158

  Hart, Bernard Marius't ^a   Vockeroth, Johannes ^b   Schumann, Frank ^c   Bartl, Klaus ^b   Schneider, Erich ^b   König, Peter ^c   Einhäuser, Wolfgang ^a  

^a PHILIPPS UNIVERSITY MARBURG   (Germany)

^b LUDWIG MAXIMILIANS UNIVERSITY   (Germany)

^c UNIVERSITY OF OSNABRÜCK   (Germany)

Author keywords

Attention; Eye movements; Human; Natural stimuli; Real world

Indexed keywords

ACCURACY; ARTICLE; CALCULATION; CONTROLLED STUDY; EYE MOVEMENT; EYE POSITION; EYE TRACKING; GAZE; HUMAN; HUMAN EXPERIMENT; PRIORITY JOURNAL; RECEIVER OPERATING CHARACTERISTIC; STIMULUS RESPONSE; VISUAL FIELD; VISUAL STIMULATION; VISUAL SYSTEM FUNCTION;

EID: 66149148782     PISSN: 13506285     EISSN: 14640716     Source Type: Journal    
DOI: 10.1080/13506280902812304     Document Type: Article

References (60)

1. Baddeley, R. J., & Tatler, B. W. (2006). High frequency edges (but not contrast) predict where we fixate: A Bayesian system identification analysis. Vision Research, 46, 2824-2833.
2. Brainard, D. H. (1997). The Psychophysics Toolbox. Spatial Vision, 10, 433-436.
3. Brandt, T., Glasauer, S., & Schneider, E. (2006). A third eye for the surgeon. Journal of Neurology, Neurosurgery. and Psychiatry, 77, 278.
4. Buswell, G. T. (1935). How people look at pictures: A study of the psychology of perception in art. Chicago: University of Chicago Press.
5. Carmi, R., & Itti, L. (2006). Visual causes versus correlates of attentional selection in dynamic scenes. Vision Research, 46(26), 4333-4345.
6. Cerf, M., Harel, J., Einhäuser, W., & Koch, C. (2008). Predicting human gaze using low-level saliency combined with face detection. Advances in Neural Information Processing, 20, 241-248.
7. Chajka, K., Hayhoe, M., Sullivan, B., Pelz, J., Mennie, N., & Droll, J. (2006). Predictive eye movements in squash [Abstract]. Journal of Vision, 6(6), 481, 481a.
8. Crouzet, S., Kirchner, H., & Thorpe, S.J. (2008). Saccading towards faces in 100 ms. What's the secret? Perception, 37(ECVP Abstr. Suppl.), 119.
9. Cornelissen, F. W., Peters, E. M., & Palmer, J. (2002). The Eyelink Toolbox: Eye tracking with MATLAB and the Psychophysics Toolbox. Behavior Research Methods, Instruments and Computers, 34, 613-617.
10. Einhäuser, W., Hipp, J., Eggert, J., Körner, E., & König, P. (2005). Learning viewpoint invariant object representations using a temporal coherence. principle. Biological Cybernetics, 93, 79-90.
11. Einhäuser, W., & König, P. (2003). Does luminance-contrast contribute to a saliency map for overt visual attention? European Journal of Neuroscience, 17, 1089-1097.
12. Einhäuser, W., Moeller, G. U., Schumann, F., Conradt, J., Vockeroth, J., Bartl, K., et al. (2009). Eye-head coordination during free exploration in human and cat. Annals of the New York Academy of Sciences, 1164, 353-366.
13. Einhäuser, W., Rutishauser, U., & Koch, C. (2008). Task-demands can immediately reverse the effects of sensory-driven saliency in complex visual stimuli. Journal of Vision, 8(2), 1-19.
14. Einhäuser, W., Schumann, F., Bardins, S., Bartl, K., Böning, G., Schneider, E., & König, P. (2007). Human eye-head co-ordination in natural exploration. Network: Computation in Neural Systems, 18(3), 267-297.
15. Einhäuser, W., Schumann, F., Vockeroth, J., Bartl, K., Cerf, M., Harel, J., et al. (2009). Distinct roles for eye and head movements in selecting salient image parts during natural exploration. Annals of the New York Academy of Sciences, 1164, 188-193.
16. Einhäuser, W., Spain, M., & Perona, P. (2008). Objects predict fixations better than early saliency. Journal of Vision, 8(14), 1-26.
17. Elazary, L., & Itti, L. (2008). Interesting objects are visually salient. Journal of Vision, 8(3), 1-15.
18. Fairchild, M. D., Johnson, G. M., Babcock, J., & Pelz, J. B. (2001). Is your eye on the ball? Eye tracking golfers while putting. Retrieved from http://www.cis.rit.edu/people/faculty/fairchild/
19. Fuller, H. J. (1992). Head movement propensity. Experimental Brain Research, 92, 152-164.
20. Hayhoe, M., Ballard, D., Triesch, J., Shinoda, H., Alvar, P., & Sullivan, B. (2002). Vision in natural and virtual environments. Proceedings of the Symposium on Eye Tracking Research and Applications, 7-13.
21. Hayhoe, M., Mannie, N., Sullivan, B., & Gorgos, K. (2005). The role of internal models and prediction in catching balls. Proceedings of AAAI, Fall 2005.
22. Henderson, J. M., Brockmole, J. R., Castelhano, M. S., & Mack, M. (2007). Visual saliency does not account for eye-movements during visual search in real-world scenes. In R. van Gompel, M. Fischer,W. Murray, & R. Hill (Eds.), Eye movement research: Insights into mind and brain. (pp. 537-562) Oxford: Elsevier.
23. Itti, L. (2005). Quantifying the contribution of low-level saliency to human eye movements in dynamic scenes. Visual Cognition, 12(6), 1093-1123.
24. Itti, L., & Baldi, P. (2006). Bayesian surprise attracts human attention. Advances in Neural Information Processing Systems, 19, 1-8.
25. Itti, L., & Koch, C. (2000). A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research, 40(10-12), 1489-1506.
26. Itti, L., Koch, C., & Niebur, E. (1998). A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(11), 1254-1259.
27. Jovancevic, J., Sullivan, B., & Hayhoe, M. (2006). Control of attention and gaze in complex environments. Journal of Vision, 6, 1431-1450.
28. Kayser, C., Nielsen, K. K., & Logothetis, N. K. (2006). Fixations in natural scenes: Interaction of image structure and image content. Vision Research, 46(16), 2535-2545.
29. Kirchner, H., & Thorpe, S. J. (2006). Ultra-rapid object detection with saccadic eye movements: Visual processing speed revisited. Vision Research, 46(11), 1762-1776.
30. Koch, C., & Ullman, S. (1985). Shifts in selective visual attention: Towards the underlying neural circuitry. Human Neurobiology, 4, 219-227.
31. Krieger, G., Rentschler, I., Hauske, G., Schill, K., & Zetzsche, C. (2000). Object and scene analysis by saccadic eye-movements: An investigation with higher-order statistics. Spatial Vision, 13, 201-214.
32. Land, M. F., & Hayhoe, M. (2001). In what ways do eye movements contribute to everyday activities? Vision Research, 41, 3559-3565.
33. Land, M. F., & Lee, D. N. (1994). Where we look when we steer. Nature, 369, 742-744.
34. Land., M. F., & McLeod, P. (2000). From eye movements to actions: How batsmen hit the ball. Nature Neuroscience, 3, 1340-1345.
35. Land, M. F., Mennie, N., & Rusted, J. (1999). The roles of vision and eye movements in the control of activities of daily living. Perception, 28, 1311-1328.
36. Land, M. F., & Tatler, B. W. (2001). Steering with the head: The visual strategy of a racing driver. Current Biology, 11, 1215-1220.
37. Mannan, S. K., Ruddock, K. H., & Wooding, D. S. (1996). The relationship between the locations of spatial features and those of fixations made during visual examination of briefly presented images. Spatial Vision, 10(3), 165-188.
38. Navalpakkam, V., & Itti, L. (2005). Modeling the influence of task on attention. Vision Research, 45, 205-231.
39. Parkhurst, D., Law, K., & Niebur, E. (2002). Modeling the role of salience in the allocation of overt visual attention. Vision Research, 42, 107-123.
40. Pelli, D. G. (1997). The VideoToolbox software for visual psychophysics: Transforming numbers into movies. Spatial Vision, 10, 437-442.
41. Peters, R. J., & Itti, L. (2008). Applying computational tools to predict gaze direction in interactive visual environments. ACM Transactions on Applied Perception, 5(2), 8.
42. Peters, R. J., Iyer, A., Itti, L., & Koch, C. (2005). Components of bottom-up gaze allocation in natural images. Vision Research, 45(18), 2397-2416.
43. Privitera, C., & Stark, L. (2000). Algorithms for defining visual regions-of-interest: Comparison with eye fixations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(9), 970-982.
44. Reinagel, P., & Zador, A. M. (1999). Natural scene statistics at the centre of gaze. Network: Computation in Neural Systems, 10, 341-350.
45. Rothkopf, C. A., Ballard, D. H., & Hayhoe, M. M. (2007). Task and context determine where you look. Journal of Vision, 7(14), 1-20.
46. Schneider, E., Bartl, K., Bardins, S., Dera, T., Boning, G., & Brandt, T. (2005). Eye movement driven head-mounted camera: It looks where the eyes look. Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, 2437-2442.
47. Schneider, E., Bartl, K., Dera, T., Boning, G., Wagner, P., & Brandt, T. (2006). Documentation and teaching of surgery with an eye movement driven head-mounted camera: See what the surgeon sees and does. Studies in Health Technology and Informatics, 119, 486-490.
48. Schneider, E., Villgrattner, T., Vockeroth, J., Bartl, K., Kohlbecher, S., Bardins, S., et al. (2009). EyeSeeCam: An eye movement-driven head camera for the examination of natural visual exploration. Annals of the New York Academy of Sciences, 1164, 461-467.
49. Schumann, F., Einhäuser, W., Vockeroth, J., Bartl, K., Schneider, E., & König, P. (2008). Salient features in gaze-aligned recordings of human visual input during free exploration of natural environments. Journal of Vision, 8(14), 1-17.
50. Sprague, N., & Ballard, D. (2004). Eye movements for reward maximization. Advances in Neural Information Processing (NPIS 2003).
51. Sprague, N., Ballard, D., & Robinson, A. (2007). Modeling embodied visual behaviors. ACM Transactions on Applied Perception, 4(2), 1-23.
52. Stahl, J. S. (1999). Amplitude of human head movements associated with horizontal saccades. Experimental Brain Research, 126, 41-54.
53. Tatler, B. W. (2007). The central fixation bias in scene viewing: Selecting an optimal viewing position independently of motor biases and image feature distributions. Journal of Vision, 7(14), 1-17.
54. Tatler, B. W., Baddeley, R. J., & Gilchrist, I. D. (2005). Visual correlates of fixation selection: Effects of scale and time. Vision Research, 45, 643-659.
55. Torralba, A., Oliva, A., Castelhano, M. S., & Henderson, J. M. (2006). Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search. Psychological Review, 113, 766786.
56. Tosi, V., Mecacci, L., & Pasquali, E. (1997). Scanning eye movements made when viewing film: Preliminary observations. International Journal of Neuroscience, 92(1-2), 47-52.
57. Vockeroth, J., Bardins, S., Bartl, K., Dera, T., & Schneider, E. (2007). The combination of a mobile gaze-driven and a head-mounted camera in a hybrid perspective setup. Proceedings of the IEEE Conference on Systems, Man and Cybernetics, 2576-2581.
58. Wallis, G., & Rolls, E. T. (1997). Invariant face and object recognition in the visual system. Progress in Neurobiology, 51(2), 167-194.
59. Yarbus, A. L. (1967). Eye movements and vision. New York: Plenum Press.
60. Zhang, L., Tong, M. H., Marks, T. K., Shan, H., & Cottrell, G. W. (2008). SUN: A Bayesian framework for saliency using natural statistics. Journal of Vision, 8(7), 1-20.