It depends on when you look at it: Salience influences eye movements in natural scene viewing and search early in time

Journal of Vision

Volumn 15, Issue 5, 2015, Pages 1-22

  Anderson, Nicola C ^a   Ort, Eduard ^a   Kruijne, Wouter ^a   Meeter, Martijn ^a   Donk, Mieke ^a  

^a VU UNIVERSITY AMSTERDAM   (Netherlands)

Author keywords

Attention; Eye movements; Natural scene viewing; Salience

Indexed keywords

ADOLESCENT; ADULT; CONTRAST SENSITIVITY; EYE FIXATION; FEMALE; HUMAN; MALE; PATTERN RECOGNITION; PHYSIOLOGY; SACCADIC EYE MOVEMENT; YOUNG ADULT;

ADOLESCENT; ADULT; CONTRAST SENSITIVITY; FEMALE; FIXATION, OCULAR; HUMANS; MALE; PATTERN RECOGNITION, VISUAL; SACCADES; YOUNG ADULT;

EID: 84930678499     PISSN: None     EISSN: 15347362     Source Type: Journal    
DOI: 10.1167/15.5.9     Document Type: Article

References (70)

1. Altmann, G. T. M. (2004). Language-mediated eye movements in the absence of a visual world: The "blank screen paradigm." Cognition, 93(2), B79-B87, doi:10.1016/j.cognition.2004.02.005.
2. Brockmole, J. R., Castelhano, M. S., & Henderson, J. M. (2006). Contextual cueing in naturalistic scenes: Global and local contexts. Journal of Experimental Psychology - Learning, Memory and Cognition, 32(4), 699-706, doi:10.1037/0278-7393.32.4.699.
3. Bruce, N. D., & Tsotsos, J. K. (2009). Saliency, attention, and visual search: An information theoretic approach. Journal of Vision, 9(3):5, 1-24, http://www.journalofvision.org/content/9/3/5, doi: 10.1167/9.3.5. [PubMed] [Article]
4. Cousineau, D. (2005). Confidence intervals in withinsubject designs: A simpler solution to Loftus and Masson's method. Tutorial in Quantitative Methods for Psychology, 1(1), 42-45.
5. Donk, M., & Soesman, L. (2010). Salience is only briefly represented: Evidence from probe-detection performance. Journal of Experimental Psychology-Human Perception and Performance, 36(2), 286-302, doi:10.1037/a0017605.
6. Donk, M., & Soesman, L. (2011). Object salience is transiently represented whereas object presence is not: Evidence from temporal order judgment. Perception, 40(1), 63-73.
7. Donk, M., & van Zoest, W. (2008). Effects of salience are short-lived. Psychological Science, 19(7), 733-739, doi:10.1111/j.1467-9280.2008.02149.x.
8. Einhäuser, W., Rutishauser, U., Frady, E. P., Nadler, S., Konig, P., & Koch, C. (2006). The relation of phase noise and luminance contrast to overt attention in complex visual stimuli. Journal of Vision, 6(11):1, 1148-1158, http://www.journalofvision.org/content/6/11/1, doi:10.1167/6.11.1. [PubMed] [Article]
9. Einhäuser, W., Rutishauser, U., & Koch, C. (2008). Task-demands can immediately reverse the effects of sensory-driven saliency in complex visual stimuli. Journal of Vision, 8(2):2, 1-19, http://www.journalofvision.org/content/8/2/2, doi:10.1167/8.2.2. [PubMed] [Article]
10. Einhäuser, W., Spain, M., & Perona, P. (2008). Objects predict fixations better than early saliency. Journal of Vision, 8(14):18, 1-26, http://www.journalofvision.org/content/8/14/18, doi:10.1167/8.14.18. [PubMed] [Article]
11. Fischer, B., & Ramsperger, E. (1984). Human express saccades: Extremely short reaction times of goal directed eye movements. Experimental Brain Research, 57(1), 191-195.
12. Folk, C. L., & Remington, R. (1998). Selectivity in distraction by irrelevant featural singletons: Evidence for two forms of attentional capture. Journal of Experimental Psychology-Human Perception and Performance, 24(3), 847-858, doi:10.1037/0096-1523.24.3.847.
13. Foulsham, T., & Underwood, G. (2008). What can saliency models predict about eye movements? Spatial and sequential aspects of fixations during encoding and recognition. Journal of Vision, 8(2):6, 1-17, http://www.journalofvision.org/content/8/2/6, doi:10.1167/8.2.6. [PubMed] [Article]
14. Foulsham, T., Walker, E., & Kingstone, A. (2011). The where, what and when of gaze allocation in the lab and the natural environment. Vision Research, 51(17), 1920-1931, doi:10.1016/j.visres.2011.07.002.
15. Godijn, R., & Theeuwes, J. (2002). Programming of endogenous and exogenous saccades: Evidence for a competitive integration model. Journal of Experimental Psychology-Human Perception and Performance, 28(5), 1039-1054, doi:10.1037//0096-1523.28.5.1039.
16. Hayhoe, M., & Ballard, D. (2005). Eye movements in natural behavior. Trends in Cognitive Sciences, 9(4), 188-194, doi:10.1016/j.tics.2005.02.009.
17. Henderson, J. M., Brockmole, J. R., Castelhano, M. S., & Mack, M. (2007). Visual saliency does not account for eye movements during visual search in real-world scenes. In R. P. G. van Gompel, M. H. Fischer, W. S. Murray, & R. L. Hill (Eds.), Eye movements: a window on mind and brain (pp. 537-562). Oxford, UK: Elsevier.
18. Henderson, J.M., & Hollingworth, A. (1999). High-level scene perception. Annual Review of Psychology, 50, 243-271, doi:10.1146/annurev.psych.50.1.243.
19. Hickey, C., van Zoest, W., & Theeuwes, J. (2010). The time course of exogenous and endogenous control of covert attention. Experimental Brain Research, 201(4), 789-796, doi:10.1007/s00221-009-2094-9.
20. Humphrey, K., & Underwood, G. (2009). Domain knowledge moderates the influence of visual saliency in scene recognition. British Journal of Psychology, 100, 377-398, doi:10.1348/000712608x344780.
21. Humphrey, K., Underwood, G., & Lambert, T. (2012). Salience of the lambs: A test of the saliency map hypothesis with pictures of emotive objects. Journal of Vision, 12(1):22, 1-15, http://www.journalofvision.org/content/12/1/22, doi:10.1167/12.1.22.
22. Hunt, A. R., von Muhlenen, A., & Kingstone, A. (2007). The time course of attentional and oculomotor capture reveals a common cause. Journal of Experimental Psychology-Human Perception and Performance, 33(2), 271-284, doi:10.1037/0096-1523.33.2.271.
23. Irwin, D. E., Colcombe, A. M., Kramer, A. F., & Hahn, S. (2000). Attentional and oculomotor capture by onset, luminance and color singletons. Vision Research, 40(10-12), 1443-1458, doi:10.1016/S0042-6989(00)00030-4.
24. Itti, L., & Koch, C. (2000). A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research, 40(10-12), 1489-1506, doi:10.1016/S0042-6989(99)00163-7.
25. Itti, L., Koch, C., & Niebur, E. (1998). A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(11), 1254-1259, doi: 10.1109/34.730558.
26. Judd, T., Ehinger, K., Durand, F., & Torralba, A. (2009). Learning to predict where humans look. In IEEE international conference on computer vision (pp. 2106-2113) IEEE Computer Society.
27. Kingstone, A., Smilek, D., & Eastwood, J. D. (2008). Cognitive ethology: A new approach for studying human cognition. British Journal of Psychology, 99(Pt. 3), 317-340, doi:10.1348/000712607X251243.
28. Koch, C., & Ullman, S. (1985). Shifts in selective visual attention-Towards the underlying neural circuitry. Human Neurobiology, 4(4), 219-227.
29. Lamy, D., & Zoaris, L. (2009). Task-irrelevant stimulus salience affects visual search. Vision Research, 49(11), 1472-1480, doi:10.1016/j.visres.2009.03.007.
30. Land, M. F. (2009). Vision, eye movements, and natural behavior. Visual Neuroscience, 26(1), 51-62, doi:10.1017/S0952523808080899.
31. Mackay, M., Cerf, M., & Koch, C. (2012). Evidence for two distinct mechanisms directing gaze in natural scenes. Journal of Vision, 12(4):9, 1-12, http://www.journalofvision.org/content/12/4/9, doi:10.1167/12.4.9. [PubMed] [Article]
32. Mannan, S. K., Ruddock, K. H., & Wooding, D. S. (1996). The relationship between the locations of spatial features and those of fixations made during visual examination of briefly presented images. Spatial Vision, 10(3), 165-188, doi:10.1163/156856896x00123.
33. Mathot, S., Schreij, D., & Theeuwes, J. (2012). Open-Sesame: An open-source, graphical experiment builder for the social sciences. Behavior ResearchMethods, 44(2), 314-324, doi:10.3758/s13428-011-0168-7.
34. Morey, R. D. (2008). Confidence intervals from normalized data: A correction to Cousineau (2005). Tutorial in Quantitative Methods for Psychology, 4(2), 61-64.
35. Nuthmann, A., & Henderson, J. M. (2010). Objectbased attentional selection in scene viewing. Journal of Vision, 10(8):20, 1-19, http://www.journalofvision.org/content/10/8/20, doi:10.1167/10.8.20. [PubMed] [Article]
36. Nuthmann, A., Smith, T. J., Engbert, R., & Henderson, J. M. (2010). CRISP: A computational model of fixation durations in scene viewing. Psychological Review, 117(2), 382-405, doi:10.1037/a0018924.
37. Nystrom, M., & Holmqvist, K. (2008). Semantic override of low-level features in image viewing-Both initially and overall. Journal of Eye Movement Research, 2(2), 1-11.
38. Oliva, A., & Torralba, A. (2006). Building the gist of a scene: The role of global image features in recognition. Visual Perception, Part 2-Fundamentals of Awareness: Multi-Sensory Integration and High-Order Perception, 155, 23-36, doi:10.1016/S0079-6123(06)55002-2.
39. Parkhurst, D., Law, K., & Niebur, E. (2002). Modeling the role of salience in the allocation of overt visual attention. Vision Research, 42(1), 107-123, doi:10.1016/S0042-6989(01)00250-4.
40. Peters, R. J., Iyer, A., Itti, L., & Koch, C. (2005). Components of bottom-up gaze allocation in natural images. Vision Research, 45(18), 2397-2416, doi:10.1016/j.visres.2005.03.019.
41. Rao, R. P., Zelinsky, G. J., Hayhoe, M. M., & Ballard, D. H. (2002). Eye movements in iconic visual search. Vision Research, 42(11), 1447-1463.
42. Reinagel, P., & Zador, A. M. (1999). Natural scene statistics at the centre of gaze. Network-Computation in Neural Systems, 10(4), 341-350, doi:10.1088/0954-898x/10/4/304.
43. Reingold, E. M., Charness, N., Pomplun, M., & Stampe, D. M. (2001). Visual span in expert chess players: Evidence from eye movements. Psychological Science, 12(1), 48-55, doi:10.1111/1467-9280.00309.
44. Reuter-Lorenz, P. A., Hughes, H. C., & Fendrich, R. (1991). The reduction of saccadic latency by prior offset of the fixation point: An analysis of the gap effect. Perception & Psychophysics, 49(2), 167-175.
45. Richardson, D. C., & Spivey, M. J. (2000). Representation, space and Hollywood Squares: Looking at things that aren't there anymore. Cognition, 76(3), 269-295, doi:10.1016/S0010-0277(00)00084-6.
46. Siebold, A., van Zoest, W., & Donk, M. (2011). Oculomotor evidence for top-down control following the initial saccade. PLoS One, 6(9), doi:10.1371/journal.pone.0023552.
47. Siebold, A., van Zoest, W., Meeter, M., & Donk, M. (2013). In defense of the salience map: Salience rather than visibility determines selection. Journal of Experimental Psychology - Human Perception and Performance, 39(6), 1516-1524, doi:10.1037/a0032182.
48. Stirk, J. A., & Underwood, G. (2007). Low-level visual saliency does not predict change detection in natural scenes. Journal of Vision, 7(10):3, 1-10, http://www.journalofvision.org/content/7/10/3, doi:10.1167/7.10.3. [PubMed] [Article]
49. Tatler, B. W. (2007). The central fixation bias in scene viewing: Selecting an optimal viewing position independently of motor biases and image feature distributions. Journal of Vision, 7(14):4, 1-17, http://www.journalofvision.org/content/7/14/4, doi:10.1167/7.14.4. [PubMed] [Article]
50. Tatler, B. W., Baddeley, R. J., & Gilchrist, I. D. (2005). Visual correlates of fixation selection: Effects of scale and time. Vision Research, 45(5), 643-659, doi:10.1016/j.visres.2004.09.017.
51. Tatler, B. W., Baddeley, R. J., & Vincent, B. T. (2006). The long and the short of it: Spatial statistics at fixation vary with saccade amplitude and task. Vision Research, 46(12), 1857-1862, doi:10.1016/j.visres.2005.12.005.
52. Tatler, B. W., Hayhoe, M. M., Land, M. F., & Ballard, D. H. (2011). Eye guidance in natural vision: Reinterpreting salience. Journal of Vision, 11(5):5, 1-23, http://www.journalofvision.org/content/11/5/5, doi:10.1167/11.5.5. [PubMed] [Article]
53. 't Hart, B. M., Schmidt, H. C. E. F., Roth, C., & Einhauser, W. (2013). Fixations on objects in natural scenes: Dissociating importance from salience. Frontiers in Psychology, 4, 455, doi:10.3389/Fpsyg.2013.00455.
54. Theeuwes, J. (1992). Perceptual selectivity for color and form. Perception & Psychophysics, 51(6), 599-606.
55. Theeuwes, J. (1994). Endogenous and exogenous control of visual selection. Perception, 23(4), 429-440, doi:10.1068/P230429.
56. Theeuwes, J. (2004). Top-down search strategies cannot override attentional capture. Psychonomic Bulletin & Review, 11(1), 65-70, doi:10.3758/Bf03206462.
57. Theeuwes, J., De Vries, G. J., & Godijn, R. (2003). Attentional and oculomotor capture with static singletons. Perception & Psychophysics, 65(5), 735-746, doi:10.3758/Bf03194810.
58. Theeuwes, J., & Godijn, R. (2002). Irrelevant singletons capture attention: Evidence from inhibition of return. Perception & Psychophysics, 64(5), 764-770, doi:10.3758/Bf03194743.
59. Torralba, A., Oliva, A., Castelhano, M. S., & Henderson, J. M. (2006). Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search. Psychological Review, 113(4), 766-786, doi:10.1037/0033-295X.113.4.766.
60. Turatto, M., & Galfano, G. (2000). Color, form and luminance capture attention in visual search. Vision Research, 40(13), 1639-1643, doi:10.1016/S0042-6989(00)00061-4.
61. Underwood, G., & Foulsham, T. (2006). Visual saliency and semantic incongruency influence eye movements when inspecting pictures. Quarterly Journal of Experimental Psychology, 59(11), 1931-1949, doi:10.1080/17470210500416342.
62. Underwood, G., Foulsham, T., & Humphrey, K. (2009). Saliency and scan patterns in the inspection of real-world scenes: Eye movements during encoding and recognition. Visual Cognition, 17(6-7), 812-834, doi:10.1080/13506280902771278.
63. Underwood, G., Foulsham, T., van Loon, E., Humphreys, L., & Bloyce, J. (2006). Eye movements during scene inspection: A test of the saliency map hypothesis. European Journal of Cognitive Psychology, 18(3), 321-342, doi:10.1080/09541440500236661.
64. van Zoest, W., Donk, M., & Theeuwes, J. (2004a). The role of stimulus-driven and goal-driven control in saccadic visual selection. Journal of Experimental Psychology-Human Perception and Performance, 30(4), 746-759, doi:10.1037/0096-1523.30.4.749.
65. van Zoest, W., Donk, M., & Theeuwes, J. (2004b). Stimulus-driven and goal-directed control in saccadic target selection. Perception, 33, 146-146.
66. Walther, D., & Koch, C. (2006). Modeling attention to salient proto-objects. Neural Networks, 19(9), 1395-1407, doi:10.1016/j.neunet.2006.10.001.
67. Wolfe, J. M. (1994). Guided search 2.0-A revised model of visual-search. Psychnomic Bulletin & Review, 1(2), 202-238, doi:10.3758/Bf03200774.
68. Xiao, J., Hays, J., Ehinger, K., Oliva, A., & Torralba, A. (2010). SUN database: Large-scale scene recognition from Abbey to Zoo. Proceedings of the 23rd IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 8, 3485-3492.
69. Yarbus, A. L. (1967). Eye movements and vision. New York: Plenum Press.
70. Zehetleitner, M., Koch, A. I., Goschy, H., & Muller, H.J. (2013). Salience-based selection: Attentional capture by distractors less salient than the target. PLoS One, 8(1), doi:10.1371/journal.pone.0052595.