Attention in natural scenes: Contrast affects rapid visual processing and fixations alike

Philosophical Transactions of the Royal Society B: Biological Sciences

Volumn 368, Issue 1628, 2013, Pages

  t'Hart, Bernard Marius ^a   Schmidt, Hannah Claudia Elfriede Fanny ^a   Klein Harmeyer, Ingo ^a   Einhäuser, Wolfgang ^a,b  

^a PHILIPPS UNIVERSITY MARBURG   (Germany)

^b Center for Interdisciplinary Research (ZiF)   (Germany)

Author keywords

Eye movements; Free viewing; Gaze; Recognition; Salience

Indexed keywords

FIXATION; IMAGE PROCESSING; PATTERN RECOGNITION; PROBABILITY; VISUAL CUE; VISUALIZATION;

ADULT; ARTICLE; ATTENTION; CONTRAST SENSITIVITY; EYE FIXATION; EYE MOVEMENT; FEMALE; FREE-VIEWING; GAZE; GERMANY; HUMAN; MALE; PATTERN RECOGNITION; PHOTOSTIMULATION; PHYSIOLOGY; RECOGNITION; SALIENCE; VISION;

EYE MOVEMENTS; FREE-VIEWING; GAZE; RECOGNITION; SALIENCE;

ADULT; ATTENTION; CONTRAST SENSITIVITY; EYE MOVEMENTS; FEMALE; FIXATION, OCULAR; GERMANY; HUMANS; MALE; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; VISUAL PERCEPTION;

EID: 84896588921     PISSN: 09628436     EISSN: 14712970     Source Type: Journal    
DOI: 10.1098/rstb.2013.0067     Document Type: Article

References (64)

1. Rizzolatti G, Riggio L, Dascola I, Umiltá C. 1987 Reorienting attention across the horizontal and vertical meridians: evidence in favor of a premotor theory of attention. Neuropsychologia 25, 31-40. (doi:10.1016/0028-3932(87)90041-8)
2. Deubel H, Schneider WX. 1996 Saccade target selection and object recognition: evidence for a common attentional mechanism. Vision Res. 36, 1827-1837. (doi:10.1016/0042-6989(95)00294-4)
3. Potter MC, Levy EI. 1969 Recognition memory for a rapid sequence of pictures. J. Exp. Psychol. 81, 10-15. (doi:10.1037/h0027470)
4. Thorpe S, Fize D, Marlot C. 1996 Speed of processing in the human visual system. Nature 381, 520-522. (doi:10.1038/381520a0)
5. Kirchner H, Thorpe SJ. 2006 Ultra-rapid object detection with saccadic eye movements: visual processing speed revisited. Vision Res. 46, 1762-1776. (doi:10.1016/j.visres.2005.10.002)
6. Walker S, Stafford P, Davis G. 2008 Ultra-rapid categorization requires visual attention: scenes with multiple foreground objects. J. Vis. 8, 21. (doi:10. 1167/8.4.21)
7. Fei-Fei L, Iyer A, Koch C, Perona P. 2007 What do we perceive in a glance of a real-world scene? J. Vis. 7, 10. (doi:10.1167/7.1.10)
8. Liu J, Harris A, Kanwisher N. 2002 Stages of processing in face perception: an MEG study. Nat. Neurosci. 5, 910-916. (doi:10.1038/nn909)
9. Crouzet SM, Kirchner H, Thorpe SJ. 2010 Fast saccades toward faces: face detection in just 100 ms. J. Vis. 10, 16. (doi:10.1167/10.4.16)
10. Li FF, VanRullen R, Koch C, Perona P. 2002 Rapid natural scene categorization in the near absence of attention. Proc. Natl Acad. Sci. USA 99, 9596-9601. (doi:10.1073/pnas.092277599)
11. Rousselet GA, Fabre-Thorpe M, Thorpe SJ. 2002 Parallel processing in high-level categorization of natural images. Nat. Neurosci. 5, 629-630.
12. Rousselet GA, Thorpe SJ, Fabre-Thorpe M. 2004 Processing of one, two or four natural scenes in humans: the limits of parallelism. Vision Res. 44, 877-894. (doi:10.1016/j.visres.2003.11.014)
13. Reddy L, Wilken P, Koch C. 2004 Face-gender discrimination is possible in the near-absence of attention. J. Vis. 4, 106-117. (doi:10.1167/4.2.4)
14. Raymond JE, Shapiro KL, Arnell KM. 1992 Temporary suppression of visual processing in an RSVP task: an attentional blink? J. Exp. Psychol. Hum. Percept. Perform. 18, 849-860. (doi:10.1037/ 0096-1523.18.3.849)
15. Evans KK, Treisman A. 2005 Perception of objects in natural scenes: is it really attention free? J. Exp. Psychol. Hum. Percept. Perform. 31, 1476-1492. (doi:10.1037/0096-1523.31.6.1476)
16. Einhäuser W, Koch C, Makeig S. 2007 The duration of the attentional blink in natural scenes depends on stimulus category. Vision Res. 47, 597-607. (doi:10.1016/j.visres.2006.12.007)
17. Itti L, Baldi P. 2005 A principled approach to detecting surprising events in video. In Proc. 2005 IEEE Comp. Soc. Conf. Comp. Vision Pattern Recogn. (CVPR) 1, 631-637.
18. Einhäuser W, Mundhenk TN, Baldi P, Koch C, Itti L. 2007 A bottom-up model of spatial attention predicts human error patterns in rapid scene recognition. J. Vis. 7, 6. (doi:10.1167/7.10.6)
19. Zelinsky GJ, Adeli H, Peng Y, Samaras D. 2013 Modelling eye movements in a categorical search task. Phil. Trans. R. Soc. B 368, 20130058. (doi:10. 1098/rstb.2013.0058)
20. Torralba A, Oliva A. 2003 Statistics of natural image categories. Network 14, 391-412. (doi:10.1088/ 0954-898X/14/3/302)
21. Wichmann FA, Rosas P, Gegenfurtner KR. 2005 Rapid animal detection in natural scenes: critical features are local. J. Vis. 5, 376. (doi:10.1167/ 5.8.376)
22. Guyonneau R, Kirchner H, Thorpe SJ. 2006 Animals roll around the clock: the rotation invariance of ultrarapid visual processing. J. Vis. 6, 1008-1017. (doi:10.1167/6.10.1)
23. Wichmann FA, Drewes J, Rosas P, Gegenfurtner KR. 2010 Animal detection in natural scenes: critical features revisited. J. Vis. 10, 6. (doi:10.1167/10.4.6)
24. Yao AYJ, Einhäuser W. 2008 Colour aids late but not early stages of rapid natural scene recognition. J. Vis. 8, 12. (doi:10.1167/8.16.12)
25. Buswell GT. 1935 How people look at pictures. A study of the psychology of perception in art. Chicago, IL: University of Chicago Press.
26. Yarbus AL. 1967 Eye movements and vision. New York, NY: Plenum Press.
27. Henderson JM, Brockmole JR, Castelhano MS, Mack M. 2007 Visual saliency does not account for eyemovements during visual search in real-world scenes. In Eye movement research: insights into mind and brain (eds R Van Gompel, M Fischer, W Murray, R Hills), pp. 437-562. Oxford, UK: Elsevier.
28. Einhäuser W, Rutishauser U, Koch C. 2008 Taskdemands can immediately reverse the effects of sensory-driven saliency in complex visual stimuli. J. Vis. 8, 2. (doi:10.1167/8.2.2)
29. Itti L, Koch C, Niebur E. 1998 A model of saliencybased visual-attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 20, 1254-1259. (doi:10.1109/34.730558)
30. Peters RJ, Iyer A, Itti L, Koch C. 2005 Components of bottom-up gaze allocation in natural images. Vision Res. 45, 2397-2416. (doi:10.1016/j.visres.2005.03. 019)
31. Reinagel P, Zador AM. 1999 Natural scene statistics at the centre of gaze. Network 10, 341-350. (doi:10.1088/0954-898X/10/4/304)
32. Krieger G, Rentschler I, Hauske G, Schill K, Zetzsche C. 2000 Object and scene analysis by saccadic eye-movements: an investigation with higher-order statistics. Spat. Vis. 13, 201-214. (doi:10.1163/ 156856800741216)
33. Mannan SK, Ruddock KH, Wooding DS. 1997 Fixation patterns made during brief examination of two-dimensional images. Perception 26, 1059-1072. (doi:10.1068/p261059)
34. Tatler BW. 2007 The central fixation bias in scene viewing: selecting an optimal viewing position independently of motor biases and image feature distributions. J. Vis. 7, 4. (doi:10.1167/7.14.4)
35. Einhäuser W, König P. 2003 Does luminancecontrast contribute to a saliency map for overt visual attention? Eur. J. Neurosci. 17, 1089-1097. (doi:10.1046/j.1460-9568.2003.02508.x)
36. Elazary L, Itti L. 2008 Interesting objects are visually salient. J. Vis. 8, 3. (doi:10.1167/8.3.3)
37. Einhäuser W, Spain M, Perona P. 2008 Objectspredict fixations better than early saliency. J. Vis. 8, 18. (doi:10.1167/8.14.18)
38. Parkhurst DJ, Niebur E. 2004 Texture contrast attracts overt visual attention in natural scenes. Eur. J. Neurosci. 19, 783-789. (doi:10.1111/j.0953- 816X.2003.03183.x)
39. Acik A, Onat S, Schumann F, Einhäuser W, König P. 2009 Effects of luminance contrast and its modifications on fixation behaviour during free viewing of images from different categories. Vision Res. 49, 1541-1553. (doi:10.1016/j.visres.2009.03.011)
40. Pelli DG. 1997 The VIDEOTOOLBOX software for visual psychophysics: transforming numbers into movies. Spat. Vis. 10, 437-442. (doi:10.1163/156856897X 00366)
41. Brainard DH. 1997 The PSYCHOPHYSICS TOOLBOX. Spat. Vis. 10, 433-436. (doi:10.1163/156856 897X00357)
42. Cornelissen FW, Peters E, Palmer J. 2002 The EYELINK TOOLBOX: eye tracking with MATLAB and the PSYCHOPHYSICS TOOLBOX. Behav. Res. Methods Instrum. Comp. 34, 613-617. (doi:10.3758/BF03195489)
43. R Development Core Team. 2011 R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing.
44. Everingham M, Van Gool L, Williams CKI, Winn J, Zisserman A. 2010 The PASCAL visual object classes (VOC) challenge. Int. J. Comp. Vis. 88, 303-338. (doi:10.1007/s11263-009-0275-4)
45. Derrington AM, Krauskopf J, Lennie P. 1984 Chromatic mechanisms in lateral geniculate nucleus of macaque. J. Physiol. 357, 241-265.
46. Macmillan N, Creelman C. 2005 Detection theory, 2nd edn. Mahwah, NJ: Lawrence Erlbaum Associates.
47. Peli E. 1990 Contrast in complex images. J. Opt. Soc. Am. A 7, 2032-2040. (doi:10.1364/JOSAA.7. 002032)
48. Benjamini Y, Hochberg Y. 1995 Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. R. Stat. Soc. B Meterol. 57, 289-300.
49. Baddeley RJ, Tatler BW. 2006 High frequency edges (but not contrast) predict where we fixate: a Bayesian system identification analysis. Vision Res. 46, 2824-2833. (doi:10.1016/j.visres. 2006.02.024)
50. Einhäuser W, Rutishauser U, Frady EP, Nadler S, König P, Koch C. 2006 The relation of phase noise and luminance contrast to overt attention in complex visual stimuli. J. Vis. 6, 1148-1158. (doi:10.1167/6.11.1)
51. Engmann S, 't Hart BM, Sieren T, Onat S, König P, Einhäuser W. 2009 Saliency on a natural-scene background: effects of color- and luminancecontrast add linearly. Atten. Percept. Psychophys. 71, 1337-1352. (doi:10.3758/APP.71.6.1337)
52. Nuthmann A, Henderson JM. 2010 Object-based attentional selection in scene viewing. J. Vis. 10, 20. (doi:10.1167/10.8.20)
53. Gao D, Mahadevan V, Vasconcelos N. 2008 On the plausibility of the discriminant center-surround hypothesis for visual saliency. J. Vis. 8, 13. (doi:10. 1167/8.7.13)
54. Macé MJ, Delorme A, Richard G, Fabre-Thorpe M. 2010 Spotting animals in natural scenes: efficiency of humans and monkeys at very low contrasts. Anim. Cogn. 13, 405-418. (doi:10.1007/s10071- 009-0290-4)
55. Naber M, Hilger M, Einhäuser W. 2012 Animal detection and identification in natural scenes: image statistics and emotional valence. J. Vis. 12, 25. (doi:10.1167/12.1.25)
56. James W. 1890 Principles of psychology. New York, NY: Holt.
57. 't Hart BM, Vockeroth J, Schumann F, Bartl K, Schneider E, König P, Einhäuser W. 2009 Gaze allocation in natural stimuli: comparing free exploration to head-fixed viewing conditions. Vis. Cogn. 17, 1132-1158. (doi:10.1080/13506280902 812304)
58. Rothkopf CA, Ballard DH. 2009 Image statistics at the point of gaze during human navigation. Vis. Neurosci. 26, 81-92. (doi:10.1017/S0952523808080978)
59. Cristino F, Baddeley R. 2009 The nature of the visual representations involved in eye movements when walking down the street. Vis. Cogn. 17, 880-903. (doi:10.1080/13506280902834696)
60. Land MF, McLeod P. 2000 From eye movements to actions: how batsmen hit the ball. Nat. Neurosci. 3, 1340-1345. (doi:10.1038/81887)
61. Diaz G, Cooper J, Rothkopf C, Hayhoe M. 2013 Saccades to future ball location reveal memorybased prediction in a virtual-reality interception task. J. Vis. 13, 20. (doi:10.1167/13.1.20)
62. VanRullen R, Reddy L, Koch C. 2005 Attentiondriven discrete sampling of motion perception. Proc. Natl Acad. Sci. USA 102, 5291-5296. (doi:10.1073/pnas.0409172102)
63. Kline KA, Eagleman DM. 2008 Evidence against the temporal subsampling account of illusory motion reversal. J. Vis. 8, 13. (doi:10.1167/8.4.13)
64. Schneider WX. 2013 Selective visual processing across competition episodes: a theory of task-driven visual attention and working memory. Phil. Trans. R. Soc. B 368, 20130060. (doi:10.1098/rstb.2013.0060)