Saliency does not account for fixations to eyes within social scenes

Vision Research

Volumn 49, Issue 24, 2009, Pages 2992-3000

  Birmingham, Elina ^a   Bischof, Walter F ^b   Kingstone, Alan ^c  

^a CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^b UNIVERSITY OF ALBERTA   (Canada)

^c UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

Eye movements; Gaze selection; Scene perception; Social Attention; Visual saliency

Indexed keywords

ARTICLE; CONTROLLED STUDY; EYE FIXATION; GAZE; HUMAN; HUMAN EXPERIMENT; LATENT PERIOD; NORMAL HUMAN; PRIORITY JOURNAL; SACCADIC EYE MOVEMENT; SELECTIVE ATTENTION; SOCIAL BEHAVIOR; VISUAL INFORMATION; VISUAL STIMULATION;

EYE MOVEMENT MEASUREMENTS; FIELD DEPENDENCE-INDEPENDENCE; FIXATION, OCULAR; HUMANS; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; REACTION TIME; SACCADES; SOCIAL PERCEPTION; YOUNG ADULT;

EID: 70449524305     PISSN: 00426989     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.visres.2009.09.014     Document Type: Article

References (51)

1. Adolphs R. The neurobiology of social cognition. Current Opinion in Neurobiology 11 (2001) 231-239
2. Baron-Cohen S. How to build a baby that can read minds: Cognitive mechanisms in mindreading. Cahiers de Psychologie Cognitive 13 (1994) 513-552
3. Baron-Cohen S., Wheelright S., and Joliffe T. Is there a "language of the eyes" evidence from normal adults, and adults with autism or Asperger syndrome. Visual Cognition 4 3 (1997) 311-331
4. Bindemann M., Scheepers C., and Burton A.M. Viewpoint and center of gravity affect eye movements to human faces. Journal of Vision 9 2 (2009) 1-16
5. Birmingham E., Bischof W.F., and Kingstone A. Why do we look at eyes?. Journal of Eye Movement Research 1 1 (2007) 1-6
6. Birmingham E., Bischof W.F., and Kingstone A. Social attention and real world scenes: The roles of action, competition, and social content. Quarterly Journal of Experimental Psychology 61 7 (2008) 986-998
7. Birmingham E., Bischof W.F., and Kingstone A. Gaze selection in complex social scenes. Visual Cognition 16 2/3 (2008) 341-355
8. Birmingham E., Bischof W.F., and Kingstone A. Get real! Resolving the debate about equivalent social stimuli. Visual Cognition 17 6/7 (2009) 904-924
9. Brothers L. The social brain: A project for integrating primate behavior and neurophysiology in a new domain. Concepts Neurosci 1 (1990) 27-51
10. Cerf M., Harel J., Einhäuser W., and Koch C. Predicting human gaze using low-level saliency combined with face detection. In: Platt J., Koller D., Singer Y., and Roweis S. (Eds). Advances in neural information processing systems Vol. 20 (2008), MIT Press, Cambridge, MA
11. Dalton K.M., Nacewicz B.M., Johnstone T., Schaefer H.S., Gernsbacher M.A., Goldsmith H.H., et al. Gaze fixation and the neural circuitry of face processing in autism. Nature Neuroscience 8 4 (2005) 519-526
12. Dawson G., Meltzoff A.N., Osterling J., Rinaldi J., and Brown E. Children with autism fail to orient to naturally occurring social stimuli. Journal of Autism and Developmental Disorders 28 (1998) 479-485
13. Einhäuser W., Rutishauser U., and Koch C. Task-demands can immediately reverse the effects of sensory-driven saliency in complex visual stimuli. Journal of Vision 8 2 (2008) 1-19
14. Emery N.J. The eyes have it: The neuroethology, function and evolution of social gaze. Neuroscience and Biobehavioral Reviews 24 (2000) 581-604
15. Fletcher-Watson S., Findlay J.M., Leekam S.R., and Benson V. Rapid detection of person information in a naturalistic scene. Perception 37 (2008) 571-583
16. Fletcher-Watson S., Leekam S.R., Benson V., Frank M.C., and Findlay J.M. Eye-movements reveal attention to social information in autism spectrum disorder. Neuropsychologia 47 (2009) 248-257
17. Foulsham T., and Underwood G. How does the purpose of inspection influence the potency of visual salience in scene perception?. Perception 36 (2007) 1123-1138
18. Foulsham T., and Underwood G. What can saliency models predict about eye movements? Spatial and sequential aspects of fixations during encoding and recognition. Journal of Vision 8 2 (2008) 1-17
19. Haith M.M., Bergman T., and Moore M.J. Eye contact and face scanning in early infancy. Science 198 (1977) 853-855
20. Henderson J.M., Brockmole J.R., Castelhano M.S., and Mack M. Visual saliency does not account for eye movements during visual search in real-world scenes. In: van Gompel R., Fisher M., Murray W., and Hill R. (Eds). Eye movement research: Insights into mind and brain (2007), Elsevier
21. Henderson J.M., Weeks Jr. P.A., and Hollingworth A. The effects of semantic consistency on eye movements during scene viewing. Journal of Experimental Psychology: Human Perception and Performance 25 1 (1999) 210-228
22. Henderson J.M., Williams C.C., and Falk R. Eye movements are functional during face learning. Memory & Cognition 33 1 (2005) 98-106
23. Itier R.J., Villate C., and Ryan J.D. Eyes always attract attention but gaze orienting is task-dependent: Evidence from eye movement monitoring. Neuropsychologia 45 (2007) 1019-1028
24. Itti L. Quantifying the contribution of low-level saliency to human eye movements in dynamic scenes. Visual Cognition 12 6 (2005) 1093-1123
25. Itti L., and Koch C. A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research 40 (2000) 1489-1506
26. Itti L., Koch C., and Niebur E. A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 20 (1998) 1254-1259
27. Klin A., Jones W., Schultz R., Volkmar F., and Cohen D. Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. Archives of General Psychiatry 59 (2002) 809-816
28. Kobayashi H., and Koshima S. Unique morphology of the human eye. Nature 387 (1997) 767-768
29. Koch C., and Ullman S. Shifts in selective visual attention: Towards the underlying neural circuitry. Human Neurobiology 4 (1985) 219-227
30. Lewis M.B., and Edmonds A.J. Face detection: Mapping human performance. Perception 32 (2003) 903-920
31. Maurer D., and Salapatek P. Developmental changes in the scanning of faces by young infants. Child Development 47 (1976) 523-527
32. Nummenmaa T. The language of the face (Jyvaskyla studies in education), psychology, and social research (1964), Jyvaskyla, Finland
33. Nyström M., and Homlqvist K. Semantic override of low-level features in image viewing - Both initially and overall. Journal of Eye Movement Research 2 2 (2008) 1-11
34. Parkhurst D., Law K., and Niebur E. Modeling the role of salience in the allocation of overt visual attention. Vision Research 42 (2002) 107-123
35. Pelphrey K.A., Sasson N.J., Reznick S., Paul G., Goldman B.D., and Piven J. Visual scanning of faces in autism. Journal of Autism and Developmental Disorders 32 4 (2002) 249-261
36. Rothkopf C.A., Ballard D.H., and Hayhoe M.M. Task and context determine where you look. Journal of Vision 7 14 (2007) 1-20
37. Smilek D., Birmingham E., Cameron D., Bischof W.F., and Kingstone A. Cognitive ethology and exploring attention in real world scenes. Brain Research 1080 (2006) 101-119
38. Tatler, B. W. (2007). The central fixation bias in scene viewing: Selecting an optimal viewing position independently of motorbiases and image feature distributions. Journal of Vision, 7(14), 4, 1-17.
39. Tatler B.W., Baddeley R.J., and Gilchrist I.D. Visual correlates of fixation selection: Effects of scale and time. Vision Research 45 (2005) 643-659
40. Torralba A. Modeling global scene factors in attention. Journal of the Optical Society of America 20 7 (2003) 1407-1418
41. Torralba A., Oliva A., Castelhano M.S., and Henderson J.M. Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search. Psychological Review 113 4 (2006) 766-786
42. Treisman A.M., and Gelade G. A feature integration theory of attention. Cognitive Psychology 12 (1980) 97-136
43. Turano K.A., Geruschat D.R., and Baker F.H. Oculomotor strategies for the direction of gaze tested with a real-world activity. Vision Research 43 (2003) 333-346
44. van der Geest J.N., Kemner C., Verbaten M.N., and van Engeland H. Gaze behavior of children with pervasive developmental disorder toward human faces: a fixation time study. Journal of child psychology and psychiatry, and allied disciplines 43 5 (2002) 669-678
45. van Zoest W., Donk M., and Theeuwes J. The role of stimulus-driven and goal-driven control in saccadic visual selection. Journal of Experimental Psychology: Human Perception and Performance 30 4 (2004) 746-759
46. Viola, P., & Jones, M. (2001). Rapid object detection using a boosted cascade of simple features. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition.
47. Walker-Smith G., Gale A.G., and Findlay J.M. Eye movement strategies involved in face perception. Perception 6 3 (1977) 313-326
48. Walther, D., & Koch, C. (2005). Saliency Toolbox (Version 2.0) (Computer Software). Retrieved 2.12.05.
49. Walther D., and Koch C. Modeling attention to salient proto-objects. Neural Networks 19 (2006) 1395-1407
50. Yarbus A.L. Eye movements and vision (B. Haigh, Trans.) (1967), Plenum Press, New York (Original work published 1965)
51. Zelinsky G., Zhang W., Yu B., Chen X., and Samaras D. The role of top-down and bottom-up processes in guiding eye movements during visual search. In: Weiss Y., Scholkopf B., and Platt J. (Eds). Advances in neural information processing systems Vol. 18 (2006), MIT Press, Cambridge, MA 1569-1576