Top-down influences on visual attention during listening are modulated by observer sex

Vision Research

Volumn 65, Issue , 2012, Pages 62-76

  Shen, John ^a   Itti, Laurent ^a,b  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b University of Southern California   (United States)

Author keywords

Eye tracking; Faces; Saliency; Sex differences; Task relevance; Visual attention

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; ATTENTION; AUDITORY STIMULATION; COLOR; CONVERSATION; ENERGY; EYE; EYE FIXATION; EYE TRACKING; FEMALE; GAZE; GENDER; HEARING; HUMAN; HUMAN EXPERIMENT; LISTENING; MALE; MOTION; MOUTH; NONVERBAL COMMUNICATION; NORMAL HUMAN; ORIENTATION; PRIORITY JOURNAL; SACCADIC EYE MOVEMENT; SEX DIFFERENCE; SPEECH; TASK PERFORMANCE; VISION; VISUAL ATTENTION;

ADOLESCENT; ADULT; ANALYSIS OF VARIANCE; ATTENTION; COMMUNICATION; FEMALE; FIXATION, OCULAR; HUMANS; MALE; MIDDLE AGED; NONVERBAL COMMUNICATION; SEX FACTORS; YOUNG ADULT;

EID: 84863746942     PISSN: 00426989     EISSN: 18785646     Source Type: Journal    
DOI: 10.1016/j.visres.2012.06.001     Document Type: Article

References (73)

1. Adolphs R., Spezio M. Role of the amygdala in processing visual socials stimuli. Progress in Brain Research 2006, 156:363-378.
2. Argyle M., Alkema F., Gilmour R. The communication of friendly and hostile attitudes by verbal and non-verbal signals. European Journal of Social Psychology 1971, 1:385-402.
3. Bailly G., Raidt S., Elisei F. Gaze, conversational agents and face-to-face communication. Speech Communication 2010, 52:598-612.
4. Berg D.J., Boehnke S.E., Marino R.A., Munoz D.P., Itti L. Free viewing of dynamic stimuli by humans and monkeys. Journal of Vision 2009, 9:1-15.
5. Bindemann M., Burton M.A., Hooge I.T.C., Jenkins E.H., De Haan Rob Faces retain attention. Psychonomic Bulletin & Review 2005, 12:1048-1053.
6. Birmingham E., Bischof W.F., Kingstone A. Get real! resolving the debate about equivalent social stimuli. Visual Cognition 2009, 17:904-924.
7. Blais C., Jack R.E., Scheepers C., Fiset D., Caldara R. Culture shapes how we look at faces. PLoS ONE 2008, 3:e3022. 10.1371/journal.pone.0003022.
8. Briton N.J., Hall J.A. Beliefs about female and male nonverbal communication. Sex Roles 1995, 32:79-90.
9. Buchan J.N., Pare M., Munhall K.G. The effect of varying talker identity and listening conditions on gaze behavior during audiovisual speech perception. Brain Research 2008, 1242:162-171.
10. Bundesen C. A theory of visual attention. Psychological Review 1990, 97:523-547.
11. Cahill L., Uncapher M., Kilpatrick L., Alkire M.T., Turner J. Sex-related hemispheric lateralization of amygdala function in emotionally influenced memory: An fMRI investigation. Learning & Memory 2004, 11:261-266.
12. Carmi R., Itti L. Visual causes versus correlates of attentional selection in dynamic scenes. Vision Research 2006, 46:4333-4345.
13. Cerf M., Frady E.P., Koch C. Faces and text attract gaze independent of the task: Experimental data and computer model. Journal of Vision 2009, 9:1-15.
14. Chauvin A., Worsley K.J., Schyns P.G., Arguin M., Gosselin F. Accurate statistical tests for smooth classification images. Journal of Vision 2005, 5:1-8. 10.1167/5.9.1.
15. Crouzet S.M., Kirchner H., Thorpe S.J. Fast saccades toward faces: Face detection in just 100ms. Journal of Vision 2010, 10:16.1-17.
16. Dalton K.M., Nacewicz B.M., Johnstone T., Schaefer H.S., Gernsbacher M.A., Goldsmith H.H., et al. Gaze fixation and the neural circuitry of face processing in autism. Nature Neuroscience 2005, 8:519-526.
17. Dorr M., Martinetz T., Gegenfurtner K.R., Barth E. Variability of eye movements when viewing dynamic natural scenes. Journal of Vision 2010, 10:28.
18. Droll J.A., Hayhoe M.M., Triesch J., Sullivan B.T. Task demands control acquisition and storage of visual information. Journal of Experimental Psychology; Human Perception and Performance 2005, 31:1416-1438.
19. Elazary L., Itti L. Interesting objects are visually salient. Journal of Vision 2008, 8:3.1-15.
20. Fletcher-Watson S., Leekam S., Benson V., Frank M., Findlay J. Eye-movements reveal attention to social information in autism spectrum disorder. Neuropsychologia 2009, 47:248-257.
21. Foulsham T., Walker E., Kingstone A. The where, what and when of gaze allocation in the lab and the natural environment. Vision Research 2011, 51:1920-1931.
22. Frances S.J. Sex differences in nonverbal behavior. Sex Roles 1979, 5:519-535.
23. Franconeri S.L., Simons D.J., Junge J.A. Searching for stimulus-driven shifts of attention. Psychonomic Bulletin & Review 2004, 11:876-881.
24. Gamer M., Büchel C. Amygdala activation predicts gaze toward fearful eyes. Journal of Neuroscience 2009, 29:9123-9126.
25. Hall J.A. Gender effects in decoding nonverbal cues. Psychological Bulletin 1978, 85:845-857.
26. Hall J.A. Nonverbal sex differences: Communication accuracy and expressive style 1984, The Johns Hopkins University Press, Baltimore, Maryland.
27. Hall J.A., Matsumoto D. Gender differences in judgments of multiple emotions from facial expressions. Emotion 2004, 4:201-206.
28. Henderson J.M., Brockmole J.R., Castelhano M.S., Mack M. Visual saliency does not account for eye movements during visual search in real-world scenes. Eye movements: A window on mind and brain 2007, 537-562. Elsevier, Amsterdam, Netherlands. R.P.G. van Gompel, M.H. Fischer, W.S. Murray, R.L. Hill (Eds.).
29. Hillstrom A.P., Yantis S. Visual motion and attentional capture. Perception & Psychophysics 1994, 55:399-411.
30. Honey C., Kirchner H., VanRullen R. Faces in the cloud: Fourier power spectrum biases ultrarapid face detection. Journal of vision 2008, 8(9):1-13.
31. Itti L. Automatic foveation for video compression using a neurobiological model of visual attention. IEEE Transactions on Image Processing 2004, 13:1304-1318.
32. Itti L. Quantitative modeling of perceptual salience at human eye position. Visual Cognition 2006, 14:959-984.
33. Itti L., Koch C. Computational modelling of visual attention. Nature Reviews. Neuroscience 2001, 2:194-203.
34. Itti L., Koch C., Niebur E. A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 1998, 20:1254-1259.
35. Jovancevic-Misic J., Hayhoe M. Adaptive gaze control in natural environments. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience 2009, 29:6234-6238.
36. Kanan C., Tong M.H., Zhang L., Cottrell G.W. Sun: Top-down saliency using natural statistics. Visual Cognition 2009, 17:979-1003.
37. Kanwisher N., McDermott J., Chun M.M. The fusiform face area: A module in human extrastriate cortex specialized for face perception. Journal of Neuroscience 1997, 17:4302-4311.
38. Kennedy D.P., Adolphs R. Impaired fixation to eyes following amygdala damage arises from abnormal bottom-up attention. Neuropsychologia 2010, 48:3392-3398.
39. Klin A., Jones W., Schultz R., Volkmar F., Cohen D. Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. Archives of General Psychiatry 2002, 59:809-816.
40. Kollmorgen S., Nortmann N., Schrder S., Knig P. Influence of low-level stimulus features, task dependent factors, and spatial biases on overt visual attention. PLoS Computational Biology 2010, 6:e1000791.
41. Laidlaw K.E.W., Foulsham T., Kuhn G., Kingstone A. Potential social interactions are important to social attention. Proceedings of the National Academy of Sciences 2011, 108:5548-5553.
42. Land M.F., Hayhoe M. In what ways do eye movements contribute to everyday activities?. Vision Research 2001, 41:3559-3565.
43. Le Meur O., Le Callet P., Barba D. Predicting visual fixations on video based on low-level visual features. Vision Research 2007, 47:2483-2498.
44. McClure E.B. A meta-analytic review of sex differences in facial expression processing and their development in infants, children, and adolescents. Psychological Bulletin 2000, 126:424-453.
45. Mechelli A., Friston K.J., Frackowiak R.S., Price C.J. Structural covariance in the human cortex. Journal of Neuroscience 2005, 25:8303-8310.
46. Mital P.K., Smith T.J., Hill R.L., Henderson J.M. Clustering of gaze during dynamic scene viewing is predicted by motion. Cognitive Computation 2010, 3:5-24.
47. Navalpakkam V., Itti L. Search goal tunes visual features optimally. Neuron 2007, 53:605-617.
48. Neumann D., Spezio M.L., Piven J., Adolphs R. Looking you in the mouth: Abnormal gaze in autism resulting from impaired top-down modulation of visual attention. Social Cognitive and Affective Neuroscience 2006, 1:194-202.
49. Nuthmann A., Henderson J.M. Object-based attentional selection in scene viewing. Journal of Vision 2010, 10:20.
50. Nyström M., Holmqvist K. Semantic override of low-level features in image viewing both initially and overall. Journal of Eye Movement Research 2008, 2:1-11.
51. Parkhurst D., Law K., Niebur E. Modeling the role of salience in the allocation of overt visual attention. Vision Research 2002, 42:107-123.
52. Pelphrey K.A., Sasson N.J., Reznick J.S., Paul G., Goldman B.D., Piven J. Visual scanning of faces in autism. Journal of Autism and Developmental Disorders 2002, 32:249-261.
53. Peters, R.J., & Itti, L. (2007). Beyond bottom-up: Incorporating task-dependent influences into a computational model of spatial attention. In IEEE conference on computer vision and pattern recognition (pp. 1-8).
54. Peters R.J., Itti L. Applying computational tools to predict gaze direction in interactive visual environments. ACM Transactions on Applied Perception 2008, 5:1-19.
55. Rayner K. Eye movements in reading and information processing: 20years of research. Psychological Bulletin 1998, 124:372-422.
56. Riby D.M., Doherty-Sneddon G., Bruce V. The eyes or the mouth? Feature salience and unfamiliar face processing in Williams syndrome and autism. The Quarterly Journal of Experimental Psychology 2009, 62:189-203.
57. Rossion B., Caharel S. ERP evidence for the speed of face categorization in the human brain: Disentangling the contribution of low-level visual cues from face perception. Vision Research 2011, 51:1297-1311.
58. Sergent J., Ohta S., MacDonald B. Functional neuroanatomy of face and object processing: A positron emission tomography study. Brain 1992, 115:15-36.
59. Spezio M.L., Huang P.-Y.S., Castelli F., Adolphs R. Amygdala damage impairs eye contact during conversations with real people. Journal of Neuroscience 2007, 27:3994-3997.
60. Swaab R.I., Swaab D.F. Sex differences in the effects of visual contact and eye contact in negotiations. Journal of Experimental Social Psychology 2009, 45:129-136.
61. Tatler B. The central fixation bias in scene viewing: Selecting an optimal viewing position independently of motor biases and image feature distributions. Journal of Vision 2007, 7:1-17.
62. Tatler B.W., Baddeley R.J., Gilchrist I.D. Visual correlates of fixation selection: Effects of scale and time. Vision Research 2005, 45:643-659.
63. Tiddeman B., Burt D.M., Perrett D. Prototyping and transforming facial textures for perception research. IEEE Computer Graphics and Applications 2001, 21:42-50.
64. Torralba A., Oliva A., Castelhano M.S., Henderson J.M. Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search. Psychological Review 2006, 113:766-786.
65. Tseng P.-H., Carmi R., Cameron I.G.M., Munoz D.P., Itti L. Quantifying center bias of observers in free viewing of dynamic natural scenes. Journal of Vision 2009, 9:4.
66. Vassallo S., Cooper S.L., Douglas J.M. Visual scanning in the recognition of facial affect: Is there an observer sex difference?. Journal of Vision 2009, 9:11.1-11.10.
67. Vatikiotis-Bateson E., Eigsti I.M., Yano S., Munhall K.G. Eye movement of perceivers during audiovisual speech perception. Perception & Psychophysics 1998, 60:926-940.
68. Vincent B., Baddeley R., Correani A. Do we look at lights? Using mixture modelling to distinguish between low-and high-level factors in natural image viewing. Visual Cognition 2009, 17:856-879.
69. Viola P., Jones M. Rapid object detection using a boosted cascade of simple features. Proceedings of the 2001 IEEE computer society conference on computer vision and pattern recognition. CVPR 2001 2001, IEEE Comput. Soc, I-511-I-518.
70. Walther D., Koch C. Modeling attention to salient proto-objects. Neural Networks 2006, 19:1395-1407.
71. Wischnewski M., Belardinelli A., Schneider W., Steil J. Where to look next? Combining static and dynamic proto-objects in a TVA-based model of visual attention. Cognitive Computation 2010, 2:1-18.
72. Yuen, J., Russell, B., Liu, C., & Torralba, A. (2009). Labelme video: Building a video database with human annotations. In Proceedings of the 2009 IEEE 12th international conference on computer vision (pp. 1451-1458).
73. Zelinsky G.J. A theory of eye movements during target acquisition. Psychological Review 2008, 115:787-835.