Gaze behaviour in audiovisual speech perception: Asymmetrical distribution of face-directed fixations

Perception

Volumn 36, Issue 10, 2007, Pages 1535-1545

  Everdell, Ian T ^a   Marsh, Heidi ^b   Yurick, Micheal D ^b   Munhall, Kevin G ^a,b   Paré, Martin ^a,b  

^a QUEEN S UNIVERSITY   (Canada)

^b QUEEN S UNIVERSITY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 38349070803     PISSN: 03010066     EISSN: None     Source Type: Journal    
DOI: 10.1068/p5852     Document Type: Article

References (43)

1. Baynes K, Funnell M G, Fowler C A, 1994 "Hemispheric contributions to the integration of visual and auditory information in speech perception" Perception & Psychophysics 55 633-641
2. Benton A, 1990 "Facial recognition" Cortex 26 491-499
3. Borod J C, Caron H S, 1980 "Facedness and emotion related to lateral dominance, sex, and expression type" Neuropsychologia 18 237-241
4. Borod J C, Kent J, Koff E, Martin C, Alpert M, 1988 "Facial asymmetry while posing positive and negative emotions: Support for the right hemisphere hypothesis" Neuropsychologia 26 759-764
5. Bryden M P, Sprott D A, 1981 "Statistical determination of degree of laterality" Neuropsychologia 19 571-581
6. Buchan J N, Paré M, Munhall K G, 2007 "Spatial statistics of gaze fixations during dynamic face processing" Social Neuroscience 2 1-13
7. Burt D M, Perrett D I, 1997 "Perceptual asymmetries in judgements of facial attractiveness, age, gender, speech and expressions" Neuropsychologia 35 685-693
8. Butler S, Gilchrist I D, Burt D M, Perrett D I, Jones E, Harvey M, 2005 "Are the perceptual biases found in chimeric face processing reflected in eye-movement patterns?" Neuropsychologia 43 52-59
9. Campbell R, 1982a "Asymmetries in moving faces" British Journal of Psychology 73 95-103
10. Campbell R, 1982b "The lateralization of emotion: A critical review" International Journal of Psychology 17 211-229
11. Campbell R, 1986 "The lateralization of lip-read sounds: A first look" Brain and Cognition 5 1-21
12. Christman S D, Hackworth M D, 1993 "Equivalent perceptual asymmetries for free viewing of positive and negative emotional expressions in chimeric faces" Neuropsychologia 31 621-624
13. David A S, 1993 "Spatial and selective attention in the cerebral hemispheres in depression, mania, and schizophrenia" Brain and Cognition 23 166-180
14. Davidson R J, 1995 "Cerebral asymmetry, emotion and affective style", in Brain Asymmetry Eds R J Davidson, K Hugdahl (Cambridge, MA: MIT Press) pp 361-387
15. Diesch E, 1995 "Left and right hemifield advantages of fusions and combinations in audiovisual speech perception" Quarterly Journal of Experimental Psychology A 48 320-333
16. Everdell I T, Buchan J N, Munhall K G, Paré M, 2006 "Quantifying the spatio-temporal statistics of gaze fixations during face processing" Society for Neuroscience Abstracts 36 439.10/116
17. Gilbert C, Bakan P, 1973 "Visual asymmetry in perception of faces" Neuropsychologia 11 355-362
18. Graves R, Goodglass H, Landis T, 1982 "Mouth asymmetry during spontaneous speech" Neuropsychologia 20 371-381
19. Lansing C R, McConkie G W, 1999 "Attention to facial regions in segmental and prosodie visual speech perception tasks" Journal of Speech, Language, and Hearing Research 42 526-539
20. Lansing C R, McConkie G W, 2003 "Word identification and eye fixation locations in visual and visual-plus-auditory presentations of spoken sentences" Perception & Psychophysics 65 536-552
21. Leonards U, Scott-Samuel N E, 2005 "Idiosyncratic initiation of saccadic face exploration in humans" Vision Research 45 2677-2684
22. Luh K E, Rueckert L M, Levy J, 1991 "Perceptual asymmetries for free viewing of several types of chimeric stimuli" Brain and Cognition 16 83-103
23. McGurk H, MacDonald J, 1976 "Hearing lips and seeing voices" Nature 264 746-748
24. Mertens I, Siegmund H, Grüsser O J, 1993 "Gaze motor asymmetries in the perception of faces during a memory task" Neuropsychologia 31 989-998
25. Moscovitch M, Scullion D, Christie D, 1976 "Early versus late stages of processing and their relation to functional hemispheric asymmetries in face recognition" Journal of Experimental Psychology: Human Perception and Performance 2 401-416
26. Munhall K G, Jones J A, Callan D E, Kuratate T, Vatikiotis-Bateson E, 2004a "Visual prosody and speech intelligibility: Head movement improves auditory speech perception" Psychological Science 15 133-137
27. Munhall K G, Kroos C, Jozan G, Vatikiotis-Bateson E, 2004b "Spatial frequency requirements for audiovisual speech perception" Perception & Psychophysics 66 574-583
28. Munhall K G, Servos P, Santi A, Goodale M A, 2002 "Dynamic visual speech perception in a patient with visual form agnosia" NeuroReport 13 1793-1796
29. Nicholls M E R, Ellis B E, Clement J G, Yoshino M, 2004b "Detecting hemifacial asymmetries in emotional expression with three-dimensional computerized image analysis" Proceedings of the Royal Society of London, Series B 271 663-668
30. Nicholls M E R, Searle D A, 2006 "Asymmetries for visual expression and perception of speech" Brain & Language 97 322-331
31. Nicholls M E R, Searle D A, Bradshaw J L, 2004a "Read my lips: Asymmetries in the visual expression and perception of speech revealed through the McGurk effect" Psychological Science 15 138-141
32. Palmer A R, Strobeck C, 1986 "Fluctuating asymmetry: Measurement, analysis, patterns" Annual Review of Ecology and Systematics 17 391-421
33. Paré M, Richler R C, Ten Hove M, Munhall K G, 2003 "Gaze behavior in audiovisual speech perception: the influence of ocular fixations on the McGurk effect" Perception & Psychophysics 65 553-567
34. Richardson C K, Bowers D, Bauer R M, Heilman K M, Leonard C M, 2000 "Digitizing the moving face during dynamic displays of emotion" Neuropsychologia 38 1028-1039
35. Robert F, Robert J, 1996 Face to Face (Baden, Switzerland: Lars Müller)
36. Smeele P M T, Massaro D W, Cohen M M, Sittig A C, 1998 "Laterality in visual speech perception" Journal of Experimental Psychology: Human Perception and Performance 24 1232-1242
37. Sumby W H, Pollack I, 1954 "Visual contribution to speech intelligibility in noise" Journal of the Acoustical Society of America 26 212-215
38. Vaid J, Singh M, 1989 "Asymmetries in the perception of facial affect: Is there an influence of reading habits?" Neuropsychologia 27 1277-1287
39. Vallortigara G, Rogers L J, 2005 "Survival with an asymmetrical brain: Advantages and disadvantages of cerebral lateralization" Behavioral and Brain Sciences 28 575-633
40. Vatikiotis-Bateson E, Eigsti I M, Yano S, 1994 "Listener eye movement behavior during audiovisual perception" Journal of the Acoustic Society of Japan 94 679-680
41. Vatikiotis-Bateson E, Eigsti I M, Yano S, Munhall K G, 1998 "Eye movements of perceivers during audiovisual speech perception" Perception & Psychophysics 60 926-940
42. Yehia H C, Rubin P E, Vatikiotis-Bateson E, 1998 "Quantitative association of vocal-tract and facial behavior" Speech Communication 26 23-44
43. Wolf M E, Goodale M A, 1987 "Oral asymmetries during verbal and non-verbal movements of the mouth" Neuropsychologia 25 375-396