Speaker variations influence speechreading speed for dynamic faces

Perception

Volumn 34, Issue 5, 2005, Pages 595-610

  Kaufmann, Jürgen M ^a   Schweinberger, Stefan R ^a  

^a UNIVERSITY OF GLASGOW   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 21144448910     PISSN: 03010066     EISSN: None     Source Type: Journal    
DOI: 10.1068/p5104     Document Type: Article

References (89)

1. Allen J S, Miller J L, DeSteno D, 2003 "Individual talker differences in voice-onset-time" Journal of the Acoustical Society of America 113 544-552
2. Allison T, Puce A, McCarthy G, 2000 "Social perception from visual cues: role of the STS region" Trends in Cognitive Sciences 4 267-278
3. Arnold P, Hill F, 2001 "Bisensory augmentation: A speechreading advantage when speech is clearly audible and intact" British Journal of Psychology 92 339-355
4. Bradlow A R, Nygaard L C, Pisoni D B, 1999 "Effects of talker, rate, and amplitude variation on recognition memory for spoken words" Perception & Psychophysics 61 206-219
5. Braida L D, 1991 "Crossmodal integration in the identification of consonant segments" The Quarterly Journal of Experimental Psychology A 43 647-677
6. Bruce V, Young A, 1986 "Understanding face recognition" British Journal of Psychology 77 305-327
7. Calvert G A, Brammer M J, Bullmore E T, Campbell R, Iversen S D, David A S, 1999 "Response amplification in sensory-specific cortices during crossmodal binding" NeuroReport 10 2619-2623
8. Calvert G A, Bullmore E T, Brammer M J, Campbell R, Williams S C R, McGuire P K, Woodruff P W, Iversen S D, David A S, 1997 "Activation of auditory cortex during silent lipreading" Science 276 593-596
9. Calvert G A, Campbell R, 2003 "Reading speech from still and moving faces: The neural substrates of visible speech" Journal of Cognitive Neuroscience 15 57-70
10. Calvert G A, Campbell R, Brammer M J, 2000 "Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex" Current Biology 10 649-657
11. Campbell R, 1992 "The neuropsychology of lipreading" Philosophical Transactions of the Royal Society of London, Series B 335 39-44
12. Campbell R, 1998 "Speechreading: Advances in understanding its cortical bases and implications for deafness and speech rehabilitation" Scandinavian Audiology 27 80-86
13. Campbell R, Brooks B, Haan E de, Roberts T, 1996a "Dissociating face processing skills: Decisions about lip-read speech, expression, and identity" The Quarterly Journal of Experimental Psychology A 49 295-314
14. Campbell R, Dodd B, 1980 "Hearing by eye" Quarterly Journal of Experimental Psychology 32 85-99
15. Campbell R, Gelder B De, Haan E de, 1996b "The lateralization of lip-reading: A second look" Neuropsychologia 34 1235-1240
16. Campbell R, Haan E H F de, 1998 "Repetition priming for face speech images: Speech-reading primes face identification" British Journal of Psychology 89 309-323
17. Campbell R, Landis T, Regard M, 1986 "Face recognition and lip reading: A neurological dissociation" Brain 109 509-521
18. Campbell R, MacSweeney M, Surguladze S, Calvert G, McGuire P, Suckling J, Brammer M J, David A S, 2001 "Cortical substrates for the perception of face actions: an fMRI study of the specificity of activation for seen speech and for meaningless lower-face acts (gurning)" Cognitive Brain Research 12 233-243
19. Campbell R, Zihl J, Massaro D, Munhall K, Cohen M M, 1997 "Speechreading in the akinetopsic patient, L.M." Brain 120 1793-1803
20. Christie F, Bruce V, 1998 "The role of dynamic information in the recognition of unfamiliar faces" Memory & Cognition 26 780-790
21. Eimas P D, Tartter V C, Miller J L, Keuthen N J, 1978 "Asymmetric dependencies in processing phonetic features" Perception & Psychophysics 23 12-20
22. Ellis A W, 1989 "Neuro-cognitive processing of faces and voices", in Handbook of Research on Face Processing Eds A W Young, H D Ellis (Amsterdam: North-Holland) pp 207-215
23. Etcoff N, 1984 "Selective attention to facial identity and facial emotion" Neuropsychologia 22 281-295
24. Fowler C A, Dekle D J, 1991 "Listening with eye and hand: cross-modal contributions to speech perception" Journal of Experimental Psychology: Human Perception and Performance 17 816-828
25. Garner W R, 1974 The Processing of Information and Structure (Potomac, MD: Lawrence Erlbaum Associates)
26. Garner W R, 1976 "Interaction of stimulus dimensions in concept and choice processes" Cognitive Psychology 898-123
27. Goldinger S D, Pisoni D B, Logan J S, 1991 "On the nature of talker variability effects on recall of spoken word lists" Journal of Experimental Psychology: Learning, Memory, and Cognition 17 152-162
28. Grant K W, Seitz P F, 2000 "The use of visible speech cues for improving auditory detection of spoken sentences" Journal of the Acoustical Society of America 108 1197-1208
29. Green K P, Kuhl P K, 1991 "Integral processing of visual place and auditory voicing information during phonetic perception" Journal of Experimental Psychology: Human Perception and Performance 17 278-288
30. Green K P, Tomiak G R, Kuhl P K, 1997 "The encoding of rate and talker information during phonetic perception" Perception & Psychophysics 59 675-692
31. Haxby J V, Hoffman E A, Gobbini M I, 2000 "The distributed human neural system for face perception" Trends in Cognitive Sciences 4 223-233
32. Huynh H, Feldt L S, 1976 "Estimation of the Box correction for degrees of freedom from sample data in randomized block and split-plot designs" Journal of Educational Statistics 1 69-82
33. Kaiser A R, Kirk K I, Lachs L, Pisoni D B, 2003 "Talker and lexical effects on audiovisual word recognition by adults with cochlear implants" Journal of Speech, Language, and Hearing Research 46 390-404
34. Kamachi M, Hill H, Lander K, Vatikiotis-Bateson E, 2003 "Putting the face to the voice: Matching identity across modality" Current Biology 13 1709-1714
35. Kanwisher N, McDermott J, Chun M M, 1997 "The fusiform face area: a module in human extrastriate cortex specialized for face perception" Journal of Neuroscience 17 4302-4311
36. Knappmeyer B, Thornton I M, Bülthoff H H, 2003 "The use of facial motion and facial form during the processing of identity" Vision Research 43 1921-1936
37. Knight B, Johnston A, 1997 "The role of movement in face recognition" Visual Cognition 4 265-273
38. Lander K, Bruce V, 2000 "Recognizing famous faces: Exploring the benefits of facial motion" Ecological Psychology 12 259-272
39. Lander K, Christie F, Bruce V, 1999 "The role of movement in the recognition of famous faces" Memory & Cognition 27 974-985
40. Lansing C R, McConkie G W, 1999 "Attention to facial regions in segmental and prosodic visual speech perception tasks" Journal of Speech, Language, and Hearing Research 42 526-539
41. Lidestam B, Lyxell B, Andersson G, 1999 "Speech-reading: cognitive predictors and displayed emotion" Scandinavian Audiology 28 211-217
42. Ludman C N, Summerfield A Q, Hall D, Elliott M, Foster J, Hykin J L, Bowtell R, Morris P G, 2000 "Lip-reading ability and patterns of cortical activation studied using fMRI" British Journal of Audiology 34 225-230
43. McCarthy G, Puce A, Gore J C, Allison T, 1997 "Face-specific processing in the human fusiform gyrus" Journal of Cognitive Neuroscience 9 605-610
44. McGurk H, MacDonald J, 1976 "Hearing lips and seeing voices" Nature 264 746-748
45. MacLeod A, Summerfield Q, 1987 "Quantifying the contribution of vision to speech perception in noise" British Journal of Audiology 21 131-141
46. MacSweeney M, Amaro E, Calvert G A, Campbell R, David A S, McGuire P, Williams S C R, Woll B, Brammer M J, 2000 "Silent speechreading in the absence of scanner noise: an event-related fMRI study" NeuroReport 11 1729-1733
47. MacSweeney M, Woll B, Campbell R, McGuire P K, David A S, Williams S C R, Suckling J, Calvert G A, Brammer M J, 2002 "Neural systems underlying British Sign Language and audio-visual English processing in native users" Brain 125 1583-1593
48. Marassa L K, Lansing C R, 1995 "Visual word recognition in 2 facial motion conditions -full face versus lips-plus-mandible" Journal of Speech, Language, and Hearing Research 38 1387-1394
49. Martin C S, Mullennix J W, Pisoni D B, Summers W V, 1989 "Effects of talker variability on recall of spoken word lists" Journal of Experimental Psychology: Learning, Memory, and Cognition 15 676-684
50. Martinez A M, 2003 "Matching expression variant faces" Vision Research 43 1047-1060
51. Massaro D W, 1987 Speech Perception by Ear and Eye: A Paradigm for Psychological Inquiry (Hillsdale, NJ: Lawrence Erlbaum Associates)
52. Massaro D W, Cohen M M, 1990 "Perception of synthesized audible and visible speech" Psychological Science 1 55-63
53. Meltzoff A N, Kuhl P K, 1994 "Faces and speech: intermodal processing of biologically relevant signals in infants and adults", in The Development of Intersensitive Perception: Comparative Perspectives Eds D J Lewkowicz, R Lickliter (Hillsdale, NJ: Lawrence Erlbaum Associates) pp 335-369
54. Montgomery A A, Jackson P L, 1983 "Physical characteristics of the lips underlying vowel lipreading performance" Journal of the Acoustical Society of America 73 2134-2144
55. Mottonen R, Krause C M, Tiippana K, Sams M, 2002 "Processing of changes in visual speech in the human auditory cortex" Cognitive Brain Research 13 417-425
56. Mullennix J W, Bihon T, Bricklemyer J, Gaston J, Keener J M, 2002 "Effects of variation in emotional tone of voice on speech perception" Language and Speech 45 255-283
57. Mullennix J W, Pisoni D B, Martin C S, 1989 "Some effects of talker variability on spoken word recognition" Journal of the Acoustical Society of America 85 365-378
58. Munhall K G, Gribble P, Sacco L, Ward M, 1996 "Temporal constraints on the McGurk effect" Perception & Psychophysics 58 351-361
59. Munhall K G, Vatikiotis-Bateson E, 1998 "The moving face during speech communication", in Hearing by Eye Part 2: Advances in the Psychology of Speechreading and Audio Visual Speech Eds R Campbell, B Dodd, D Burnham (Hove, Sussex: Psychology Press) pp 123-139
60. Nygaard L C, Pisoni D B, 1998 "Talker-specific learning in speech perception" Perception & Psychophysics 60 355-376
61. Nygaard L C, Sommers M S, Pisoni D B, 1994 "Speech-perception as a talker-contingent process" Psychological Science 5 42-46
62. O'Toole A J, Roark D A, Abdi H, 2002 "Recognizing moving faces: a psychological and neural synthesis" Trends in Cognitive Sciences 6 261-266
63. Parry F M, Young A W, Saul J S M, Moss A, 1991 "Dissociable face processing impairments after brain injury" Journal of Clinical and Experimental Neuropsychology 13 545-558
64. Paulesu E, Perani D, Blasi V, Silani G, Borghese N A, De Giovanni U, Sensolo S, Fazio F, 2003 "A functional-anatomical model for lipreading" Journal of Neurophysiology 90 2005-2013
65. Pilotti M, Beyer T, Yasunami M, 2001 "Encoding tasks and the processing of perceptual information in young and older adults" Journals of Gerontology, Series B: Psychological Sciences and Social Sciences 56 119-128
66. Pisoni D B, 1993 "Long-term memory in speech-perception - some new findings on talker variability, speaking rate and perceptual-learning" Speech Communication 13 109-125
67. Preminger J E, Lin H B, Payen M, Levitt H, 1998 "Selective visual masking in speechreading" Journal of Speech, Language, and Hearing Research 41 564-575
68. Puce A, Allison T, Bentin S, Gore J C, McCarthy G, 1998 "Temporal cortex activation in humans viewing eye and mouth movements" Journal of Neuroscience 18 2188-2199
69. Reisberg D, McLean J, Goldfield A, 1987 "Easy to hear but hard to understand: A lipreading advantage with intact auditory stimuli", in Hearing by Eye: The Psychology of Lip-reading Eds B Dodd, R Campbell (Hillsdale, NJ: Lawrence Erlbaum Associates) pp 97-113
70. Rosenblum L D, Johnson J A, Saldana H M, 1996 "Point-light facial displays enhance comprehension of speech in noise" Journal of Speech, Language, and Hearing Research 39 1159-1170
71. Rosenblum L D, Saldaña H M, 1996 "An audiovisual test of kinematic primitives for visual speech perception" Journal of Experimental Psychology: Human Perception and Performance 22 318-331
72. Rosenblum L D, Saldaña H M, 1998 "Time varying information for visual speech perception", in Hearing by Eye Part 2: Advances in the Psychology of Speechreading and Audiovisual Speech Eds R Campbell, B Dodd, D Burnham (Hillsdale, NJ: Lawrence Erlbaum Associates)
73. Rosenblum L D, Schmuckler M A, Johnson J A, 1997 "The McGurk effect in infants" Perception & Psychophysics 59 347-357
74. Sams M, Aulanko R, Hamalainen M, Hari R, Lounasmaa O V, Lu S T, Simola J, 1991 "Seeing speech: visual information from lip movements modifies activity in the human auditory cortex" Neuroscience Letters 127 141-145
75. Schweinberger S R, 1992 "Funktionelle und neuroanatomische Aspekte der Prosopagnosie" Zeitschrift für Neuropsychologie 3 106-119
76. Schweinberger S R, Burton A M, Kelly S W, 1999 "Asymmetric dependencies in perceiving identity and emotion: Experiments with morphed faces" Perception & Psychophysics 61 1102-1115
77. Schweinberger S R, Pickering E C, Jentzsch I, Burton A M, Kaufmann J M, 2002 "Event-related brain potential evidence for a response of inferior temporal cortex to familiar face repetitions" Cognitive Brain Research 14 398-409
78. Schweinberger S R, Sommer W, 1991 "Contributions of stimulus encoding and memory search to right hemisphere superiority in face recognition: Behavioral and electrophysiological evidence" Neuropsychologia 29 389-413
79. Schweinberger S R, Soukup G R, 1998 "Asymmetric relationships among perceptions of facial identity, emotion, and facial speech" Journal of Experimental Psychology: Human Perception and Performance 24 1748-1765
80. Schyns P G, Oliva A, 1999 "Dr. Angry and Mr. Smile: when categorization flexibly modifies the perception of faces in rapid visual presentations" Cognition 69 243-265
81. Sergent J, MacDonald B, Zuck E, 1994 "Structural and functional organization of knowledge about faces and proper names: a positron emission tomography study", in Attention and Performance XV Eds C M Umiltá, M Moscovitch (Cambridge, MA: MIT Press) pp 203-228
82. Sumby W H, Pollack I, 1954 "Visual contribution to speech intelligibility in noise" Journal of the Acoustical Society of America 26 212-215
83. Summerfield Q, McGrath M, 1984 "Detection and resolution of audiovisual incompatibility in the perception of vowels" The Quarterly Journal of Experimental Psychology A 36 51-74
84. Summerfield Q, MacLeod A, McGrath M, Brooke M, 1989 "Lips, teeth and the benefits of lip-reading", in Handbook of Research on Face Processing Eds A W Young, A W Ellis (Amsterdam: North Holland) pp 223-233
85. Takayanagi S, Dirks D D, Moshfegh A, 2002 "Lexical and talker effects on word recognition among native and non-native listeners with normal and impaired hearing" Journal of Speech, Language, and Hearing Research 45 585-597
86. Thompson L A, Lee K M, 1996 "Information integration in cross-modal pattern recognition: An argument for acquired modularity" Acta Psychologica 92 79-104
87. Walker S, Bruce V, O'Malley C, 1995 "Facial identity and facial speech processing - familiar faces and voices in the McGurk effect" Perception & Psychophysics 57 1124-1133
88. Yakel D A, Rosenblum L D, Fortier M A, 2000 "Effects of talker variability on speechreading" Perception & Psychophysics 62 1405-1412
89. Yonan C A, Sommers M S, 2000 "The effects of talker familiarity on spoken word identification in younger and older listeners" Psychology and Aging 15 88-99