The role of facial colour and luminance in visual and audiovisual speech perception

Perception

Volumn 32, Issue 8, 2003, Pages 921-936

  McCotter, Maxine V ^a,b   Jordan, Timothy R ^a  

^a UNIVERSITY OF NOTTINGHAM   (United Kingdom)

^b UNIVERSITY OF GLASGOW   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0347579290     PISSN: 03010066     EISSN: None     Source Type: Journal    
DOI: 10.1068/p3316     Document Type: Article

References (87)

1. Benoit C, Guiard-Marigny T, Le Goff B, Adjoudani A, 1996 "Which components of the face do humans and machines best speechread?", in Speechreading by Humans and Machines Eds D G Stork, M E Hennecke (New York: Springer) pp 315-328
2. Binnie C A, Montgomery A A, Jackson P L, 1974 "Auditory and visual contributions to the perception of consonants" Journal of Speech and Hearing Research 17 619-630
3. Brooke N M, Summerfield Q, 1983 "Analysis, synthesis, and perception of visible articulatory movements" Journal of Phonetics 11 63-76
4. Bruce V, Burton M, Hanna E, Healey P, Mason O, Coombes A, Fright R, Linney A, 1993 "Sex discrimination: how do we tell the difference between male and female faces?" Perception 22 131-152
5. Bruce V, Henderson Z, Greenwood K, Hancock P J B, Burton A M, Miller P, 1999 "Verification of face identities from images captured on video" Journal of Experimental Psychology: Applied 5 339-360
6. Bruce V, Langton S, 1994 "The use of pigmentation and shading information in recognising the sex and identities of faces" Perception 23 803-822
7. Burt D M, Perrett D I, 1995 "Perception of age in adult caucasian male faces: computer graphic manipulation of shape and colour information" Proceedings of the Royal Society of London, Series B 159 137-143
8. Campbell R, de Haan E, Brooks B, 1997 "Space and time in the identification of spoken syllables" Department of Human Communication Science, Work in Progress, 7 (London: University College London Press)
9. Campbell R, Dodd B, Burnham D (Eds), 1998 Hearing by Eye II: Advances in the Psychology of Speechreading and Auditory-visual Speech (London: Taylor and Francis)
10. Campbell C S, Massaro D W, 1997 "Perception of visible speech: influence of spatial quantization" Perception 26 627-644
11. Cavanagh P, Leclerc Y G, 1989 "Shape from shadows" Journal of Experimental Psychology: Human Perception and Performance 15 3-27
12. Cohen M A, Grossberg S, 1984 "Neural dynamics of brightness perception: features, boundaries, diffusion and resonance" Perception & Psychophysics 36 428-456
13. Cohen M M, Walker R L, Massaro D M, 1996 "Perception of synthetic visual speech", in Speechreading by Humans and Machines Eds D G Stork, M E Hennecke (New York: Springer) pp 153-168
14. Davies G, 1997 "Video surveillance: the impact of colour on person description and identification" Proceedings of the British Psychological Society 5 67
15. Erber N, 1969 "Interaction of audition and vision in the recognition of oral speech stimuli" Journal of Speech and Hearing Research 12 423-425
16. Fisher C G, 1968 "Confusions among visually perceived consonants" Journal of Speech and Hearing Research 11 796-804
17. Gailey L, 1987 "Psychological parameters of lip reading skills", in Hearing by Eye: The Psychology of Lip-Reading Eds B Dodd, R Campbell (London: Lawrence Erlbaum Associates) pp 115-141
18. Galper R E, 1970 "Recognition of faces in photographic negative" Psychonomic Science 19 207-208
19. Galper R E, Hochberg J, 1971 "Recognition memory for photographs of faces" American Journal of Psychology 84 351-354
20. Gibson E J, 1969 Principles of Perceptual Learning and Development (New York: Appleton-Century)
21. Glucksberg S, Danks J H, 1975 Experimental Psycholinguistics: An Introduction (New York: Lawrence Erlbaum Associates)
22. Green K P, 1994 "The influence of an inverted face on the McGurk effect", Poster presented at the 127th meeting of the Acoustical Society of America Journal of the Acoustical Society of America 95 3014 (Abstract)
23. Green K P, Kuhl P K, Meltzhoff A N, Stevens E B, 1991 "Integrating speech information across talkers, gender, and sensory modality: Female faces and male voices in the McGurk effect" Perception & Psychophysics 50 524-536
24. Guiard-Marigny T, Ostry D J, Benoit C, 1995 "Speech intelligibility of synthetic lips and jaw", in Proceedings of the 13th International Congress of Phonetic Sciences volume 3 (Stockholm) pp 222-225
25. Hayes A, 1988 "Identification of two-tone images: some implications for high- and low-spatial frequency processes in human vision" Perception 17 429-436
26. Hayes A, Morrone M C, Burr D C, 1986 "Recognition of positive and negative bandpass-filtered images" Perception 15 595-602
27. Hill H, Bruce V, Akamatsu S, 1995 "Perceiving the sex and race of faces: the role of shape and colour" Proceedings of the Royal Society of London, Series B 261 367-373
28. Humphrey G K, Goodale M A, Jakobson L S, Servos P, 1994 "The role of surface information in object recognition: studies of a visual form agnosic and normal subjects" Perception 23 1457-1481
29. Jackson P L, Montgomery A A, Binnie C A, 1976 "Perceptual dimensions underlying vowel lipreading performance" Journal of Speech and Hearing Research 19 796-812
30. Johnston A, Hill H, Carman N, 1992 "Recognising faces: effects of lighting direction, inversion, and brightness reversal" Perception 21 365-375
31. Jordan T R, Sevan K, 1997 "Seeing and hearing rotated faces: Influences of facial orientation on visual and audiovisual speech recognition" Journal of Experimental Psychology: Human Perception and Performance 23 388-403
32. Jordan T R, McCotter M V, Thomas S M, 2000 "Visual and audiovisual speech perception with color and gray scale facial images" Perception & Psychophysics 62 1394-1404
33. Jordan T R, Sergeant P C, 1998 "Effects of facial image size on visual and audio visual speech recognition", in Hearing by Eye. Part 2: The Psychology of Speechreading and Audiovisual Speech Eds R Campbell, B Dodd, D Burnham (London: Taylor and Francis) pp 155-176
34. Jordan T R, Sergeant P C, 2000 "Effects of distance on visual and audiovisual speech recognition" Language and Speech 43 107-124
35. Jordan T R, Thomas S M, 2001 "Effects of horizontal viewing angle on visual and audiovisual speech recognition" Journal of Experimental Psychology: Human Perception and Performance 27 1386-1403
36. Joseph J E, Profitt D R, 1996 "Semantic versus perceptual influences of color in object recognition" Journal of Experimental Psychology: Human Perception and Performance 22 407-429
37. Kanzaki R, Campbell R, 1999 "Effect of facial brightness reversal on visual and audiovisual speech perception", paper presented at the Audio Visual Speech Processing Conference, University of California, Santa Cruz, August 1999
38. Kemp R, Pike G, White P, Musselman A, 1996 "Perception and recognition of normal and negative faces: the role of shape from shading and pigmentation cues" Perception 25 37-52
39. Knight B, Johnston A, 1997 "The role of movement in face recognition" Visual Cognition 4 265-273
40. Lee K J, Perrett D, 1997 "Presentation-time measures of the effects of manipulations in colour space on discrimination of famous faces" Perception 26 733-752
41. Lesner S A, 1988 "The talker" Volta Review 90 89-98
42. Lewis M B, Johnston R A, 1997 "The Thatcher illusion as a test of configural disruption" Perception 26 225-227
43. Liberman A M, 1982 "On finding that speech is special" American Psychologist 37 148-167
44. Liberman A M, Mattingly I G, 1985 "The motor theory of speech perception revised" Cognition 21 1-36
45. Liu C H, Chaudhuri A, 1998 "Are there qualitative differences between face processing in photographic positive and negative?" Perception 27 1107-1122
46. Liu C H, Collin C A, Burton A M, Chaudhuri A, 1999 "Lighting direction affects recognition of untextured faces in photographic positive and negative" Vision Research 39 4003-4009
47. Luria S M, Strauss M S, 1978 "Comparison of eye movements over faces in photographic positives and negatives" Perception 7 349-358
48. MacDonald J, Andersen S, Bachmann T, 2000 "Hearing by eye: how much spatial degradation can be tolerated?" Perception 29 1155-1168
49. McGurk H, MacDonald J, 1976 "Hearing lips and seeing voices" Nature 264 746-748
50. MacLeod A, Summerfield Q, 1987 "Quantifying the contribution of vision to speech perception in noise" British Journal of Audiology 12 131-141
51. Marrasa L K, Lansing C R, 1995 "Visual word recognition in two facial motion conditions: Full face versus lips plus mandible" Journal of Speech and Hearing Research 38 1387-1394
52. Massaro D M, 1987 "Speech perception by ear and eye", in Hearing by Eye: The Psychology of Lip Reading Eds B Dodd, R Campbell (London: Lawrence Erlbaum Associates) pp 53-83
53. Massaro D M, 1998 Perceiving Talking Faces: From Speech Perception to a Behavioral Principle (Cambridge, MA: MIT Press)
54. Massaro D W, Cohen M M, 1990 "Perception of synthesized audible and visible speech" Psychological Science 1 55-63
55. Massaro D W, Cohen M M, 1996 "Perceiving speech from inverted faces" Perception & Psychophysics 58 1047-1065
56. Middleweerd M J, Plomp R, 1987 "The effect of speechreading on the speech-reception threshold of sentences in noise" Journal of the Acoustical Society of America 82 2145-2147
57. Miller G A, Nicely P E, 1955 "An analysis of perceptual confusions among some English consonants" Journal of the Acoustical Society of America 27 338-352
58. Montgomery A A, Jackson P L, 1983 "Physical characteristics of the lips underlying vowel lipreading performance" Journal of the Acoustical Society of America 73 2134-2144
59. Oliva A, Schyns P G, 2000 "Diagnostic colors mediate scene recognition" Cognitive Psychology 41 176-210
60. Owens E, Blaznek B, 1985 "Visemes observed by hearing impaired and normal hearing adult viewers" Journal of Speech and Hearing Research 28 381-393
61. Phillips R J, 1972 "Why are faces hard to recognise in photographic negative?" Perception & Psychophysics 12 425-426
62. Plant G L, 1980 "Visual identification of Australian vowels and dipthongs" Australian Journal of Audiology 2 83-91
63. Prazdny K, 1983 "Illusory contours are not caused by simultaneous brightness contrast" Perception & Psychophysics 34 403-404
64. Prazdny K, 1985 "On the nature of inducing forms generating perceptions of illusory contours" Perception & Psychophysics 37 237-242
65. Price C J, Humphreys G W, 1989 "The effects of surface detail on object categorization and naming" The Quarterly Journal of Experimental Psychology A 41 797-828
66. Ramachandran V S, 1988 "Perception of shape from shading" Nature 331 163-166
67. Reisberg D, McLean J, Goldfield A, 1987 "Easy to hear but hard to understand: A lipreading advantage with intact auditory stimuli", in Hearing by Eye: The Psychology of Lip Reading Eds B Dodd, R Campbell (London: Lawrence Erlbaum Associates) pp 97-113
68. Ronneberg J, 1993 "Cognitive characteristics of skilled tactiling: the case of G.S." European Journal of Cognitive Psychology 5 19-33
69. Rosenblum L D, Saldaña H M, 1992 "Discrimination tests of visually influenced syllables" Perception & Psychophysics 4 461-473
70. Rosenblum L D, Saldaña H M, 1996 "An audiovisual test of kinematic primitives for visual speech perception" Journal of Experimental Psychology: Human Perception and Performance 22 318-331
71. Rosenblum L D, Saldaña H M, 1998 "Time-varying information for visual speech perception", in Hearing by Eye. Part 2: The Psychology of Speechreading and Audiovisual Speech Eds R Campbell, B Dodd, D Burnham (London: Taylor and Francis) pp 61-81
72. Rosenblum L D, Yakel D A, Green K P, 2000 "Face and mouth inversion effects on visual and audiovisual speech perception" Journal of Experimental Psychology: Human Perception and Performance 26 806-819
73. Samuelsson S, Ronneberg J, 1993 "Implicit and explicit use of scripted constraints in lip reading" European Journal of Cognitive Psychology 5 201-233
74. Schwartz J L, Robert-Ribes J, Escudier P, 1998 "Ten years after Summerfield: a taxonomy of models for audiovisual fusion in speech perception", in Hearing by Eye. Part 2: The Psychology of Speechreading and Audiovisual Speech Eds R Campbell, B Dodd, D Burnham (London: Taylor and Francis) pp 85-107
75. Sekiyama K, Tohkura Y, 1991 "McGurk effect in non-English listeners: few visual effects for Japanese subjects hearing Japanese syllables of high auditory intelligibility" Journal of the Acoustical Society of America 90 1797-1805
76. Sekiyama K, Tohkura Y, 1993 "Inter-language differences in the influence of visual cues in speech perception" Journal of Phonetics 21 427-444
77. Shapley R, Gordon J, 1985 "Nonlinearity in the perception of form" Perception & Psychophysics 37 84-88
78. Smeele P M T, Hahnlen L, Stevens E, Kuhl P, Meltzhoff A, 1995 "Investigating the role of specific facial information in audiovisual speech perception" (Abstract) Journal of the Acoustical Society of America 98 5aSC7
79. Sudman J A, Berger K W, 1971 "Two-dimension vs. three dimension viewing in speech reading" Journal of Communication Disorders 4 195-198
80. Sumby W H, Pollack I, 1954 "Visual contribution to speech intelligibility in noise" Journal of the Acoustical Society of America 26 212-215
81. Summerfield A Q, 1987 "Some preliminaries to a comprehensive account of audiovisual speech perception", in Hearing by Eye: The Psychology of Lip Reading Eds B Dodd, R Campbell (London: Lawrence Erlbaum Associates) pp 3-51
82. Summerfield Q, McGrath M, 1984 "Detection and resolution of audiovisual incompatibility in the perception of vowels" Quarterly Journal of Experimental Psychology A 36 51-74
83. Summerfield Q, MacLeod A, McGrath M, Brooks M, 1989 "Lips, teeth, and the benefits of lipreading", in Handbook of Research on Face Processing Eds A W Young, H D Ellis (Amsterdam: Elsevier) pp 223-233
84. Tanaka J W, Presnell L M, 1999 "Color diagnosticity in object recognition" Perception & Psychophysics 61 1140-1153
85. Walden B E, Prosek R A, Montgomery A A, Scherr C K, Jones C J, 1977 "Effects of training on the visual recognition of consonants" Journal of Speech and Hearing Research 20 130-145
86. Woodward M F, Barber C G, 1960 "Phoneme perception in lipreading" Journal of Speech and Hearing Research 3 212-222
87. Wurm L H, Legge G E, Isenberg L M, Luebker A, 1993 "Color improves object recognition in normal and low vision" Journal of Experimental Psychology: Human Perception and Performance 19 899-911