Face and mouth inversion effects on visual and audiovisual speech perception

Journal of Experimental Psychology: Human Perception and Performance

Volumn 26, Issue 2, 2000, Pages 806-819

  Rosenblum, Lawrence D ^a   Yakel, Deborah A ^a   Green, Kerry P ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; DISCRIMINATION LEARNING; FACIAL EXPRESSION; FEMALE; HUMAN; LIP READING; MALE; MOUTH; ORIENTATION; PERCEPTION DISORDER; SPEECH PERCEPTION;

ADULT; DISCRIMINATION LEARNING; FACIAL EXPRESSION; FEMALE; HUMANS; LIPREADING; MALE; MOUTH; ORIENTATION; PERCEPTUAL DISTORTION; SPEECH PERCEPTION;

EID: 0034168459     PISSN: 00961523     EISSN: None     Source Type: Journal    
DOI: 10.1037/0096-1523.26.2.806     Document Type: Article

References (66)

1. Bartlett, J. C., & Searcy, J. (1993). Inversion and configuration of faces. Cognitive Psychology, 25, 281-316.
2. Baynes, K., Funnell, M. G., & Fowler, C. A. (1994). Hemispheric contributions to the integration of visual and auditory information in speech perception. Perception & Psychophysics, 55, 633-641.
3. Bertelson, P., Vroomen, J., Wiegeraad, G., & de Gelder, B. (1994). Exploring the relation between McGurk interference and ventriloquism. Proceedings of the 1994 International Conference on Spoken Language Processing (ICLP94), 2, 559-562.
4. Bingham, G. P., Rosenblum, L. D., & Schmidt, R. C. (1995). Dynamics and the orientation of kinematic forms in visual event recognition. Journal of Experimental Psychology: Human Perception and Performance, 21, 1473-1493.
5. Bruce, V. (1988). Recognising faces. Hove, England: Erlbaum.
6. Bruce, V., & Young, A. (1986). Understanding face recognition. British Journal of Psychology, 77, 305-327.
7. Campbell, R. T. (1986). The lateralization of lip-read sounds: A first look. Brain and Cognition, 5, 1-21.
8. Campbell, R. T., de Gelder, B., & de Haan, E. (1996). The lateralization of lip-reading: A second look. Neuropsychologia, 34, 1235-1240.
9. Campbell, R. T., Landis, T., & Regard, M. (1986). Face recognition and lip-reading: A neurological dissociation. Brain, 109, 509-521.
10. Carey, S., & Diamond, R. (1977, January 17). From piecemeal to configurational representation of faces. Science, 195, 312-314.
11. Church, B. A., & Schacter, D. L. (1994). Perceptual specificity of auditory priming: Implicit memory for voice intonation and fundamental frequency. Journal of Experimental Psychology: Learning, Memory, and Cognition, 20, 521-533.
12. Damasio, A. R. (1989). Neural mechanisms. In A. Young & A. Ellis (Eds.), Handbook of research on face processing (pp. 405-425). Amsterdam: North Holland and Elsevier.
13. de Gelder, B., Vroomen, J., & Van der Heide, L. (1991). Face recognition and lip-reading in autism. European Journal of Cognitive Psychology, 3, 69-86.
14. Diamond, R., & Carey, S. (1986). Why faces are not special: An effect of expertise. Journal of Experimental Psychology: General, 115, 107-117.
15. Diesch, E. (1995). Left and right hemifield advantages of fusions and combinations in audiovisual speech perception. Quarterly Journal of Experimental Psychology: Human Experimental Psychology, 48, 320-333.
16. Ellis, H. D. (1989). Processes underlying face recognition. In R. Bruyer (Ed.), Neuropsychology of face perception and facial expression (pp. 41-49). Hillsdale, NJ: Erlbaum.
17. Fodor, J. A. (1983). Modularity of mind. Cambridge, MA: Bradford Books.
18. Green, K. P. (1994, May). The influence of an inverted face on the McGurk effect. Poster presented at the meeting of the Acoustical Society of America, Cambridge, MA. (From Journal of the Acoustical Society of America, 95, 3014, Abstract No. 5pSP34)
19. Green, K. P., Kuhl, P. K., Meltzoff, A. M., & Stevens, E. B. (1991). Integrating speech information across talkers, gender, and sensory modality: Female faces and male voices in the McGurk effect. Perception & Psychophysics, 50, 524-536.
20. Hillger, L. A., & Koenig, O. (1991). Separable mechanisms in face processing: Evidence from hemispheric specialization. Journal of Cognitive Neuroscience, 3, 42-58.
21. Jordan, T. R., & Bevan, K. (1997). Seeing and hearing rotated faces: Influences of facial orientation on visual and audio-visual speech recognition. Journal of Experimental Psychology: Human Perception and Performance, 23, 388-403.
22. Lander, K., Rosenblum, L. D., & Bruce, V. (1999). Recognizing "Thatcherized" faces: Influences of inverted and dynamic presentations. Manuscript in preparation.
23. Liberman, A. M., & Mattingly, I. G. (1985). The motor theory of speech perception revised. Cognition, 21, 1-36.
24. MacLeod, A., & Summerfield, Q. (1987). Quantifying the contribution of vision to speech perception in noise. British Journal of Audiology, 21, 131-141.
25. Massaro, D. W. (1987). Speech perception by ear and eye. In B. Dodd & R. Campbell (Eds.), Hearing by eye: The psychology of lip-reading (pp. 53-83). London: Erlbaum.
26. Massaro, D. W., & Cohen, M. M. (1996). Perceiving speech from inverted faces. Perception & Psychophysics, 58, 1047-1065.
27. McGrath, M. (1985). An examination of cues for visual and audio-visual speech perception using natural and computer-generated faces. Unpublished doctoral dissertation, University of Nottingham, England.
28. McGurk, H., & MacDonald, J. W. (1976). Hearing lips and seeing voices. Nature, 264, 746-748.
29. Mills, A. E. (1987). The development of phonology in the blind child. In B. Dodd & R. Campbell (Eds.), Hearing by eye: The psychology of lip-reading (pp. 145-162). Hillsdale, NJ: Erlbaum.
30. Montgomery, A. A., & Jackson, P. L. (1983). Physical characteristics of the lips underlying vowel lipreading performance. Journal of the Acoustical Society of America, 73, 2134-2144.
31. Mullennix, J. W., Pisoni, D. B., & Martin, C. S. (1989). Some effects of talker variability on spoken word recognition. Journal of the Acoustical Society of America, 85, 365-378.
32. Nygaard, L. C., Sommers, M. S., & Pisoni, D. B. (1994). Speech perception as a talker-contingent process. Psychological Science, 5, 42-46.
33. Palmeri, T. J., Goldinger, S. D., & Pisoni, D. B. (1993). Episodic encoding of voice attributes and recognition memory for spoken words. Journal of Experimental Psychology: Learning, Memory, and Cognition, 19, 309-328.
34. Parks, T. E. (1983). Letter to the editor. Perception, 12, 88.
35. Parks, T. E., Coss, R. G., & Coss, C. S. (1985). Thatcher and the Cheshire cat: Context and the processing of facial features. Perception, 14, 747-754.
36. Reisberg, D., McLean, J., & Goldfield, A. (1987). Easy to hear but hard to understand: A lipreading advantage with intact auditory stimuli. In B. Dodd & R. Campbell (Eds.), Hearing by eye: The psychology of lip-reading (pp. 97-113). Hillsdale, NJ: Erlbaum.
37. Remez, R. E., Fellowes, J. M., & Rubin, P. E. (1995, November). Perceiving the sex of a talker without natural voice timbre. Barnard College Technical Report: Speech Perception Laboratory, (pp. 1-5). New York: Barnard College.
38. Remez, R. E., Fellowes, J. M., & Rubin, P. E. (1997). Talker identification based on phonetic information. Journal of Experimental Psychology: Human Perception and Performance, 23, 651-666.
39. Rhodes, G., Brake, S., & Atkinson, A. P. (1993). What's lost in inverted faces? Cognition, 47, 25-57.
40. Rock, I. (1974, January). The perception of disoriented figures. Scientific American, 230, 78-85.
41. Rock, I. (1988). On Thompson's inverted-face phenomenon. Perception, 17, 815-817.
42. Rosenblum, L. D., & Saldaña, H. M. (1992). Discrimination tests of visually-influenced syllables. Perception & Psychophysics, 52, 461-473.
43. Rosenblum, L. D., & Saldaña, H. M. (1996). An audiovisual test of kinematic primitives for visual speech perception. Journal of Experimental Psychology: Human Perception and Performance, 22, 318-331.
44. Rosenblum, L. D., & Saldaña, H. M. (1998). Time-varying information for visual speech perception. In R. Campbell, B. Dodd, & D. Bumham (Eds.), Hearing by eye: Part 2. The psychology of speechreading and audiovisual speech (pp. 61-81). Hillsdale, NJ: Erlbaum.
45. Saldaña, H. M., & Rosenblum, L. D. (1993). Visual influences on auditory pluck and bow judgments. Perception & Psychophysics, 54, 406-416.
46. Saldaña, H. M., & Rosenblum, L. D. (1994a). Selective adaptation in speech perception using a compelling audiovisual adaptor. Journal of the Acoustical Society of America, 95, 3658-3661.
47. Saldaña, H. M., & Rosenblum, L. D. (1994b, May). Poster presented at the meeting of the Acoustical Society of America, Cambridge, MA. (From Journal of the Acoustical Society of America, 95, 2870, Abstract No. 2p SP4).
48. Scapinello, K. F., & Yarmey, A. D. (1970). The role of familiarity and orientation in immediate and delayed recognition of pictorial stimuli. Psychonomic Science, 21, 329-331.
49. Schweinberger, S. R., & Soukup, G. R. (1998). Asymmetric relationships among perceptions of facial identity, emotion, and facial speech. Journal of Experimental Psychology: Human Perception and Performance, 24, 1748-1765.
50. Sergent, J. (1982). About face: Left-hemisphere involvement in processing physiognomies. Journal of Experimental Psychology: Human Perception and Performance, 8, 1-14.
51. Sergent, J. (1984). An investigation into component and configural processes underlying face perception. British Journal of Psychology, 75, 221-242.
52. Sheffert, S. M., & Fowler, C. A. (1995). The effects of voice and visible speaker change on memory for spoken words. Journal of Memory and Language, 34, 665-685.
53. Sjoberg, W., & Windes, J. D. (1992). Recognition times for rotated normal and "Thatcher" faces. Perceptual & Motor Skills, 75, 1176-1178.
54. Smeele, P. M. T., Massaro, D. W., Cohen, M. M., & Sittig, A. C. (1998). Laterality in visual speech perception. Journal of Experimental Psychology: Human Perception and Performance, 24, 1232-1242.
55. Summerfield, Q., MacLeod, P., McGrath, M., & Brooke, N. M. (1989). Lips, teeth, and the benefits of lipreading. In A. Young & H. Ellis (Eds.), Handbook of research on face processing (pp. 223-233). Amsterdam: Elsevier.
56. Summerfield, Q., & McGrath, M. (1984). Detection and resolution of audio-visual incompatibility in the perception of vowels. Quarterly Journal of Experimental Psychology: Human Experimental Psychology, 36A, 51-74.
57. Tanaka, J. W., & Farah, M. J. (1993). Parts and wholes in face recognition. Quarterly Journal of Experimental Psychology: Human Experimental Psychology, 46A, 225-245.
58. Thompson, P. (1980). Margaret Thatcher: A new illusion. Perception, 9, 483-484.
59. Valentine, T. (1988). Upside-down faces: A review of the effect of inversion upon face recognition. British Journal of Psychology, 79, 411-491.
60. Valentine, T., & Bruce, V. (1985). What's up? The Margaret Thatcher illusion revisited. Perception, 14, 515-516.
61. Valentine, T., & Bruce, V. (1988). Mental rotation of faces. Memory & Cognition, 16, 556-566.
62. Walker, S., Bruce, V., & O'Malley, C. (1995). Facial identity and facial speech processing: Familiar faces and voices in the McGurk effect. Perception & Psychophysics, 57, 1124-1133.
63. Yakel, D. A., Rosenblum, L. D., & Fourtier, M. A. (in press). Effects of talker variability on speechreading. Perception & Psychophysics
64. Yin, R. K. (1969). Looking at upside-down faces. Journal of Experimental Psychology, 81, 141-145.
65. Young, A. W. (1984). Right hemisphere superiority for recognizing the internal and external features of famous faces. British Journal of Psychology, 75, 161-169.
66. Young, A. W., Hay, D. C., McWeeny, K. H., Ellis, A. W., & Barry, C. (1985). Familiarity decisions for faces presented to the left and right cerebral hemispheres. Brain and Cognition, 4, 439-450.