Auditory-visual integration of talker gender in vowel perception

Journal of Phonetics

Volumn 27, Issue 4, 1999, Pages 359-384

  Johnson, Keith ^a   Strand, Elizabeth A ^a   D'Imperio, Mariapaola ^a  

^a OHIO STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0039596330     PISSN: 00954470     EISSN: None     Source Type: Journal    
DOI: 10.1006/jpho.1999.0100     Document Type: Article

References (92)

1. Ainsworth W. A. The influence of precursive sequences on the perception of synthesized vowels. Language and Speech. 17:1974;103-109.
2. Ainsworth W. A. Intrinsic and extrinsic factors in vowel judgments. Fant G., Tatham M. Auditory analysis and perception of speech. 1975;Academic Press, London.
3. Bahrick L. E., Netto D., Hernandez-Reif M. Intermodal perception of adult and child faces and voices by infants. Child Development. 69:1998;1263-1275.
4. Bergem D. R. van, Pols L. C. W., Koopmans-van Beinum F. J. Perceptual normalization of the vowels of a man and a child. Speech Communication. 7:1988;1-20.
5. Bladon A., Henton C., Pickering J. B. Towards an auditory theory of speaker normalization. Language Communication. 4:1984;59-69.
6. Braida L. D. Crossmodal integration in the identification of consonant segments. Quarterly Journal of Experimental Psychology: Human Experimental Psychology. 43:1991;647-677.
7. Chomsky N. Aspects of the Theory of Syntax. 1965;MIT Press, Cambridge.
8. Daly N., Bench J., Chappell H. Interpersonal impressions, gender stereotypes, and visual speech. Journal of Language and Social Psychology. 15:1996;468-479.
9. Dechovitz, D. 1977, Information conveyed by vowels: a confirmation, SR-5152, 213, 9.
10. Dekle D. J., Fowler C. A., Funnell M. G. Audiovisual integration in perception of real words. Perception & Psychophysics. 51:1992;355-362.
11. Diehl R. L., Lindblom B., Hoemeke K. A., Fahey R. P. On explaining certain male-female differences in the phonetic realization of vowel categories. Journal of Phonetics. 24:1996;187-208.
12. Dodd B. The role of vision in the perception of speech. Perception. 6:1977;31-40.
13. Erber N. P. Interaction of audition and vision in the recognition of oral speech stimuli. Journal of Speech and Hearing Research. 12:1969;423-425.
14. Erber N. P. Auditory, visual and auditory-visual recognition of consonants by children with normal and impaired hearing. Journal of Speech and Hearing Research. 15:1975;413-422.
15. Eskenazi M. Trends in speaking styles research. EuroSpeech93. 1993;. p. 501-9.
16. Estes W. K. Concepts, categories, and psychological science. Psychological Science. 4:1993;143-153.
17. Fant, G. 1975, Non-uniform vowel normalization, 2-3, 1, 19, Royal Institute of Technology, Stockholm.
18. Fant, G. Liljencrants, J. Lin, Q. 1985, A four-parameter model of glottal flow, 4, 1, 13, Royal Institute of Technology, Stockholm.
19. Firth J. R. The tongues of men. 1937,×1964;Oxford University Press, London.
20. Fowler C. A., Dekle D. J. Listening with eye and hand: cross-modal contributions to speech perception. Journal of Experimental Psychology: Human Perception and Performance. 17:1991;816-828.
21. Fujisaki H., Kawashima T. The roles of pitch and higher formants in the perception of vowels. IEEE Transactions on Audio and Electro-Acoustics. AU-16:1968;73-77.
22. Goldinger S. D. Echoes of echoes? An episodic theory of lexical access. Psychological Review. 105:1998;251-279.
23. Grant K. W., Braida L. D. Evaluating the articulation index for auditory-visual input. Journal of the Acoustical Society of America. 89:1991;2952-2960.
24. Grant K. W., Seitz P. F. Measures of auditory-visual integration in nonsense syllables and sentences. Journal of the Acoustical Society of America. 104:1998;2438-2450.
25. Grant K. W., Walden B. E., Seitz P. F. Auditory-visual speech recognition by hearing-impaired subjects: consonant recognition, sentence recognition, and auditory-visual integration. Journal of the Acoustical Society of America. 103:1998;2677-2690.
26. Green K. P., Gerdeman A. Cross-modal discrepancies in coarticulation and the integration of speech information: the McGurk effect with mismatched vowels. Journal of Experimental Psychology: Human Perception and Performance. 21:1995;1409-1426.
27. Green K. P., Kuhl P. K. The role of visual information in the processing of place and manner features in speech perception. Perception & Psychophysics. 45:1989;34-42.
28. Green K. P., Kuhl P. K. Integral processing of visual place and auditory voicing information during phonetic perception. Journal of Experimental Psychology: Human Perception and Performance. 17:1991;278-288.
29. Green K. P., Kuhl P. K., Meltzoff A. N., Stevens E. B. Integrating speech information across talkers, gender, and sensory modality: female faces and male voices in the McGurk effect. Perception & Psychophysics. 50:1991;524-536.
30. Green K. P., Tomiak G. R., Kuhl P. K. The encoding of rate and talker information during phonetic perception. Perception & Psychophysics. 59:1997;675-692.
31. Gussenhoven C., Rietveld T. On the speaker-dependence of the perceived prominence of F 0 peaks. Journal of Phonetics. 26:1998;371-380.
32. Hintzman D. L. "Schema abstraction" in a multiple-trace memory model. Psychological Review. 93:1986;411-428.
33. Holmes J. N. Normalization and vowel perception. Perkell J. S., Klatt D. H. Invariance and variability in speech processes. 1986;346-359 Lawrence Erlbaum Associates, Hillsdale.
34. Johnson K. The role of perceived speaker identity in F 0 normalization of vowels. Journal of the Acoustical Society of America. 88:1990a;642-654.
35. Johnson K. Contrast and normalization in vowel perception. Journal of Phonetics. 18:1990b;229-254.
36. Johnson K. Speech perception without speaker normalization: an exemplar model. Johnson K., Mullennix J. Talker variability in speech processing. 1997a;145-166 Academic Press, New York.
37. Johnson K. The auditory/perceptual basis for speech segmentation. OSU Working Papers in Linguistics. 50:1997b;101-113.
38. Joos M. Acoustic phonetics. Language. 24:1948;1-136.
39. Kuhl P. K., Meltzoff A. N. The intermodal representation of speech in infants. Infant Behavior and Development. 7:1984;361-381.
40. Kuhl P. K., Williams K. A., Meltzoff A. N. Cross-modal speech perception in adults and infants using non-speech auditory stimuli. Journal of Experimental Psychology: Human Perception and Performance. 17:1991;829-840.
41. Ladefoged P., Broadbent D. E. Information conveyed by vowels. Journal of the Acoustical Society. 29:1957;98-104.
42. Liberman A. M., Cooper F. S., Shankweiler D., Studdert-Kennedy M. Perception of the speech code. Psychological Review. 74:1967;431-461.
43. Lindblom B. Explaining phonetic variation: a sketch of H&H theory. Hardcastle W. J., Marchal A. Speech production and speech modeling. 1990;403-440 Kluwer Academic Publishers, Dordrecht.
44. Lisker L., Rossi M. Auditory and visual cueing of the [± rounded] feature of vowels. Language and Speech. 35:1992;391-417.
45. Massaro D. W., Cohen M. M. Perceiving speech from inverted faces. Perception & Psychophysics. 58:1996;1047-1065.
46. Massaro D. W., Cohen M. M. Speech perception in perceivers with hearing loss: synergy of multiple modalities. Journal of Speech, Language and Hearing Research. 42:1999;21-41.
47. Massaro D. W., Friedman D. Models of integration given multiple sources of information. Psychological Review. 97:1990;225-252.
48. MacDonald J., McGurk H. Visual influences on speech perception processes. Perception & Psychophysics. 24:1978;253-257.
49. McGurk H., MacDonald J. Hearing lips and seeing voices. Nature. 264:1976;746-748.
50. Miller J. D. Auditory-perceptual interpretation of the vowel. Journal of the Acoustical Society of America. 85:1989;2114-2134.
51. Miller R. L. Auditory tests with synthetic vowels. Journal of the Acoustical Society of America. 25:1953;114-121.
52. Mullennix J. W., Pisoni D. B. Stimulus variability and processing dependencies in speech perception. Perception & Psychophysics. 47:1990;379-390.
53. Munhall K. G., Gribble P., Sacco L., Ward M. Temporal constraints on the McGurk effect. Perception & Psychophysics. 58:1996;351-362.
54. Nearey T. M. Phonetic feature systems for vowels. 1978;IU Linguistics Club, Bloomington.
55. Nearey T. M. Static, dynamic, and relational properties in vowel perception. Journal of the Acoustical Society of America. 85:1989;2088-2113.
56. Ni Chasaide A., Gobl C. Voice source variation. Hardcastle W. J., Laver J. The handbook of phonetic sciences. 1997;427-461 Blackwell Publishers, Oxford.
57. Nordström P.-E., Lindblom B. A normalization procedure for vowel formant data. Proceedings of the 8th International Congress of Phonetic Sciences. 1975.
58. Nosofsky R. M. Choice, similarity, and the context theory of classification. Journal of Experimental Psychology: Learning, Memory, and Cognition. 10:1984;104-114.
59. Nosofsky R. M. Attention, similarity, and the identification-categorization relationship. Journal of Experimental Psychology: General. 115:1986;39-57.
60. Nygaard L. C., Sommers M. S., Pisoni D. B. Speech perception as a talker-contingent process. Psychological Science. 5:1994;42-45.
61. Palmeri T. J., Goldinger S. D., Pisoni D. B. Episodic encoding of voice attributes and recognition memory for spoken words. Journal of Experimental Psychology: Learning, Memory, and Cognition. 19:1993;309-328.
62. Perkell J., Klatt D. Invariance and variability of speech processes. 1986;Lawrence Erlbaum, Hillsdale.
63. Pisoni D. B. Long-term memory in speech perception: Some new findings on talker variability, speaking rate and perceptual learning. Speech Communication. 13:1993;109-125.
64. Potter R., Steinberg J. Toward the specification of speech. Journal of the Acoustical Society of America. 22:1950;807-820.
65. Qi Y. Replacing tracheoesophageal voicing sources using LPC synthesis. Journal of the Acoustical Society of America. 88:1990;1228-1235.
66. Reber A. S. Implicit learning and tacit knowledge: an essay on the cognitive unconscious. 1993;Oxford University Press, Oxford.
67. Rosenblum L. D., Johnson J. A., Saldana H. M. Point-light facial displays enhance comprehension of speech in noise. Journal of Speech and Hearing Research. 39:1996;1159-1170.
68. Rosenblum L. D., Schmuckler M. A., Johnson J. A. The McGurk effect in infants. Perception & Psychophysics. S9:1997;347-357.
69. Sams M., Manninen P., Surakka V., Helin P., Katto R. McGurk effect in Finnish syllables, isolated words, and words in sentences: effects of word meaning and sentence context. Speech Communication. 26:1998;75-87.
70. Schacter D. L. Implicit memory: History and current status. Journal of Experimental Psychology: Learning, Memory, and Cognition. 13:1987;501-518.
71. Schacter D. L., Eich J., Tulving E. Richard Semon's theory of memory. Journal of Verbal Learning and Verbal Behavior. 17:1978;721-743.
72. Schwippert C., Benoit C. Audiovisual intelligibility of an androgynous speaker. Benoit C., Campbell R. Proceedings of the ESCA workshop on audio-visual speech processing (AVSP'97) cognitive and computational approaches. 1997;81-84.
73. Sekiyama K. Cultural and linguistic factors in audiovisual speech processing: the McGurk effect in Chinese subjects. Perception & Psychophysics. 59:1997;73-80.
74. Sekiyama K. Face or voice? Determinant of compellingness to the McGurk effect. Audio-Visual Speech Processing (AVSP'98). 1998.
75. Sekiyama K., Tohkura Y. Inter-language differences in the influence of visual cues in speech perception. Journal of Phonetics. 21:1993;427-444.
76. Semon R. Duffy B. Minemic psychology. 1923;Allen & Unwin, London.
77. Sheffert S. M., Fowler C. A. The effects of voice and visible speaker change on memory for spoken words. Journal of Memory and Language. 34:1995;665-685.
78. Slawson A. W. Vowel quality and musical timbre as functions of spectrum envelope and fundamental frequency. Journal of the Acoustical Society of America. 43:1968;87-101.
79. Stevens K. N., Blumstein S. E. Invariant cues for place of articulation in stop consonants. Journal of the Acoustical Society of America. 64:1978;1358-1368.
80. Strand E. A., Johnson K. Gradient and visual speaker normalization in the perception of fricatives. Gibbon D. Natural language processing and speech technology: results of the 3rd KONVENS conference. 1996;14-26 Mouton de Gruyter, Berlin.
81. Sumby W. H., Pollack I. Visual contribution to speech intelligibility in noise. Journal of the Acoustical Society of America. 26:1954;212-215.
82. Summerfield Q. Use of visual information for phonetic perception. Phonetica. 36:1979;314-331.
83. Summerfield Q., McGrath M. Detection and resolution of audio-visual incompatibility in the perception of vowels. Quarterly Journal of Experimental Psychology: Human Experimental Psychology. 36A:1984;51-74.
84. Sussman H. M. A neuronal model of vowel normalization and representation. Brain and Language. 28:1986;12-23.
85. Syrdal A., Gopal H. A perceptual model of vowel recognition based on the auditory representation of American English vowels. Journal of the Acoustical Society of America. 79:1984;1086-1100.
86. Tillberg I., Roennberg J., Svaerd I., Ahlner B. Audio-visual speechreading in a group of hearing aid users: The effects of onset age, handicap age, and degree of hearing loss. Scandinavian Audiology. 25:1996;267-272.
87. Traunmüller H. Perceptual dimension of openness in vowels. Journal of the Acoustical Society of America. 69:1981;1465-1475.
88. Walden B. E., Busacco D. A., Montgomery A. A. Benefit from visual cues in auditory-visual speech recognition by middle-aged and elderly persons. Journal of Speech and Hearing Research. 36:1993;431-436.
89. Walden B. E., Montgomery A. A., Prosek R. A., Hawkins D. B. Visual biasing of normal and impaired auditory speech perception. Journal of Speech and Hearing Research. 33:1990;163-173.
90. Walker S., Bruce V., O'Malley C. Facial identity and facial speech processing: Familiar faces and voices in the McGurk effect. Perception & Psychophysics. S9:1995;1124-1133.
91. Watkins A. J. Central, auditory mechanisms of perceptual compensation for spectral-envelope distortion. Journal of the Acoustical Society of America. 90:1991;2942-2955.
92. Watkins A. J., Makin S. J. Perceptual compensation for speaker differences and for spectral-envelope distortion. Journal of the Acoustical Society of America. 96:1994;1263-1282.