Contributions of temporal encodings of voicing, voicelessness, fundamental frequency, and amplitude variation to audiovisual and auditory speech perception

Journal of the Acoustical Society of America

Volumn 106, Issue 4 I, 1999, Pages 2063-2073

  Faulkner, Andrew ^a   Rosen, Stuart ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; AUDITORY STIMULATION; CONSONANT; HUMAN; HUMAN EXPERIMENT; NORMAL HUMAN; PRIORITY JOURNAL; SPEECH PERCEPTION; VOICE;

ACOUSTIC STIMULATION; ADOLESCENT; ADULT; CUES; FEMALE; HUMANS; PHONETICS; SPEECH; SPEECH ACOUSTICS; SPEECH PERCEPTION; TIME FACTORS; VISUAL PERCEPTION; VOICE;

EID: 0032876794     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.427951     Document Type: Article

References (32)

1. Baer, T., and Moore, B. C. J. (1993). "Effects of spectral smearing on the intelligibility of sentences in noise," J. Acoust. Soc. Am. 94, 1229-1241.
2. Baker, R., and Rosen, S. (1994). "Temporal information in consonant identification," Speech Hearing and Language; Work in Progress, Dept. Phonetics and Linguistics, University College London, 7, 3-29.
3. Bamford, J., and Wilson, I. (1979). "Methodological considerations and practical aspects of the BKB sentence lists," in Speech-Hearing Tests and the Spoken Language of Hearing-Impaired Children, edited by J. Bench and J. Bamford (Academic, London), pp. 147-187.
4. Breeuwer, M., and Plomp, R. (1986). "Speech reading supplemented with auditorily presented speech parameters," J. Acoust. Soc. Am. 79, 481-499.
5. Drullman, R., and Smoorenburg, G. F. (1997). "Auditory-visual perception of compressed speech by profoundly hearing impaired subjects," Audiology 36, 165-177.
6. Fant, G. (1973). Speech Sounds and Features (MIT Press, Cambridge, MA).
7. Faulkner, A., Rosen, S., and Moore, B. C. J. (1990). "Residual frequency selectivity in the profoundly hearing impaired listener," Br. J. Audiol. 24, 381-392.
8. Faulkner, A., Ball, V., Rosen, S., Moore, B. C. J., and Fourcin, A. J. (1992). "Speech pattern hearing aids for the profoundly hearing-impaired: Speech perception and auditory abilities," J. Acoust. Soc. Am. 91, 2136-2155.
9. Foster, J. R., Summerfield, A. Q., Marshall, D. H., Palmer, L., Ball, V., and Rosen, S. (1993). "Lip-reading the BKB sentence lists; corrections for list and practice effects," Br. J. Audiol. 27, 233-246.
10. Fourcin, A. J. (1977). "English speech patterns with special reference to artificial auditory stimulation," in A Review of Artificial Auditory Stimulation: Medical Research Council Working Group Report, edited by A. R. Thornton (Institute of Sound and Vibration Research, University of Southampton), pp. 42-44.
11. Fourcin, A. (1990). "Prospects for Speech Pattern Element Aids," Acta Oto-Laryngol. Suppl. 469, 257-267.
12. Grant, K. W., Ardell, L. H., Kuhl, P. K., and Sparks, D. W. (1985). "The contribution of fundamental frequency, amplitude envelope and voicing duration cues to speechreading in normal-hearing subjects," J. Acoust. Soc. Am. 77, 671-677.
13. Grant, K. W., Braida, L. D., and Renn, R. J. (1991). "Single-band amplitude envelope cues as an aid to speechreading," Q. J. Exp. Psychol. 43A, 647-678.
14. Lisker, L., and Abramson, A. S. (1970). "The voicing dimension: some experiments in comparative phonetics," in Proceedings of the Sixth International Congress of Phonetic Sciences, Prague, 1967 (Academia, Prague), pp. 563-567.
15. Miller, G. A., and Nicely, P. E. (1955). "An analysis of perceptual confusions among some English consonants," J. Acoust. Soc. Am. 27, 338-352.
16. Moore, B. C. J. (1996). "Perceptual consequences of cochlear hearing loss and their implications for the design of hearing aids," Ear Hear. 17, 133-161.
17. Rabinowitz, W. M., Eddington, D. K., Delhome, L. A., and Cuneo, P. A. (1992). "Relations among different measures of speech reception in subjects using a cochlear implant," J. Acoust. Soc. Am. 92, 1869-1881.
18. Remez, R. E., and Rubin, P. E. (1990). "On the perception of speech from time-varying acoustic information: Contributions of amplitude variation," Percept. Psychophys. 48, 313-325.
19. Risberg, A., and Lubker, J. L. (1978). "Prosody and speechreading," Report of STL-QPSR, Dept. of Linguistics, University of Stockholm, Stockholm, Sweden, 4, 1-16.
20. Rosen, S., Fourcin, A. J., and Moore, B. C. J. (1981). "Voice pitch as an aid to lipreading," Nature (London) 291, 150-152.
21. Rosen, S., Faulkner, A., and Smith, D. A. J. (1990). "The psychoacoustics of profound hearing impairment," Acta Oto-Laryngol. Suppl. 469, 16-22.
22. Rosen, S. (1992). "Temporal information in speech: Acoustic, auditory and linguistic aspects," Philos. Trans. R. Soc. London, Ser. B 367-373.
23. Shannon, R. V. (1993). "Psychophysics," in Cochlear Implants: Radiological Foundations, edited by R. S. Tyler (Singular Publishing, San Diego), pp. 357-388.
24. Shannon, R. V., Zeng, F.-G., Kamath, V., Wygonski, J., and Ekelid, M. (1995). "Speech recognition with primarily temporal cues," Science 270, 303-304.
25. Shinn, P., and Blumstein, S. E. (1984). "On the role of amplitude envelope for the perception of [b] and [w]," J. Acoust. Soc. Am. 75, 1243-1252.
26. Souza, P. E., and Turner, C. W. (1996). "Effect of single-channel compression on temporal speech information," J. Speech Hear. Res. 39, 901-911.
27. Studebaker, G. A., Pavlovic, C. V., and Sherbecoe, R. L. (1987). "A frequency importance function for continuous discourse," J. Acoust. Soc. Am. 81, 1130-1138.
28. Summerfield, A. Q. (1987). "Some preliminaries to a comprehensive account of audio-visual speech perception," in Hearing by Eye: The Psychology of Lipreading, edited by B. Dodd and R. Campbell (Lawrence Earlbaum Associates, Hove, U.K.), pp. 3-51.
29. Van Tasell, D. J., Soli, S. D., Kirby, V. M., and Widin, G. (1987). "Speech waveform envelope cues for consonant recognition," J. Acoust. Soc. Am. 82, 1152-1181.
30. Van Tasell, D. J., Greenfield, D. G., Logemann, J. J., and Nelson, D. A. (1992). "Temporal cues for consonant recognition: Training, talker generalization, and use in the evaluation of cochlear implants," J. Acoust. Soc. Am. 92, 1247-1257.
31. Van Tasell, D. J., and Trine, T. D. (1996). "Effects of single-band syllabic amplitude compression on temporal speech information in nonsense syllables and in sentences," J. Speech Hear. Res. 39, 912-922.
32. Waldstein, R. S., and Boothroyd, A. (1994). "Speechreading enhancement using a sinusoidal substitute for voice fundamental frequency," Speech Commun. 14, 303-312.