The role of vowel and consonant fundamental frequency, envelope, and temporal fine structure cues to the intelligibility of words and sentences

Journal of the Acoustical Society of America

Volumn 131, Issue 2, 2012, Pages 1490-1501

  Fogerty, Daniel ^a,b   Humes, Larry E ^a  

^a INDIANA UNIVERSITY   (United States)

^b UNIVERSITY OF SOUTH CAROLINA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DYNAMIC CUES; FUNDAMENTAL FREQUENCIES; ISOLATED WORDS; MONOSYLLABIC WORDS; NATURAL VARIATION; NOISY SIGNALS; PROCESSING CONDITION; SENTENCE INTELLIGIBILITY; SPEECH INFORMATION; SPEECH SIGNALS; SPOKEN WORDS; TEMPORAL FINE STRUCTURE;

ACOUSTIC PROPERTIES; NATURAL FREQUENCIES; SIGNAL PROCESSING; SPEECH PROCESSING;

LINGUISTICS;

ANALYSIS OF VARIANCE; ARTICLE; ASSOCIATION; CLINICAL TRIAL; COMPREHENSION; CONTROLLED CLINICAL TRIAL; CONTROLLED STUDY; FEMALE; HUMAN; MALE; METHODOLOGY; NOISE; PERCEPTION; PHONETICS; PHYSIOLOGY; RANDOMIZED CONTROLLED TRIAL; SPEECH; SPEECH AUDIOMETRY; SPEECH INTELLIGIBILITY;

ANALYSIS OF VARIANCE; COMPREHENSION; CUES; FEMALE; HUMANS; MALE; NOISE; PERCEPTUAL MASKING; PHONETICS; SPEECH ACOUSTICS; SPEECH DISCRIMINATION TESTS; SPEECH INTELLIGIBILITY;

EID: 84857394300     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.3676696     Document Type: Article

References (76)

1. ANSI (2004). ANSI S3.6-2004, American National Standard Specification for Audiometers (American National Standards Institute, New York).
2. Apoux, F., and Bacon, S. P. (2004). Relative importance of temporal information in various frequency regions for consonant identification in quiet and in noise., J. Acoust. Soc. Am. 116, 1671-1680. 10.1121/1.1781329
3. Bregman, A. S., Liao, C., and Levitan, R. (1990). Auditory grouping based on fundamental frequency and formant peak frequency., Can. J. Psych. 44, 400-413. 10.1037/h0084255
4. Carreiras, M., and Price, C. (2008). Brain activation for consonants and vowels., Cerebral Cortex 18, 1727-1735. 10.1093/cercor/bhm202
5. Carreiras, M., Gillon-Dowens, M., Vergara, M., and Perea, M. (2009). Are vowels and consonants processed differently? Event-related potential evidence with a delayed letter paradigm., J. Cogn. Neurosci. 21, 275-288. 10.1162/jocn.2008.21023
6. Cole, R., Yan, Y., Mak, B., Fanty, M., and Bailey, T. (1996). The contribution of consonants versus vowels to word recognition in fluent speech., Proceedings of the ICASSP'96, pp. 853-856.
7. Coleman, J. (2003). Discovering the acoustic correlated or phonological contrasts., J. Phonetics 31, 351-372. 10.1016/j.wocn.2003.10.001
8. Cooke, M. (2003). Glimpsing speech., J. Phonetics 31, 579-584. 10.1016/S0095-4470(03)00013-5
9. Crouzet, O., and Ainsworth, W. A. (2001). Envelope information in speech processing: Acoustic- phonetic analysis vs. auditory figure-ground segregation., EUROSPEECH-2001, pp. 477-480.
10. Darwin, C. J., Brungart, D. S., and Simpson, B. D. (2003). Effects of fundamental frequency and vocal-tract length changes on attention to one of two simultaneous talkers., J. Acoust. Soc. Am. 114, 2913-2922. 10.1121/1.1616924
11. Dirks, D. D., Takayanagi, S., and Moshfegh, A. (2001). Effects of lexical factors on word recognition among normal-hearing and hearing-impaired listeners., J. Am. Acad. Audiol. 12, 233-244.
12. Dorman, M. F., Loizou, P. C., and Rainey, D. (1997). Speech intelligibility as a function of the number of channels of stimulation for signal processors using sine-wave and noise-band outputs., J. Acoust. Soc. Am. 102, 2403-2411. 10.1121/1.419603
13. Dreschler, W. A. (1989). Phoneme perception via hearing aids with and without compression and the role of temporal resolution., Audiol. 28, 49-60. 10.3109/00206098909081610
14. Ernestus, M., Baayen, H., and Schreuder, R. (2002). The recognition of reduced word forms., Brain Lang. 81, 162-173. 10.1006/brln.2001.2514
15. Faulkner, A., Rosen, S., and Smith, C. (2000). Effects of the salience of pitch and periodicity information on the intelligibility of four-channel vocoded speech: Implications for cochlear implants., J. Acoust. Soc. Am. 108, 1877-1887. 10.1121/1.1310667
16. Fogerty, D. (2011). Perceptual weighting of individual and concurrent cues for sentence intelligibility: Frequency, envelope, and fine structure., J. Acoust. Soc. Am. 129, 977-988. 10.1121/1.3531954
17. Fogerty, D., and Humes, L. E. (2010). Perceptual contributions to monosyllabic word intelligibility: Segmental, lexical, and noise replacement factors., J. Acoust. Soc. Am. 128, 3114-3125. 10.1121/1.3493439
18. Fogerty, D., and Kewley-Port, D. (2009). Perceptual contributions of the consonant-vowel boundary to sentence intelligibility., J. Acoust. Soc. Am. 126, 847-857. 10.1121/1.3159302
19. Fujimura, O., and Lindqvist, J. (1971). Sweep-tone measurements of vocal-tract characteristics., J. Acoust. Soc. Am. 49, 541-558. 10.1121/1.1912385
20. Gallun, F., and Souza, P. (2008). Exploring the role of the modulation spectrum in phoneme recognition., Ear Hear. 29, 800-813. 10.1097/AUD. 0b013e31817e73ef
21. Garofolo, J., Lamel, L., Fisher, W., Fiscus, J., Pallett, D., and Dahlgren, N. (1990). DARPA TIMIT Acoustic-Phonetic Continuous Speech Corpus CD-ROM., National Institute of Standards and Technology. NTIS Order No. PB91-505065.
22. Gay, T. (1978). Effect of speaking rate on vowel formant movements., J. Acoust. Soc. Am. 63, 223-230. 10.1121/1.381717
23. Greenberg, S., Arai, T., and Silipo, R. (1998). Speech intelligibility derived from exceedingly sparse spectral information., Proceedings of the International Conference on Spoken Language Processing, Sydney, Australia, 2803-2806.
24. Hawkins, S. (2003). Roles and representations of systematic fine phonetic detail in speech understanding., J Phonetics 31, 373-405. 10.1016/j.wocn.2003. 09.006
25. Hillenbrand, J. M., and Nearey, T. M. (1999). Identification of resynthesized/hVd/utterances: Effects of formant contour., J. Acoust. Soc. Am. 105, 3509-3523. 10.1121/1.424676
26. Janse, E. (2004). Word perception in fast speech: Artificially time-compressed vs. naturally produced speech., Speech Commun. 42, 155-173. 10.1016/j.specom.2003.07.001
27. Janse, E., and Ernestus, M. (2011). The roles of bottom-up and top-down information in the recognition of reduced speech: Evidence from listeners with normal and impaired hearing., J. Phonetics 39, 330-343. 10.1016/j.wocn.2011.03. 005
28. Jenstad, L. M., and Souza, P. E. (2007). Temporal envelope changes of compression and speech rate: Combined effects on recognition for older adults., J. Speech Lang. Hear. Res. 50, 1123-1138. 10.1044/1092-4388(2007/078)
29. Kawahara, H., Masuda-Kastuse, I., and Cheveigne, A. (1999). Restructuring speech representations using a pitch adaptive time-frequency smoothing and an instantaneous- frequency-based F0 extraction: Possible role of a repetitive structure in sounds., Speech Commun. 27, 187-207. 10.1016/S0167-6393(98)00085-5
30. Kent, R. D., and Minifie, F. D. (1977). Coarticulation in recent speech production models., J. Phonetics 5, 115-117.
31. Kewley-Port, D., Burkle, Z., and Lee, J. (2007). Contribution of consonant versus vowel information to sentence intelligibility for young normal-hearing and elderly hearing-impaired listeners., J. Acoustic. Soc. Am. 122, 2365-2375. 10.1121/1.2773986
32. Ladefoged, P. (2001). Vowels and Consonants: An Introduction to the Sounds of Languages (Blackwell, Oxford), pp. 1-191.
33. Ladefoged, P., and Broadbent, D. E. (1957). Information conveyed by vowels., J. Acoust. Soc. Am. 29, 98-104. 10.1121/1.1908694
34. Laures, J., and Weismer, G. (1999). The effect of flattened F0 on intelligibility at the sentence- level., J. Speech Lang. Hear. Res. 42, 1148-1156.
35. Lehiste, I. (1970). Suprasegmentals (MIT Press, Cambridge, MA), pp. 1-194.
36. Leiberman, P. (1963). Some effects of semantic and grammatical context on the production and perception of speech., Lang. Speech 6, 172-187.
37. Liberman, A. M., Cooper, F. S., Shankweiler, D. P., and Studdert-Kennedy, M. (1967). Perception of the speech code., Psychol. Rev. 74, 431-461. 10.1037/h0020279
38. Lindblom, B. (1963). Spectrographic study of vowel reduction., J. Acoust. Soc. Am. 35, 1773-1781. 10.1121/1.1918816
39. Local, J. (2003). Variable domains and variance relevance: Interpreting phonetic exponents., J Phonetics 31, 321-339. 10.1016/S0095-4470(03)00045-7
40. Lorenzi, C., Gilbert, G., Carn, H., Garnier, S., and Moore, B. C. J. (2006). Speech perception problems of the hearing impaired reflect inability to use temporal fine structure., Proc. Natl. Acad. Sci. 103, 18866-18869. 10.1073/pnas.0607364103
41. Luce, P. A., and Pisoni, D. B. (1998). Recognizing spoken words: The Neighborhood Activation Model., Ear Hear. 19, 1-36.
42. Max, L., and Caruso, A. J. (1997). Acoustic measures of temporal intervals across speaking rates: Variability of syllable- and phrase-level relative timing., J. Speech Hear. Res. 40, 1097-1110.
43. Miller, M. A., Heise, G. A., and Lichten, W. (1951). The intelligibility of speech as a function of the context of the test materials., J. Exp. Psych. 41, 329-335. 10.1037/h0062491
44. Moore, B. C. J. (2004). An Introduction to the Psychology of Hearing, 5th Ed. (Elsevier, London), pp. 1-200.
45. Nearey, T. M., and Assmann, P. (1986). Modeling the role of vowel inherent spectral change in vowel identification., J. Acoust. Soc. Am. 80, 1297-1308. 10.1121/1.394433
46. Nelson, P. B., and Jin, S -H. (2004). Factors affecting speech understanding in gated interference: Cochlear implant users and normal-hearing listeners., J. Acoust. Soc. Am. 115, 2286-2294. 10.1121/1.1703538
47. Nelson, P. B., Jin, S -H., Carney, A. E., and Nelson, D. A. (2003). Understanding speech in modulated interference: Cochlear implant users and normal-hearing listeners., J. Acoust. Soc. Am. 113, 961-968. 10.1121/1.1531983
48. Nespor, M., Pea, M., and Mehler, J. (2003). On the different roles of vowels and consonants in speech processing and language acquisition., Lingue Linguaggio 2, 201-227.
49. New, B., Arajo, V., and Nazzi, T. (2008). Differential processing of vowels and consonants in lexical access through reading., Psych. Sci. 19, 1223-1227. 10.1111/j.1467-9280.2008.02228.x
50. Owren, M. J., and Cardillo, G. C. (2006). The relative roles of vowels and consonants in discriminating talker identity versus word meaning., J. Acoust. Soc. Am. 119, 1727-1739. 10.1121/1.2161431
51. Pickett, J. M., and Pollack, I. (1963). Intelligibility of excerpts from fluent speech: Effects of rate of utterance and duration of excerpt., Lang. Speech 3, 151-164.
52. Plack, C. J., and Oxenham, A. J. (2005). The psychophysics of pitch., in Pitch: Neural Coding and Perception, edited by, C. J. Plack, A. J. Oxenham, A. N. Popper, and, R. Fay, (Springer, New York), pp. 7-55.
53. Plomp, R. (1988). The negative effect of amplitude compression in multichannel hearing aids in the light of the modulation-transfer function., J. Acoust. Soc. Am. 83, 2322-2327. 10.1121/1.396363
54. Port, R. F. (1981). Linguistic timing factors in combination., J. Acoust. Soc. Am. 69, 262-274. 10.1121/1.385347
55. Port, R. F. (2003). Meter and speech., J. Phonetics 31, 599-611. 10.1016/j.wocn.2003.08.001
56. Ramus, F., Nespor, M., and Mehler, J. (1999). Correlates of linguistic rhythm in the speech signal., Cognition 75, AD3-AD30.
57. Rosen, S. (1992). Temporal information in speech: Acoustic, auditory, and linguistic aspects., Philos. Trans. R. Soc. B. 336, 367-373. 10.1098/rstb.1992.0070
58. Shannon, R. V., Zeng, F -G., Kamath, V., Wygonski, J., and Ekelid, M. (1995). Speech recognition with primarily temporal cues., Science 270, 303-304. 10.1126/science.270.5234.303
59. Shattuck-Hufnagel, S., and Turk, A. E. (1996). A prosody tutorial for investigators of auditory sentence processing., J. Psycholing. Res. 25, 193-247. 10.1007/BF01708572
60. Smith, Z. M., Delgutte, A. J., and Oxenham, A. J. (2002). Chimaeric sounds reveal dichotomies in auditory perception., Nature 416, 87-90. 10.1038/416087a
61. Souza, P. E., and Kitch, V. (2001). The contribution of amplitude envelope cues to sentence identification in young and aged listeners., Ear Hear. 22, 112-119. 10.1097/00003446-200104000-00004
62. Steeneken, H. J. M., and Houtgast, T. (1999). Mutual dependence of the octave-band weights in predicting speech intelligibility., Speech Commun. 28, 109-123. 10.1016/S0167-6393(99)00007-2
63. Stevens, K. N. (2002). Toward a model for lexical access based on acoustic landmarks and distinctive features., J. Acoust. Soc. Am. 111, 1872-1891. 10.1121/1.1458026
64. Stilp, C. E., and Kluender, K. R. (2010). Cochlea-scaled spectral entropy, not consonants, vowels, or time, best predicts speech intelligibility., Proc. Natl. Acad. Sci. 107, 12387-12392. 10.1073/pnas.0913625107
65. Strange, W., Jenkins, J. J., and Johnson, T. L. (1983). Dynamic specification of coarticulated vowels., J. Acoust. Soc. Am. 74, 695-705. 10.1121/1.389855
66. Studebaker, G. (1985). A rationalized arcsine transform., J. Speech Hear. Res. 28, 455-462.
67. Tajima, K., and Port, R. F. (2003). Speech rhythm in English and Japanese., in Phonetic Interpretation: Papers in Laboratory Phonology VI, edited by, J. Local, R. Ogden, and, R. Temple, (Cambridge University Press, Cambridge, UK), pp. 317-334.
68. Takayanagi, S., Dirks, D., and Moshfegh, A. (2002). Lexical and talker effects on word recognition among native and non-native listeners with normal and impaired hearing., J. Am. Acad. Aud. 16, 494-504.
69. Toro, J. M., Nespor, M., Mehler, J., and Bonatti, L. L. (2008). Finding words and rules in a speech stream: Functional differences between vowels and consonants., Psychol. Sci. 19, 137-144. 10.1111/j.1467-9280.2008.02059.x
70. Van Tasell, D. J., and Trine, T. D. (1996). Effects of single-band syllabic amplitude compression on temporal speech information in nonsense syllables and in sentences., J. Speech Hear. Res. 39, 912-922.
71. Waibel, A. (1987). Prosodic knowledge sources for word hypothesization in a continuous speech recognition system. Acoustics, Speech, and Signal Processing, IEEE International Conference on ICASSP'87, pp. 856-859.
72. Watson, P. J., and Schlauch, R. S. (2008). The effect of fundamental frequency on the intelligibility of speech with flattened intonation contours., Am J Speech Lang Pathol. 17, 348-355. 10.1044/1058-0360(2008/07-0048)
73. Wingfield, A., Lahar, C. J., and Stine, E. A. L. (1989). Age and decision strategies in running memory for speech: Effects of prosody and linguistic structure., J. Gerontol: Psychol. Sci. 44, 106-113.
74. Wingfield, A., Lombardi, L., and Sokol, S. (1984). Prosodic features and the intelligibility of accelerated speech: Syntactic versus periodic segmentation., J. Speech Hear. Res. 27, 128-134.
75. Xu, L., Thompson, C. S., and Pfingst, B. E. (2005). Relative contributions of spectral and temporal cues for phoneme recognition., J. Acoust. Soc. Am. 117, 3255-3267. 10.1121/1.1886405
76. Zue, V. W., and Seneff, S. (1988). Transcription and alignment of the TIMIT database., Proceedings of the Second Meeting on Advanced Man-Machine Interface through Spoken Language, 11.1-11.10.