Speech identification based on temporal fine structure cues

Journal of the Acoustical Society of America

Volumn 124, Issue 1, 2008, Pages 562-575

  Sheft, Stanley ^a   Ardoint, Marine ^b,c   Lorenzi, Christian ^b,c  

^a LOYOLA UNIVERSITY CHICAGO   (United States)

^b UNIVERSITÉ PARIS DESCARTES   (France)

^c GDR CNRS 2967 GRAEC

Author keywords

[No Author keywords available]

Indexed keywords

AUDITION; CIVIL AVIATION; MODULATION; PERMANENT MAGNETS; POWDER METALLURGY; REPAIR; RESTORATION; SPEECH PROCESSING; WAVE FILTERS;

ACOUSTICAL SOCIETY OF AMERICA (ASA); ANALYTIC SIGNALS; AUDITORY FILTERING; CARRIER (CO); CARRIER SIGNALS; CENTER FREQUENCY (CF); CONSONANT IDENTIFICATION; EXPERIMENTAL CONDITIONS; FILTER BANDWIDTHS; MODULATION FUNCTIONS; NORMAL-HEARING (NH) LISTENERS; PERIPHERAL (SPI); PHONETIC INFORMATION; SPEECH IDENTIFICATION; TEMPORAL FINE STRUCTURE;

SPEECH;

ADULT; ANALYSIS; ARTICLE; ASSOCIATION; AUDITORY SYSTEM; COMPARATIVE STUDY; CONFUSION; CONSONANT; CONTROLLED STUDY; FEMALE; HEARING; HUMAN; HUMAN EXPERIMENT; INFORMATION; MODULATION; PHONETICS; PRIORITY JOURNAL; SPEECH; SPEECH ARTICULATION; STIMULUS; TEMPORAL FINE STRUCTURE CUE; VOWEL;

ADULT; CUES; FEMALE; HUMANS; PHONETICS; SPEECH PERCEPTION;

EID: 47649118793     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.2918540     Document Type: Article

References (51)

1. Bernstein, J. G. W., and Oxenham, A. J. (2006). " The relationship between frequency selectivity and pitch discrimination: Effects of stimulus level.," J. Acoust. Soc. Am. 120, 3916-3928.
2. Crouzet, O., and Ainsworth, W. A. (2001). " On the various influences of envelope information on the perception of speech in adverse conditions: An analysis of between-channel envelope correlation.," in Workshop on Consistent and Reliable Cues for Sound Analysis (Aalborg, Denmark).
3. de Cheveigń, A., and Kawahara, H. (2002). " YIN, a fundamental frequency estimator for speech and music.," J. Acoust. Soc. Am. 111, 1917-1930.
4. Drennan, W. R., Won, J. H., Dasika, V. K., and Rubenstein, J. T. (2007). " Effects of temporal fine structure on the lateralization of speech and on speech understanding in noise.," J. Assoc. Res. Otolaryngol. 8, 373-383.
5. Drullman, R. (1995). " Temporal envelope and fine structure cues for speech intelligibility.," J. Acoust. Soc. Am. 97, 585-592.
6. Flanagan, J. L. (1980). " Parametric coding of speech spectra.," J. Acoust. Soc. Am. 68, 412-419.
7. Flanagan, J. L., and Golden, R. M. (1966). " Phase vocoder.," Bell Syst. Tech. J. 45, 1493-1509.
8. French, N. R., and Steinberg, J. C. (1947). " Factors governing the intelligibility of speech sounds.," J. Acoust. Soc. Am. 19, 90-119.
9. Füllgrabe, C., Berthommier, F., and Lorenzi, C. (2006). " Masking release for consonant features in temporally fluctuating background noise.," Hear. Res. 211, 74-84.
10. Ghitza, O. (2001). " On the upper cutoff frequency of the auditory critical-band envelope detectors in the context of speech perception.," J. Acoust. Soc. Am. 110, 1628-1640.
11. Gilbert, G., and Lorenzi, C. (2006). " The ability of listeners to use recovered envelope cues from speech fine structure.," J. Acoust. Soc. Am. 119, 2438-2444.
12. Gilbert, G., Bergeras, I., Voillery, D., and Lorenzi, C. (2007). " Effects of periodic interruptions on the intelligibility of speech based on temporal fine-structure or envelope cues.," J. Acoust. Soc. Am. 122, 1336-1339.
13. Glasberg, B. R., and Moore, B. C. J. (1990). " Derivation of auditory filter shapes from notched-noise data.," Hear. Res. 47, 103-138.
14. Glasberg, B. R., and Moore, B. C. J. (2000). " Frequency selectivity as a function of level and frequency measured with uniformly exciting notched noise.," J. Acoust. Soc. Am. 108, 2318-2328.
15. Hicks, M. L., and Bacon, S. P. (1999). " Psychophysical measures of auditory nonlinearities as a function of frequency in individuals with normal hearing.," J. Acoust. Soc. Am. 105, 326-338.
16. Humes, L. E., Dirks, D. D., Bell, T. S., Ahlstrom, C., and Kincaid, G. E. (1986). " Application of the articulation index and the speech transmission index to the recognition of speech by normal-hearing and hearing-impaired listeners.," J. Speech Hear. Res. 29, 447-462.
17. Irino, T., and Patterson, R. D. (1997). " A time domain, level dependent auditory filter: The gammachirp.," J. Acoust. Soc. Am. 101, 412-419.
18. Irino, T., and Patterson, R. D. (2006). " A dynamic compressive gammachirp auditory filterbank.," IEEE Trans. Audio, Speech, Lang. Process. 14, 2222-2232.
19. Jeffress, L. A. (1968). " Beating sinusoids and pitch changes.," J. Acoust. Soc. Am. 43, 1464.
20. Lorenzi, C., Gilbert, G., Carn, H., Garnier, S., and Moore, B. C. J. (2006). " Speech perception problems of the hearing impaired reflect inability to use temporal fine structure.," Proc. Natl. Acad. Sci. U.S.A. 103, 18866-18869.
21. Loughlin, P. J., and Tacer, B. (1996). " On the amplitude and frequency decomposition of signals.," J. Acoust. Soc. Am. 100, 1594-1601.
22. Martin, P. (1996). Éĺments de phońtique, avec application au fraņais (Elements of Phonetics, with Application to French) (Les Presses de l'Universite Laval, Sainte-Foy).
23. Miller, G. A., and Nicely, P. E. (1955). " Analysis of perceptual confusions among some English consonants.," J. Acoust. Soc. Am. 27, 338-352.
24. Nelson, P. B., Jin, S., Carney, A. E., and Nelson, D. A. (2003). " Understanding speech in modulated interference: Cochlear implant users and normal-hearing listeners.," J. Acoust. Soc. Am. 113, 961-968.
25. Nie, K., Stickney, G., and Zeng, F.-G. (2005). " Encoding frequency modulation to improve cochlear implant performance in noise.," IEEE Trans. Biomed. Eng. 52, 64-73.
26. Oxenham, A. J., and Moore, B. C. J. (1997). " Modeling the effects of peripheral nonlinearity in listeners with normal and impaired hearing.," in Modeling Sensorineural Hearing Loss, edited by, W. Jesteadt, (Erlbaum, Mahwah, N.J.), pp. 273-288.
27. Papoulis, A. (1983). " Random modulation: A review.," IEEE Trans. Acoust., Speech, Signal Process. 31, 96-105.
28. Patterson, R. D., Nimmo-Smith, I., Holdsworth, J., and Rice, P. (1987). " An efficient auditory filterbank based on the gammatone function.," in Paper Presented at a Meeting of the IOC Speech Group on Auditory Modeling at RSRE, Malvern, England, December 14-15.
29. Qin, M. K., and Oxenham, A. J. (2003). " Effects of simulated cochlear-implant processing on speech reception in fluctuating maskers.," J. Acoust. Soc. Am. 114, 446-454.
30. Qin, M. K., and Oxenham, A. J. (2006). " Effects of introducing unprocessed low-frequency information on the reception of envelope-vocoder processed speech.," J. Acoust. Soc. Am. 119, 2417-2426.
31. Remez, R. E., Rubin, P. E., Pisoni, D. B., and Carrell, T. D. (1981). " Speech perception without traditional speech cues.," Science 212, 947-949.
32. Remez, R. E., and Rubin, P. E. (1990). " On the perception of speech from time-varying acoustic information: Contributions of amplitude variations.," Percept. Psychophys. 48, 313-325.
33. Rhode, W. S. (1971). " Observations of the vibration of the basilar membrane in squirrel monkeys using the Mössbauer technique.," J. Acoust. Soc. Am. 49, 1218-1231.
34. Robles, L., Ruggero, M. A., and Rich, N. C. (1986). " Basilar membrane mechanics at the base of the chinchilla cochlea. I. Input-output functions, tuning curves and phase responses.," J. Neurophysiol. 41, 692-704.
35. Rosen, S. (1992). " Temporal information in speech: acoustic, auditory and linguistic aspects.," Philos. Trans. R. Soc. London, Ser. B 336, 367-373.
36. Rosen, S., and Stock, D. (1992). " Auditory filter bandwidths as a function of level at low frequencies (125- 1 kHz).," J. Acoust. Soc. Am. 92, 773-781.
37. Schimmel, M., and Altas, L. E. (2005). " Coherent envelope detection for modulation filtering of speech.," IEEE Trans. Acoust., Speech, Signal Process., Philadelphia, PA, pp. 221-224.
38. Shannon, R., Zeng, F.-G., Kamath, V., Wygonski, J., and Ekelid, M. (1995). " Speech recognition with primarily temporal cues.," Science 270, 303-304.
39. Sheft, S. (2008). " Envelope processing and sound-source perception.," in Auditory Perception of Sound Sources, edited by, W. A. Yost, A. N. Popper, and, R. R. Fay, (Springer, New York), pp. 233-280.
40. Sheft, S., and Yost, W. A. (2001). " Auditory abilities of experienced signal analysts.," AFRL Prog. Rep. No. 1, contract SPO700-98-D-4002.
41. Smith, Z. M., Delgutte, B., and Oxenham, A. J. (2002). " Chimaeric sounds reveal dichotomies in auditory perception.," Nature (London) 416, 87-90.
42. Steeneken, H. J. M., and Houtgast, T. (1999). " Mutual dependence of the octave-band weights in predicting speech intelligibility.," Speech Commun. 28, 109-123.
43. Steeneken, H. J. M., and Houtgast, T. (2002). " Phoneme group specific octave-band weights in predicting speech intelligibility.," Speech Commun. 38, 399-411.
44. Stickney, G. S., Nie, K., and Zeng, F.-G. (2005). " Contribution of frequency modulation to speech recognition in noise.," J. Acoust. Soc. Am. 118, 2412-2420.
45. Stone, M. A., and Moore, B. C. J. (2007). " Quantifying the effects of fast-acting compression on the envelope of speech.," J. Acoust. Soc. Am. 121, 1654-1664.
46. Turner, C. W., Kwon, B. J., Tanaka, C., Knapp, J., Hubbartt, J. L., and Doherty, K. A. (1998). " Frequency-weighting functions for broadband speech as estimated by a correlational method.," J. Acoust. Soc. Am. 104, 1580-1585.
47. Viemeister, N. F. (1979). " Temporal modulation transfer functions based upon modulation thresholds.," J. Acoust. Soc. Am. 66, 1364-1380.
48. Xu, L., and Pfingst, B. E. (2003). " Relative importance of temporal envelope and fine structure in lexical-tone perception.," J. Acoust. Soc. Am. 114, 3024-3027.
49. Xu, L., Thompson, C. S., and Pfingst, B. E. (2005). " Relative contribution of spectral and temporal cues for phoneme recognition.," J. Acoust. Soc. Am. 117, 3255-3267.
50. Zeng, F. G., Nie, K., Liu, S., Stickney, G., Del Rio, E., Kong, Y. Y., and Chen, H. (2004). " On the dichotomy in auditory perception between temporal envelope and fine structure cues.," J. Acoust. Soc. Am. 116, 1351-1354.
51. Zeng, F. G., Nie, K., Stickney, G. S., Kong, Y. Y., Vongphoe, M., Bhargave, A., Wei, C., and Cao, K. (2005). " Speech recognition with amplitude and frequency modulations.," Proc. Natl. Acad. Sci. U.S.A. 102, 2293-2298.