On the balance of envelope and temporal fine structure in the encoding of speech in the early auditory system

Journal of the Acoustical Society of America

Volumn 133, Issue 5, 2013, Pages 2818-2833

  Shamma, Shihab ^a   Lorenzi, Christian ^b,c  

^a UNIVERSITY OF MARYLAND   (United States)

^b ECOLE NORMALE SUPÉRIEURE   (France)

^c UNIVERSITÉ PARIS DESCARTES   (France)

Author keywords

[No Author keywords available]

Indexed keywords

AUDITORY NERVES; AUDITORY PROCESSING; AUDITORY SYSTEMS; NOISY CONDITIONS; SPECTRO-TEMPORAL MODULATIONS; SPEECH SPECTROGRAM; STIMULATION STRATEGIES; TEMPORAL FINE STRUCTURE;

ENCODING (SYMBOLS); MODULATION; VOCODERS;

SPEECH INTELLIGIBILITY;

ASSOCIATION; AUDITORY REHABILITATION; AUDITORY STIMULATION; AUTOMATED PATTERN RECOGNITION; BIOLOGICAL MODEL; COCHLEAR IMPLANTATION; COCHLEAR NERVE; HEARING DISORDERS; HUMAN; NOISE; PATHOPHYSIOLOGY; PATIENT; PERCEPTION; PROCEDURES; PSYCHOLOGY; REHABILITATION; SIGNAL PROCESSING; SOUND DETECTION; SPEECH; SPEECH INTELLIGIBILITY; SPEECH PERCEPTION; TIME; TIME PERCEPTION;

ACOUSTIC STIMULATION; COCHLEAR IMPLANTATION; COCHLEAR NERVE; CORRECTION OF HEARING IMPAIRMENT; CUES; HEARING DISORDERS; HUMANS; MODELS, NEUROLOGICAL; NOISE; PATTERN RECOGNITION, AUTOMATED; PERCEPTUAL MASKING; PERSONS WITH HEARING IMPAIRMENTS; SIGNAL PROCESSING, COMPUTER-ASSISTED; SOUND SPECTROGRAPHY; SPEECH ACOUSTICS; SPEECH INTELLIGIBILITY; SPEECH PERCEPTION; TIME FACTORS; TIME PERCEPTION;

EID: 84877592215     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.4795783     Document Type: Article

References (60)

1. Ardoint, M., and Lorenzi, C. (2010). Effects of lowpass and highpass filtering on the intelligibility of speech based on temporal fine-structure or envelope cues., Hear. Res. 260, 89-95. 10.1016/j.heares.2009.12.002
2. Ardoint, M., Sheft, S., Fleuriot, P., Garnier, S., and Lorenzi, C. (2010). Perception of temporal fine structure cues in speech with minimal envelope cues for listeners with mild- to-moderate hearing loss., Int. J. Audiol. 49, 823-831. 10.3109/14992027.2010.492402
3. Baskent, D. (2006). Speech recognition in normal hearing and sensorineural hearing loss as a function of the number of spectral channels., J. Acoust. Soc. Am. 120, 2908-2925. 10.1121/1.2354017
4. Blackburn, C., and Sachs, M. (1990). The representations of the steady-state vowel sound /e/ in the discharge patterns of cat anteroventral cochlear nucleus neurons., J. Neurophysiol. 63 (5), 1191-1212.
5. Buss, E., Hall, J. W., 3rd, and Grose, J. H. (2004). Temporal fine structure cues to speech recognition and pure tone modulation in observers with sensorineural hearing loss., Ear. Hear. 25, 242-250. 10.1097/01.AUD.0000130796. 73809.09
6. Carlyon, R. P., and Shamma, S. A. (2003). An account of monaural phase sensitivity., J. Acoust. Soc. Am. 114, 333-348. 10.1121/1.1577557
7. Carney, L. H. (1990). Sensitivities of cells in anteroventral cochlear nucleus of cat to spatiotemporal discharge patterns across primary afferents., J. Neurophysiol. 64, 437-456.
8. Carney, L. H., Heinz, M. G., Evilsizer, M. E., Gilkey, R. H., and Colburn, H. S. (2002). Auditory phase opponency: A temporal model for masked detection at low frequencies., Acta Acust. Acust. 88, 334-347.
9. Cedolin, L., and Delgutte, B (2007). Spatio-temporal representation of the pitch of complex tones in the auditory nerve., in Hearing-From Sensory Processing to Perception, edited by, B. Kollmeier, G. Klump, V. Hohmann, U. Langemann, M. Mauermann, S. Uppenkamp, and, J. Verhey, (Springer-Verlag, Berlin), pp. 61-70.
10. Clark, P., and Atlas, L. (2009). Time-frequency coherent modulation filtering of non-stationary signals., IEEE Trans. Signal Process. 57 (11), 4323-4332. 10.1109/TSP.2009.2025107
11. Deng, L., and Geisler, C. (1987). Responses of auditory-nerve fibers to nasal consonant-vowel syllables., J. Acoust. Soc. Am. 82, 1977-1988. 10.1121/1.395642
12. Deshmukh, O., Espy-Wilson, C., and Carney, L. (2007). Speech enhancement using the modified phase-opponency model., J. Acoust. Soc. Am. 121, 3886-3898. 10.1121/1.2714913
13. Drullman, R. (1995). Temporal envelope and fine structure cues for speech intelligibility., J. Acoust. Soc. Am. 97, 585-592. 10.1121/1.413112
14. Drullman, R., Festen, J. M., and Plomp, R. (1994). Effect of reducing slow temporal modulations on speech reception., J. Acoust. Soc. Am. 95, 2670-2680. 10.1121/1.409836
15. Dudley, H., Riesz, R. R., and Watkins, S. S. A. (1939). A synthetic speaker., J. Franklin Inst. 227, 739-764. 10.1016/S0016-0032(39)90816-1
16. Friesen, L. M., Shannon, R. V., Baskent, D., and Wang, X. (2001). Speech recognition in noise as a function of the number of spectral channels: comparison of acoustic hearing and cochlear implants., J. Acoust. Soc. Am. 110, 1150-1163. 10.1121/1.1381538
17. Ghitza, O. (2001). On the upper cutoff frequency of the auditory critical-band envelope detectors in the context of speech perception., J. Acoust. Soc. Am. 110, 1628-1640. 10.1121/1.1396325
18. Gilbert, G., Bergeras, I., Voillery, D., and Lorenzi, C. (2007). Effects of periodic interruption on the intelligibility of speech based on temporal fine-structure or envelope cues., J. Acoust. Soc. Am. 122, 1336-1339. 10.1121/1.2756161
19. Gilbert, G., and Lorenzi, C. (2006). The ability of listeners to use recovered envelope cues from speech fine structure., J. Acoust. Soc. Am. 119, 2438-2444. 10.1121/1.2173522
20. Gnansia, D., Pean, V., Meyer, B., and Lorenzi, C. (2009). Effects of spectral smearing and temporal fine structure degradation on speech masking release., J. Acoust. Soc. Am. 125, 4023-4033. 10.1121/1.3126344
21. Heinz, M. G., and Swaminathan, J. (2009). Quantifying Envelope and Fine-Structure Coding in Auditory Nerve Responses to Chimaeric Speech., J. Assoc. Res. Otolaryngol. 10, 407-423. 10.1007/s10162-009-0169-8
22. Heinz, M. G., Swaminathan, J., Boley, J. D., and Kale, S. (2010). Across-fiber coding of temporal fine structure: Effects of noise-induced hearing loss on auditory-nerve responses., in The Neurophysiological Bases of Auditory Perception, edited by, E. A. Lopez- Poveda, A. R. Palmer, and, R. Meddis, (Springer, New York), pp. 621-630.
23. Hopkins, K., Moore, B. C., J., and Stone, M. A. (2008). Effects of moderate cochlear hearing loss on the ability to benefit from temporal fine structure information in speech., J. Acoust. Soc. Am. 123, 1140-1153. 10.1121/1.2824018
24. Hopkins, K., Moore, B. C. J., and Stone, M. A. (2010). The effects of the addition of low-level, low-noise noise on the intelligibility of sentences processed to remove temporal envelope information., J. Acoust. Soc. Am. 128, 2150-2161. 10.1121/1.3478773
25. Howard, M. A., and Rubel, E. W. (2010). dynamic spike thresholds during synaptic integration preserve and enhance temporal response properties in the avian cochlear nucleus., J. Neurosci. 30, 12063-12074. 10.1523/JNEUROSCI.1840- 10.2010
26. Ibrahim, R. A., and Bruce, I. C. (2010). Effects of peripheral tuning on the auditory nerves representation of speech envelope and temporal fine structure cues., in The Neurophysiological Bases of Auditory Perception, edited by, E. A. Lopez-Poveda, A. R. Palmer, and, R. Meddis, (Springer, New York), Chap., pp. 429-438.
27. Johnson, D. H. (1980). The relationship between spike rate and synchrony in responses of auditory-nerve fibers to single tones., J. Acoust. Soc. Am. 68, 1115-1122. 10.1121/1.384982
28. Joris, P. X., and Yin, T. C. (1992). Responses to amplitude-modulated tones in the auditory nerve of the cat., J. Acoust. Soc. Am. 91, 215-232. 10.1121/1.402757
29. Joris, P. X., Carney, L. H., Smith, P. H., and Yin, T. C. (1994). Enhancement of neural synchronization in the anteroventral cochlear nucleus. I. Responses to tones at the characteristic frequency., J. Neurophysiol. 71, 1022-1036.
30. Kale, S., and Heinz, M. G. (2010). Envelope coding in auditory nerve fibers following noise-induced hearing loss., J. Assoc. Res. Otolaryngol. 11, 657-673. 10.1007/s10162-010-0223-6
31. Kujawa, S. G., and Liberman, M. C. (2009). Adding insult to injury: Cochlear nerve degeneration after temporary' noise-induced hearing loss., J. Neurosci. 29, 14077-14085. 10.1523/JNEUROSCI.2845-09.2009
32. Loeb, G. E., White, M. W., and Merzenich, M. M. (1983). Spatial cross-correlation, A proposed mechanism for acoustic pitch perception., Biol. Cybern. 47, 149-163. 10.1007/BF00337005
33. Logan, B. F., Jr. (1977). Information in the zero crossings of bandpass signals., Bell Syst. Tech. J. 56, 487-510.
34. Lorenzi, C., Debruille, L., Garnier, S., Fleuriot, P., and Moore, B. C. J. (2009). Abnormal processing of temporal fine structure in speech for frequencies where absolute thresholds are normal., J. Acoust. Soc. Am. 125, 27-30. 10.1121/1.2939125
35. Lorenzi, C., Gilbert, G., Carn, H., Garnier, S., and Moore, B. C. J. (2006). Speech perception problems of the hearing impaired reflect inability to use temporal fine structure., Proc. Natl. Acad. Sci. USA 103, 18866-18869. 10.1073/pnas.0607364103
36. Lyon, R., and Shamma, S. (1996). Auditory representations of timbre and pitch., Auditory Computation, edited by, Hawkins, H. L., McMullen, T. A., Popper, A. N., and, Fay, R. R., (Springer, New York), pp. 221-270.
37. Miller, R. L., Schilling, J. R., Franck, K. R., and Young, E. D. (1997). Effects of acoustic trauma on the representation of the vowel eh in cat auditory nerve fibers., J. Acoust. Soc. Am. 101, 3602-3616. 10.1121/1.418321
38. Moore, B. C. J. (2007). Cochlear Hearing Loss: Physiological, Psychological, and Technical Issues, 2nd ed. (Wiley, Chichester), pp. 1-327.
39. Moore, B. C. J. (2008). The choice of compression speed in hearing aids: Theoretical and practical considerations and the role of individual differences., Trends Amplif. 12, 103-112. 10.1177/1084713808317819
40. Moore, D. R., and Shannon, R. V. (2009). Beyond cochlear implants: awakening the deafened brain., Nat. Neurosci. 12, 686-691. 10.1038/nn.2326
41. Nelson, P. B., Jin, S. H., Carney, A. E., and Nelson, D. A. (2003). Understanding speech in modulated interference: cochlear implant users and normal-hearing listeners., J. Acoust. Soc. Am. 113, 961-968. 10.1121/1.1531983
42. Rice, S. O. (1973). Distortion produced by band limitation of an FM wave., Bell Syst. Tech. J. 52, 605-626.
43. Sachs, M. B., and Young, E. D. (1979). Encoding of steady state vowels in the auditory nerve: Representation in terms of discharge rate., J. Acoust. Soc. Am. 66, 470-479. 10.1121/1.383098
44. Shamma, S. A. (1985a). Speech processing in the auditory system: I. The representation of speech sounds in the responses of the auditory nerve., J. Acoust. Soc. Am. 78, 1612-1621. 10.1121/1.392799
45. Shamma, S. A. (1985b). Speech processing in the auditory system: II. Lateral inhibition and the central processing of speech evoked activity in the auditory nerve., J. Acoust. Soc. Am. 78, 1622-1632. 10.1121/1.392800
46. Shamma, S. A., and Klein, D. J. (2000). The case of the missing pitch templates: How harmonic templates may form in the early auditory system., J. Acoust. Soc. Am. 107, 2631-2644. 10.1121/1.428649
47. Shamma, S. A., and Morrish, K. A. (1987). Synchrony suppression in complex stimulus responses of a biophysical model of the cochlea., J. Acoust. Soc. Am. 81, 1486-1498. 10.1121/1.394501
48. Shannon, R. V. (2007). Understanding hearing through deafness., Proc. Natl. Acad. Sci. USA 104, 6883-6884. 10.1073/pnas.0702220104
49. Shannon, R. V., Zeng, F. G., Kamath, V., Wygonski, J., and Ekelid, M. (1995). Speech recognition with primarily temporal cues., Science 270, 303-304. 10.1126/science.270.5234.303
50. Sheft, S., Ardoint, M., and Lorenzi, C. (2008). Speech identification based on temporal fine structure cues., J. Acoust. Soc. Am. 124, 562-575. 10.1121/1.2918540
51. Smith, Z. M., Delgutte, B., and Oxenham, A. J. (2002). Chimaeric sounds reveal dichotomies in auditory perception., Nature 416, 87-90. 10.1038/416087a
52. Swaminathan, J. (2010). The role of envelope and temporal fine structure in the perception of noise degraded speech., Ph.D. Dissertation, University of Purdue.
53. Swaminathan, J., and Heinz, M. G. (2012). Psychophysiological analyses demonstrate the importance of neural envelope coding for speech perception in noise., J. Neurosci. 32, 1747-1756. 10.1523/JNEUROSCI.4493-11.2012
54. Voelcker, H. B. (1966). Towards a unified theory of modulation. I. phase-envelope relationships., Proc. IEEE 54, 340-354. 10.1109/PROC.1966.4695
55. Wilson, B. S., and Dorman, M. F. (2008). Cochlear implants: Current designs and future possibilities., J. Rehabil. Res. Dev. 45, 695-730. 10.1682/JRRD.2007.10.0173
56. Yang, X., Wang, K., and Shamma, S. (1992). Auditory representations of acoustic signals., IEEE Trans. Info. Theory 38, 824-839. 10.1109/18.119739
57. Yin, T. C. T., Chan, J. C. K., and Carney, L. H. (1987). Effects of interaural time delays of noise stimuli on low-frequency cells in the cats inferior colliculus III. Evidence for cross correlation., J. Neurophysiol. 58, 562-583.
58. Young, E., and Sachs, M. (1979) Representation of steady-state vowels in the temporal aspects of the discharge patterns of populations of auditory-nerve fibers., J. Acoust. Soc. Am. 66, 1381-1403. 10.1121/1.383532
59. Zeng, F. G., Nie, K., Liu, S., Stickney, G., Del Rio, E., Kong, Y. Y., and Chen, H. (2004). On the dichotomy in auditory perception between temporal envelope and fine structure cues., J. Acoust. Soc. Am. 116, 1351-1354. 10.1121/1.1777938
60. Zeng, F. G., Nie, K., Stickney, G. S., Kong, Y. Y., Vongphoe, M., Bhargave, A., Wei, C., and Cao, K. (2005). Speech recognition with amplitude and frequency modulations., Proc. Natl. Acad. Sci. USA 102, 2293-2298. 10.1073/pnas.0406460102