The psychoacoustics of noise vocoded speech: A physiological means to a perceptual end

Hearing Research

Volumn 241, Issue 1-2, 2008, Pages 87-96

  Loebach, Jeremy L ^a,b   Wickesberg, Robert E ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b INDIANA UNIVERSITY   (United States)

Author keywords

Auditory nerve; Noise vocoded speech; Spectrally reduced speech; Speech perception

Indexed keywords

ACCURACY; ADULT; ARTICLE; AUDITORY STIMULATION; CONTROLLED STUDY; FEMALE; HUMAN; MALE; NOISE; NORMAL HUMAN; PRIORITY JOURNAL; PSYCHOPHYSICS; RECOGNITION; SCORING SYSTEM; SPEECH PERCEPTION; STATISTICAL SIGNIFICANCE; TASK PERFORMANCE;

ACOUSTIC STIMULATION; ACTION POTENTIALS; ADULT; COCHLEAR NERVE; FEMALE; HUMANS; MALE; PERCEPTUAL MASKING; PSYCHOACOUSTICS; SPEECH PERCEPTION; TIME FACTORS; TIME PERCEPTION;

EID: 45649085140     PISSN: 03785955     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.heares.2008.05.002     Document Type: Article

References (58)

1. Casarotto S., Bianchi A.M., Cerutti S., and Chiarenza G.A. Dynamic time warping in the analysis of event-related potentials. IEEE Eng. Med. Biol. Mag. 24 1 (2005) 68-77
2. Delgutte B. Representation of speech-like sounds in the discharge patterns of auditory-nerve fibers. J. Acoust. Soc. Am. 68 3 (1980) 843-857
3. Delgutte B., and Kiang N.Y. Speech coding in the auditory nerve: I. vowel-like sounds. J. Acoust. Soc. Am. 75 3 (1984) 866-878
4. Delgutte B., and Kiang N.Y. Speech coding in the auditory nerve: III, voiceless fricative consonants. J. Acoust. Soc. Am. 75 3 (1984) 887-896
5. Delgutte B., and Kiang N.Y. Speech coding in the auditory nerve: IV. Sounds with consonant-like dynamic characteristics. J. Acoust. Soc. Am. 75 3 (1984) 897-907
6. Diehl R.L., Lotto A.J., and Holt L.L. Speech perception. Ann. Rev. Psych. 55 (2004) 149-179
7. Dorman M.F., and Loizou P.C. Speech intelligibility as a function of the number of channels of stimulation for normal-hearing listeners and patients with cochlear implants. Am. J. Otol. 18 Suppl. 6 (1997) S113-S114
8. Dorman M.F., and Loizou P.C. The identification of consonants and vowels by cochlear implant patients using a 6-channel continuous interleaved sampling processor and by normal-hearing subjects using simulations of processors with two to nine channels. Ear. Hear. 19 2 (1998) 162-166
9. Dorman M.F., Loizou P.C., Fitzke J., and Tu Z. The recognition of sentences in noise by normal-hearing listeners using simulations of cochlear-implant signal processors with 6-20 channels. J. Acoust. Soc. Am. 104 6 (1998) 3583-3585
10. Dorman M.F., Loizou P.C., and Rainey D. Speech intelligibility as a function of the number of bands of stimulation for signal processors using sine wave and noise-band outputs. J. Acoust. Soc. Am. 102 4 (1997) 2403-2411
11. Drullman R., Festen J.M., and Plomp R. Effect of temporal envelope smearing on speech reception. J. Acoust. Soc. Am. 95 2 (1994) 1054-1064
12. Drullman R., Festen J.M., and Plomp R. Effect of reducing slow temporal modulations on speech reception. J. Acoust. Soc. Am. 95 5 (1994) 2670-2680
13. Drullman R. Temporal envelope and fine structure cues for speech intelligibility. J. Acoust. Soc. Am. 97 1 (1995) 585-592
14. Fishman K.E., Shannon R.V., and Slattery W.H. Speech recognition as a function of the number of electrodes used in the SPEAK cochlear implant speech processor. J. Speech Lang. Hear. Res. 40 5 (1997) 1201-1215
15. French N.R., and Steinberg J.C. Factors governing the intelligibility of speech sounds. J. Acoust. Soc. Am. 19 1 (1947) 90-119
16. Fripp D., Owen C., Quintana-Rizzo E., Shapiro A., Buckstaff K., Jankowski K., Wells R., and Tyack P. Bottlenose dolphin (Tursiops truncatus) calves appear to model their signature whistles on the signature whistles of community members. Anim. Cogn. 8 1 (2005) 17-26
17. Fu Q.J., Chinchilla S., and Galvin J.J. The role of spectral and temporal cues in voice gender discrimination by normal-hearing listeners and cochlear implant users. J. Assoc. Res. Otolaryngol. 5 (2004) 253-260
18. Fu Q.G., Chinchilla S., Nogaki G., and Galvin J.J. Voice gender identification by cochlear implant users: the role of spectral and temporal resolution. J. Acoust. Soc. Am. 118 3 (2005) 1711-1719
19. Fu Q.J., and Galvin J.J. Recognition of spectrally asynchronous speech by normal-hearing listeners and Nucleus-22 cochlear implant users. J. Acoust. Soc. Am. 109 3 (2001) 1166-1172
20. Fu Q.J., Shannon R.V., and Wang X. Effects of noise and spectral resolution on vowel and consonant recognition: acoustic and electric hearing. J. Acoust. Soc. Am. 104 6 (1998) 3586-3596
21. Gygi B., Kidd R.R., and Watson C.S. Spectral-temporal factors in the identification of environmental sounds. J. Acoust. Soc. Am. 115 3 (2004) 1252-1265
22. Keogh E., and Ratanamahatana C.A. Exact indexing of dynamic time warping. Knowledge and Information Systems 7 3 (2005) 358-386
23. Keogh, E., Pazzani, M., 1999. Scaling up dynamic time warping to massive datasets. In: Proceedings of the Third European Conference on Principles and Practice of Knowledge Discovery in Databases, 1-11.
24. Kiang N.Y. Processing of speech by the auditory nervous system. J. Acoust. Soc. Am. 68 3 (1980) 830-835
25. Kogan J.A., and Margoliash D. Automated recognition of bird song elements from continuous recordings using dynamic time warping and hidden Markov models: a comparative study. J. Acoust. Soc. Am. 103 4 (1998) 2185-2196
26. Lenarz T. Cochlear implants: what can be achieved. Am. J. Otol. 18 (1997) S2-S3
27. Loebach J.L., and Pisoni D.B. Perceptual learning of spectrally degraded speech and environmental sounds. J. Acoust. Soc. Am. 123 2 (2008) 1126-1139
28. Loebach J.L., and Wickesberg R.E. The representation of noise vocoded speech in the auditory nerve of the chinchilla: Physiological correlates for the perception of spectrally reduced speech. Hear. Res. 213 1-2 (2006) 130-144
29. Loebach, J.L., 2005. Temporal aspects of speech: The encoding of naturally produced and spectrally reduced synthetic speech by the auditory nerve, Doctoral dissertation, University of Illinois at Urbana-Champaign.
30. Loizou P.C., Dorman M., and Tu Z. On the number of channels needed to understand speech. J. Acoust. Soc. Am. 106 4 (1999) 2097-2103
31. Middlebrooks J.C., and Bierer J.A. Auditory cortical images of cochlear-implant stimuli: coding of stimulus channel and current level. J. Neurophysiol. 87 (2002) 493-507
32. Middlebrooks J.C., Bierer J.A., and Snyder R.L. Cochlear implants: the view from the brain. Curr. Opion. Neurobio. 15 (2005) 488-493
33. Miller M.I., and Sachs M.B. Representation of stop consonants in the discharge patterns of auditory nerve fibers. J. Acoust. Soc. Am. 74 (1983) 502-517
34. Munson B., Donaldson G.S., Allen S.L., Collison E.A., and Nelson D.A. Patterns of phoneme perception errors by listeners with cochlear implants as a function of overall speech perception ability. J. Acoust. Soc. Am. 113 2 (2003) 925-935
35. Picton T., Hunt M., Mowrey R., Rodriguez R., and Maru J. Evaluation of brain-stem auditory evoked potentials using dynamic time warping. Electroencephalogr. Clin. Neurophysiol. 71 (1988) 212-225
36. Rabiner L.R., Rosenberg A.E., and Levinson S.E. Considerations in dynamic time warping algorithms for discrete word recognition. IEEE Trans. Acoust. Speech Sig. Proc. ASSP-26 6 (1978) 575-582
37. Reed C.M., and Delhorne L.A. Reception of environmental sounds through cochlear implants. Ear. Hear. 26 1 (2005) 48-61
38. Remez R.E., Rubin P.E., Pisoni D.B., and Carrell T.D. Speech perception without traditional speech cues. Science 212 4497 (1981) 947-949
39. Remez R.E., Rubin P.E., Berns S.M., Pardo J.S., and Lang J.M. On the perceptual organization of speech. Psych. Rev. 101 (1994) 129-156
40. Sachs M.B., and Young E.D. Encoding of steady-state vowels in the auditory nerve: representation in terms of discharge rate. J. Acoust. Soc. Am. 66 2 (1979) 470-479
41. Sachs M.B., and Young E.D. Effects of nonlinearities on speech encoding in the auditory nerve. J. Acoust. Soc. Am. 68 3 (1980) 858-875
42. Sakoe H., and Chiba S. Dynamic programming algorithm optimization for spoken word recognition. IEEE Trans. Acoust. Speech Sig. Proc. ASSP-26 1 (1978) 43-49
43. Shannon R.V., Zeng F.G., Kamath V., Wygonski J., and Ekelid M. Speech recognition with primarily temporal cues. Science 270 5234 (1995) 303-304
44. Shannon R.V., Zeng F.G., and Wygonski J. Speech recognition with altered spectral distribution of envelope cues. J. Acoust. Soc. Am. 104 4 (1998) 2467-2476
45. Sinex D.G., and Geisler C.D. Responses of auditory-nerve fibers to consonant-vowel syllables. J. Acoust. Soc. Am. 73 2 (1983) 602-615
46. Sinex D.G., and McDonald L.P. Average discharge rate representation of voice onset time in the chinchilla auditory nerve. J. Acoust. Soc. Am. 83 5 (1988) 1817-1827
47. Sinex D.G., and McDonald L.P. Synchronized discharge rate representation of voice-onset time in the chinchilla auditory nerve. J. Acoust. Soc. Am. 85 5 (1989) 1995-2004
48. Smith Z.M., Delgutte B., and Oxenham A.J. Chimaeric sounds reveal dichotomies in auditory perception. Nature 416 7 (2002) 87-90
49. Stevens K.N. Acoustic Phonetics (1998), MIT Press, Boston, MA
50. Stevens H.E., and Wickesberg R.E. Ensemble responses of the auditory nerve to normal and whispered stop consonants. Hear. Res. 13 (1999) 47-62
51. Stevens H.E., and Wickesberg R.E. Responses of whispered word-final stop consonants in the auditory nerve. Hear. Res. 173 (2002) 119-133
52. Stevens, H.E., 2003. The representation of normally-voiced and whispered speech sounds in the temporal aspects of auditory nerve responses, Doctoral dissertation, University of Illinois at Urbana-Champaign.
53. Tice, R., Carrell, T.D., 1998. Level 2.0.3, University of Nebraska.
54. Van Tasell D.J., Soli S.D., Kirby V.M., and Widin G.P. Speech waveform envelope cues for consonant recognition. J. Acoust. Soc. Am. 82 4 (1987) 1152-1161
55. Van Tasell D.J., Greenfield D.G., Logemann J.J., and Nelson D.A. Temporal cues for consonant recognition: training, talker generalization, and use in the evaluation of cochlear implants. J. Acoust. Soc. Am. 92 3 (1992) 1247-1257
56. Victor J.D., and Purpura K.P. Nature and precision of temporal coding in visual cortex: A metric-space analysis. J. Neurophysiol. 76 2 (1996) 1310-1326
57. Wang K., Begleiter H., and Porjesz B. Warp-averaging event-related potentials. Clin. Neurophys. 112 (2001) 1917-1924
58. Young E.D., and Sachs M.B. Representation of steady-state vowels in the temporal aspects of the discharge patterns of populations of auditory-nerve fibers. J. Acoust. Soc. Am. 66 5 (1979) 1381-1403