Relative contributions of spectral and temporal cues for phoneme recognition

Journal of the Acoustical Society of America

Volumn 117, Issue 5, 2005, Pages 3255-3267

  Xu, Li ^a,b   Thompson, Catherine S ^b   Pfingst, Bryan E ^b  

^a OHIO UNIVERSITY   (United States)

^b UNIVERSITY OF MICHIGAN HEALTH SYSTEM   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUDITION; CHANNEL CAPACITY; COMPUTER SIMULATION; SPEECH RECOGNITION; SPEECH SYNTHESIS; VOCODERS;

CUES; INFORMATION TRANSFER; NOISE-EXCITED VOCODERS; VOWEL RECOGNITION;

SPEECH ANALYSIS;

ACOUSTICS; ADULT; ARTICLE; COCHLEA PROSTHESIS; CONSONANT; CONTROLLED STUDY; FEMALE; FREQUENCY ANALYZER; HEARING; HUMAN; HUMAN EXPERIMENT; INFORMATION PROCESSING; LANGUAGE; MALE; NOISE; NORMAL HUMAN; PERFORMANCE; PHONEME; PRIORITY JOURNAL; SPEECH DISCRIMINATION; VOWEL;

ADULT; CUES; FEMALE; HUMANS; MALE; PHONETICS; RECOGNITION (PSYCHOLOGY); SPEECH DISCRIMINATION TESTS; SPEECH PERCEPTION; TIME PERCEPTION;

EID: 18744405425     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.1886405     Document Type: Article

References (61)

1. Bacon, S. P., and Viemeister, N. F. (1985). "Temporal modulation transfer functions in normal-hearing and hearing-impaired listeners," Audiology 24, 117-134.
2. Baer, T., and Moore, B. C. J. (1993). "Effects of spectral smearing on the intelligibility of sentences in noise," J. Acoust. Soc. Am. 94, 1229-1241.
3. Baer, T., and Moore, B. C. J. (1994). "Effects of spectral smearing on the intelligibility of sentences in the presence of interfering speech," J. Acoust. Soc. Am. 95, 2277-2280.
4. Blumstein, S. E., and Stevens, K. N. (1979). "Acoustic invariance in speech production: Evidence from measurements of the spectral characteristics of stop consonants," J. Acoust. Soc. Am. 66, 1001-1017.
5. Boothroyd, A., Mulhearn, B., Gong, J., and Ostroff, J. (1996). "Effects of spectral smearing on phoneme and word recognition," J. Acoust. Soc. Am. 100, 1807-1818.
6. Burns, E. M., and Viemeister, N. F. (1976). "Nonspectral pitch," J. Acoust. Soc. Am. 60, 863-869.
7. Burns, E. M., and Viemeister, N. F. (1981). "Played-again SAM: Further observations on the pitch of amplitude-modulated noise," J. Acoust. Soc. Am. 70, 1655-1660.
8. Dau, T., Verhey, J., and Kohlrausch, A. (1999). "Intrinsic envelope fluctuations and modulation-detection thresholds for narrow-band noise carriers," J. Acoust. Soc. Am. 106, 2752-2760.
9. Dorman, M. F., Loizou, P. C., Fitzke, J., and Tu, Z. (1998). "The recognition of sentences in noise by normal-hearing listeners using simulations of cochlear-implant signal processors with 6-20 channels," J. Acoust. Soc. Am. 104, 3583-3585.
10. Dorman, M. F., Loizou, P. C., Fitzke, J., and Tu, Z. (2000). "Recognition of monosyllabic words by cochlear implant patients and by normal-hearing subjects listening to words processed through cochlear implant signal processing strategies," Ann. Otol. Rhinol. Laryngol. Suppl. 109, 64-66.
11. Dorman, M. F., Loizou, P. C., and Rainey, D. (1997). "Speech intelligibility as a function of the number of channels of stimulation for signal processors using sine-wave and noise-band outputs," J. Acoust. Soc. Am. 102, 2403-2411.
12. Drullman, R., Festen, J. M., and Plomp, R. (1994a). "Effect of temporal envelope smearing on speech perception," J. Acoust. Soc. Am. 95, 1053-1064.
13. Drullman, R., Festen, J. M., and Plomp, R. (1994b). "Effect of reducing slow temporal modulations on speech reception," J. Acoust. Soc. Am. 95, 2670-2680.
14. Dudley, H. (1939). "Remaking speech," J. Acoust. Soc. Am. 11, 169-177.
15. Eisenberg, L. S., Shannon, R. V., Martinez, A. S., Wygonski, J., and Boothroyd, A. (2000). "Speech recognition with reduced spectral cues as a function of age," J. Acoust. Soc. Am. 107, 2704-2710.
16. Fishman, K. E., Shannon, R. V., and Slattery, W. H. (1997). "Speech recognition as a function of the number of electrodes used in the SPEAK cochlear implant speech processor," J. Speech Lang. Hear. Res. 40, 1201-1215.
17. Friesen, L. M., Shannon, R. V., Baskent, D., and Wang, X. (2001). "Speech recognition in noise as a function of the number of spectral channels: Comparison of acoustic hearing and cochlear implants," J. Acoust. Soc. Am. 110, 1150-1163.
18. Fu, Q.-J., and Shannon, R. V. (1999). "Effects of electrode location and spacing on phoneme recognition with the Nucleus-22 cochlear implant," Ear Hear. 20, 321-331.
19. Fu, Q.-J., and Shannon, R. V. (2000). "Effect of stimulation rate on phoneme recognition by Nucleus-22 cochlear implant listeners," J. Acoust. Soc. Am. 107, 589-597.
20. Fu, Q.-J., Shannon, R. V., and Wang, X. (1998). "Effects of noise and spectral resolution on vowel and consonant recognition: Acoustic and electric hearing," J. Acoust. Soc. Am. 104, 3586-3596.
21. Greenwood, D. D. (1990). "A cochlear frequency-position function for several species-29 years later," J. Acoust. Soc. Am. 87, 2592-2605.
22. Halle, M., Hughes, G. W., and Radley, J.-P. A. (1957). "Acoustic properties of stop consonants," J. Acoust. Soc. Am. 29, 107-116.
23. Henry, B. A., and Turner, C. W. (2003). "The resolution of complex spectral patterns by cochlear implant and normal-hearing listeners," J. Acoust. Soc. Am. 113, 2861-2873.
24. Hill, F. J., McRae, L. P., and McClellan, R. P. (1968). "Speech recognition as a function of channel capacity in a discrete set of channels," J. Acoust. Soc. Am. 44, 13-18.
25. Hillenbrand, J., Getty, L. A., Clark, M. J., and Wheeler, K. (1995). "Acoustic characteristics of American English vowels," J. Acoust. Soc. Am. 97, 3099-3111.
26. Hornsby, B. W. Y., and Ricketts, T. A. (2001). "The effects of compression ratio, signal-to-noise ratio, and level on speech recognition in normal-hearing listeners," J. Acoust. Soc. Am. 109, 2964-2973.
27. Kong, Y.-Y., Cruz, R., Jones, J. A., and Zeng, F.-G. (2004). "Music perception with temporal cues in acoustic and electric hearing," Ear Hear. 25, 173-185.
28. Loizou, P. C., Dorman, M., Poroy, O., and Spahr, T. (2000). "Speech recognition by normal-hearing and cochlear implant listeners as a function of intensity resolution," J. Acoust. Soc. Am. 108, 2377-2387.
29. Loizou, P. C., Dorman, M., and Tu, Z. (1999). "On the number of channels needed to understand speech," J. Acoust. Soc. Am. 106, 2097-2103.
30. MATLAB (2002). "The language of technical computing," The Math Works, Inc., Natick, MA.
31. Miller, G. A., and Nicely, P. E. (1955). "An analysis of perceptual confusions among some English consonants," J. Acoust. Soc. Am. 27, 338-352.
32. Peterson, G. E., and Barney, H. L. (1952). "Control methods used in a study of the vowels," J. Acoust. Soc. Am. 24, 175-184.
33. Rosen, S. (1992). "Temporal information in speech: Acoustic, auditory and linguistic aspects," Philos. Trans. R. Soc. London, Ser. B 336, 367-373.
34. Rubinstein, J. T., and Hong, R. (2003). "Signal coding in cochlear implants: Exploiting stochastic effects of electrical stimulation," Ann. Otol. Rhinol. Laryngol. 112, 14-19.
35. Schroeder, M. R. (1966). "Vocoders: Analysis and synthesis of speech," Proc. IEEE 54, 352-366.
36. Shannon, R. V. (1983). "Multichannel electrical stimulation of the auditory nerve in man," I. basic psychophysics. Hear. Res. 11, 157-189.
37. Shannon, R. V. (1992). "Temporal modulation transfer functions in patients with cochlear implants," J. Acoust. Soc. Am. 91, 2156-2164.
38. Shannon, R. V. (2003). "The auditory smorgasbord: Perceptual use of temporal neural information," Assoc. Res. Otolaryngol. Abs. 26, 2.
39. Shannon, R. V., Fu, Q.-J., Wang, X., Galvin, J., and Wygonski, J. (2001). "Critical cues for auditory pattern recognition in speech: Implications for cochlear implant speech processor design," Physiological and Psychological Bases of Auditory Function, Proceedings of the 12th International Symposium on Hearing, edited by A. J. M. Houtsma, A. Kohlrausch, V. F. Prijs, and R, Schoonhoven (Shaker Publishing BV, Maastricht, NL).
40. Shannon, R. V., Jensvold, A., Padilla, M., Robert, M. E., and Wang, X. (1999). "Consonant recordings for speech testing," J. Acoust. Soc. Am. 106, L71-74.
41. Shannon, R. V., Zeng, F.-G., Kamath, V., Wygonski, J., and Ekelid, M. (1995). "Speech recognition with primarily temporal cues," Science 270, 303-304.
42. Shannon, R. V., Zeng, F.-G., and Wygonski, J. (1998). "Speech recognition with altered spectral distribution of envelope cues," J. Acoust. Soc. Am. 104, 2467-2476.
43. Skinner, M. W., Arndt, P. L., and Staller, S. J. (2002). "Nucleus 24 advanced encoder conversion study. Performance vs preference," Ear Hear. 23, 2S-25S.
44. Skinner, M. W., Fourakis, M. S., Holden, T. A., Holden, L. K., and Demorest, M. E. (1996). "Identification of speech by cochlear implant recipients with the multipeak (MPEAK) and spectral peak (SPEAK) speech coding strategies: I. Vowels," Ear Hear. 17, 182-197.
45. Skinner, M. W., Holden, L. K., Holden, T. A., Demorest, M. E., and Fourakis, M. S. (1997). "Speech recognition at simulated soft, conversational, and raised-to-loud vocal efforts by adults with cochlear implants," J. Acoust. Soc. Am. 101, 3766-3782.
46. Stevens, K. N. (1980). "Acoustic correlates of some phonetic categories," J. Acoust. Soc. Am. 68, 836-842.
47. ter Keurs, M., Festen, J. M., and Plomp, R. (1992). "Effect of spectral envelope smearing on speech reception I," J. Acoust. Soc. Am. 91, 2872-2880.
48. ter Keurs, M., Festen, J. M., and Plomp, R. (1993). "Effect of spectral envelope smearing on speech reception. II," J. Acoust. Soc. Am, 93, 1547-1552.
49. Turner, C. W., Gantz, B. J., Vidal, C., Behrens, A., and Henry, B. A. (2004). "Speech recognition in noise for cochlear implant listeners: Benefits of residual acoustic hearing," J. Acoust. Soc. Am. 115, 1729-1735.
50. Tye-Murray, N., Tyler, R. S., Woodworth, G. G., and Gantz, B. J. (1992). "Performance over time with a Nucleus or Ineraid cochlear implant," Ear Hear. 13, 200-209.
51. Tyler, R. S., Tye-Murray, N., and Otto, S. R. (1989). "The recognition of vowels differing by a single formant by cochlear-implant subjects," J. Acoust. Soc. Am. 86, 2107-2112.
52. Tyler, R. S., and Moore, B. C. J. (1992). "Consonant recognition by some of the better cochlear-implant patients," J. Acoust. Soc. Am. 92, 3068-3077.
53. Tyler, R. S., Preece, J. P., Lansing, C. R., and Gantz, B. J. (1992). "Natural vowel perception by patients with the Ineraid cochlear implant," Audiol. 31, 228-239.
54. Van Tasell, D. J., Soli, S.D., Kirby, V. M., and Widin, G. P. (1987). "Speech waveform envelope cues for consonant recognition," J. Acoust. Soc. Am. 82, 1152-1161.
55. van Wieringen, A., and Wouters, J. (1999). "Natural vowel and consonant recognition by Laura cochlear implantees," Ear Hear. 20, 89-103.
56. Villchur, E. (1977). "Electronic models to simulate the effect of sensory distortions on speech perception by the deaf," J. Acoust. Soc. Am. 62, 665-674.
57. Viemeister, N. F. (1979). "Temporal modulation transfer functions based upon modulation thresholds," J. Acoust. Soc. Am. 66, 1364-1380.
58. Wang, M. D., and Bilger, R. C. (1973). "Consonant confusions in noise: A study of perceptual features," J. Acoust. Soc. Am. 54, 1248-1266.
59. Xu, L., Tsai, Y., and Pfingst, B. E. (2002). "Features of stimulation affecting tonal-speech perception: Implications for cochlear prostheses," J. Acoust. Soc. Am. 112, 247-258.
60. Wilson, B. S., Finley, C. C., Lawson; D. T., and Zerbi, M. (1997). "Temporal representations with cochlear implants," Am. J. Otol. 18, S30-34.
61. Zeng, F.-G. (2002). "Temporal pitch in electric hearing," Hear. Res. 174, 101-106.