The modulation transfer function for speech intelligibility

PLoS Computational Biology

Volumn 5, Issue 3, 2009, Pages

  Elliott, Taffeta M ^a   Theunissen, Frédéric E ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUDIO ACOUSTICS; AUDIO SIGNAL PROCESSING; AUDIO SYSTEMS; COCHLEAR IMPLANTS; IMAGE SEGMENTATION; MODULATION; SPECTROSCOPY; SPEECH COMMUNICATION; SPEECH INTELLIGIBILITY; TRANSFER FUNCTIONS;

FILTERING TECHNIQUE; HUMAN LISTENERS; MODULATION FILTERING; NOVEL MODULATION; SPECTRAL INFORMATION; SPECTRAL MODULATION; SPECTROTEMPORAL MODULATIONS; SPEECH SIGNALS; TEMPORAL INFORMATION; TEMPORAL MODULATIONS;

INFORMATION FILTERING;

ADULT; ARTICLE; AUDITORY DISCRIMINATION; CONTROLLED STUDY; FEMALE; GENDER IDENTITY; HUMAN; HUMAN EXPERIMENT; MALE; MODULATION TRANSFER FUNCTION; NOISE REDUCTION; NORMAL HUMAN; PSYCHOPHYSICS; SIGNAL PROCESSING; SPEECH INTELLIGIBILITY; HEARING; SPEECH;

AUDITORY PERCEPTION; FEMALE; HUMANS; MALE; SPEECH;

EID: 63549114783     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1000302     Document Type: Article

References (49)

1. Liberman AM (1996) Speech: A Special Code. CambridgeMassachusetts: MIT Press.
2. Chi T, Gao Y, Guyton MC, Ru P, Shamma S (1999) Spectro-temporal modulation transfer functions and speech intelligibility. J Acoust Soc Am 106: 2719-2732.
3. Singh NC, Theunissen FE (2003) Modulation spectra of natural sounds and ethological theories of auditory processing. J Acoust Soc Am 114: 3394-3411.
4. Silipo R, Greenberg S, Arai T (1999) Temporal constraints on speech intelligibility as deduced from exceedingly sparse spectral representations. Eurospeech-99, Budapest, Hungary.
5. Dorman MF, Loizou PC, Rainey D (1997) Speech intelligibility as a function of the number of channels of stimulation for signal processors using sine-wave and noise-band outputs. J Acoust Soc Am 102: 2403-2411.
6. Shannon RV, Zeng FG, Kamath V, Wygonski J, Ekelid M (1995) Speech recognition with primarily temporal cues. Science 270: 303-304.
7. Baer T, Moore BCJ (1993) Effects of spectral smearing on the intelligibility of sentences in noise. J Acoust Soc Am 94: 1229-1241.
8. ter Keurs M, Festen JM, Plomp R (1992) Effect of spectral envelope smearing on speech reception. I. J Acoust Soc Am 91: 2872-2880.
9. Drullman R, Festen JM, Plomp R (1994) Effect of temporal envelope smearing on speech reception. J Acoust Soc Am 95: 1053-1064.
10. Arai T, Pavel M, Hermansky H, Avendano C (1999) Syllable intelligibility for temporally filtered LPC cepstral trajectories. J Acoust Soc Am 105: 2783-2791.
11. Arai T, Greenberg S (1998) Speech intelligibility in the presence of cross-channel spectral asynchrony. Proc IEEE Int Conf Acoust Speech Signal Process ICASSP 2: 933-936.
12. Shamma S (2001) On the role of space and time in auditory processing. Trends Cogn Sci 5: 340-348.
13. Eggermont JJ (2001) Between sound and perception: reviewing the search for a neural code. Hear Res 157: 1-42.
14. Fu Q-J, Chinchilla S, Nogaki G, Galvin JJ III (2005) Voice gender identification by cochlear implant users: the role of spectral and temporal resolution. J Acoust Soc Am 118: 1711-1718.
15. Remez RE. Spoken expression of individual identity and the listener. In: Expressing Onself/Expressing One's Self: A Festschrift in Honor of Robert M Krauss Morsella E, ed. London: Taylor & Francis, In press.
16. Cohen YE, Theunissen F, Russ BE, Gill P (2007) Acoustic features of rhesus vocalizations and their representation in the ventrolateral prefrontal cortex. J Neurophysiol 97: 1470-1484.
17. Ewert SD, Dau T (2000) Characterizing frequency selectivity for envelope fluctuations. J Acoust Soc Am 108: 1181-1196.
18. Creelman CD (1962) Human discrimination of auditory duration. J Acoust Soc Am 34: 582-593.
19. Stevens SS (1957) On the psychophysical law. Psychol Rev 64: 153-181.
20. Zeng FG, Nie K, Stickney GS, Kong YY, Vongphoe M, et al. (2005) Speech recognition with amplitude and frequencymodulations. Proc Natl Acad SciU S A 102: 2293-2298.
21. Mesgarani N, David SV, Fritz JB, Shamma SA (2008) Phoneme representation and classification in primary auditory cortex. J Acoust Soc Am 123: 899-909.
22. Pickett JM (1999) The Acoustics of Speech Communication: Fundamentals, Speech Perception Theory, and Technology. Boston, Massachusetts: Allyn & Bacon.
23. Gold B, Morgan N (2000) The cepstrum as a spectral analyzer. Speech and Audio Signal Processing. New York: John Wiley. pp 271-279.
24. Hillenbrand J, Getty LA, Clark MJ, Wheeler K (1995) Acoustic characteristics of American English vowels. J Acoust Soc Am 97: 3099-3111.
25. Friesen LM, Shannon RV, Baskent D, Wang X (2001) Speech recognition in noise as a function of the number of spectral channels: comparison of acoustic hearing and cochlear implants. J Acoust Soc Am 110: 1150-1163.
26. Liberman AM (1970) Some characteristics of perception in the speech mode. In: Perception and Its Disorders. Hamburg DA, Pribram KH, Stunkard AJ, eds. New York: Williams & Wilkins Company.
27. Liberman AM, Cooper FS, Shankweiler DP, Studdert-Kennedy M (1967) Perception of the speech code. Psychol Rev 74: 431-461.
28. Greenberg S, Arai T, Kingsbury BE, Morgan N, Shire M, et al. (1999) Syllablebased speech recognition using auditorylike features. J Acoust Soc Am 105: 1157-1158.
29. Greenberg S, Arai T (2001) The relation between speech intelligibility and the complex modulation spectrum. Eurospeech-2001, Aalborg, Denmark. pp 473-476.
30. Kusumoto A, Arai T, Kinoshita K, Hodoshima N, Vaughan N (2005) Modulation enhancement of speech by a preprocessing algorithm for improving intelligibility in reverberant environments. Speech Commun 45: 101-113.
31. Miller LM, Escabi MA, Read HL, Schreiner CE (2002) Spectrotemporal receptive fields in the lemniscal auditory thalamus and cortex. J Neurophysiol 87: 516-527.
32. Woolley SM, Fremouw TE, Hsu A, Theunissen FE (2005) Tuning for spectrotemporal modulations as a mechanism for auditory discrimination of natural sounds. Nat Neurosci 8: 1371-1379.
33. Joris PX, Schreiner CE, Rees A (2004) Neural processing of amplitudemodulated sounds. Physiol Rev 84: 541-577.
34. Gill P, Woolley SMN, Fremouw T, Theunissen FE (2008) What's that sound? Auditory area CLM encodes stimulus surprise, not intensity or intensity changes. J Neurophysiol 99: 2809-2820.
35. Peterson GE, Barney HL (1952) Control methods used in a study of the vowels. J Acoust Soc Am 24: 175-184.
36. Childers DG, Wu K (1991) Gender recognition from speech. Part II: fine analysis. J Acoust Soc Am 90: 1841-1856.
37. Johnson KA (2005) Speaker normalization in speech perception. In: The Handbook of Speech Perception. Pisoni DB, Remez RE, eds. Malden, Massachusetts: Blackwell Publishing. pp 363-389.
38. McDermott HJ (2004) Music perception with cochlear implants: a review. Trends Amplif 8: 49-82.
39. Versnel H, Shamma SA (1998) Spectral-ripple representation of steady-state vowels in primary auditory cortex. J Acoust Soc Am 103: 2502-2514.
40. Tyler RS, Preece JP, Lowder MW (1987) The Iowa audiovisual speech perception laser videodisc. Laser Videodisc and Laboratory Report. Iowa City, Iowa: Department of Otolaryngology, University of Iowa.
41. Cohen L (1995) Time-Frequency Analysis. Englewood Cliffs, New Jersey: Prentice Hall.
42. Gill P, Zhang J, Woolley SM, Fremouw T, Theunissen FE (2006) Sound representation methods for spectro-temporal receptive field estimation. J Comput Neurosci 22: 22.
43. Griffin DW, Lim JS (1984) Signal estimation from modified short-time Fourier transform. IEEE Trans Acoust 32: 236-243.
44. Slaney M (1994) An introduction to auditory model inversion. Interval Technical Report IRC1994.
45. Smith ZM, Delgutte B, Oxenham AJ (2002) Chimaeric sounds reveal dichotomies in auditory perception. Nature 416: 87-90.
46. Theunissen FE, Doupe AJ (1998) Temporal and spectral sensitivity of complex auditory neurons in the nucleus HVc of male zebra finches. J Neurosci 18: 3786-3802.
47. Plomp R, Mimpen AM (1979) Improving the reliability of testing the speech reception threshold for sentences. Audiology 18: 43-52.
48. Plomp R (1986) A signal-to-noise ratio model for the speech-reception threshold of the hearing impaired. J Speech Hear Res 29: 146-154.
49. Glasberg BR, Moore BC (1989) Psychoacoustic abilities of subjects with unilateral and bilateral cochlear hearing impairments and their relationship to the ability to understand speech. Scand Audiol Suppl 32: 1-25.