Cochlear Implants Special Issue Article: Vocal Emotion Recognition by Normal-Hearing Listeners and Cochlear Implant Users

Trends in Amplification

Volumn 11, Issue 4, 2007, Pages 301-315

  Luo, Xin ^a   Fu, Qian Jie ^a   Galvin, John J ^a  

^a HOUSE EAR INSTITUTE   (United States)

Author keywords

cochlear implant; normal hearing; spectral resolution; temporal resolution; vocal emotion

Indexed keywords

ADULT; AGED; AMPLITUDE MODULATION; ARTICLE; AUDITORY STIMULATION; AUDITORY SYSTEM; CLINICAL ARTICLE; COCHLEA PROSTHESIS; EMOTION; FEMALE; HEARING; HUMAN; MALE; SPEECH;

AGED; AUDITORY PERCEPTION; COCHLEAR IMPLANTS; CUES; EMOTIONS; FEMALE; HEARING DISORDERS; HEARING IMPAIRED PERSONS; HUMANS; MALE; MIDDLE AGED; PITCH PERCEPTION; REHABILITATION OF HEARING IMPAIRED; SPEECH ACOUSTICS; SPEECH PERCEPTION; TIME FACTORS;

EID: 36248979256     PISSN: 10847138     EISSN: 19405588     Source Type: Journal    
DOI: 10.1177/1084713807305301     Document Type: Article

References (33)

1. Fu QJ Shannon RV Wang X. Effects of noise and spectral resolution on vowel and consonant recognition: acoustic and electric hearing. J Acoust Soc Am. 1998;104: 3586–3596.
2. Friesen LM Shannon RV Baskent D Wang X. Speech recognitioninnoiseasafunctionofthenumberofspectral channels: comparison of acoustic hearing and cochlear implants. J Acoust Soc Am. 2001;110: 1150–1163.
3. Fu QJ Nogaki G. Noise susceptibility of cochlear implant users: the role of spectral resolution and smearing. J Assoc Res Otolaryngol. 2005;6: 19–27.
4. Fu QJ Chinchilla S Galvin JJ III. The role of spectral and temporal cues in voice gender discrimination by normal-hearing listeners and cochlear implant users. J Assoc Res Otolaryngol. 2004;5: 253–260.
5. Fu QJ Chinchilla S Nogaki G Galvin JJ III. Voice gender identification by cochlear implant users: the role of spectral and temporal resolution. J Acoust Soc Am. 2005;118: 1711–1718.
6. Gonzalez J Oliver JC. Gender and speaker identification as a function of the number of channels in spectrally reduced speech. J Acoust Soc Am. 2005;118: 461–470.
7. Vongphoe M Zeng FG. Speaker recognition with temporal cues in acoustic and electric hearing. J Acoust Soc Am. 2005;118: 1055–1061.
8. Shannon RV Zeng FG Kamath V Wygonski J Ekelid M. Speech recognition with primarily temporal cues. Science. 1995;270: 303–304.
9. Banse R Scherer KR. Acoustic profiles in vocal emotion expression. J Pers Soc Psychol. 1996;70: 614–636.
10. Fernald A. Intonation and communicative intent in mothers’ speech to infants: is the melody the message? Child Dev. 1989;60: 1497–1510.
11. Cooper RP Aslin RN. Preference for infant-directed speech in the first month after birth. Child Dev. 1990;61: 1584–1595.
12. Trainor LJ Austin CM Desjardins RN. Is infant-directed speech prosody a result of the vocal expression of emotion? Psychol Sci. 2000;11: 188–195.
13. Williams CE Stevens KN. Emotions and speech: some acoustical correlates. J Acoust Soc Am. 1972; 52: 1238–1250.
14. Murray IR Arnott JL. Toward the simulation of emotion in synthetic speech: a review of the literature on human vocal emotion. J Acoust Soc Am. 1993;93: 1097–1108.
15. Scherer KR. Vocal communication of emotion: A review of research paradigms. Speech Communication. 2003;40: 227–256.
16. Dellaert F Polzin T Waibel A. Recognizing emotion in speech. In: Proceedings of the International Conference on Spoken Language Processing. 1996;1970-1973. Online archive of International Speech Communication Association proceedings available at: http://www.isca-speech.org.
17. Petrushin VA. Emotion recognition in speech signal: experimental study, development, and application. In: Proceedings of the International Conference on Spoken Language Processing. 2000;2: 222–225. Online archive of International Speech Communication Association proceedings available at: http://www.isca-speech.org.
18. Cowie R Douglas-Cowie E Tsapatsoulis N et al., Emotion recognition in human-computer interaction. IEEE Signal Process Mag 2001;18: 32–80.
19. Lee CM Narayanan SS. Toward detecting emotions in spoken dialogs. IEEE Trans Speech Audio Process. 2005;13: 293–303.
20. Yildirim S Bulut M Lee CM et al., An acoustic study of emotions expressed in speech. In: Proceedings of the International Conference on Spoken Language Processing. 2004;2193-2196. Online archive of International Speech Communication Association proceedings available at: http://www.isca-speech.org.
21. Moore BC. Perceptual consequences of cochlear hearing loss and their implications for the design of hearing aids. Ear Hear. 1996;17: 133–161.
22. Most T Weisel A Zaychik A. Auditory, visual and auditory-visual identification of emotions by hearing and hearing-impaired adolescents. Br J Audiol. 1993;27: 247–253.
23. House D. Perception and production of mood in speech by cochlear implant users. In: Proceedings of the International Conference on Spoken Language Processing. 1994;2051-2054. Online archive of International Speech Communication Association proceedings available at: http://www.isca-speech.org.
24. Pereira C. The perception of vocal affect by cochlear implantees. In: Waltzman SB Cohen NL eds. Cochlear Implants. New York, NY: Thieme Medical; 2000: 343–345.
25. Shinall AR. Emotion Perception in Pre-kindergarten School Children at Central Institute for the Deaf [master's thesis]. St Louis, Mo: Washington University School of Medicine; 2005.
26. Schorr EA. Social and Emotional Functioning of Children With Cochlear Implants [dissertation]. College Park: University of Maryland; 2005.
27. Peters KP. Emotion Perception in Speech: Discrimination, Identification, and the Effects of Talker and Sentence Variability [dissertation]. St Louis, Mo: Washington University School of Medicine; 2006.
28. Wilson BS Finley CC Lawson DT Wolford RD Eddington DK Rabinowitz WM. Better speech recognition with cochlear implants. Nature. 1991;352: 236–238.
29. Sjölander K Beskow J. Wavesurfer speech processing software. Department of Speech, Music and Hearing, KTH, Sweden, 2006. Available at: http://www.speech.kth.se/wavesurfer/. Accessed November 1, 2005.
30. Shannon RV Adams DD Ferrel RL Palumbo RL Grandgenett M. A computer interface for psychophysical and speech research with the Nucleus cochlear implant. J Acoust Soc Am. 1990;87: 905–907.
31. Wygonski J Robert ME. HEI Nucleus Research Interface Specification. Los Angeles, Calif: House Ear Institute; 2001.
32. Greenwood DD. A cochlear frequency-position function for several species—29 years later. J Acoust Soc Am. 1990;87: 2592–2605.
33. Fu QJ Shannon RV. Effects of amplitude nonlinearity on phoneme recognition by cochlear implant users and normal-hearing listeners. J Acoust Soc Am. 1998;104: 2570–2577.