A novel temporal fine structure-based speech synthesis model for cochlear implant

Signal Processing

Volumn 88, Issue 11, 2008, Pages 2693-2699

  Chen, Fei ^a   Zhang, Yuan Ting ^a,b,c  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^b SHENZHEN INSTITUTES OF ADVANCED TECHNOLOGY   (China)

^c INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

Author keywords

Cochlear implant; Mandarin tone identification; Speaker recognition; Speech intelligibility; Speech synthesis; Temporal fine structure

Indexed keywords

BOOLEAN FUNCTIONS; CIVIL AVIATION; FILTRATION; LAW ENFORCEMENT; LEAD; PLANNING; SEMICONDUCTING LEAD COMPOUNDS; SPEECH INTELLIGIBILITY; SPEECH PROCESSING; SPEECH RECOGNITION; SPEECH SYNTHESIS; STRATEGIC PLANNING;

ACOUSTIC SIMULATIONS; BAND PASS FILTERING; COCHLEAR IMPLANT (CI); COCHLEAR IMPLANTEES; ELSEVIER (CO); EXPERIMENTAL RESULTS; FINE STRUCTURES; HIGH RATES; MODEL BASED (OPC); PEAK POSITIONS; SPEAKER RECOGNITION; SPEECH PERCEPTION; SPEECH SIGNALS; SUBJECTIVE ASSESSMENTS; SYNTHESIS (OF CHIRAL IONIC LIQUIDS); SYNTHESIZED SPEECH; TEMPORAL FINE STRUCTURE; TONAL LANGUAGES;

SPEECH;

EID: 47749101667     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sigpro.2008.05.011     Document Type: Article

References (30)

1. Loizou P.C. Introduction to cochlear implants. IEEE Eng. Med. Biol. Mag. 18 1 (1999) 32-42
2. Zeng F.G. Trends in cochlear implants. Trends Amplif. 8 (2004) 1-34
3. Smith Z.M., Delgutte B., and Oxenham A.J. Chimaeric sounds reveal dichotomies in auditory perception. Nature 416 6876 (2002) 87-90
4. Wilson B.S., Schatzer R., Lopez-Poveda E.A., Sun X.A., Lawson D.T., and Wolford R.D. Two new directions in speech processor design for cochlear implants. Ear Hear. 26 Suppl. 4 (2005) 73-81
5. Wilson B.S., Finley C.C., Lawson D.T., Wolford R.D., Eddington D.K., and Rabinowitz W.M. Better speech recognition with cochlear implants. Nature 352 6332 (1991) 236-238
6. Shannon R.V., Zeng F.G., Kamath V., Wygonski J., and Ekelid M. Speech recognition with primarily temporal cues. Science 270 5234 (1995) 303-304
7. Kong Y.Y., Cruz R., Jones J.A., and Zeng F.G. Music perception with temporal cues in acoustic and electric hearing. Ear Hear. 25 2 (2004) 173-185
8. Vongphoe M., and Zeng F.G. Speaker recognition with temporal cues in acoustic and electric hearing. J. Acoust. Soc. Am. 118 2 (2005) 1055-1061
9. Wei C.G., Cao K.L., and Zeng F.G. Mandarin tone recognition in cochlear-implant subjects. Hear. Res. 197 1-2 (2004) 87-95
10. Ciocca V., Francis A.L., Aisha R., and Wong L. The perception of Cantonese lexical tones by early-deafened cochlear implantees. J. Acoust. Soc. Am. 111 5 pt 1 (2002) 2250-2256
11. Nie K.B., Stickney G., and Zeng F.G. Encoding frequency modulation to improve cochlear implant performance in noise. IEEE Trans. Biomed. Eng. 52 1 (2005) 64-73
12. Lan N., Nie K.B., Gao S.K., and Zeng F.G. A novel speech-processing strategy incorporating tonal information for cochlear implants. IEEE Trans. Biomed. Eng. 51 5 (2004) 752-760
13. F. Chen, Y.T. Zhang, Loudness normalization for cochlear implant using pulse-rate modulation to convey Mandarin tonal information: a model-based study, in: Proceedings of the 28th Annual International Conference on IEEE-EMBS, 2006, pp. 1236-1239.
14. F. Chen, Y.T. Zhang, Frequency-specific fine structure cues from Mandarin for designing electrical stimulation strategy of cochlear implant, in: Proceedings of the World Congress on Med. Phy. and Biomed. Eng., 2006, p. 5068.
15. F. Chen, Y.T. Zhang, A new acoustic model incorporating temporal fine structure cue for cochlear implant, in: Proceedings of the 5th International Special Topic Conference on ITAB, 2006.
16. Luo X., and Fu Q.J. Enhancing Chinese tone recognition by manipulating amplitude envelope: implications for cochlear implants. J. Acoust. Soc. Am. 116 6 (2004) 3659-3667
17. Xu L., and Pfingst B.E. Relative importance of temporal envelope and fine structure in lexical-tone perception. J. Acoust. Soc. Am. 114 6 pt 1 (2003) 3024-3027
18. J.T. Rubinstein, C. Turner, A novel acoustic simulation of cochlear implant hearing: effects of temporal fine structure, in: Proceedings of the 1st IEEE EMBS Conference on Neural Engineering, 2003, pp. 142-145.
19. Baher H. Analog & Digital Signal Processing. second ed. (2001), Wiley, Chichester, NY pp. 103-104
20. Zeng F.G., Nie K.B., Stickney G.S., Kong Y.Y., Vongphoe M., Bhargave A., Wei C.G., and Cao K.L. Speech recognition with amplitude and frequency modulations. Proc. Natl. Acad. Sci. USA 102 7 (2005) 2293-2298
21. Dorman M.F., Loizou P.C., and Rainey D. Speech intelligibility as a function of the number of channels of stimulation for signal processors using sine-wave and noise-band outputs. J. Acoust. Soc. Am. 102 4 (1997) 2403-2411
22. Remez R.E., Fellowes J.M., and Rubin P.E. Talker identification based on phonetic information. J. Exp. Psychol. Hum. Percept. Perform. 23 3 (1997) 651-666
23. Gonzalez J., and Oliver J.C. Gender and speaker recognition as a function of the number of channels in spectrally reduced speech. J. Acoust. Soc. Am. 118 1 (2005) 461-470
24. Greenwood D.D. A cochlear frequency-position function for several species-29 years later. J. Acoust. Soc. Am. 87 6 (1990) 2592-2605
25. van Hoesel R.J.M., and Tyler R.S. Speech perception, localization, and lateralization with bilateral cochlear implants. J. Acoust. Soc. Am. 113 3 (2003) 1617-1630
26. Vandali A.E., Sucher C., Tsang D.J., McKay C.M., Chew J.W.D., and McDermott H.J. Pitch ranking ability of cochlear implant recipients: a comparison of sound-processing strategies. J. Acoust. Soc. Am. 117 5 (2005) 3126-3138
27. F. Chen, Y.T. Zhang, Zerocrossing-based representation of the temporal fine structure: towards improving the tone identification for cochlear implantees, BME 2006 Biomed Eng. Conf. Hong Kong, 2006, 89-92.
28. Zeng F.G. Temporal pitch in electric hearing. Hear. Res. 174 1-2 (2002) 101-106
29. Fishman K., Shannon R.V., and Slattery W.H. Speech recognition as a function of the number of electrodes used in the SPEAK cochlear implant speech processor. J. Speech Hear. Res. 40 5 (1997) 1201-1215
30. Friesen L., Shannon R.V., Baskent D., and Wang X.S. Speech recognition in noise as a function of the number of spectral channels: comparison of acoustic hearing and cochlear implants. J. Acoust. Soc. Am. 110 2 (2002) 1150-1163